“Obama could only smirk and look downward.”
Maybe he was trying to diss Romney - to convey his disdain and contempt by deliberately smirking at his remarks while not bothering to look him in the eye. IOW, a subtler version of his infamous “one-fingered gesture”.
He was certainly trying to project that, but the truth is, he really couldn't look Romney in the eye. Coward.