I heard a sermon recently on that passage and because the man was not there as well, the pastor thinks the whole thing was actually a set up to trap Jesus and the woman was just the pawn the Pharisees were using.
Yeah, He was wise to that ploy. Pretty sharp if you ask me.