According to the VV, Spitzer is really in trouble because of the Mann Act violation. He can scream about prostitution should be legal, but he crossed state lines to arrange this.
What will probably piss them all off, will be that he was probably snared because of the Patriot Act.