You'd have a hassle coming back, as well as going to any country that is also using the scanners.
I don't mind the hassle, within reason, so long as the RFID-disabled passport is ultimately accepted. I mean, I do mind even slight hassle, to be sure, but not remotely as much as I mind having an RFID passport.
And yes, I surely do blame the Bush administration and the GOP congresses, FWIW, not that I really expect the Dems would be any better at all. They'd probably be worse since they've latched on to the 9/11 Commission's recommendations as their security policy mantra.
PS. And, to be exact, the 9/11 Commission recommended a uniform, scannable National ID that would include biometric identifiers and with a standardized nationwide database.