You've got that backwards. The "out" party typically does better in non-Presidential years.
But you're right about the off-year White House troubles. However, using that same historical pattern, Dubya's high approval ratings mean the GOP has a decent chance of breaking even or gaining seats.