Newt on the sofa with Pelosi didn’t make me as mad as his undermining of Bush over Katrina.
He stampeded the Congress into passing all of that Katrina money (including the gift cards)by talking about a Gulf Coast Marshal Plan, and then when it turned out to be corrupt, wasteful, and a total boondoggle, he then got on Bush and Congress for getting the government involved.
The Pelosi thing mostly just hurt Newt. The Katrina thing caused headaches for a lot of people and contributed to the idea that Bush was incompetent over Katrina.