Bush lost votes for those reasons. He also won votes because of 9/11 and the war. Which group was larger? And which is more likely to stay where they are and which to return to their old loyalties? I don't know. Maybe they balance out.
Bush gained no votes over Iraq. He in fact lost enough votes to nearly lose the election.