For me, that's what someone telling the truth about the situation would say. Though Andy Card is no longer Chief of Staff, I have never gotten the impression that President Bush felt that Card had failed to be loyal. I do get that impression with Powell and Armitage, in contrast.
I'll take Andy Card's word over Bob Woodward any day of the week.
You're right ... Andy Card is not conniving or manipulating .. he's a decent, loyal, straightforward guy. I still believe he should never have delved into any private admin issues with Woodward period. Imagine how different the situation would be now if he hadn't.