Well Madison WAS a politician as well as a Founding Father.
Yes, but we don't normally think of the founders as being anything other than noble and altruistic. We like our civic gods on pedestals.