James Madison
Wikiquote says that there is no known source for this and it is probably a paraphrase of some genuine Madison quotes that say similar things:
"Perhaps it is a universal truth that the loss of liberty at home is to be charged against provisions against danger, real or pretended from abroad."
"The means of defence agst. foreign danger, have been always the instruments of tyranny at home."