The old formula was a third, a third and a third: Loyalist, Patriot and Leave Me Alone. One particular area during the RevWar that exemplifies this was Westchester County in NY--for most of the war it was a no man's land fraught with danger for those traversing it unarmed. The so-called "Cowboys" were Loyalists who brought meat to the Brits who were running things from NYC.
Some areas of the colonies had more representation among the neutrals, for instance, the Quakers in PA and the Dutch farmers in Brooklyn, NY.
It is also worth noting that the term "patriotism" has only endured because we were successful. At the time, it was treason.
Robert E. Lee is considered a great American by many, but the label of "patriot" is never used.