I could be misremembering, but I’m pretty sure that the first time I saw a flag pin was on the label of President Ronald Reagan.
When Tim Kaine wore a Blue Star Service Banner pin in honor of his son, a deployed Marine, GOP bloggers were saying the pin was the flag of Honduras. So it might be possible to understand why some people might be mad about the flag pin thing.