“Lots of people want to be able to go out in public without others taking pictures of them.”
You mean lots of people who drive cars with flashy lights and who wear badges and bullet proof vests? Those people?
I would include the six year old boy who wants to go to school without being kidnapped. Or the six year old girl at the beach who shouldn't be photographed by pedophiles. Or the person who doesn't want to be in photos that are sold for publication. Lots of people don't want to be photographed without their permission.
Our founding fathers said nothing about any special right to take pictures of other people.