In this day & age? Nope. Not by a long shot.
Maybe this guy wasn't a terrorist, but it sounds like he was definitely casing your home. Either way, you done good.
Anything short of "recon by fire" is not over reacting.