On the rare occasion where a policeman has knocked on our door, or asked me on the street whether I had seen something, I never considered it an intrusion. I considered it an opportunity to help the officer achieve goals I share with him. I can't quite sympathize with the concern here.
Have you ever had the IRS, EPA, etc. knock on your door?
Talk to some innocent citizens after the Feds have knocked down their door.