The one time I was there in 2005, I seriously wondered if anyone could use the bathroom and not be watched, the place was so guarded.
I have to admit, it can be. I am about a mile from the White House and used to jog there every day during the Obama administration. When that black car came out of the driveway, the Secret Service made sure my jog was diverted another way. My experience with the Secret Service has always been positive. I have not yet encountered a surly or mean agent in my everyday encounters.