This is just what they're choosing to tell us, for political purposes. Imagine what secret programs they have behind the scenes that they're not making public. Always assume your communications are being recorded.
You are right, and I suppose that we should also assume that these programs operate without any oversight. Mr. Gonzales should simply state, "We know what's best. We are doing this for your own good. Just trust us."
I called a friend in Scotland once and said "Hold on a minute. Hello NSA guys. You're doing a great job. Keep up the good work keeping us safe." He said "What's that all about?" and then I told him that all international calls were recorded, and that if someone in the NSA just happened to actually listen to this one, I wanted to make them laugh and be encouraged.
It should be if you are a terrorist. Are you a terrorist?