Yes you do.
It's so freakin' simple. Use your remote control and watch what you want to watch, and don't watch what you don't want to watch. I get Lifetime on my cable package. Do I watch it? No. Don't care about it at all. I don't spend time worrying about, "Oh, but it's ON THERE! I HAVE IT! What do I DO?"
Grow up.
You pay for the All Men Suck network even if you don't watch it.