I can't imagine cheering for a team simply because they happen to be in the same conference as a team I liked. Who cheers for a conference? It's dumb.
Well I don’t know what to tell you. I disagree that it is dumb, weird or silly. It just is.
I think of it more like SEC schools are like brothers, they fight amongst each other, but will defend each other from outsiders.