That's true. And most SEC teams don't have two other in-state rivals out of conference like Florida does. UGA and South Carolina are the only others, that come to mind.
But still, a little variety would be nice.
Neither does any other team in the country. What is their excuse for not scheduling 5 or 6 top 25 teams every year?
When your conference schedule already includes 4 or 5 top 20 teams, it doesn't make much since to add more when teams from other conferences only have one or two hard games a year.
Bobby Bowden was offered the Alabama job after Bill Curry left and he turned it down saying that he felt it was almost impossible to go unbeaten in the SEC.