Of course you are correct, one game can always be a fluke. But better to be decided in a game than by a vote of people who are "loyal" to their conference and try to vote in a way that "ups" their side either now or in future years. As for a bad call deciding the game, that is always the worst way for a team to win or lose. But good refs know they should not determine the outcome of the game, and the playoff could get good refs.
"But better to be decided in a game than by a vote of people who are "loyal" to their conference and try to vote in a way that "ups" their side either now or in future years."
You're assuming that everything would be decided on the field. What if the 'best' team loses? It happens frequently in college football.
"But good refs know they should not determine the outcome of the game, and the playoff could get good refs."
Good polls could get 'good' voters too.