Too many teams. Everyone can't play everyone else so it wouldn't be fair as some would have an easier road than others.
And this is a problem the divisional arrangement solves? Look at this year, Wisconsin had the easier of two divisions and has a worse record than Michigan, Michigan had the harder schedule and doesn't get to go to the game despite a better record. This problem is endemic to the divisional arrangement as well.