I think that argument makes sense, essentially that the games are "impossible."
The difficult spot for conferences, though, is that a lot of out of conference games are incredibly lucrative, especially in the SEC. What I do not think a conference can do is pick and choose what games it wants to play.
Put differently, if Tennessee decides it does not want to pay Furman to play in Knoxville, I don't see how they could play Oklahoma the week earlier. You either play both, or neither.
Bookmarks