It’s not unheard of. The League tries to minimize travel but they don’t allow divisional games.... so for most teams, if you take away their divisional opponents, the nearest rivals will be out of conference....
I think if you went and looked year by year you'd see that to be the case more years than not. I can't guarantee I'm right about that, but anecdotally that's what I've found.