Dungeon architecture isn't a game breaker for me, random loot is.
Oblivion dungeons were generic as fuck, if you explored on you knew them all, but that was not game breaking for me, game breaking was the fact that they ALL had random loot, no unique special item , not even a generic item...