Deserts tend to get cooler more often than once in awhile, usually every night. This would result in a lot more fashion styling than twice a year. Also remember that in-game time often doesn't represent actual time.
Besides that, weather changes could be nice, but maybe only for some flavour.