I swore off owning a White vehicle after parking at our plant. My 1988 Acura Integra was white and there was some small particulate that would cover the car when the wind was blowing the wrong way. I'm sure it would have been bad on any color, but it stood out on the white like little rusty black dots.
The clay in our county is golden-yellow in color, so the dust tends to be that color. When my Escape gets dusty, it just loses its shine.