Why not play with an actual speaker with some actual sounds and measure with a microphone?
Because in such arrangement (speaker) you mostly hear mechanical imperfections and noises of the electro-acoustic transducer rather than true non-linear distortion. It is more correct to use good headphones and to add non-linear distortion mathematically.