Not much, but it's a lot harder to judge distances correctly. You still can, if you use outside knowledge and perspective, but it's less accurate.
Same for stereo hearing. With two ears it's easier to locate where a sound is coming from. With one ear you can tell if something at constant volume is moving away or moving towards you based on loudness. With two ears you can tell if something at constant volume is stationary or circling around you.
Unfortunately I don't think there are words to describe it. You "just know", because it's an unconscious brain thing.
You could sort of simulate it by rotating your head 180 degrees and noticing how the sound changes. People with two working ears can do this without moving their head.
The effect for music is mostly: it's easier to separate instruments even if they are the same volume, if they are in different spatial locations so the brain can filter against it. Stuff can sound less "cluttered, muddy", but it doesn't help as much as you think in recordings because you as a listener can't move the microphone. I think it would be a bigger deal in small live shows, or music performed in virtual reality where a 3D engine can calculate the audio delay appropriately for each ear, and that difference is relevant because you the listener are close to the musician and possibly moving relative to them.
Many early stereo mixes were so bad because the stereo mix literally just put half the channels into L and the other half into R. For Beatles’ stereo mixes you would lose basically half the song by changing the balance full L or R. This was the case for many other early mono to stereo masters. Capitol Records’ Duphonic process also added a slight delay between the two channels to give a feeling of depth. It almost certainly didn’t reflect what the original producers or engineers would have ever intended.
For many classic albums that got this “fake stereo” treatment if you were lucky you would eventually end up with a proper stereo remaster done decades later. For example, hearing the original the properly remastered stereo version of Pet Sounds released in 1997 is a drastic improvement over the Duophonic stereo mix from 1966.
You can increase the accuracy if you are afforded the opportunity to concentrate on the sound.