There's a skill of picking a voice out of a noisy environment, like a party. I don't know what it is called, and several web searches have found me articles about it, but none with a name. Anyway, I lack that skill. I'm also nearly incapable of understanding lyrics in a lot of music.
Consequently I don't really like noisy parties.
I feel socially obligated to make an effort, but I can't really hear much and it becomes frustrating.
Add to that noise becomes painfully loud for me at lower volumes than most people and preference for quiet seems natural.
At the work event I attended today, many of the socializing / networking / get-to-know-co-workers parts were just unpleasant. I ended up leaving early because I just couldn't stand it anymore.