Same! It isn't so much the small talk, but being stuck making small talk with a stranger or coworker/distant relation or whatever that you have no interest in speaking to.
Which... is pretty much the definition of small talk. If I'm making small talk, it's because I don't want you to feel awkward with the silence, which means I don't know you well enough to know what you prefer.
This is why I hate getting haircuts. I don't have any personal relationship with the person cutting my hair. Maybe we'll find a common interest, but if I could just wear earbuds the whole time and not seem like an asshole, I would. But instead I just shave my head when my hair gets long enough to annoy me.
Yeah, I agree. I'm more social than I was ~10 years ago but that's because I've found good people to surround myself with. Back then I would've said I hate small talk. I didn't hate small talk, I hated the people I was talking with.