Anyone else feel like social anxiety doesn't fully explain things?

I am socially avoidant to an extreme, absolutely no drive to connect with people. I definitely do have a certain level of social anxiety but it's mild enough that I can be relatively calm just being around people, I don't think that explains my extreme isolation. I don't understand why I'm like this.