Lack of friend group identity

Wanted to discuss my toxic trait

So I wanted to discuss a toxic trait of mine and see how many people relate to this.

I am great with people and have great connections and know a lot of people. However, I have trouble accepting the group identity of the friend group. I always leave a social gathering when I want and am only in for plans that interest/excite me. This behaviour in turn tends to make others in the group closer (understandably so) and even starts making me feel a little alienated after a while. I have never been able to identify with one social group and hang out with people as I see fit. This kinda leaves me in Limbo where Im part of many "groups" but not 100% invested in one. Like some people are part of the same friend group for years on end. I am still to be in a group like that.

Obviously its just me, but is it really? Are there others like that?

TLDR: Am I crazy for not being able to submit to group identity?