I (28F) want to take my fiance's (27M) last name, but my family's name has ties to powerful people

I love my fiancé and I really want to take his last name. But my family is really well-connected and wealthy... and our last name is known in a lot of upper-class circles. Like, there are buildings named after us and billionaires in my parents' contact lists. (We're not quite billionaires ourselves yet but we are at the level of wealth where the distinction stops mattering.)

Regardless, I don't feel particularly attached to it... but my fiancé disagrees somewhat. He told me that I may want to just think about it a bit more. I think he's got a pretty good point. He likes the idea of me taking his last name, and says it's ultimately up to me, but he has observed directly that my name comes with some perks, and I trust his perspective. It's possible that I'll regret changing my name if it means losing "access" to certain lifestyle perks. Then again, it could be nice to live a bit more anonymously. Should I change my last name legally but use my family name professionally? Apparently celebrities sometimes do this, but it feels like it'll just be confusing. What should I do?