My little toe has literally developed a callus from dress shoes. How do you guys avoid this?

Anyone else deal with dress shoes murdering your pinky toe?

For years I thought it was just the wrong size. Shoes feel fine in the store, but a few hours of walking in and my little toe starts rubbing on the side, and by the end of the day it's all I can think about. Ended up with an actual callus there.

Tried going half a size up helped the toes a bit, but then my heel wasn't secure and the whole shoe felt too long. Didn't really fix anything.

What I've noticed is two pairs in the exact same size can fit totally differently up front. Some squeeze my toes together right away, others leave just enough room that I barely notice.

Now when I try shoes on, I don't just check if my big toe has space I press on where my pinky toe sits. That's always where it goes wrong for me.