Fracture - painful shoes

Hello, hoping to get some advice or anecdotes from folks in a similar situation. I fractured one of my sesamoid bones last year and after discovering this, was in a boot for a month.

After follow up X-rays, my podiatrist was confident he saw bridging/healing in the fracture and advised gradual return to normal activity without the boot. I immediately discovered the bulk of the pain was still present after walking for a bit in shoes.

Here is the odd part. I tend to feel the least pain in no shoes when walking normally. The most pain in tennis shoes ( I’ve been using Altra shoes - wide toe box) with and without inserts + dancer pads. I tend to feel moderate pain in firmer flat shoes (loafers/court shoes).

Anyone experience anything similar? This seems to be the opposite of what I see everyone saying they are experiencing.

Thanks in advance!