R.M. Williams: Comfort Craftsman Wide Sizing

Just got my first pair and went with my usual boots sizing in whites /IR, so a 10.5m extra wide... the boot is initially rubbing where my pinky toe is due to one of my feet being wider... should I consider sending these back for a 11 or will I be fine once the leather stretches out and adjusts? length wise is good with room (1") to spare, mainly concerned if the pinky toe area will be a weak spot on the leather as time goes on and I eventually will wear the leather there and damage the boot to a point its irreparable