Strange bug keeps happening on multi-player world

I'm not sure how or why its happening but its frustrating. I can only replicate it by trying to craft from an unopened chest while a player accesses that chest but it occurs outside of that inciden as well.

Essentially the bug stops me (The host) from being able to place, throw, use, melee anything at all but other players (not hosts) can place and use and throw and melee just fine. the only fix that works so far is reloading the world.

Anyone else running into this issue? I'm on the latest version and on Xbox Series X