Inventory problem

I have this reoccurring problem where I can’t open my inventory. The little white dot appears and I can see the ball orb thingy but it won’t let me grab it. I deleted a bunch of mods but it still won’t work.