Slight lag issue.

So, im playing on a world, and any time I open the inventory or any menu, my fos drops significantly from 120 fps down to 50 to 60 fps, and it can be rather noticeable. Is there any fixes?