Gpu usage randomly going to 100 percent

When i'm playing Minecraft, my gpu's vram slowly climbs up and my fps drops. Also my 3d usage goes to max randomly too. It happens on lunar client, feather client, vanilla launcher with mods, vanilla, vanilla with lunar and modrinth. It happens on 1.21.4 and 1.21.11. How do i fix this? I have 10gb of ram allocated. my render distance and simulation distances are low (12 and 8 chunks), i dont use shaders, i dont have a high resolution texture pack and my particles are minimum. i tried googling this so many times but nothing works. this wasnt happening on my old pc with a gtx 1080, intel i7-6700 and 16gb or ddr4 ram (6gb allocated).

System specs:
rtx 5070 12gb vram

ryzen 7 9700x

32gb ddr5 ram 4800mhz

2tb ssd

my temperatures are barely 50 celcius