Performance of render gpu dropping overtime

my setup is 4090 for render gpu and second card with display plugged up is 5060. when i enable ls it starts off great then over 5 mins it drops the 4090 usage and slowly drops over time