Project 64 is sometimes smooth and sometimes not

I‘m doing SM64 speedruns on the Project 64 emulator and i‘ve noticed something strange. Sometimes when i start sm64 on my emulator, it runs smoother and faster and sometimes not (even when i only have PJ64 opened and nothing else). How can i fix this and make the game run faster and smoother in general?