How can I save my progress between different server instances?

I have been experimenting with LLaMa 3.3 70b by renting vast.ai servers. Because I'm on a budget, I destroy the instance after using it so that I don't have pay for storage there. Is there a way I can save what I do each session and some how upload it to new instances? Or is there a better way for me to go about using heavy duty LLMs on a budget?