Hi folks,
I want to create a website that allows people to play around with different deep-learning models. I spent half a day researching and have not progressed as far as i typically would, so hoping for crowd knowledge here ;).
I am a fairly advanced software dev (mainly Python), very comfortable with docker, linux, networking etc. However, I'm not very familiar with cloud engineering (apart from hosting some websites and running some VMs on AWS).
Thus, I would appreciate your advice on the architecture for the above.
For the PoC I could easily take a GPU VM (e.g. g5.xlarge), run a web UI on it, and directly return the results (1 result takes ~5-10sec on a GTX3080).
What is not cle
