r/mlops•
KsaffX

Help with project deployment

Hi guys!

Currently I am developing project to build my MLops portfolio.

It's chatbot related and the project, which requires around 24 gb of vram to run, as well as less than 100 gb of storage for LLM.

I have already build FastApi app and dockerized it and it works well locally on my GPU.

What I want to do now is to deploy it - but the problem is that I don't know which technologies should I use.

Preferablly I would want to do it for free or for very low cost, and once deployed gate under password, so it's only avaliable when I want to present it to someone.

I also would love to use AWS in some form for it, to gain experience with cloud platform.

Could you guys maybe point in a direction, which tech should I use to deploy it?

Posted Mar 12, 2024, 10:01 PM UTC

12

Comments aren't archived yet

This post had 2 comments on Reddit. Comments for this period haven't been loaded into the archive yet.