Where are you actually running your LLM backend in production?

Discussion

Not serverless. Not "it depends". Just curious what people are genuinely using for a basic setup:

Client → Backend API(Web Framework, queue....cashes..) → LLM API(agent or SDK..)

Bare VM? Docker Compose on a single box? k8s? Something else entirely?

And if you've migrated from one to another — what pushed you to change?

Posted Mar 4, 2026, 7:06 AM UTC

10
Loading comments…