Where are you actually running your LLM backend in production?
Not serverless. Not "it depends". Just curious what people are genuinely using for a basic setup:
Client → Backend API(Web Framework, queue....cashes..) → LLM API(agent or SDK..)
Bare VM? Docker Compose on a single box? k8s? Something else entirely?
And if you've migrated from one to another — what pushed you to change?
Posted Mar 4, 2026, 7:06 AM UTC
10