Are engineering managers ditching cloud AI for local LLMs?

Between rising costs, tighter token limits, and the whims of a US President willing to flick the switch on availability for frontier models, engineering managers are facing Hobson’s choice.

Since the advent of ChatGPT those in charge have historically had two, equally bad, options available to them. Either they fork out for expensive and sometimes shaky seat licences for AI, or they have to forego frontier inference entirely because legal departments are too worried about data governance.

However, there’s a third option emerging for managers to pick from: local large language models (LLMs)...

https://leaddev.com/ai/engineering-managers-ditch-cloud-ai-for-local-llms