Besting the commercial SOTA

Hey Community!

So I’ve been wondering for a long time. Can you setup a local running model that beats the Commercial SOTAs?

Obviously not 1:1 since us normal peole might not have enough katchiing and skills but… hear me out.

Personally I use LLMs to when researching domain specific knowledge of new systems or applications I need built, and then have them serup my EU cloud server, harden them, pentest them, document, develop the apps, harden the apps, optimise the apps for hw or programming language or whatever and then build some user first UIs, and that’s in high level it.

Claude Code and Codex have been my go to’s but after burning too many tokens I think it’s time to rething the idea.

Now with Ollama and support for MLX on Apple Silicon, it’s becoming in reach to run something interesting +

Setup the infrastructure of Vector/Graphs, DBs training setups and go train the LLM for my specific usecases. Devleopment, CyberSec, Domain knowledge for each new app, ext ssds for agent persona develeopment and training knowledge or something like that.

How many have tried with succes? And on what local models?

Bring your insights!