Framework Desktop running local LLMs for coding — Ryzen AI MAX+ 395, 96GB unified memory, GPU pegged at 100%

u/GosuCoder on X spent a full day coding with nothing but local LLMs on a Framework Desktop. The setup: AMD Ryzen AI MAX+ 395 with 96GB unified memory running GLM 4.5 Air, Qwen 3 Coder 30B, GPT-OSS-120b, and Seed-OSS 36B — plus Qwen 3 Coder on an RTX 5090.

Key takeaways:

• MoE models run way better than dense models on Framework Desktop (40 tps vs 5 tps)
• Flash attention + KV Q8 is necessary for bigger models
• Vulkan outperforms ROCm for large models in LM Studio
• Biggest pain point: TTFB timeouts with agentic coding tools

Source: https://x.com/GosuCoder/status/1960705908410851661

Image: https://pbs.twimg.com/media/GzXTb7sXwAAuiTM?format=png&name=large