r/LocalLLM•
ServesYouRice

Best small coding models for offline use?

Question

Looking to reuse my old PC (9700, 16gb ram, 1660S) as an offline homelab and one of the things I want to do is have some small model that can run on 6gb of VRAM for coding some small projects.

Any recommendations? Not really familiar with how the things work or what the latest models are (I have the holy trinity (Claude, Codex, Gemini) for online coding but need something local for fun). I get that with 6gb VRAM and 16gb RAM I cant get much but speed isnt really important to me and better something than nothing. Qwen 3.5 4b, Qwen 2.5 Coder 3b, Qwen 3.5 9b or some more recent quantized solution (not sure what people even use to lower requirements for these either so I would appreciate suggestions for those too)

Thanks in advance

Posted Jul 13, 2026, 10:31 AM UTC

614
Loading comments…