Happy Camper with Qwen3.6 35B A3B

I am running Qwen3.6 35B A3B on a Ryzen 9 3900 CPU (12 cores), 64GB Ram, 4060 GPU (8GB Vram) and llama.cpp with this startup command:

llama-server.exe -m "C:\Users\mdimi\.lmstudio\models\XpressAI\Qwen3.6-35B-A3B-ExpertClone-Logic-UD-Q4_K_XL-GGUF\Qwen3.6-35B-A3B-expert_clone_logic-UD-Q4_K_XL.gguf" --host 0.0.0.0 --port 8080 --n-gpu-layers 99 --n-cpu-moe 41 --cache-type-k q4_0 --cache-type-v q4_0 --chat-template-kwargs "{\"enable_thinking\":false}" --temp 0.5 --min-p 0.1 --repeat-penalty 1.07 --ctx-size 131072 --flash-attn on

I have TailScale setup so I can access it, Hermes, and Open WebUI from my phone and laptop.

I get ~22 t/s and am happier than a kid in a toy store.

It is just ok for complex coding. For that I actually use Composer2.5 in Cursor, or Deepseek V4 Flash/Pro in VS Code which seems to work great. Both are damned cheap and do what I need for my coding work.

I use Qwen for lite code work, writing, and research (with Brave search in Hermes).

No more subs for research, writing, or just a dumb question. Now all I have to do is get it working in Home Assistant.

If your budget will not allow you to have more powerful equipment, like mine, you might want to give it a try. Both Qwen and Deepseek helped me tweak the start command.

I have to say, it is way cool to be able to access my local model various ways from anywhere for free.