Qwen 3.6 27B + Openclaw on 16 GB of VRAM
Hey guys, I just upgraded my graphics card to a 5070ti with 16GB of VRAM.
My goal for the upgrade was to run Openclaw locally. I know that Qwen 3.6 27B is kind of the bare minimum of what you need to run something like Openclaw. Because of my limited VRAM I first tried Qwen 3.6 35B and while it works well for general chats, it has a lot of issues with tool calling and ending up in loops with Openclaw.
Before I start llama I use a little script that closes all programs to try and clear up as much VRAM as possible. This way I get around 15.2 GB and have about 800MB free once the model is loaded. This means you kind of have to run the system headless. I turn this setup on when I don't use the computer so I can chat with Openclaw through telegram.
```
start "llama-server Backend" /min llama-server ^
-m "c:\models\Qwen3.6-27B-4bpw-16GB-VRAM.gguf" ^
-c 100000 ^
-ngl 99 ^
-t 10 ^
-ub 512 ^
-np 1 ^
--spec-type ngram-mod ^
--spec-ngram-mod-n-match 24 ^
--spec-ngram-mod-n-min 12 ^
--spec-ngram-mod-n-max 48 ^
--kv-unified ^
--kv-offload ^
--mlock ^
--no-mmap ^
-fa on ^
-ctk q4_0 ^
-ctv q4_0 ^
--temp 0.6 ^
--top-p 0.95 ^
--top-k 20 ^
--min-p 0 ^
--repeat-penalty 1.0 ^
--presence-penalty 0.0 ^
--port 1235
```
So far the system seems steady and tool calling works well. I've tested Openclaw for around 2 hours so I can't give any long term feedback on stability yet. Just wanted to share my setup to see if someone else wants to try this.
Posted Jun 12, 2026, 12:55 PM UTC