Qwen 3.6 27B + Openclaw on 16 GB of VRAM

Tutorial | Guide

Hey guys, I just upgraded my graphics card to a 5070ti with 16GB of VRAM.

​

My goal for the upgrade was to run Openclaw locally. I know that Qwen 3.6 27B is kind of the bare minimum of what you need to run something like Openclaw. Because of my limited VRAM I first tried Qwen 3.6 35B and while it works well for general chats, it has a lot of issues with tool calling and ending up in loops with Openclaw.

​

Before I start llama I use a little script that closes all programs to try and clear up as much VRAM as possible. This way I get around 15.2 GB and have about 800MB free once the model is loaded. This means you kind of have to run the system headless. I turn this setup on when I don't use the computer so I can chat with Openclaw through telegram.

​

```

start "llama-server Backend" /min llama-server ^

-m "c:\models\Qwen3.6-27B-4bpw-16GB-VRAM.gguf" ^

-c 100000 ^

-ngl 99 ^

-t 10 ^

-ub 512 ^

-np 1 ^

--spec-type ngram-mod ^

--spec-ngram-mod-n-match 24 ^

--spec-ngram-mod-n-min 12 ^

--spec-ngram-mod-n-max 48 ^

--kv-unified ^

--kv-offload ^

--mlock ^

--no-mmap ^

-fa on ^

-ctk q4_0 ^

-ctv q4_0 ^

--temp 0.6 ^

--top-p 0.95 ^

--top-k 20 ^

--min-p 0 ^

--repeat-penalty 1.0 ^

--presence-penalty 0.0 ^

--port 1235

```

​

So far the system seems steady and tool calling works well. I've tested Openclaw for around 2 hours so I can't give any long term feedback on stability yet. Just wanted to share my setup to see if someone else wants to try this.

​

​

Posted Jun 12, 2026, 12:55 PM UTC

1221
Loading comments…