vLLM speed issues

I find myself in the awkward position that my Q4 llamacpp version of Qwen3-VL-30b-A3b is significantly faster (like 2x speed per token) than the equivalent vLLM AWQ version and I can't point my finger on why.

Single first requests so not a KV cache issue.

In principle vLLM should technically be faster but I'm just not seeing it. Might I be misconfiguring it somehow? Has anyone else run into similar trouble?