What am I missing? GPT-OSS is much slower than Qwen 3 30B A3B for me!

Hey to y'all,

I'm having a slightly weird problem. For weeks now, people have been saying "GPT-OSS is so fast, it's so quick, it's amazing", and I agree, the model is great.

But one thing bugs me out; Qwen 30B A3B is noticeably faster on my end. For context, I am using an RTX 4070 Ti (12 GB VRAM) and 5600 MHz 32 GB system RAM with a Ryzen 7 7700X. As for quantizations, I am using the default MFPX4 format for GPT-OSS and Q4_K_M for Qwen 3 30B A3B.

I am launching those with almost the same command line parameters (llama-swap in the background):

/app/llama-server -hf unsloth/gpt-oss-20b-GGUF:F16 --jinja -ngl 19 -c 8192 -fa on -np 4

/app/llama-server -hf unsloth/Qwen3-30B-A3B-Instruct-2507-GGUF:Q4_K_M --jinja -ngl 26 -c 8192 -fa on -np 4

(I just increased -ngl as long as I could until it wouldn't fit anymore - using -ngl 99 didn't work for me)

What am I missing? GPT-OSS only hits 25 tok/s on good days, while Qwen easily hits up to 34.5 tok/s! I made sure to use the most recent releases when testing, so that can't be it... prompt processing is roughly the same speed (149 tok/s for GPT-OSS and 143 tok/s for Qwen)

Anyone with the same issue?