Qwen 3.8 27B vs Qwen 3.8 177B Flash Next

I did not believe that I will say this bit IQ3_XXS Flash Next outperforms Q8_0 27B.

I know, I know... more parameters has potential to be beter even quantized, but IQ3, which for me was considered very dumb quantization (3.6 27B IQ3 was useles for me).

Setup is two RTX 3090s on PCIe Gen4 x8 with no NVLink, a Ryzen 7 9700X, and

32 GB of DDR5 that is single channel. Both models ran with

temp 1.0, top_p 0.95, top_k 20, min_p 0 and reasoning_effort medium.

Averaged over nine tests the 27B lands at 92% and Flash-Next at 94%.

Yeah I know... 2% but at my coding tasks they matter.

I am hardware developer and Flash Next has very good understanding of ARM architecture but also follows datasheets better. I gave it same tasks, hardware acces, SD card with file system, high speed Serial communication, DMA, caching issues... they are both suprisingly good but Flash Next in those 2 percent gave solutions that Opus 5 did not... so...

I will not go in details becouse they are boring but if someone is interested to try it, you will not regret... model is amazing for local hardware, speeds are also. I managed to get 40+tps which is more than usable (flash next is so verbose on xHigh)...