
simplefunction
u/simplefunction


Souchastnik: An offline Android keyboard layer running local Qwen 3.5 (0.8B) via llama.cpp to predict your Russian prison sentence as you type.
github.com/MShverdiakov/souchastnik
github.comI am not an author, here is link:
https://github.com/Highwayaiexpose/CMP-170hx-64gb-LLM-benchmarks
CMP 170hx 8gb(64gb), 300w vbios, 610 driver.
Qwen3.6-27B (dense) Β· tg, tok/s
(xx) - without MTP. 170HX W8A8 =100%.
| Card | VRAM | Q Β· backend | tg | % |
|---|---|---|---|---|
| q > 4 | ||||
| 170HX 64GB | 64G | W8A8 Β· vLLM MTP3 | 97 (42) | 100% |
| RTX PRO 6000 | 96G | Q8_0 Β· llama.cpp MTP | 79 (46) | 81% |
| 2Γ2080Ti 22G | 2Γ22G | Q6 Β· llama.cpp MTP2 | 46 (38) | 47% |
| Atlas |
https://i.imgur.com/qqEjxmW.png
https://github.com/amoghmunikote/cmpunlocker
I'm not an author, I'm just one of those who regrets not buying some of these for $200.
================================================================================ CMP 170HX 8gb β Perf + Memory + PCIe Gen2 Unlock NVIDIA Driver 610.43.03 (patched open kernel modules)
GPU: CMP 170HX (0x20C2) Result: 64 GB HBM2e + 173 TFLOPS BF16 + PCIe Gen2 x4 (2 GB/s) OS: Linux x86_64 (Fedora, Ubuntu, Debian, Arch, openSUSE) Kernel: 5.x β 7.x
WHAT'S INSIDE βββββββββββββ
cmp170hx-unlock/ βββ install.sh β installer (run this) βββ NVIDIA-Linux-x86_64-610.43.03.run β NVIDIA userspace (libs, firmware) βββ open-gpu-kernel-modules-610.43.03/ β patched
https://github.com/abobasixseven/unlock-cmp-170hx
Unlock itself.
Prices went up from ~17k rub (200$) to 90k and above (1200usd and more.
It was posted 2 days ago here, link above.
https://github.com/abobasixseven/unlock-cmp-170hx
Unlock itself.
Prices went up from ~17k rub (200$) to 90k and above (1200usd and more.
I'm very lame, idk how to pick a model, quant, and which settings to apply for llamacpp/kobold. Here is what AI suggested:
./llama-server -m gemma-4-26B-A4B-it-uncensored-heretic-MXFP4_MOE.gguf --ctx-size 200000 --parallel 1 --n-gpu-layers 999 --n-cpu-moe 12 --flash-attn on --cache-type-k q8_0 --cache-type-v turbo4 --batch-size 1024 --ubatch-size 512 --reasoning off --jinja --temp 0.7 --top-p 0.8 --top-k 20 --min-p 0.0 --presence-penalty 0.0 --repeat-penalty 1.0 --fit-target 128 --checkpoint-every-n-tokens -1
I downloaded a turboquant fork for llama, but also have original and kobold too.
I don't know how and when did it happen, but there is just no dlss option in menu. Only FXAA and TAA. It used to be on DLAA, but now it doesn't work and TAA is much, much worse. How can I set it back? Maybe force it with NVPI somehow?
Driver is on 610.47, RTX 5070 Ti




