Thermal-concerned (esp. laptop) users, what do you use?
So far I've found that vulkan llama.cpp on qwens 27B works up ~20C cooler than on cuda(65-75C vs 85-95C) even on long generations, also gives 2-3 extra token per sec, but takes eternity to load, and unusable when part of layers are unloaded (eg 35B moe qwens) as it go <10 tok/s. I've tried limiting gpu clock and use lower thread number, no changes. So... Is there any secret in either settings or using not llama.cpp but vllm or exllama or whatever? (Spending hours to download their models just to test doesn't seems interesting, I'd rather ask here.)
Posted Aug 28, 2026, 7:33 AM UTC
210