shing3232
u/shing3232
About 40~% cheaper
it's up now!
The text is gone. we might heading to server reopen soon.
There are rumor of moving servers and reopening at April 10 in China.
llama_kv_cache_unified: kv_size = 163840, type_k = 'f16', type_v = 'f16', n_layer = 61, can_shift = 0, padding = 256
llama_kv_cache_unified: CUDA0 KV buffer size = 10980.00 MiB
llama_kv_cache_unified: KV self size = 10980.00 MiB, K (f16): 10980.00 MiB, V (f16): 0.00 MiB
The full context of 160k tokens now takes up less than 11GB without kquants
https://github.com/mit-han-lab/nunchaku/discussions/236
🚀 Performance
- First-Block-Cache: Up to 2× speedup for 50-step inference and 1.4× for 30-step. (u/ita9naiwa )
- 16-bit Attention: Delivers ~1.2× speedups on RTX 30-, 40-, and 50-series GPUs. (@sxtyzhangzk )
🔥 LoRA Enhancements
https://huggingface.co/deepseek-ai/DeepSeek-R1
https://huggingface.co/deepseek-ai/DeepSeek-R1-Zero
I am waiting for this. hopfully today
【京东】https://3.cn/29-XUdC1「爱乐酷光固化3D打印机 土星4 Ultra 16K LCD大尺寸全自动调平桌面家用高速3d打印机 【新品上市 升级大尺寸】土星4U 16K」 点击链接直接打开
It does seems like it has heater build in, but i am not sure anyone would upgrade