Could you help me test MTP for GLM-4.7-Flash?
Some of you may remember old models from GLM, like GLM Air or GLM Flash. I know they’re outdated, but I have a soft spot for them, so I am currently working on enabling MTP for them in llama.cpp.
If you know how to compile llama.cpp from source and have the hardware to run GLM-4.7-Flash, could you test this out and let me know if it works for you (and what's the speed gain with MTP), or if you encounter any issues?
https://huggingface.co/jacek2024/GLM-4.7-Flash-MTP-GGUF
(if you need smaller quant - let me know)
Posted Jun 25, 2026, 6:52 AM UTC
117