r/LocalLLaMA•
combo-user

Gemma 4 MTP with assistant vs llama cpp type MTP

Question | Help

Hi all

Been loving the QAT models but honestly what is up with the assistant models, any ggufs and ways to make em work with vanilla llamacpp and if this way of MTP is different than the one am17an developed for llamacpp.

Followup question - anyway I can run Gemma4 26BA4B q4 QAT with MTP and or assistant models on vanilla llamacpp?

Posted Jun 8, 2026, 4:43 PM UTC

06
Loading comments…