Qwen 3.5 27B Macbook M4 Pro 48GB
Has anyone tried Qwen 3.5 27b on a 48gb Macbook Pro?
What has been the results for them and at what quant? I have been reading that the 27b outperforms the 35B-A3B and I am curious to see if anyone has the same system as above and if it runs smooth (with enough room for cache and context)
There are some mlx-versions available on huggingface I have seen that offer different quants. 4b, Opus Distilled 6bit, a 7 bit, mxfp8, etc. Would appreciate feedback from any hands on experience with these models, their speeds, quality in quantizations, and viability for real world use. Much Appreciated.
Posted Mar 8, 2026, 8:01 PM UTC
2633