Claude + local model qwen3.8:27b-mlx times out

Question

I've tried Claude Code now with qwen3.8:27b-mlx via `ollama launch claude --model qwen3.8:27b-mlx` multiple times, and while the process starts off promising, at some point, the API simply times out and the whole process stops.

Has anyone had any luck here? Do other harnesses work better?I have a capable machine with 64GB RAM, this is, in theory, doable. I'e tried adjusting `num_ctx` to no avail. Thanks for any help and experience anyone has to share.

Posted Sep 2, 2026, 12:40 PM UTC

14
Loading comments…