Mac M1 cluster for LLM Inference?

🗣️ Discussion

I have a mac mini m1 16gb and m1 air 16 gb. I want to try distributed inference and use these machines specifically to learn llm concepts in and around inferencing.

I am not sure if it's possible or not. I dont want to end up stacking machines if not for this purpose. I dont need them to solve or replace any coding assistants but any usable output for small automations + plus a lot of learning around inferencing, llm concepts is what I'm trying to get out of it.

Cannot buy a gpu based pc with the budget even if i sell the macs.

Any idea on this ?

Posted Aug 1, 2026, 3:51 AM UTC

31
Loading comments…