Fit an entire voice assistant into ~1.2 GB on a phone — runs 100% on-device, benchmarked on iPhone / S23 / Mac

Been building a voice assistant that hears you, thinks, and talks back with nothing leaving the device — and got the whole thing surprisingly small:

- iPhone 16 Pro: ~1.2 GB for the full loop

- Galaxy S23: ~1.5 GB, real-time on CPU

- Mac: ~3.6 GB, running Gemma 4 at 214 tokens/sec so it can actually hold a conversation and drive the machine by voice

It's one pipeline (voice detection → speech-to-text → LLM → text-to-speech) that scales by hardware — tiny models on a phone, a real brain on a laptop. No cloud round-trip, no per-call cost, private by default.

Numbers + how it works: https://soniqo.audio/blog/on-device-voice-agents · Mac app: https://github.com/soniqo/runner