I wired a fully offline voice loop to Ollama + LM Studio — 100% CPU, no GPU, nothing leaves your machine (Silero VAD + Parakeet STT + Supertonic TTS 3)

Discussion

I've been running Ollama locally for a while and the one thing I kept missing was voice. Every solution I found either sent audio to the cloud, needed a GPU, or was locked to macOS.

So I built one that does none of that.

**The full stack — all local, all CPU, all ONNX:**

**Silero VAD** — neural voice activity detection, ~5ms per frame on any CPU. No push-to-talk, no manual clipping. It just knows when you start and stop speaking.

**Parakeet TDT 0.6B** — ONNX INT8 transcription. 25 languages, ~200–500ms on a regular laptop CPU. OpenAI-compatible API on :5093. No Whisper API, no cloud STT.

**Supertonic TTS 3** — ONNX synthesis, ~100–500ms CPU. Multilingual EN/ES/KO/PT/FR. Genuinely good quality. No ElevenLabs, no cloud TTS.

**The privacy story (the part I should have led with):**

If you pair this with Ollama + OpenCode or LM Studio, here's the complete data flow:

Your voice → Silero VAD (your CPU) → Parakeet STT (your CPU) → Ollama / LM Studio (your machine) → Supertonic TTS 3 (your CPU) → your speakers

That's it. Zero bytes leave your hardware. No transcription API. No synthesis API. No inference cloud. Your conversations are entirely private.

**Cross-platform — macOS, Linux, and Windows:**

One command on macOS/Linux:

git clone https://github.com/groxaxo/opencode-voice-service && cd opencode-voice-service && ./setup.sh

On Windows (PowerShell):

.setup.ps1

The installer is interactive — it asks which components you want (Parakeet, Supertonic, VAD venv) and which agent integrations to set up (Claude Code, OpenCode, OpenClaw, Hermes, Codex). Picks up launchd on macOS, systemd on Linux, Task Scheduler on Windows automatically.

Tested on a 4-year-old ThinkPad. No GPU. Works fine.

**GitHub:** https://github.com/groxaxo/opencode-voice-service

Happy to answer questions about the VAD tuning or ONNX performance on specific hardware.

Posted Jun 11, 2026, 2:47 AM UTC

1814
Loading comments…