**Quick recap:** Building a completely offline, private voice AI assistant called ARIA. No cloud. No usage limits. Learns from you over time.

**Day 2 progress — the technical foundation:**

*The Stack:*  
*Frontend: Tauri 2 + React + Three.js + deck*

*Backend: FastAPI + LangGraph + Redis + Qdrant*

*AI: faster-whisper + Llama 3.1 (Ollama) + Piper*

*Feeds: OpenSky, AISstream, CelesTrak, USGS, GDELT, NASA FIRMS*

*What actually shipped today:*

1. **WebSocket voice pipeline** — audio chunks stream to FastAPI, STT returns interim transcripts, LLM responds, TTS streams back. End-to-end latency: \~1.2s on an M1.
2. **LangGraph agent with 9 tools** — the LLM decides when to call search, telemetry queries, device commands, or anomaly detection. Tool definitions are fully typed with Pydantic.
3. **First globe integration** — aircraft markers rendering on deck-gl with CARTO Dark Matter tiles. Click any marker → assistant reads full entity details aloud.
4. **Permission gatekeeper** — walks users through mic, notifications, and accessibility permissions with custom "Fix It" dialogs instead of browser alerts.
5. **HUD orb state machine** — 4 distinct visual states mapped to AI phases. The orb scale responds to live TTS audio frequency data via AnalyserNode.

*The hard lessons today:*

* **Transparent windows + CSS backdrop-filter don't mix** → solved by applying Mica/Acrylic at the OS level via `window-vibrancy` crate
* **Wake word false positives** → sensitivity tuning + audio preprocessing
* **Ollama initial latency** → swapped to Groq for development, will revert to Ollama for final build
* **CORS with WebSockets** → needed explicit `allow_origins=["tauri://localhost"]`

*Tomorrow's targets:*

* Device control layer (lock screen, open apps, system commands)
* Proactive anomaly alerts (earthquake clustering, unusual vessel patterns)
* Long-term memory via Qdrant (semantic search across conversation history)

**The orb animation:** Each AI state now has unique behavior

* `idle`: blue, slow rotation
* `listening`: cyan pulse, waveform bars
* `thinking`: purple, accelerated spin
* `speaking`: green, scale driven by audio frequency

**Open question for the community:** I'm debating between Qdrant and Chroma for long-term memory. Qdrant seems more robust for production, Chroma is lighter. Anyone running either in production at scale?

Code is being published incrementally at \[repo link once public\]. Follow #BuildingARIA for daily updates.

Day 2 in the books. 28+ days to go.  
\#BuildingARIA

**#BuildInPublic #LocalAI #VoiceAssistant #Tauri #RustLang**

[ Removed by moderator ]