I've been building this thing for a while now and finally open-sourced it. Figured some of you might find it useful. It is built on top of PI and it is OSS, MIT.

[https://youtu.be/OLUt1exGUfE](https://youtu.be/OLUt1exGUfE)

ExSecAI - Your AI Executive Secretary with Live Assist and Voice Transcription to action mode.

I  
wanted an AI assistant that actually does things autonomously, not just chat. Something I could leave running and come back to find completed research reports, scheduled emails, generated spreadsheets, all without babysitting it.

Think of it like an OpenClaw you can actually control and see what it does. Full dashboard, full visibility into every task, every agent action, every output. No black box.

ExSecAI is a self-hosted agent orchestration platform built on top of Pi, using TS. You write tasks as markdown files, drop them in a folder, and a supervisor picks them up and runs them through AI agents. Each task gets an agent role (researcher, writer, analyst, etc.), access to tools, and a full execution lifecycle with evaluation and auto-retry.

It has a dashboard. It's a full web app with:

What I'm having most fun with - Live Assist mode, real-time interactive sessions where you talk to the AI and it produces structured action cards, with research, task creation, whatever else you want. You can pause, resume, pick different agent roles mid-session. I envision real conversations, or Dr. consultation with real time feedback and context expansion just based on context, completely hands off and proactive.

Voice input with VAD - tap the mic, talk, it transcribes and sends. Silero voice activity detection handles the "when did they stop talking" problem. I access it from my phone over Tailscale when I'm away from my desk.

Built-in terminal on the web - chat with the AI in one tab, check its work in an actual terminal in the other. No switching windows. Open Claude Code, Opencode, Pi, whatever you want, right on the web, anywhere in the world, through tailscale.

Cron scheduler - set any task to recur. \`Schedule: daily 08:00\` in the frontmatter and it runs every morning. There's a heartbeat task that self-monitors the whole system.

Ralph loops - this is the weird one. Write a PRD with user stories, point Ralph at it, and it iterates through each story autonomously: implement, test, commit, next story. I've had it build small projects from scratch while I sleep. I just wanted to have the bells and whistles... and I'll keep iterating on it.

Telegram bot - chat with your agents from Telegram. DM or group chat. I use this to send quick tasks when I'm on my phone.

20+ Python skills - Excel, Word, PDF, PowerPoint, data visualization, web scraping, social media tools. Agents invoke them as needed. I'm just more familiar with Python... Some of these tools are still broken and will be fixed with time. But most of them work wonderfully well.

Where other agent platforms give you autonomy but zero visibility (you kick off a task and pray), ExSecAI gives you a dashboard where you can watch the agent work in real time, see every tool call, inspect every output file, and intervene if needed. Autonomous when you want it, interactive when you need it.

It runs on Node.js, uses the Pi Coding Agent SDK under the hood (which supports Claude Code, Antigravity, and a few other OAuth logins, and other providers through extensions). There's a NanoGPT extension included that makes tool calling work with cheap models like Kimi K2.5, Qwen, DeepSeek etc through a cheap account. I've spent about a day on this, collecting fixes from all over the internet, so now I can do tool calling on K2.5, 4.7, M2.1 and all the sota OpenSource models out there, even non cheap inference servers with broken trasnformers.

Local models on LmStudio like GPT-OSS20B works wonderfully well! I does 95% of what I need on a daily basis through ExSecAI.

Easy Install...  
\`\`\`  
npm install -g exsecai  
mkdir my-secretary && cd my-secretary  
exsecai init  
exsecai start  
\`\`\`

Docker works too. MIT licensed. Although I couldn't make Pi OAUTH work through docker... regular API keys/ endpoints should work fine though.

I'm a solo dev on this, so there's MANY rough edges. But the core loop -- drop task, agent runs, get output -- has been solid for me for months. The dashboard and the Live Assist is the real quality-of-life win.

Another super cool feature - Try it... Press and hold on mobile, or click and hold on desktop on chat/ mic icon on bottom right quadrant, and you'll start transcribing right away. Your message will be sent to agent as soon as you release. Just a quick accessibility tool that comes quity in handy when I'm driving, or on the road (although I know I shouldn't). Try it, tell if me if you like.

Last cool thing - I've spent the time working through several hoops to make Transcription work on Desktop, Chrome, Iphone (Ios in General) and Android. Each of these had its own quirks, but everything is working (at least one of the 5 STT methods works in one of these systems).

Would love feedback. Please try it and give me your feedback.  
Supporters and contributors are welcome!

\- GitHub: [https://github.com/sermtech/ExSecAI](https://github.com/sermtech/ExSecAI)  
\- npm: [https://www.npmjs.com/package/exsecai](https://www.npmjs.com/package/exsecai)

I built an open-source AI secretary ExSecAI that runs on your machine, with any LLM models - tasks are created with markdown files. It has a heartbeat (like openclaw) and you can tell it to do anything with tools, skills and agents. You gotta try the Live Assist mode! Most fun (OSS, MIT)