Run LLMs locally in your Kotlin apps - no internet, no API keys, or hidden fees (Gemma 4, Qwen 3.5...)
We've built an open-source Kotlin library that runs LLMs entirely on-device. Your users get AI features without internet connectivity, and you avoid cloud costs and API dependencies.
What you can do
- Build offline chatbots and AI assistants using any model in .gguf format
- On-device document search without sending data to the cloud
- Give your LLM the ability to interact with the outside world with tool calling
- Feed image & audio inputs directly to your LLM
Benefits
- Works offline, private by design
- Hardware acceleration with Vulkan
- No usage fees or rate limits
- Free for commercial use
Links
Happy to answer any technical questions in the comments!
Posted Jun 3, 2026, 1:20 PM UTC
109