I built a self-hosted video knowledge base using local ML models

Hey,

This project will be helpful if you have a lot of videos and you want to search across them

I wanna share with you a project that I've been working on for the last couple of months.

For context, I'm a software dev and video content creator, and I have a lot of video footage (public videos, personal, and family videos). I have almost 4 TB+ of content (mainly videos), some of which I couldn't find or I don't have the time to edit. And I don't wanna upload my videos to the cloud (or someone else's server).

I've decided to build a tool to solve my problem. I started with video transcription, using a local ML model, then I added a video frame analysis stage (face recognition (similar to Immich face labeling), object detection, emotion analysis, text visible on the frame, and more). Then we have multi-modal embedding (text, visual, and audio).

With this video processing pipeline, we can search by text (moments where Ilias is looking happy), by image (drag and drop an image, and we can find a moment similar to what you've attached).

Also, I have a chat feature with Ollama. You can chat with the assistant to give moments video compilation, export specific video moments, and more.

Keep in mind that all of this is happening on your machine. We don't share or upload your video data anywhere, and using local machine learning models. You can check the source code here https://github.com/IliasHad/edit-mind

I'm looking forward to hearing your feedback and support for this project (sharing this project with your friends who may find it useful). I'm actively working on this project by fixing bugs, adding new feature and more.

Thank you :)

Github Project: https://github.com/IliasHad/edit-mind

Showcase Video: https://youtu.be/YrVaJ33qmtg