Llm with RAG

Project

I have an idea in my head that I want to prototype before I ask my work for funding.

I have a vector database that I want to query via a LLM and perform RAG against the data.

This is for Proof of concept only performance doesn’t matter.
If the PoC works than I can ask for hardware what is well outside my personal budget

Can the Orin nano do this?

I can run the PoC off my m4 air. But I like to have the code running on nvidia hardware if possible

Posted Oct 30, 2025, 4:07 PM UTC

311
Loading comments…