Llm with RAG
I have an idea in my head that I want to prototype before I ask my work for funding.
I have a vector database that I want to query via a LLM and perform RAG against the data.
This is for Proof of concept only performance doesn’t matter.
If the PoC works than I can ask for hardware what is well outside my personal budget
Can the Orin nano do this?
I can run the PoC off my m4 air. But I like to have the code running on nvidia hardware if possible
Posted Oct 30, 2025, 4:07 PM UTC
311