anedisi

I know about Ollama, llama-server, vLLM and all the other options for hosting LLMs, but I’m looking for something similar for RAG that I can self-host.

Basically: I want to store scraped websites, upload PDF files, and similar documents — and have a simple system that handles: • vector DB storage • chunking • data ingestion • querying the vector DB when a user asks something • sending that to the LLM for final output

I know RAG gets complicated with PDFs containing tables, images, etc., but I just need a starting point so I don’t have to build all the boilerplate myself.

Is there any open-source, self-hosted solution that’s already close to this? Something I can install, run locally/

I’m a PM (ex-senior dev, had one exit). Built an MVP in a niche I think is underserved. I want to keep freelancing at my enterprise gig (pays well), but test this project on the side.

Plan: keep building myself, hire a junior/student salesperson to look for customers. My biggest concern: I know from past experience it’s harder to find a good salesperson than it sounds. So I’m thinking of creating a concrete plan of attack with them, so they basically just follow what I’d do if I went full-time, and adjust as we go.

Money-wise, I could even afford to try 1–2 juniors for 2–4 months if needed, without leaving my contract. The niche isn’t complex to learn.

Question:

Is this a smart way to va

I already have a 5090 and was researching what would i need to be able to host something like qwen3 coder locally with ok speeds. And together with some research i came with up with this

Part Model Est. EU Price (incl. VAT) Motherboard Supermicro H13DSH (dual SP5, 24 DIMM slots) ~€1,320 CPUs 2 × AMD EPYC 9124 (16c, 2P-capable) ~€2,300 (both) RAM 24 × 32 GB DDR5-4800 ECC RDIMM (768 GB total) ~€1,700–1,900 Coolers 2 × Supermicro SNK-P0083AP4 (SP5) ~€200 Case SilverStone ALTA D1 (SSI-EEB tower) ~€730 PSU Seasonic PRIME TX-1600 (ATX 3.1) ~€500 Storage 2 × 2 TB NVMe PCIe 4.0 (mirror) ~€300

Total (without GPU, that i already have): ~€6,750–7,000

What im not sure how to get about how many token

I don't see here any mention of models/projects that are able to replicate, basically uploading a wireframe and text and building a prototype with it live with a preview on the right side. And then that can be prompted to change things in the design.

Im a dev turned product person without (proper) design skills so this would help me trying some stuff out. I tried openhands with codestral, but it runs so slow, and i have a 5090. Is there something better and what models should i try.

My 5090 is coming tomorrow, and I want to run llama 3.3 70b locally. I also have system ram with 128gb 6400 Mt. Could this setup run this model, and with Which settings for vllm.

So, i just wanted to ask is there anybody that is using Revolut for investing. Something in the range of 50-100k. Im looking between IB and Revolut and Revolut has for me a better interface and i have expirience with Revolut. Im planing to just buy index and bonds so no day trading or anything, but im afraid to have the money there and them blocking my acc. I have some history with revolut and last year i spent on revolut more then 40k but that was always topping up like 400E and then spending.

What protections does Revolut offer for the money and who to contact if i need.

We are visiting UK and are from EU, i would like to know how does it work with VAT return with UK and tourists. For example if i would to buy some car equipment and bring it with me, i cannot really say "it's" mine, i would have to declare it, and then there is a risk of having to pay the VAT twice. If i would get the VAT return in UK and pay it in my country that would be ok. Is that possible ?