r/mlscaling•
ekolpack

Please recommend a machine for deep research on health and nutrition.

D, Hardware, Econ

Basically, I've got 3 options:

#1: Mac Studio M1 Max w/ 128GB unified RAM + 32GB of 5090 VRAM (external TB PCI-e enclosure) = fast system for smaller models like Gemma 4 12b or Qwen 9B.

#2: Dell PowerEdge R7425 w/ 1.5TB ECC system RAM + 48GB VRAM from 2 x RTX 3090's (expandable up to 8!) = much slower system capable of running much larger models (in system RAM, passing off to VRAM, big bottleneck) like Kimi K2.6, DeepSeek R1, etc.

#3: Recommendations? I have an HP Z840....maybe load it up with cheaper AMD cards for more VRAM and run a larger model quantized? Other options?

Goal: Assist with research on various health and nutrition topics. Flag possible errors in methodology or conclusions, conflicts of interest from authors or funding, P hacking, poor controls, etc. Assist with systematic reviews and meta-analyses to yield high-probability or "provisional conclusions". The model would need to either ingest research documents, or scape the web, PubMed, Google Scholar, etc. to find and scrape them itself.

Precision and reasoning is more important than speed. I can ask a question and walk away for an hour or two, or even a day or two on huge stuff. Agentic capabilities would be really nice cause I could create a "research quality control agent" that would keep running the data through to improve and refine over time. But would the system RAM pass off to VRAM just be too much of a bottleneck? Like are we talking a MASSIVE increase in time spent as to be unreasonable? Like many questions might take days or weeks to process? Would it create other problems besides speed?

Am I better off just paying for tokens on Kimi K or something?

Electricity and heat from running the system are not issues, I've got that covered. Thanks!

Posted Jun 6, 2026, 9:39 PM UTC

01
Loading comments…