Best setup for AI PRO R9700 + 256GB of RAM
Hi,
I have an AMD 9950X3D + 256GB of DDR5 at 5600MT/s (bought before the rampocalipse) and a radeon 7900XT with 24GB of vRAM.
I have run some small models on the 7900XT, but now I got a new PROD R9700 with 32GB of vRAM that I would use to run local inference.
Anyone having a similar machine? What is the best setup/model to run on it? Can MoE models use the 256GB of RAM efficiently for caching unused experts while keeping active experts on vRAM?
Thanks for your suggestions.
Posted Aug 12, 2026, 11:00 AM UTC
122