Current best models to run locally with 1x5090 and 1xRTX pro 6000?
Spec:
1x 5090
1x RTX pro 6000
128GB DDR5 6000MT/s
Current cpu and motherboard are bottleneck since one gpu is connected via pcie4x8 while other is pcie5x16. Open to swapping with Epyc later since current setup kills latency
Primarily for coding replacement for paid models.
Any good recommendations? Preferably don’t wanna offload to RAM but open to it.
Posted May 1, 2026, 3:43 AM UTC
01