New rig thoughts? Feedback welcomed.

Accidentally deleted my first post on this… fml

Currently running an ASUS 4060 with a lot of ram but have been waiting to invest in something better. The ultimate goal is scalability to a terabyte of VRAM for multi agent flows and training for an architecture I’m building and I’d really love to not pay for runpod anymore.

Looked into Macs and may add them in the future for inference but want to go the CUDA route first. I’ve never built a machine like this so my setup could be off.

Noise, power and thermals are no issue. 10GbE fiber existing and plenty of room for activities lol.

Love to hear some feedback:

GPU
NVIDIA RTX PRO 6000 Blackwell, 96GB GDDR7 ECC
(Possibly 2 x 3090s linked in v1 but idk)

CPU
AMD EPYC 7443P, 24 cores / 48 threads, 8-channel DDR4-3200

Motherboard
Supermicro H12SSL-i, SSI-EEB, AMD SP3, 8 DIMM slots, 7 PCIe 4.0 x16

CPU Cooler
Noctua NH-U14S TR4-SP3

Memory
256/512GB DDR4-3200 ECC RDIMM (8 x 32GB, dual-rank)
-DDR5 when memory comes down if ever

Chassis
Rosewill RSV-L4500U, 4U rackmount

Power Supply
Corsair AX1600i, 1600W, 80+ Titanium, fully modular

Boot Drive
Samsung 990 Pro 1TB NVMe Gen4

Model Storage
WD Black SN850X 4TB NVMe Gen4

Case Fans
4 x Noctua NF-A12x25 PWM