Thank you for this info! I will certainly look into those models. Have you found using tensorflow or PyTorch makes a difference wrt compatibility?

Any GPU with a high VRAM count will work. Preferably 12GB+. 6 or less would be fine but using such a a low VRAM value for ML would mean more time needed to compile models for example. If you are on a budget, you can grab an old Quadro or Titan X card to use. I personally use a 3090 Ti in an eGPU for ML. There definitely will be compatibility issues with Linux but there are plenty of workarounds for it. Also note that depending on the eGPU connection used your bandwidth limitations on the connection doesn't actually effect ML performance as heavily as regular rasterization does. (10-20% performance loss on regular rasterization using TB3 for reference)

FWIW I recently picked up a Razer Core X w/ an OC 3060 (12GB) to run local stable diffusion repositories and it has been pretty buttery. Highly recommend.

Relatively new to pc hardware, but I know enough to be able to put a unit together, but don’t know which GPUs would be good for ML. Requirements: I would use it for neural nets and deep learning models, if that makes a difference. I know Nvidia is king when it comes to this, but I also know there are a bunch of issues when it comes to Linux compatibility, which this would be running on (and also I’m not that fond of them as a company). Please let me know if you need any more info. GPU recs and cases etc, would be super helpful!

Are there any Machine Learning folks that can suggest an eGPU set up?