Onboard mini-SAS or LSI HBA?
I just bought a new ASrock Rack ROMED8-2T. It’s got 2 mini-SAS ports that are currently unused, and they appear to support 4 drives each.
I’m currently using an LSI 9211-8i that I picked up because my old board only had SATA2 and I had a spare PCIe slot.
Should I ditch the LSI and just use the onboard? Seems like it would simplify a few things.
Also, any clever ideas for the 2 OCulink connectors beyond hot-swappable M.2 storage?
https://www.asrockrack.com/general/productdetail.asp?Model=ROMED8-2T#Specifications
Thanks!
Posted Jun 22, 2023, 11:43 PM UTC
The HBA should more easily pass-through devices.
Well, unRAID is running on bare metal, so there’s no need to pass it through. In any case, all 4 SATA controllers on the Epyc SoC appear available for pass-thru.
I have been considering virtualizing unRAID on top of Proxmox, if only because it’s Debian based and I feel a little claustrophobic with the level of tooling available in unRAID/Slackware, but also because I’d like a mechanism to live migrate VMs to another machine when necessary. Not unRAID, naturally, since it’s tied to the hardware, but all of the service-level dedicated VMs I have could move around.
Another reason would be to hopefully enable Infiniband on a ConnectX-3. I haven’t been able to get anywhere close to saturating the NVMe drives over that connection with unRAID, despite clocking ~36Gbps with iperf3 already. I’m not sure it’s related to the drive, or even shfs, since writing directly to shared memory also caps out at waaay slower than that.
Good to keep in mind though, thanks!