r/ceph•
ceph-n00b

serving cephfs to individual nodes to via one nfs server?

Building out a 100 client node openhpc cluster. 4 PB ceph array on 5 nodes, 3/2 replicated. Ceph Nodes running proxmox w/ ceph quincy. OpenHPC head-end on one of the ceph nodes with HA fallover to other nodes as necessary.

40GB QSFP+ backbone. Leaf switches 1GB ethernet w/ 10G links to QSFP backbone.

Am I better off:

a) having my OpenHPC head-end act as an nfs server and serve out the cephfs filesystem to the client nodes via NFS, or

b) having each client node mount cephfs natively using the kernel driver?

Googling provides no clear answer. Some say NFS other say native. Curious what the community thinks and why.

Thank you.

Posted Apr 9, 2025, 8:29 PM UTC

34
Loading comments…