Part 2 of a series on RDMA in Kubernetes pods for GPU training. Each pod gets its own SR-IOV virtual function on each rail, with 1 or 2 VFs per physical function.
Posts for: #Sr-Iov
Why Pods See Zero RoCE GIDs on DOCA-OFED
Why pods on DOCA-OFED nodes read the host’s RoCE GIDs as zero, what the driver does, and what works instead.
ARP, rp_filter and accept_ra for RDMA Pods on Kubernetes
Where the ARP, rp_filter and accept_ra settings of a multi-rail RDMA node live on Kubernetes, and who sets them.