Why pods on DOCA-OFED nodes read the host’s RoCE GIDs as zero, what the driver does, and what works instead.
Notes on GPUs, RDMA and Kubernetes.
ARP, rp_filter and accept_ra for RDMA Pods on Kubernetes
Where the ARP, rp_filter and accept_ra settings of a multi-rail RDMA node live on Kubernetes, and who sets them.
Gang Scheduling and Topology-Aware Scheduling in Upstream Kubernetes
Which parts of Kueue’s topology-aware scheduling are moving into kube-scheduler, tested on Kubernetes v1.37.1 with the same topology and mostly the same experiments as my Kueue post.
RDMA Network Locality for Multi-Node Jobs with Kueue
How Kueue’s topology-aware scheduling keeps the pods of a multi-node job in one RDMA local block or network block, tested step by step on a cluster without Kueue.
Why Large RoCE Frames Disappeared on OVS-DOCA 3.5
How OVS-DOCA 3.5 kept receive buffers sized for a 1500-byte MTU, so large RoCE frames vanished. One ovs-vsctl transaction fixed it.