RDMA Verbs

Purpose

Guide agents through RDMA programming with libibverbs: one-sided vs two-sided operations, RC/UC/UD transports, device setup (ibv_get_device_list, protection domains, memory registration, completion queues, queue pairs), work requests and completions, RoCE vs InfiniBand, perftest benchmarking, and Rust rdma-sys bindings.

When to Use

• Building ultra-low-latency storage or database networking
• Bypassing CPU for remote memory access (one-sided RDMA)
• Setting up RoCE on Ethernet fabrics
• Benchmarking network fabric with perftest tools
• Integrating RDMA into MPI or custom RPC systems
• Debugging RDMA connection and completion errors

Workflow

1. RDMA concepts