MoE Hardware Configuration Reference

Stable docs: @docs/training/moe-optimization.md Card: @skills/nemo-mbridge-perf-moe-hardware-configs/card.yaml

Quick Platform Playbook

These rows are search seeds, not hardware defaults or throughput promises.

Platform	Candidates to screen after `alltoall` bring-up	What usually matters most
H100	DeepEP or HybridEP, explicit overlap, supported FP8 modes	communication overlap, dispatcher/runtime compatibility, and PP efficiency
B200	DeepEP or HybridEP, supported FP8 modes, careful PP layout	container quality and tuned communication settings
GB200	HybridEP, then profile-driven graphs and CPU cleanup	host overhead, topology-aware dispatch, memory headroom
GB300	HybridEP and the target container's lower-precision/kernel stack	the same system interactions as GB200, with remeasurement required