nemo-mbridge-perf-hierarchical-context-parallel

Installation
SKILL.md

Hierarchical Context Parallel Skill

This skill covers hierarchical context parallelism: nested context-parallel process groups used by cp_comm_type="a2a+p2p" and configured with hierarchical_context_parallel_sizes.

For what hierarchical CP is, when to use it, and the decision tree (a2a+p2p vs pure a2a vs p2p), see:

  • @docs/training/hierarchical-context-parallel.md
  • @skills/nemo-mbridge-perf-hierarchical-context-parallel/card.yaml

Enablement

Minimal Bridge override:

Installs
1.6K
Repository
nvidia/skills
GitHub Stars
2.6K
First Seen
May 29, 2026
nemo-mbridge-perf-hierarchical-context-parallel — nvidia/skills