nemo-mbridge-perf-activation-recompute

Installation
SKILL.md

Activation Recompute

Stable docs: @docs/training/activation-recomputation.md Card: @skills/nemo-mbridge-perf-activation-recompute/card.yaml

Activation recompute (activation checkpointing) trades additional forward work during backward for lower retained-activation memory. The useful checkpoint boundary depends on the model architecture, attention backend, parallelism, and the tensor that actually drives the per-rank peak.

Quick Decision Guide

Installs
1.8K
Repository
nvidia/skills
GitHub Stars
3.2K
First Seen
May 29, 2026
nemo-mbridge-perf-activation-recompute — nvidia/skills