The Agent Skills Directory

[EXTERNAL_DOWNLOADS]: The skill provides instructions to install standard machine learning libraries including accelerate, torch, transformers, deepspeed, and flash-attn from official package registries.
[EXTERNAL_DOWNLOADS]: Includes commands to download the Megatron-LM and Apex optimization libraries from NVIDIA's official GitHub repositories for large-scale model training.
[COMMAND_EXECUTION]: Instructs the agent to perform environment diagnostics using standard utilities like nvidia-smi and to manage training processes via the accelerate launch command line interface.
[DYNAMIC_EXECUTION]: Documents the use of torch.compile for runtime optimization of PyTorch models, which is a standard performance feature for JIT-compiling computational graphs.
[SAFE]: All external references and dependencies target well-known and trusted organizations within the machine learning ecosystem, such as HuggingFace, NVIDIA, and the PyTorch foundation.

huggingface-accelerate