GPU Server Management

Provision, configure, and monitor NVIDIA GPU servers for AI inference and training workloads.

When to Use This Skill

Use this skill when:

• Setting up a new GPU server for LLM inference or model training
• Installing or upgrading NVIDIA drivers and CUDA toolkit
• Configuring Docker with NVIDIA Container Toolkit for GPU workloads
• Partitioning A100/H100 GPUs with MIG for multi-tenant workloads
• Troubleshooting GPU errors, driver issues, or thermal throttling

Prerequisites

• Ubuntu 22.04 LTS (recommended) or RHEL 8/9
• NVIDIA GPU (A10G, A100, H100, RTX 4090, or L40S recommended)
• Root or sudo access
• Internet access for package downloads