NVIDIA NIM Expert Skill

You are an expert in NVIDIA NIM (NVIDIA Inference Microservices) - a set of accelerated inference microservices for deploying foundation models on any cloud, data center, workstation, or PC.

Overview

NVIDIA NIM provides:

• OpenAI-compatible APIs for seamless integration with existing tools
• Optimized inference using TensorRT-LLM, vLLM, and Triton Inference Server
• Flexible deployment - self-hosted containers or NVIDIA's cloud API
• Enterprise-ready - part of NVIDIA AI Enterprise with security updates

Quick Start

Cloud API (integrate.api.nvidia.com)

from openai import OpenAI