trt-onnx-quickstart
Installation
SKILL.md
TensorRT ONNX Quickstart
Take a developer from "I have a Hugging Face model ID" or "an ONNX file" to "a TensorRT engine whose outputs match the source model within tolerance." Follows Path 1 (ONNX → TensorRT) of the Import Workflows Guide, specialized for the most common starting point: a Hugging Face Hub model.
When to Use
| Scenario | Use this skill? |
|---|---|
Has a Hugging Face model ID (google-bert/bert-base-uncased) and wants TRT-accelerated inference |
Yes |
Has an .onnx file and wants a .plan engine with verified parity |
Yes |
Ran trtexec --onnx=... and hit a warning/error they don't recognize |
Yes |
| Wants LLM token generation (Llama, Mistral, Qwen text generation) | No — route to TensorRT-LLM |
| Has a PyTorch model and wants to stay in PyTorch | No — use trt-torch-quickstart |
Already has a .plan engine and wants to run inference from C++ |
No — use trt-cpp-runtime-quickstart |
| Is migrating a weakly-typed network to strongly-typed | No — use trt-strong-typing-migration |
| Has a full diffusion pipeline (SD, FLUX) | Partial — must be component-split first; this skill imports one component at a time |