nvtripy Compilation Pipeline

When to Use

• Compiling functions or modules with tp.compile()
• Defining runtime inputs with InputInfo and DimensionInputInfo
• Working with compiled Executable objects
• Configuring compilation options (optimization level, timing cache)
• Understanding the Trace → MLIR → TensorRT flow
• Using dynamic shapes with min/opt/max bounds
• Debugging compilation failures

Compilation Flow

User Function → Trace (graph) → MLIR (IR) → TensorRT (engine) → Executable