trt-perf-analysis
TRT Perf Analysis
Workflow
Use <runner> below as scripts/run.sh on Unix-like systems or scripts\run.cmd on Windows. Set SKILL_PYTHON to override Python 3.8+ discovery.
Treat each step as a gate. On failure, stop, report the error, clean up temporary outputs, and do not create or preview a report.
-
Resolve inputs in this order:
- Use JSON pairs explicitly provided by the user; preserve their pairing. Filenames may be arbitrary.
- For a provided folder, find complete pairs there. Match conventional
layers_<label>.jsonandprofile_<label>.jsonnames first; use JSON structure and layer names for nonstandard names. Handle component subfolders separately. - With no explicit path, infer only from clear context: attachments, discussed paths, or the active workspace. Fail if no unambiguous pair is found.
Require at least one readable layer-info and profile/latency pair. Accept raw detailed TensorRT inspector output as either a layer array or a TensorRT 11 object containing
Layers. Do not useanalyze-data.jsonas layer-info input. Reject missing, ambiguous, layer-only, or profile-only inputs. -
Analyze in staging. Run
scripts/analyze_trt_perf.pybefore interpretation. Use repeated--data <layer.json> <profile.json>for explicit or nonstandard pairs; use folder mode only for conventionally named pairs. Pass a user-provided model name with--model-name; otherwise use analyzer inference. Writeanalyze-data.jsonoutside the final report folder and use it as the source for all conclusions.