torch-profiler-layer-track
Torch Profiler Layer Track
Create a normal Chrome JSON trace with L0, L1, ... guides beside at most ten
synthetic GPU activity lanes per device. Keep the source file. Compaction
changes event placement, not execution: original kernel names, timestamps,
durations and args.stream remain intact. CPU events stay unchanged. Label
the output as a compact view, not a runtime stream optimization.
Establish what the labels mean
Use the user's existing local trace, including a Desktop copy when requested. Obtain the layer count from matching model config/source. Identify the rank/GPU, execution phase, and one complete forward pass before counting. In speculative decoding, separate target verify from draft passes. BS=1 does not imply one token per target verify. A repeated block in the overview can be a whole iteration, not a transformer layer.