Analyze Chat Export

Purpose

Extract structured metrics from VS Code Copilot chat exports to support retrospective analysis. Provides data on model usage, tool invocations, manual approvals, rejection patterns, file edit statistics, and session timing.

Hard Rules

Must

• Use the extract-metrics.sh script for analysis (consolidates all queries).
• Redact sensitive information before committing chat logs.
• Save analysis results alongside the chat export in the feature folder.

Must Not

• Commit unredacted chat logs containing passwords, tokens, API keys, secrets, or PII.
• Load the entire JSON file into memory (use streaming jq queries).

Pre-requisites

• jq command-line JSON processor installed.
• Chat export files (.json) saved via workbench.action.chat.export command. Multiple files may exist per feature, one per agent chat session (e.g., developer.chat.json, architect.chat.json).