File Test Bug

Creates a GitHub issue in microsoft/github-copilot-for-azure for integration test failures.

Input

• Skill name (required): e.g., azure-role-selector, appinsights-instrumentation
• Test run (optional): Timestamp of test run. Defaults to most recent with logs for the skill.

Steps

1. Ask user for skill name if not provided
2. Parse tests/reports/junit.xml for failures matching the skill
3. Find test run directory (specified or most recent with matching logs)
4. Read agent-metadata.md from tests/reports/test-run-<timestamp>/<skillname>-<testname>/
5. For each failure, read the actual line of code from the test file using the location (file:line) from junit.xml
6. REQUIRED - Write diagnosis BEFORE creating issue:
   • Analyze the agent-metadata.md to understand what the agent did
   • Compare agent behavior to what the test expected (from the assertion)