Visual Studio Integration Test Failure Analysis

Investigate Visual Studio integration test failures in the roslyn-integration-CI Azure DevOps pipeline. Downloads and analyzes published test artifacts including exception logs, screenshots, MEF errors, and VSIX installer logs.

Workflow: Run the script with a BuildId → it fetches the build timeline, identifies failed/canceled integration test jobs, downloads the published test artifacts, and parses exception XMLs and error logs → read the structured output and [INTEGRATION_TEST_SUMMARY] JSON → synthesize root cause analysis. The script collects data; you generate the diagnosis.

When to Use This Skill

Use this skill when:

• Investigating failures or timeouts in the roslyn-integration-CI pipeline
• A build URL points to dev.azure.com/dnceng-public with integration test jobs (VS_Integration_*)
• Asked "why are integration tests timing out", "integration test failures", or "VS integration tests red"
• You need to analyze exception Activity XML logs, screenshots, or MEF errors from integration test runs
• Integration test jobs are canceled (usually due to timeout) and you need to understand why

⚠️ This skill is specific to Roslyn VS integration tests. For general CI analysis (compiler tests, Helix failures, build errors), use the ci-analysis skill instead.

Quick Start