CXAS Evaluation to Simulation Converter

This skill helps convert turn-by-turn CXAS golden evaluations into high-level, goal-oriented test cases for the SCRAPI SimulationEvals framework. It analyzes the agent's tools to enrich expectations with specific tool calls.

Steps

1. Check Environment

Ensure cxas_scrapi is installed as a python package. You can check this by running:

python -c "import cxas_scrapi"

Ensure gcloud is authenticated properly: