Confident AI Eval Setup

Use this skill to make an LLM application evaluable from the Confident AI platform. The hard part is the AI connection: a saved description of how to call the app's endpoint, so Confident AI can send it each golden's input and read the answer back. This skill builds that connection from the app's own code, proves it works with a ping, uploads a dataset, and hands the user the dataset page where they press Evaluate.

Everything happens through the Confident AI MCP server. Nothing is added to the user's codebase.

When This Skill Applies

• The user wants teammates to evaluate, compare, or red-team the app from the Confident AI dashboard, which needs Confident AI to call the app.
• The user has an AI connection that comes back inactive.
• The user wants test cases uploaded as a Confident AI dataset.