Netra Evaluation Setup — Specification-Driven Dataset Planning

This skill takes a QA/dev specification document and produces a complete, editable evaluation plan — dataset items, evaluators, variable mappings, and pass criteria — then creates everything in Netra on user approval.

Workflow

Execute these phases in order. Complete each phase before moving to the next.

Phase 0: Verify Provider Configuration

Before starting any planning or creation work, verify that the organization has a default provider configured.

Call netra_get_default_llm_configuration via MCP.

• If a valid configuration is returned (containing provider, model, and providerConfigurationId), proceed to Phase 1.
• If null or an error is returned, stop immediately and inform the user: