LLM Council

Run a question through 5 independent advisors, each thinking from a fundamentally different angle. They review each other's work anonymously. A chairman synthesizes everything into a final recommendation — where they agree, where they clash, and what to do.

Adapted from Andrej Karpathy's LLM Council. He dispatches queries to multiple models with anonymous peer review. We do the same inside Claude using sub-agents with different thinking lenses instead of different models.

When to Run the Council

The council is for questions where being wrong is expensive.

Good council questions:

• "Should I build this as a multi-tenant SaaS or single-tenant first?"
• "Which of these 3 positioning angles is strongest?"
• "I'm thinking of pivoting from X to Y. Am I crazy?"
• "Should I hire for this role or build an automation first?"
• "We're choosing between these two architecture approaches"

Bad council questions:

• "What's the capital of France?" (one right answer)