Cognitively Diverse Multiple-Choice Question Generation (ReQUESTA)

This skill enables Claude to generate psychometrically rigorous multiple-choice questions from any expository or academic text by implementing the ReQUESTA framework. Instead of producing questions in a single pass (which tends to yield easy, surface-level items with implausible distractors), this approach decomposes MCQ authoring into specialized subtasks: planning what to assess, generating questions at three distinct cognitive levels, evaluating each item against a quality checklist, iteratively refining failures, and post-processing for presentation consistency. The result is questions that are harder, more discriminative, and better aligned with genuine comprehension.

When to Use

• When the user provides a passage, article, textbook chapter, or technical document and asks for quiz or exam questions
• When the user wants questions at specific cognitive levels (factual recall, inference, main idea)
• When the user needs assessment items with plausible, well-crafted distractors -- not obviously wrong answers
• When building reading comprehension assessments, course quizzes, or practice exams
• When the user asks to "create a quiz" or "generate test questions" from supplied content
• When the user wants to evaluate whether learners truly understand material vs. just recognizing surface details
• When generating MCQs for training data, educational apps, or certification prep materials

Key Technique

Why single-pass MCQ generation fails. When an LLM generates MCQs in one shot, it defaults to easy text-based recall questions with distractors that are obviously wrong (different length, different register, or semantically distant from the correct answer). Research shows single-pass items average ~90% accuracy -- they don't differentiate learners. The core insight of ReQUESTA is that MCQ quality emerges from workflow design, not model capability.

The hybrid multi-agent decomposition. ReQUESTA separates stochastic tasks (planning, generation, evaluation) from deterministic tasks (text segmentation, task routing, formatting). A Planner agent first analyzes the text to extract key concepts, implicit inferences, and overarching themes, then produces a structured generation plan mapping content targets to cognitive levels. A Controller routes each subtask to one of three specialized Question Generators -- text-based, inferential, or main idea -- each scoped to its cognitive focus. An Evaluator then assesses each item against a quality checklist (stem clarity, answer-stem alignment, distractor plausibility, linguistic consistency). Failed items loop back to their generator with targeted revision feedback until they pass or hit a termination limit.