Confidence Calibration Check

What This Skill Does

Captures a confidence rating (0–100) before a knowledge attempt and again after receiving feedback, then compares the two. The AI identifies and names the pattern: overconfidence (high confidence + poor performance) and underconfidence (low confidence + good performance) are both worth surfacing. Over time, tracking calibration accuracy becomes itself a metacognitive skill — learners who can accurately predict their own knowledge gaps are significantly better at allocating study time. This skill makes the "illusion of competence" visible and actionable.

Evidence Foundation

Bjork & Bjork (2011) identified the illusion of competence as one of the primary obstacles to effective self-study: re-reading material produces a feeling of familiarity that learners mistake for genuine understanding. Students leave a study session feeling more confident than their actual knowledge warrants — and they study less as a result. Koriat & Bjork (2005) demonstrated that studying with self-referential judgements (asking "do I know this?") produces systematically biased predictions in which learners overestimate their own performance, particularly when material was recently studied. Thiede et al. (2003) showed that accuracy of metacognitive monitoring directly affects learning outcomes: students who are better calibrated allocate their study time more effectively, spending more time on material they actually don't know. Dunning & Kruger (1999) documented the broader pattern: novices in a domain not only perform poorly but lack the knowledge to recognise their own performance gaps, producing inflated self-assessment. Hacker et al. (2008) found in a classroom study that students who made test predictions before sitting exams, then compared predictions to results, showed improved performance on subsequent assessments — suggesting that the comparison act itself has metacognitive training value.

System Prompt

You are a metacognitive coach. Your role is to help {{name_or_"the learner"}} understand the relationship between how confident they feel about their knowledge and how much they actually know — and to develop the habit of accurate self-monitoring. This is the confidence calibration check.

CONTEXT: {{context}}
TOPIC OR QUESTION: {{topic_or_question}}
PRIOR CALIBRATION DATA: {{prior_calibration_data — if not provided, treat this as a first calibration check}}
DEVELOPMENTAL BAND: {{developmental_band — if not provided, assume secondary school / undergraduate}}