foundations-causal-inference

Installation
SKILL.md

Causal Inference Foundations

When to Apply

Apply causal-inference when:

  • "Did the change cause the outcome, or just correlate?" question
  • A/B test is impossible (rollout already happened, ethics, ramping risk) — observational methods needed
  • Confounding suspected — non-random treatment assignment
  • Heterogeneous treatment effects matter (CATE, uplift)
  • Mediation question — "is the effect through path X or path Y?"
  • Units interfere — marketplace, social graph, shared inventory, ranking model, or agents sharing a backend resource; randomization alone does not identify the launch effect
  • LLM evaluation pipeline uses logged data — prompt distribution, judge bias, or user self-selection confound the quality signal (Pearl's Ladder applies: estimating P(Y|do(prompt)) is different from P(Y|prompt))
  • A new router, ranker or bandit policy must be judged from logs of the old one, a short test must decide on a long-term metric, or outcomes are missing unequally by arm — see Beyond the canonical 12
Installs
6
GitHub Stars
102
First Seen
Sep 23, 2026