data-driven-design
Data-Driven Design
Sources: Goodhart's Law is Charles Goodhart (1975), in the form popularised by Marilyn Strathern (1997): "when a measure becomes a target, it ceases to be a good measure." Simpson's paradox is E. H. Simpson (1951). Survivorship bias is Abraham Wald's WWII aircraft-armour analysis. Funnel and cohort methods are standard product analytics, not game-specific. Metric thresholds in this skill are working values — replace them with figures measured on your own title.
Core Principle: Data-Informed, Not Data-Driven
Data tells you what is happening. Design judgment tells you why and what to do about it.
The distinction matters. "Data-driven" implies the data decides. "Data-informed" means the data contributes evidence to a decision that also weighs design intent, player experience goals, and creative vision. Numbers without context are noise.
Correlation ≠ causation is the most violated principle in game analytics. Players who buy the battle pass also play more — but forcing battle pass prompts on casual players won't make them play more. The causation runs the other direction: engaged players buy, not the reverse.
Guidelines for healthy data use: