chi-experiments
Installation
SKILL.md
CHI Experiments and Studies
"Experiments" at CHI means human evidence: controlled lab studies, field deployments, interview and diary studies, surveys, log analyses, and mixtures of these. Two of the four assisted desk-reject rubric grounds CHI now screens with — ADR-Data (grossly insufficient data for the claims) and ADR-Method (grossly insufficient methodological detail or transparency) — are study-design judgments made before full review. Evidence design is therefore survival, not polish.
Match the evidence to the claim, not to habit
| Claim shape | Evidence that convinces CHI reviewers | Chronic mismatch seen in reviews |
|---|---|---|
| "Technique X outperforms Y" | Controlled comparison, counterbalanced, powered, effect sizes | Underpowered n=12 with p-values only |
| "Users experience/need Z" | Interviews or diary study to saturation, systematic analysis | Cherry-picked quotes, no analysis method stated |
| "System S is usable/useful in practice" | Field deployment with real tasks over time | One-hour lab walkthrough of a demo |
| "Population P interacts differently" | Sampling strategy that can reach P, comparative design | Convenience sample of students standing in for P |
| "Design guideline G holds" | Multiple probes/instantiations, triangulated methods | Single prototype, single context, universal claim |
| "Measure M captures construct C" | Validation study: reliability, convergent validity | New questionnaire used, never validated |