Reliability of Case Evidence

Individual cases and anecdotes are the weakest form of evidence yet the most psychologically compelling. A single vivid story of someone who succeeded (or failed) with a particular approach carries more emotional weight than a statistical study of thousands—even though the study is far more informative. This asymmetry between evidential power and psychological impact is the root of countless bad decisions: investing because of one person's success story, avoiding a strategy because of one person's failure, or designing policy based on memorable anecdotes rather than population data.

When to use it

When evaluating any recommendation supported primarily by case studies or testimonials; when your own experience (a single case) contradicts statistical evidence; when designing research—case evidence generates hypotheses, not conclusions; when deciding between the vividness of a story and the reliability of data.

How it can help

When someone presents a case study or anecdote to support a recommendation, mentally downgrade its evidential weight. One company's success with a strategy tells you very little about whether it will work for you—it's a sample of one with no control group. The antidote is base rate thinking: instead of asking 'did it work for them?' ask 'what percentage of companies that try this succeed?' That question requires statistical evidence, not stories. Use anecdotes for hypothesis generation, not hypothesis confirmation.