Inconsistencies Forcing¶

Why It Matters¶

Confirmation bias is the default mode of human reasoning. We unconsciously seek, interpret, and remember information that supports existing beliefs while discounting inconsistencies. Intelligence failures repeatedly stem from ignoring contradictory information. Forcing inconsistencies reverses the bias by making disconfirming evidence the explicit target of information collection.

The Key Move¶

After forming a preliminary judgment, explicitly ask: "If I'm wrong, what evidence would I expect to find?" Then actively look for that evidence. Don't wait for it to appear - seek it out. When found, you must either explain the inconsistency (why it's not actually inconsistent) or revise your judgment. The discipline is resisting the temptation to explain away every inconsistency while never revising the hypothesis.

Classic Application¶

Cold War intelligence on Soviet military capabilities. Rather than collecting evidence of suspected capabilities, analysts developed lists: "If the SS-18 missile doesn't have the range we estimate, we'd expect to see X, Y, Z." Then they collected specifically on X, Y, and Z. When inconsistencies appeared (e.g., fuel depot locations inconsistent with estimated range), it forced hypothesis revision rather than rationalization.

Surprising Application¶

Scientific research. Strong research programs actively seek evidence that would falsify their theories rather than confirm them. Pharmaceutical trials are designed to detect if drugs don't work or cause harm (inconsistencies with efficacy hypothesis) rather than optimizing for confirming safety. This is codified in null hypothesis testing - you're trying to reject the null, not confirm your theory.

Failure Modes¶

Seeking inconsistencies in bad faith (looking in places you know won't yield them). Explaining away every inconsistency without ever revising (unfalsifiable reasoning). Expecting perfect consistency (noise and error exist - not every inconsistency invalidates a hypothesis). Not specifying in advance what inconsistencies would be meaningful (post-hoc rationalization). Paralyzing yourself by finding inconsistencies with every hypothesis (judgment requires acting on balance of evidence, not certainty).

Go Deeper¶

Popper, "Conjectures and Refutations" on falsificationism. Heuer, "Psychology of Intelligence Analysis" Chapter 4. Pherson and Heuer, "Structured Analytic Techniques" Chapter 6 on testing hypotheses.