Sources, Consensus, and When to Trust Experts

Intermediate

You can't verify everything yourself — so verify the process instead

01 The Concept

You cannot personally evaluate the primary literature on vaccines, climate, monetary policy, and structural engineering. Nobody can. So the practical question isn't 'how do I verify everything myself' — it's 'how do I decide who to trust and when.' Deferring to expertise isn't a fallacy; appeal to authority is only fallacious when the authority is outside their field, when the claim contradicts the broader consensus of that field, or when the authority is being cited instead of available evidence.

What makes expert consensus meaningful is the process behind it: many independent researchers, competing incentives to disprove each other, peer review, and replication. That's why a consensus among experts is stronger evidence than any individual expert, however brilliant. Be especially wary of the lone contrarian expert framing — the maverick who's right against the field exists but is extraordinarily rare, and this framing is the standard structure of manufactured doubt precisely because it's rhetorically compelling.

02 Case Study

CASENaomi Oreskes & Erik Conway, *Merchants of Doubt* (2010); Oreskes, 'The Scientific Consensus on Climate Change,' *Science* (2004); Cook et al., *Environmental Research Letters* (2013)

Naomi Oreskes ran a straightforward test of whether scientific consensus on climate change actually existed, given persistent media framing of an ongoing debate. She examined 928 peer-reviewed papers published between 1993 and 2003 whose abstracts matched 'global climate change' and found that not one disputed the consensus position. Her 2004 Science paper contrasted this with media coverage, which routinely presented the issue as evenly contested. Her later book with Erik Conway explained the gap: the same doubt-manufacturing playbook developed for tobacco was being run again, and one of its central techniques was elevating a handful of contrarian scientists — often the same individuals across unrelated issues, frequently outside their own areas of expertise — to create the appearance of a live scientific dispute. The tactic exploits journalistic balance norms and the genuine appeal of the maverick narrative. A later study by John Cook and colleagues examining nearly 12,000 abstracts found 97% consensus among papers taking a position.

→ Why it matters

Consensus derives its weight from many independent researchers competing to disprove each other. Oreskes found zero of 928 climate papers disputing consensus while media portrayed a debate — the lone-contrarian frame is compelling precisely because it's exploitable.

03 Key Points

01Deferring to expertise isn't a fallacy — you cannot verify everything personally

02It becomes fallacious outside the expert's field, against their field's consensus, or in place of evidence

03Consensus is stronger than any individual expert because of independent competing scrutiny

04The lone contrarian expert is rhetorically compelling and is the standard structure of manufactured doubt

Next: Survivorship Bias: The Data You Never See →