"Extraordinary claims require extraordinary evidence" (sometimes shortened toECREE),[1] also known as theSagan standard, is anaphorism popularized by science communicatorCarl Sagan. He used the phrase in his 1979 bookBroca's Brain and the 1980 television programCosmos. It has been described as fundamental to thescientific method and is regarded as encapsulating the basic principles ofscientific skepticism.
The concept is similar toOccam's razor in that bothheuristics prefer simpler explanations of a phenomenon to more complicated ones. In application, there is some ambiguity regarding when evidence is deemed sufficiently "extraordinary". It is often invoked to challenge data and scientific findings, or to criticize pseudoscientific claims. Some critics have argued that the standard can suppress innovation and affirmconfirmation biases.
An interesting debate has gone on within the [Federal Communications Commission] between those who think that all doctrines that smell ofpseudoscience should be combated and those who believe that each issue should be judged on its own merits, but that theburden of proof should fall squarely on those who make the proposals. I find myself very much in the latter camp. I believe that the extraordinary should certainly be pursued. But extraordinary claims require extraordinary evidence.
The concept is related toOccam's razor as, according to such aheuristic, simpler explanations are preferred to more complicated ones. Only in situations where extraordinary evidence exists would an extraordinary claim be the simplest explanation.[7] It appears inhypothesis testing where the hypothesis that there is no evidence for the proposed phenomenon, what is known as the "null hypothesis", is preferred. The formal argument involves assigning a strongerBayesian prior to the acceptance of the null hypothesis as opposed to its rejection.[13]
PhilosopherDavid Hume may have been the first to fully describe the principles of the Sagan standard.
Science communicatorCarl Sagan popularized the aphorism in his 1979 bookBroca's Brain,[2][14] and in his 1980 television showCosmos in reference to claims aboutextraterrestrials visiting Earth.[15] Sagan had first stated the eponymous standard in a 1977 interview withThe Washington Post.[16] However, scientific skepticMarcello Truzzi used the formulation "Extraordinary claims require extraordinary proof" in an article published byParapsychology Review in 1975,[16] as well as in aZetetic Scholar article in 1978.[17] Two 1978 articles quoted physicistPhilip Abelson—then the editor of the journalScience—using the same phrasing as Truzzi.[18][19]
In his 1748 essay "Of Miracles", philosopherDavid Hume wrote that if "the fact ... partakes of the extraordinary and the marvellous ... the evidence ... received a diminution, greater or less, in proportion as the fact is more or less unusual".[20] Deming concluded that this was the first complete elucidation of the standard. Unlike Sagan, Hume defined the nature of "extraordinary": he wrote that it was a large magnitude of evidence.[20][21]
Sagan did not describe any concrete or quantitative parameters as to what constitutes "extraordinary evidence", which raises the issue of whether the standard can be applied objectively.[5][14][24] Academic and climate change denialistDavid Deming notes that it would be "impossible to base all rational thought and scientific methodology on an aphorism whose meaning is entirely subjective". He instead argues that "extraordinary evidence" should be regarded as a sufficient amount of evidence rather than evidence deemed of extraordinary quality.[25] Tressoldi noted that the threshold of evidence is typically decided through consensus. This problem is less apparent in clinical medicine and psychology where statistical results can establish thestrength of evidence.[5]
Deming also noted that the standard can "suppress innovation and maintain orthodoxy".[25] Others, likeEtzel Cardeña, have noted that many scientific discoveries that spurredparadigm shifts were initially deemed "extraordinary" and likely would not have been so widely accepted if extraordinary evidence were required.[26][27] Uniform rejection of extraordinary claims could affirmconfirmation biases in subfields.[27] Additionally, there are concerns that, when inconsistently applied, the standard exacerbatesracial and gender biases.[28] PsychologistRichard Shiffrin has argued that the standard should not be used to bar research from publication but to ascertain what is the best explanation for a phenomenon.[29] Conversely, mathematical psychologistEric-Jan Wagenmakers stated that extraordinary claims are often false and their publication "pollutes the literature".[30] To qualify the publication of such claims, psychologist Suyog Chandramouli has suggested the inclusion of peer reviewers' opinions on their plausibility or an attached curation of post-publication peer evaluations.[27]
Cognitive scientist andAI researcherBen Goertzel believes that the phrase is utilized as a "rhetorical meme" without critical thought. PhilosopherTheodore Schick argued that "extraordinary claims do not require extraordinary evidence" if they provide the most adequate explanation.[9] Moreover, theists and Christian apologists likeWilliam Lane Craig have argued that it is unfair to apply the standard toreligious miracles as other improbable claims are often accepted based on limited testimonial evidence, such as an individual claiming that they won the lottery.[31][32]
Craig, William Lane (2008) [1994].Reasonable Faith: Christian Truth and Apologetics. Crossway.ISBN978-1-4335-0115-9.
Goertzel, Ted; Goertzel, Ben (2015). "Skeptical Responses to Psi Research". In Broderick D.; Goertzel B. (eds.).Evidence for Psi: Thirteen Empirical Research Reports. McFarland. pp. 291–301.ISBN9780786478286.OCLC896344862.
Rao, K.R. (1978)."Psi: Its Place in Nature".Journal of Parapsychology.42 (4):276–303.Archived from the original on September 4, 2023. RetrievedSeptember 5, 2023.