This is aninformation page. It is neither anencyclopedia article nor one ofWikipedia's policies or guidelines; rather, its purpose is to explain certain aspects of Wikipedia's norms, customs, technicalities, or practices. It may reflect differing levels ofconsensus andvetting. |
| “ | Self-published expert sources may be considered reliable when produced by an established subject-matter expert, whose work in the relevant field has previously been published by reliable, independent publications. | ” |
This passage fromWP:EXPERTSPS is often used to justify the inclusion of non-reliable/non-peer reviewed sources on the basis that they are written by experts. The most common of which being blog posts and preprints. The argument is that since these are experts, these sources become reliable. This would mean nearly all preprints are reliable sources because most preprints are written by experts.
The reality is that peer reviewed articles from experts often contain errors. Clearing peer review just means you get to be part of the scientific debate. Preprints, working papers, or other preliminary/non-peer reviewed results, contain evenmore errors because one of the goals of peer review is to find those errors. Experts make mistakes all the time, and Wikipedia should not try to get ahead of the process just because one expert, or even a team of experts, is claiming a certain discovery ahead of publication.
So when can you invoke an SPS as a reliable source? The short of it is that an SPS is acceptable for routine, non-controversial claims, but that novel claims must still, at the very least, clear the higher bar of peer-review.
Non-peer reviewed sources, such as preprints, are perfectly acceptable to sources routine, non-novel claims, such as where a certain person is employed, or some background information that is not central to the paper. For example, using the preprintarXiv:2412.10366, whose abstract reads
| “ | We study realistic models predicting primordial black hole (PBH) formation from density fluctuations generated in a first-order phase transition. We show that the second-order correction in the expansion of the bubble nucleation rate is necessary for accurate predictions and quantify its impact on the abundance of PBHs and gravitational waves (GWs). We find that the distribution of the fluctuations becomes more Gaussian as the second-order term increases. Consequently, models that predict the same PBH abundances can produce different GW spectra. | ” |
We could use that source to support uncontroversial statements like
<ref>arXiv:2412.10366</ref><ref>arXiv:2412.10366</ref>Because both are routine statements. Other sources might bepreferable, like the University of Warsaw staff website, or a book dedicated to primordial black holes, butWP:V andWP:SPS are both met.
However, we couldnot use that same source for the novel claim that
<ref>arXiv:2412.10366</ref>Why? Because that's the new result undergoing evaluation. Any sort of mistake could have happened to jeopardize that conclusion, ranging from
y = mx - b' in code when 'y = mx + b' was meant)Thus if a team of experts is claiming a discovery ahead of peer-review,Wikipedia cannot say something like
<ref>Smith, J. ... (preprint).</ref>as if this was an established fact, or even
<ref>Smith, J. ... (preprint).</ref>as if the determination was recognized by the scientific community.
At most, Wikipedia can say something like
<ref>Smith, J. ... (preprint).</ref>which is simply that a certain group made a certain claim, and takes no position on whether or not the claim is valid.
However, other considerations, likeWP:DUE,WP:NOTNEWS, etc., must still be met. Oftentimes, the answer is simply to wait until the claim appears in a reliable peer-reviewed venue.
Note that the above apply only topreprints, which is a term that apply to the versions of a paperprior to formal publication. It is not intended to be an authoritative resource, but rather one which is still in need of peer-review. They are usually uploaded to establish priority of discovery, but also to get feedback from the academic community, leading to an improved paper, revised arguments, correction of mistakes, etc...
A paper being on a preprint repository like arxiv is not a guarantee that it is a preprint. Several uploads are simply lecture notes, pedagogical material, or technical reports. Those are perfectly allowed underWP:EXPERTSPS.
For example