Commentary to Gusenbauer and Haddaway 2020: Evaluating retrieval qualities of Google Scholar and PubMed
- PMID:33031632
- PMCID: PMC7984402
- DOI: 10.1002/jrsm.1456
Commentary to Gusenbauer and Haddaway 2020: Evaluating retrieval qualities of Google Scholar and PubMed
Abstract
We read with considerable interest the study by Gusenbauer and Haddaway (Gusenbauer and Haddaway, 2020, Research Synthesis Methods, doi:10.1002/jrsm.1378) comparing the systematic search qualities of 28 search systems, including Google Scholar (GS) and PubMed. Google Scholar and PubMed are the two most popular free academic search tools in biology and chemistry, with GS being the number one search tool in the world. Those academics using GS as their principal system for literature searches may be unaware of research which enumerates five critical features for scientific literature tools that greatly influenced Gusenbauer's 2020 study. Using this list as the framework for a targeted comparison between just GS and PubMed, we found stark differences which overwhelmingly favored PubMed. In this comment, we show that by comparing the characteristics of the two search tools, features that are particularly useful in one search tool, but are missing in the other, are strikingly spotlighted. One especially popular feature that ubiquitously appears in GS, but not in PubMed, is the forward citation search found under every citation as a clickable Cited by N link. We seek to improve the PubMed search experience using two approaches. First, we request that PubMed add Cited by N links, making them as omnipresent as the GS links. Second, we created an open-source command-line tool, pmidcite, which is used alongside PubMed to give information to researchers to help with the choice of the next paper to examine, analogous to how GS's Cited by N links help to guide users. Find pmidcite at https://github.com/dvklopfenstein/pmidcite.
Keywords: MEDLINE; PubMed; bibliometrics; manuscripts as topic; open access publishing; publications; reproducibility; search engine.
© 2020 The Authors. Research Synthesis Methods published by John Wiley & Sons Ltd.
Conflict of interest statement
The authors declare no potential conflict of interests.
Figures


Comment on
- What every researcher should know about searching - clarified concepts, search advice, and an agenda to improve finding in academia.Gusenbauer M, Haddaway NR.Gusenbauer M, et al.Res Synth Methods. 2021 Mar;12(2):136-147. doi: 10.1002/jrsm.1457. Epub 2020 Oct 8.Res Synth Methods. 2021.PMID:33031639Free PMC article.
Similar articles
- Google Scholar is not enough to be used alone for systematic reviews.Giustini D, Boulos MN.Giustini D, et al.Online J Public Health Inform. 2013 Jul 1;5(2):214. doi: 10.5210/ojphi.v5i2.4623. Print 2013.Online J Public Health Inform. 2013.PMID:23923099Free PMC article.
- Which academic search systems are suitable for systematic reviews or meta-analyses? Evaluating retrieval qualities of Google Scholar, PubMed, and 26 other resources.Gusenbauer M, Haddaway NR.Gusenbauer M, et al.Res Synth Methods. 2020 Mar;11(2):181-217. doi: 10.1002/jrsm.1378. Epub 2020 Jan 28.Res Synth Methods. 2020.PMID:31614060Free PMC article.
- Types of Errors Hiding in Google Scholar Data.Sauvayre R.Sauvayre R.J Med Internet Res. 2022 May 27;24(5):e28354. doi: 10.2196/28354.J Med Internet Res. 2022.PMID:35622395Free PMC article.
- Medical literature search dot com.Jain V, Raut DK.Jain V, et al.Indian J Dermatol Venereol Leprol. 2011 Mar-Apr;77(2):135-40. doi: 10.4103/0378-6323.77451.Indian J Dermatol Venereol Leprol. 2011.PMID:21393941Review.
- Difficulties and challenges associated with literature searches in operating room management, complete with recommendations.Wachtel RE, Dexter F.Wachtel RE, et al.Anesth Analg. 2013 Dec;117(6):1460-79. doi: 10.1213/ANE.0b013e3182a6d33b.Anesth Analg. 2013.PMID:24257396Review.
Cited by
- PageRank Topic Finder based Algorithm for Multimedia Resources in Preschool Education.Yu G.Yu G.Comput Intell Neurosci. 2022 Jul 20;2022:4173243. doi: 10.1155/2022/4173243. eCollection 2022.Comput Intell Neurosci. 2022.Retraction in:Comput Intell Neurosci. 2023 Aug 2;2023:9867326. doi: 10.1155/2023/9867326.PMID:35909855Free PMC article.Retracted.
- Connections and Biases in Health Equity and Culture Research: A Semantic Network Analysis.Martínez-García M, Villegas Camacho JM, Hernández-Lemus E.Martínez-García M, et al.Front Public Health. 2022 Mar 29;10:834172. doi: 10.3389/fpubh.2022.834172. eCollection 2022.Front Public Health. 2022.PMID:35425756Free PMC article.
- What every researcher should know about searching - clarified concepts, search advice, and an agenda to improve finding in academia.Gusenbauer M, Haddaway NR.Gusenbauer M, et al.Res Synth Methods. 2021 Mar;12(2):136-147. doi: 10.1002/jrsm.1457. Epub 2020 Oct 8.Res Synth Methods. 2021.PMID:33031639Free PMC article.
References
- Hemminger BM, Lu D, Vaughan KTL, Adams SJ. Information seeking behavior of academic scientists. J Am Soc Inf Sci Technol. 2007;58(14):2205‐2225. 10.1002/asi.20686. - DOI
- Duke L. College Libraries and Student Culture: What we Now Know. Chicago, IL: American Library Association; 2011.
- Nicholas D, Boukacem‐Zeghmouri C, Rodríguez‐Bravo B, et al. Where and how early career researchers find scholarly information. Learn Publ. 2017;30(1):19‐29. 10.1002/leap.1087. - DOI
- Athukorala K, Hoggan E, Lehtiö A, Ruotsalo T, Jacucci G. Information‐seeking behaviors of computer scientists: challenges for electronic literature search tools. Proc Am Soc Inf Sci Technol. 2013;50(1):1‐11. 10.1002/meet.14505001041. - DOI
- Niu X, Hemminger BM. A study of factors that affect the information‐seeking behavior of academic scientists. J Am Soc Inf Sci Technol. 2011;63(2):336‐353. 10.1002/asi.21669. - DOI
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Miscellaneous