Random-effects meta-analysis of inconsistent effects: a time for change
- PMID:24727843
- DOI: 10.7326/M13-2886
Random-effects meta-analysis of inconsistent effects: a time for change
Abstract
A primary goal of meta-analysis is to improve the estimation of treatment effects by pooling results of similar studies. This article explains how the most widely used method for pooling heterogeneous studies--the Der Simonian-Laird (DL) estimator--can produce biased estimates with falsely high precision. A classic example is presented to show that use of the DL estimator can lead to erroneous conclusions. Particular problems with the DL estimator are discussed, and several alternative methods for summarizing heterogeneous evidence are presented. The authors support replacing universal use of the DL estimator with analyses based on a critical synthesis that recognizes the uncertainty in the evidence,focuses on describing and explaining the probable sources of variation in the evidence, and uses random-effects estimates that provide more accurate confidence limits than the DL estimator.
Comment in
- Random-effects meta-analysis of inconsistent effects.Lander D.Lander D.Ann Intern Med. 2014 Sep 2;161(5):379. doi: 10.7326/L14-5017-7.Ann Intern Med. 2014.PMID:25178578No abstract available.
- Random-effects meta-analysis of inconsistent effects.Keum N, Hsieh CC, Cook N.Keum N, et al.Ann Intern Med. 2014 Sep 2;161(5):379-80. doi: 10.7326/L14-5017-8.Ann Intern Med. 2014.PMID:25178579No abstract available.
- Random-effects meta-analysis of inconsistent effects. In response.Cornell JE.Cornell JE.Ann Intern Med. 2014 Sep 2;161(5):380. doi: 10.7326/L14-5017-9.Ann Intern Med. 2014.PMID:25178580No abstract available.
Similar articles
- Appropriateness of conducting and reporting random-effects meta-analysis in oncology.Ren J, Ma J, Cappelleri JC.Ren J, et al.Res Synth Methods. 2024 Mar;15(2):326-331. doi: 10.1002/jrsm.1702. Epub 2024 Jan 14.Res Synth Methods. 2024.PMID:38219287
- Comparison of statistical inferences from the DerSimonian-Laird and alternative random-effects model meta-analyses - an empirical assessment of 920 Cochrane primary outcome meta-analyses.Thorlund K, Wetterslev J, Awad T, Thabane L, Gluud C.Thorlund K, et al.Res Synth Methods. 2011 Dec;2(4):238-53. doi: 10.1002/jrsm.53. Epub 2012 Feb 14.Res Synth Methods. 2011.PMID:26061888
- [Meta-analysis of the Italian studies on short-term effects of air pollution].Biggeri A, Bellini P, Terracini B; Italian MISA Group.Biggeri A, et al.Epidemiol Prev. 2001 Mar-Apr;25(2 Suppl):1-71.Epidemiol Prev. 2001.PMID:11515188Italian.
- [The practice of systematic reviews. IV. Pooling results from separate studies].Scholten RJ, Kostense PJ, Assendelft WJ, Bouter LM.Scholten RJ, et al.Ned Tijdschr Geneeskd. 1999 Apr 10;143(15):786-91.Ned Tijdschr Geneeskd. 1999.PMID:10347641Review.Dutch.
- Statistical inference by confidence intervals: issues of interpretation and utilization.Sim J, Reid N.Sim J, et al.Phys Ther. 1999 Feb;79(2):186-95.Phys Ther. 1999.PMID:10029058Review.
Cited by
- Warfarin use and stroke, bleeding and mortality risk in patients with end stage renal disease and atrial fibrillation: a systematic review and meta-analysis.Tan J, Liu S, Segal JB, Alexander GC, McAdams-DeMarco M.Tan J, et al.BMC Nephrol. 2016 Oct 21;17(1):157. doi: 10.1186/s12882-016-0368-6.BMC Nephrol. 2016.PMID:27769175Free PMC article.Review.
- Predictors of the effects of treatment for shoulder pain: protocol of an individual participant data meta-analysis.van der Windt DA, Burke DL, Babatunde O, Hattle M, McRobert C, Littlewood C, Wynne-Jones G, Chesterton L, van der Heijden GJMG, Winters JC, Rhon DI, Bennell K, Roddy E, Heneghan C, Beard D, Rees JL, Riley RD.van der Windt DA, et al.Diagn Progn Res. 2019 Aug 8;3:15. doi: 10.1186/s41512-019-0061-x. eCollection 2019.Diagn Progn Res. 2019.PMID:31410370Free PMC article.
- Dual Versus Triple Therapy for Atrial Fibrillation After Percutaneous Coronary Intervention: A Systematic Review and Meta-analysis.Khan SU, Osman M, Khan MU, Khan MS, Zhao D, Mamas MA, Savji N, Al-Abdouh A, Hasan RK, Michos ED.Khan SU, et al.Ann Intern Med. 2020 Apr 7;172(7):474-483. doi: 10.7326/M19-3763. Epub 2020 Mar 17.Ann Intern Med. 2020.PMID:32176890Free PMC article.
- Validity of observational evidence on putative risk and protective factors: appraisal of 3744 meta-analyses on 57 topics.Janiaud P, Agarwal A, Tzoulaki I, Theodoratou E, Tsilidis KK, Evangelou E, Ioannidis JPA.Janiaud P, et al.BMC Med. 2021 Jul 6;19(1):157. doi: 10.1186/s12916-021-02020-6.BMC Med. 2021.PMID:34225716Free PMC article.
- Effect of Anticoagulant Administration on the Mortality of Hospitalized Patients With COVID-19: An Updated Systematic Review and Meta-Analysis.Jiang L, Li Y, Du H, Qin Z, Su B.Jiang L, et al.Front Med (Lausanne). 2021 Aug 4;8:698935. doi: 10.3389/fmed.2021.698935. eCollection 2021.Front Med (Lausanne). 2021.PMID:34422860Free PMC article.
MeSH terms
Related information
LinkOut - more resources
Full Text Sources
Other Literature Sources