Meta-evaluation of meta-analysis: ten appraisal questions for biologists

被引:361
|
作者
Nakagawa, Shinichi [1 ,2 ,3 ]
Noble, Daniel W. A. [1 ,2 ]
Senior, Alistair M. [4 ,5 ]
Lagisz, Malgorzata [1 ,2 ]
机构
[1] Univ New South Wales, Evolut & Ecol Res Ctr, Sydney, NSW 2052, Australia
[2] Univ New South Wales, Sch Biol Earth & Environm Sci, Sydney, NSW 2052, Australia
[3] Garvan Inst Med Res, Diabet & Metabol Div, 384 Victoria St, Sydney, NSW 2010, Australia
[4] Univ Sydney, Charles Perkins Ctr, Sydney, NSW 2006, Australia
[5] Univ Sydney, Sch Math & Stat, Sydney, NSW 2006, Australia
基金
澳大利亚研究理事会;
关键词
Effect size; Biological importance; Non-independence; Meta-regression; Meta-research; Publication bias; Quantitative synthesis; Reporting bias; Statistical significance; Systematic review; PUBLICATION BIAS; LIFE EXTENSION; EFFECT SIZE; CUMULATIVE METAANALYSIS; ASSESSING HETEROGENEITY; SYSTEMATIC REVIEWS; RESPONSE RATIOS; TEMPORAL TRENDS; MASS-PRODUCTION; ECOLOGY;
D O I
10.1186/s12915-017-0357-7
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Meta-analysis is a statistical procedure for analyzing the combined data from different studies, and can be a major source of concise up-to-date information. The overall conclusions of a meta-analysis, however, depend heavily on the quality of the meta-analytic process, and an appropriate evaluation of the quality of metaanalysis (meta-evaluation) can be challenging. We outline ten questions biologists can ask to critically appraise a meta-analysis. These questions could also act as simple and accessible guidelines for the authors of meta-analyses. We focus on meta-analyses using nonhuman species, which we term 'biological' metaanalysis. Our ten questions are aimed at enabling a biologist to evaluate whether a biological meta-analysis embodies 'mega-enlightenment', a 'mega-mistake', or something in between.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Meta-evaluation: Evaluation of evaluations some points for discussion
    M. Horvat
    Scientometrics, 1999, 45 : 533 - 542
  • [32] The Importance of Quality Appraisal in Meta-analysis Reply
    Deshpande, Abhishek
    Pasupuleti, Vinay
    Sferra, Thomas J.
    Hernandez, Adrian V.
    Pant, Chaitanya
    CLINICAL GASTROENTEROLOGY AND HEPATOLOGY, 2012, 10 (09) : 1057 - 1058
  • [33] Meta-evaluation - Criteria for the evaluation of an evaluation - German - Widmer,T
    Beywl, W
    KOLNER ZEITSCHRIFT FUR SOZIOLOGIE UND SOZIALPSYCHOLOGIE, 1997, 49 (03): : 607 - 608
  • [34] The 3-min appraisal of a meta-analysis
    Nasir Hussain
    Ammar Bookwala
    Parag Sancheti
    Mohit Bhandari
    Indian Journal of Orthopaedics, 2011, 45 : 4 - 5
  • [35] From Hot-Potato Questions to Teachable Moments: Using Analysis and Meta-Evaluation to Address Trump in the Negotiation Classroom
    Manwaring, Melissa
    NEGOTIATION JOURNAL, 2019, 35 (01) : 211 - 214
  • [36] Ten simple rules for neuroimaging meta-analysis
    Mueller, Veronika I.
    Cieslik, Edna C.
    Laird, Angela R.
    Fox, Peter T.
    Radua, Joaquim
    Mataix-Cols, David
    Tench, Christopher R.
    Yarkoni, Tal
    Nichols, Thomas E.
    Turkeltaub, Peter E.
    Wager, Tor D.
    Eickhoff, Simon B.
    NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 2018, 84 : 151 - 161
  • [37] Armor: A Benchmark for Meta-evaluation of Artificial Music
    Wang, Songhe
    Bao, Zheng
    E, Jingtong
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 5583 - 5590
  • [38] Internal Formative Meta-Evaluation: Assuring Quality in Evaluation Practice
    Harnar, Michael A.
    Hillman, Jeffrey A.
    Endres, Cheryl L.
    Snow, Juna Z.
    AMERICAN JOURNAL OF EVALUATION, 2020, 41 (04) : 603 - 613
  • [39] Meta-evaluation of the teaching evaluation system of a Mexican public university
    Hernandez-Villafana, Alma Delia
    Serrano, Edna Luna
    EDUCATION POLICY ANALYSIS ARCHIVES, 2023, 31
  • [40] Meta-evaluation of a Teaching Evaluation System from students perspective
    Hernandez-Villafana, Alma Delia
    Serrano, Edna Luna
    REVISTA FUENTES, 2023, 25 (02): : 154 - 164