Power failure: why small sample size undermines the reliability of neuroscience

被引:4978
作者
Button, Katherine S. [1 ,2 ]
Ioannidis, John P. A. [3 ]
Mokrysz, Claire [1 ]
Nosek, Brian A. [4 ]
Flint, Jonathan [5 ]
Robinson, Emma S. J. [6 ]
Munafo, Marcus R. [1 ]
机构
[1] Univ Bristol, Sch Expt Psychol, Bristol BS8 1TU, Avon, England
[2] Univ Bristol, Sch Social & Community Med, Bristol BS8 2BN, Avon, England
[3] Stanford Univ, Sch Med, Stanford, CA 94305 USA
[4] Univ Virginia, Dept Psychol, Charlottesville, VA 22904 USA
[5] Univ Oxford, Wellcome Trust Ctr Human Genet, Oxford OX3 7BN, England
[6] Univ Bristol, Sch Physiol & Pharmacol, Bristol BS8 1TD, Avon, England
基金
英国经济与社会研究理事会; 英国医学研究理事会;
关键词
ALZHEIMERS-DISEASE; PARKINSONS-DISEASE; MULTIPLE-SCLEROSIS; GENE POLYMORPHISMS; PUBLISHED RESEARCH; CEREBRAL-ISCHEMIA; METAANALYSIS; RISK; ASSOCIATION; SCHIZOPHRENIA;
D O I
10.1038/nrn3475
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
A study with low statistical power has a reduced chance of detecting a true effect, but it is less well appreciated that low power also reduces the likelihood that a statistically significant result reflects a true effect. Here, we show that the average statistical power of studies in the neurosciences is very low. The consequences of this include overestimates of effect size and low reproducibility of results. There are also ethical dimensions to this problem, as unreliable research is inefficient and wasteful. Improving reproducibility in neuroscience is a key priority and requires attention to well-established but often ignored methodological principles.
引用
收藏
页码:365 / 376
页数:12
相关论文
共 102 条
[1]   An Open, Large-Scale, Collaborative Effort to Estimate the Reproducibility of Psychological Science [J].
Alexander, Anita ;
Barnett-Cowan, Michael ;
Bartmess, Elizabeth ;
Bosco, Frank A. ;
Brandt, Mark ;
Carp, Joshua ;
Chandler, Jesse J. ;
Clay, Russ ;
Cleary, Hayley ;
Cohn, Michael ;
Costantini, Giulio ;
DeCoster, Jamie ;
Dunn, Elizabeth ;
Eggleston, Casey ;
Estel, Vivien ;
Farach, Frank J. ;
Feather, Jenelle ;
Fiedler, Susann ;
Field, James G. ;
Foster, Joshua D. ;
Frank, Michael ;
Frazier, Rebecca S. ;
Fuchs, Heather M. ;
Galak, Jeff ;
Galliani, Elisa Maria ;
Garcia, Sara ;
Giammanco, Elise M. ;
Gilbert, Elizabeth A. ;
Giner-Sorolla, Roger ;
Goellner, Lars ;
Goh, Jin X. ;
Goss, R. Justin ;
Graham, Jesse ;
Grange, James A. ;
Gray, Jeremy R. ;
Gripshover, Sarah ;
Hartshorne, Joshua ;
Hayes, Timothy B. ;
Jahn, Georg ;
Johnson, Kate ;
Johnston, William ;
Joy-Gaba, Jennifer A. ;
Lai, Calvin K. ;
Lakens, Daniel ;
Lane, Kristin ;
LeBel, Etienne P. ;
Lee, Minha ;
Lemm, Kristi ;
Mackinnon, Sean ;
May, Michael .
PERSPECTIVES ON PSYCHOLOGICAL SCIENCE, 2012, 7 (06) :657-660
[2]   Public Availability of Published Research Data in High-Impact Journals [J].
Alsheikh-Ali, Alawi A. ;
Qureshi, Waqas ;
Al-Mallah, Mouaz H. ;
Ioannidis, John P. A. .
PLOS ONE, 2011, 6 (09)
[3]   Meta-Analysis of Facial Affect Recognition Difficulties After Traumatic Brain Injury [J].
Babbage, Duncan R. ;
Yim, Jackki ;
Zupan, Barbra ;
Neumann, Dawn ;
Tomita, Machiko R. ;
Willer, Barry .
NEUROPSYCHOLOGY, 2011, 25 (03) :277-285
[4]   Meta-analysis of 5, 10-methylenetetrahydrofolate reductase gene polymorphism as a risk factor for ischemic cerebrovascular disease in a Chinese Han population [J].
Bai, Hua .
NEURAL REGENERATION RESEARCH, 2011, 6 (05) :360-365
[5]   Early stopping of randomized clinical trials for overt efficacy is problematic [J].
Bassler, Dirk ;
Montori, Victor M. ;
Briel, Matthias ;
Glasziou, Paul ;
Guyatt, Gordon .
JOURNAL OF CLINICAL EPIDEMIOLOGY, 2008, 61 (03) :241-246
[6]   Raise standards for preclinical cancer research [J].
Begley, C. Glenn ;
Ellis, Lee M. .
NATURE, 2012, 483 (7391) :531-533
[7]  
Berger J. O., 1998, LIKELIHOOD PRINCIPLE
[8]   Metformin for weight reduction in non-diabetic patients on antipsychotic drugs: a systematic review and meta-analysis [J].
Bjorkhem-Bergman, Linda ;
Asplund, Annika B. ;
Lindh, Jonatan D. .
JOURNAL OF PSYCHOPHARMACOLOGY, 2011, 25 (03) :299-305
[9]   Copper in Alzheimer's Disease: A Meta-Analysis of Serum, Plasma, and Cerebrospinal Fluid Studies [J].
Bucossi, Serena ;
Ventriglia, Mariacarla ;
Panetta, Valentina ;
Salustri, Carlo ;
Pasqualetti, Patrizio ;
Mariani, Stefania ;
Siotto, Mariacristina ;
Rossini, Paolo Maria ;
Squitti, Rosanna .
JOURNAL OF ALZHEIMERS DISEASE, 2011, 24 (01) :175-185
[10]   The secret lives of experiments: Methods reporting in the fMRI literature [J].
Carp, Joshua .
NEUROIMAGE, 2012, 63 (01) :289-300