In which fields are citations indicators of research quality?

被引:21
|
作者
Thelwall, Mike [1 ]
Kousha, Kayvan [1 ]
Stuart, Emma [1 ]
Makita, Meiko [1 ]
Abdoli, Mahshid [1 ]
Wilson, Paul [1 ]
Levitt, Jonathan [1 ]
机构
[1] Univ Wolverhampton, Stat Cybermetr & Res Evaluat Grp, Wolverhampton, England
关键词
RESEARCH ASSESSMENT EXERCISE; BIBLIOMETRIC INDICATORS; PUBLICATIONS; LIBRARY; METRICS; COUNTS;
D O I
10.1002/asi.24767
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Citation counts are widely used as indicators of research quality to support or replace human peer review and for lists of top cited papers, researchers, and institutions. Nevertheless, the relationship between citations and research quality is poorly evidenced. We report the first large-scale science-wide academic evaluation of the relationship between research quality and citations (field normalized citation counts), correlating them for 87,739 journal articles in 34 field-based UK Units of Assessment (UoA). The two correlate positively in all academic fields, from very weak (0.1) to strong (0.5), reflecting broadly linear relationships in all fields. We give the first evidence that the correlations are positive even across the arts and humanities. The patterns are similar for the field classification schemes of Scopus and Dimensions.ai, although varying for some individual subjects and therefore more uncertain for these. We also show for the first time that no field has a citation threshold beyond which all articles are excellent quality, so lists of top cited articles are not pure collections of excellence, and neither is any top citation percentile indicator. Thus, while appropriately field normalized citations associate positively with research quality in all fields, they never perfectly reflect it, even at high values.
引用
收藏
页码:941 / 953
页数:13
相关论文
共 50 条
  • [31] CITATIONS AND AREAS OF RESEARCH
    PETERS, CJ
    FASEB JOURNAL, 1991, 5 (10): : 2488 - 2488
  • [32] Are finance, management, and marketing autonomous fields of scientific research? An analysis based on journal citations
    Vieira, Pedro Cosme
    Teixeira, Aurora A. C.
    SCIENTOMETRICS, 2010, 85 (03) : 627 - 646
  • [33] Are finance, management, and marketing autonomous fields of scientific research? An analysis based on journal citations
    Pedro Cosme Vieira
    Aurora A. C. Teixeira
    Scientometrics, 2010, 85 : 627 - 646
  • [34] Indicators for measuring the impact of scientific citations in patents
    Velayos-Ortega, Gema
    Lopez-Carreno, Rosana
    WORLD PATENT INFORMATION, 2023, 72
  • [35] Indicators of the interdisciplinarity of journals: Diversity, centrality, and citations
    Amsterdam School of Communication Research , University of Amsterdam, Kloveniersburgwal 48, 1012 CX Amsterdam, Netherlands
    不详
    J. Inf., 1 (87-100):
  • [36] Electromagnetic fields and cancer: Incorrect citations
    Jauchem, JR
    OCCUPATIONAL AND ENVIRONMENTAL MEDICINE, 1997, 54 (05) : 359 - 360
  • [37] Evaluation of the Agency for Healthcare Research and Quality pediatric quality indicators
    Scanlon, Matthew C.
    Harris, J. Mitchell
    Levy, Fiona
    Sedman, Aileen
    PEDIATRICS, 2008, 121 (06) : E1723 - E1731
  • [38] A Review of the Quality Indicators of Rigor in Qualitative Research
    Johnson, Jessica L.
    Adkins, Donna
    Chauvin, Sheila
    AMERICAN JOURNAL OF PHARMACEUTICAL EDUCATION, 2020, 84 (01) : 138 - 146
  • [39] Appropriateness of quality indicators of the scientific and research production
    Gonzalez Ramos, Ana M.
    Gonzalez de la Fe, Teresa
    Fernandez Palacin, Fernando
    Munoz Marquez, Manuel
    POLITICA Y SOCIEDAD, 2006, 43 (02): : 199 - 213
  • [40] THE SELECTED RESEARCH FINDINGS ON THE QUALITY OF LIFE INDICATORS
    Simegova, Miroslava Adamik
    Szeliga, Peter
    Gubricova, Janette
    Libercanova, Kristina
    SGEM 2016, BK 1: PSYCHOLOGY AND PSYCHIATRY, SOCIOLOGY AND HEALTHCARE, EDUCATION CONFERENCE PROCEEDINGS, VOL I, 2016, : 1173 - 1179