In which fields are citations indicators of research quality?

被引:21
|
作者
Thelwall, Mike [1 ]
Kousha, Kayvan [1 ]
Stuart, Emma [1 ]
Makita, Meiko [1 ]
Abdoli, Mahshid [1 ]
Wilson, Paul [1 ]
Levitt, Jonathan [1 ]
机构
[1] Univ Wolverhampton, Stat Cybermetr & Res Evaluat Grp, Wolverhampton, England
关键词
RESEARCH ASSESSMENT EXERCISE; BIBLIOMETRIC INDICATORS; PUBLICATIONS; LIBRARY; METRICS; COUNTS;
D O I
10.1002/asi.24767
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Citation counts are widely used as indicators of research quality to support or replace human peer review and for lists of top cited papers, researchers, and institutions. Nevertheless, the relationship between citations and research quality is poorly evidenced. We report the first large-scale science-wide academic evaluation of the relationship between research quality and citations (field normalized citation counts), correlating them for 87,739 journal articles in 34 field-based UK Units of Assessment (UoA). The two correlate positively in all academic fields, from very weak (0.1) to strong (0.5), reflecting broadly linear relationships in all fields. We give the first evidence that the correlations are positive even across the arts and humanities. The patterns are similar for the field classification schemes of Scopus and Dimensions.ai, although varying for some individual subjects and therefore more uncertain for these. We also show for the first time that no field has a citation threshold beyond which all articles are excellent quality, so lists of top cited articles are not pure collections of excellence, and neither is any top citation percentile indicator. Thus, while appropriately field normalized citations associate positively with research quality in all fields, they never perfectly reflect it, even at high values.
引用
收藏
页码:941 / 953
页数:13
相关论文
共 50 条
  • [41] Quality Indicators for Reviews of Research in Special Education
    Talbott, Elizabeth
    Maggin, Daniel M.
    Van Acker, Eryn Y.
    Kumm, Skip
    EXCEPTIONALITY, 2018, 26 (04) : 245 - 265
  • [42] European Educational Research Quality Indicators (EERQI)
    Gogolin, Ingrid
    Gradmann, Stefan
    Astrom, Fredrik
    PROCEEDINGS OF ISSI 2009 - 12TH INTERNATIONAL CONFERENCE OF THE INTERNATIONAL SOCIETY FOR SCIENTOMETRICS AND INFORMETRICS, VOL 2, 2009, 2 : 934 - +
  • [43] QUALITY OF LIFE AND SOCIAL-INDICATORS RESEARCH
    SCHNEIDER, M
    PUBLIC ADMINISTRATION REVIEW, 1976, 36 (03) : 297 - 305
  • [44] Worth(less) papers - are journal impact factor and number of citations suitable indicators to evaluate quality of scientists?
    Racz, Aleksandar
    Markovic, Suzana
    NOVA PRISUTNOST, 2018, 16 (02): : 369 - 389
  • [45] RESEARCH INDICATORS AND DEPARTMENTAL OUTCOMES - A COMPARISON OF 4 ACADEMIC FIELDS
    NEUMANN, Y
    NEUMANN, L
    INTERNATIONAL SOCIAL SCIENCE REVIEW, 1982, 57 (02) : 94 - 97
  • [46] Towards understanding the relation between citations and research quality in software engineering studies
    Molleri, Jefferson Seide
    Petersen, Kai
    Mendes, Emilia
    SCIENTOMETRICS, 2018, 117 (03) : 1453 - 1478
  • [47] Towards understanding the relation between citations and research quality in software engineering studies
    Jefferson Seide Molléri
    Kai Petersen
    Emilia Mendes
    Scientometrics, 2018, 117 : 1453 - 1478
  • [48] Quality Indicators in Cranial Neurosurgery: Which Are Presently Substantiated? A Systematic Review
    Schipmann, Stephanie
    Schwake, Michael
    Molina, Eric Suero
    Roeder, Norbert
    Steudel, Wolf-Ingo
    Warneke, Nils
    Stummer, Walter
    WORLD NEUROSURGERY, 2017, 104 : 104 - 112
  • [49] WEB INDICATORS FOR RESEARCH EVALUATION. PART 1: CITATIONS AND LINKS TO ACADEMIC ARTICLES FROM THE WEB
    Thelwall, Mike
    Kousha, Kayvan
    PROFESIONAL DE LA INFORMACION, 2015, 24 (05): : 587 - 606
  • [50] Comments on the quality of citations in journals
    Hoeffel, C
    AMERICAN JOURNAL OF OBSTETRICS AND GYNECOLOGY, 1998, 179 (03) : 836 - 836