In which fields are citations indicators of research quality?

被引:21
|
作者
Thelwall, Mike [1 ]
Kousha, Kayvan [1 ]
Stuart, Emma [1 ]
Makita, Meiko [1 ]
Abdoli, Mahshid [1 ]
Wilson, Paul [1 ]
Levitt, Jonathan [1 ]
机构
[1] Univ Wolverhampton, Stat Cybermetr & Res Evaluat Grp, Wolverhampton, England
关键词
RESEARCH ASSESSMENT EXERCISE; BIBLIOMETRIC INDICATORS; PUBLICATIONS; LIBRARY; METRICS; COUNTS;
D O I
10.1002/asi.24767
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Citation counts are widely used as indicators of research quality to support or replace human peer review and for lists of top cited papers, researchers, and institutions. Nevertheless, the relationship between citations and research quality is poorly evidenced. We report the first large-scale science-wide academic evaluation of the relationship between research quality and citations (field normalized citation counts), correlating them for 87,739 journal articles in 34 field-based UK Units of Assessment (UoA). The two correlate positively in all academic fields, from very weak (0.1) to strong (0.5), reflecting broadly linear relationships in all fields. We give the first evidence that the correlations are positive even across the arts and humanities. The patterns are similar for the field classification schemes of Scopus and Dimensions.ai, although varying for some individual subjects and therefore more uncertain for these. We also show for the first time that no field has a citation threshold beyond which all articles are excellent quality, so lists of top cited articles are not pure collections of excellence, and neither is any top citation percentile indicator. Thus, while appropriately field normalized citations associate positively with research quality in all fields, they never perfectly reflect it, even at high values.
引用
收藏
页码:941 / 953
页数:13
相关论文
共 50 条
  • [21] Causal indicators in quality of life research
    Fayers, PM
    Hand, DJ
    Bjordal, K
    Groenvold, M
    QUALITY OF LIFE RESEARCH, 1997, 6 (05) : 393 - 406
  • [22] Land quality indicators: research plan
    Dumanski, J
    Pieri, C
    AGRICULTURE ECOSYSTEMS & ENVIRONMENT, 2000, 81 (02) : 93 - 102
  • [23] RESEARCH OF SOYBEAN SEED QUALITY INDICATORS
    Valevskaya, L.
    Sokolovskaya, O.
    JOURNAL OF FOOD SCIENCE AND TECHNOLOGY-UKRAINE, 2023, 17 (02): : 25 - 31
  • [24] Research on the relationships between discourse leading indicators and citations: perspectives from altmetrics indicators of international multidisciplinary academic journals
    Wang, Xu
    Feng, Xin
    LIBRARY HI TECH, 2022, : 1165 - 1190
  • [25] New bibliometric indicators for prospectivity estimation of research fields
    Muhamedyev, Ravil I.
    Aliguliyev, Ramiz M.
    Shokishalov, Zhassulan M.
    Mustakayev, Rinat R.
    ANNALS OF LIBRARY AND INFORMATION STUDIES, 2018, 65 (01) : 62 - 69
  • [26] Quality of research: which underlying values?
    Judith Czellar
    Jacques Lanarès
    Scientometrics, 2013, 95 : 1003 - 1021
  • [27] Quality of research: which underlying values?
    Czellar, Judith
    Lanares, Jacques
    SCIENTOMETRICS, 2013, 95 (03) : 1003 - 1021
  • [28] STANDARDIZATION OF RESEARCH CITATIONS
    OCONNOR, M
    NATURE, 1980, 283 (5747) : 520 - 520
  • [29] World flash on basic research -: the influence of author self-citations on bibliometric macro indicators
    Glänzel, W
    Thijs, B
    SCIENTOMETRICS, 2004, 59 (03) : 281 - 310
  • [30] Indicators of the interdisciplinarity of journals: Diversity, centrality, and citations
    Leydesdorff, Loet
    Rafols, Ismael
    JOURNAL OF INFORMETRICS, 2011, 5 (01) : 87 - 100