Study on Peer Review and Multi-indicators Evaluation in Scientific and Technological Assessment

被引：4
|
作者：
Yu Liping [1 ]
Pan Yuntao [1 ]
Yang chun [2 ]
Wu Yishan [1 ]
机构：
[1] Inst Sci & Tech Informat China, Beijing 100038, Peoples R China
[2] Jiangsu Polytechn Univ, Coll Econom & Management, Jiangsu 213164, Peoples R China
来源：
KAM: 2008 INTERNATIONAL SYMPOSIUM ON KNOWLEDGE ACQUISITION AND MODELING, PROCEEDINGS | 2008年
基金：
中国国家自然科学基金;
关键词：
D O I：
10.1109/KAM.2008.39
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
This paper analyzes the relation between peer review and multi-indicators evaluation for scientific and technical assessment. Based on the data of the 2007 Times Higher-QS world university rankings, we use two methods, multiple linear regression analysis and kappa agreement test, for analysis. The results show that the data abundance affects the agreement between peer review and multi-indicators evaluation. We conclude that comprehensive evaluation in combination with peer review is a better choice in lack of data. Regression goodness-of-fit can be used to assess data abundance. Peer review should be the basis for the choice of indicators and indicator weights. However multi-indicators evaluation is more stable and objective.
引用
收藏
页码：794 / 798
页数：5
相关论文
共 50 条
  • [41] Study on evaluation system innovation of scientific and technological achievements in oil enterprises
    Du Jijia
    PROCEEDINGS OF THE 4TH INTERNATIONAL CONFERENCE ON INNOVATION & MANAGEMENT, VOLS I AND II, 2007, : 2291 - 2294
  • [42] Study of Scientific and Technological Achievements Evaluation System in Jinpu New Area
    Sun Jihui
    Zhi Linlan
    PROCEEDINGS OF THE 9TH (2017) INTERNATIONAL CONFERENCE ON FINANCIAL RISK AND CORPORATE FINANCE MANAGEMENT, 2017, : 294 - 298
  • [43] PEER-REVIEW AND BIBLIOMETRIC INDICATORS OF SCIENTIFIC PERFORMANCE - A COMPARISON OF CUM LAUDE DOCTORATES WITH ORDINARY DOCTORATES IN PHYSICS
    NEDERHOF, AJ
    VANRAAN, AFJ
    SCIENTOMETRICS, 1987, 11 (5-6) : 333 - 350
  • [44] LONGITUDINAL EVALUATION OF SELF-ASSESSMENT AND PEER REVIEW IN A CAPSTONE COURSE
    Torlind, Peter
    Larsson, Lisa
    Eklof, Lars
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON ENGINEERING AND PRODUCT DESIGN EDUCATION, E&PDE 2023, 2023, 123 : 415 - 420
  • [45] Enhanced Peer Assessment in MOOC Evaluation Through Assignment and Review Analysis
    Alcarria, Ramon
    Bordel, Borja
    Martin de Andres, Diego
    Robles, Tomas
    INTERNATIONAL JOURNAL OF EMERGING TECHNOLOGIES IN LEARNING, 2018, 13 (01): : 206 - 219
  • [46] Safeguarding scientific integrity: A case study in examining manipulation in the peer review process
    Mcintosh, Leslie D.
    Hudson Vitale, Cynthia
    ACCOUNTABILITY IN RESEARCH-ETHICS INTEGRITY AND POLICY, 2025, 32 (03): : 195 - 213
  • [47] A noise audit of the peer review of a scientific article: a WPOM journal case study
    Bonavia, Tomas
    Marin-Garcia, Juan A.
    WPOM-WORKING PAPERS ON OPERATIONS MANAGEMENT, 2023, 14 (02): : 137 - 166
  • [48] Establishment and Study of an Evaluation Model for the Exploitation Effect of University Scientific and Technological Patents
    Zhou, Renguo
    International Journal of Emerging Technologies in Learning, 2022, 17 (20): : 231 - 247
  • [49] The Construction And Study Of The Evaluation Index System For Scientific And Technological Achievements Of Applied Technology
    Zhang, Pengnan
    Cheng, Keqiang
    Dang, Ming
    Peng, Xiangtao
    Liu, Tianjiao
    PROCEEDINGS OF THE 2018 4TH INTERNATIONAL CONFERENCE ON HUMANITIES AND SOCIAL SCIENCE RESEARCH (ICHSSR 2018), 2018, 213 : 180 - 185
  • [50] PEER COMMENTARY ON PEER-REVIEW - A CASE-STUDY IN SCIENTIFIC QUALITY-CONTROL - HARNAD,S
    BRITTAIN, JM
    SOCIAL SCIENCE INFORMATION STUDIES, 1985, 5 (01): : 38 - 40
12345