Opening the Black-Box of Peer Review: An Agent-Based Model of Scientist Behaviour

被引:21
|
作者
Squazzoni, Flaminio [1 ]
Gandelli, Claudio [2 ]
机构
[1] Univ Brescia, Dept Econ & Management, I-25122 Brescia, Italy
[2] Univ Brescia, Dept Social Sci, I-25122 Brescia, Italy
关键词
Peer Review; Referees; Referee Behaviour; Reciprocity; Fairness; STANDS TODAY; JOURNALS; ECONOMICS;
D O I
10.18564/jasss.2128
中图分类号
C [社会科学总论];
学科分类号
03 ; 0303 ;
摘要
This paper investigates the impact of referee behaviour on the quality and efficiency of peer review. We focused on the importance of reciprocity motives in ensuring cooperation between all involved parties. We modelled peer review as a process based on knowledge asymmetries and subject to evaluation bias. We built various simulation scenarios in which we tested different interaction conditions and author and referee behaviour. We found that reciprocity cannot always have per se a positive effect on the quality of peer review, as it may tend to increase evaluation bias. It can have a positive effect only when reciprocity motives are inspired by disinterested standards of fairness.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] The “flat peer learning” agent-based model
    Philippe Collard
    Journal of Computational Social Science, 2022, 5 : 161 - 187
  • [22] OPENING THE BLACK-BOX, COGNITIVE SCIENCE AND HISTORY OF SCIENCE
    NERSESSIAN, NJ
    OSIRIS, 1995, 10 : 194 - 211
  • [23] OPENING UP THE BLACK-BOX OF ARTIFICIAL NEURAL NETWORKS
    SPINING, MT
    DARSEY, JA
    SUMPTER, BG
    NOID, DW
    JOURNAL OF CHEMICAL EDUCATION, 1994, 71 (05) : 406 - 411
  • [24] PEER REVIEW UNDER THE MICROSCOPE. AN AGENT-BASED MODEL OF SCIENTIFIC COLLABORATION
    Squazzoni, Flaminio
    Gandelli, Claudio
    2012 WINTER SIMULATION CONFERENCE (WSC), 2012,
  • [25] Evidence-based review of the black-box warning for droperidol
    Jackson, Cherry W.
    Sheehan, Amy Heck
    Reddan, Jennifer G.
    AMERICAN JOURNAL OF HEALTH-SYSTEM PHARMACY, 2007, 64 (11) : 1174 - 1186
  • [26] A model for analyzing black-box optimization
    Phan, Vinhthuy
    Skiena, Steven
    Sumazin, Pavel
    Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2003, 2748 : 424 - 438
  • [27] Dataless Black-Box Model Comparison
    Theiss C.
    Brust C.A.
    Denzler J.
    Pattern Recognition and Image Analysis, 2018, 28 (4) : 676 - 683
  • [28] A model for analyzing black-box optimization
    Phan, V
    Skiena, S
    Sumazin, P
    ALGORITHMS AND DATA STRUCTURES, PROCEEDINGS, 2003, 2748 : 424 - 438
  • [29] Dataless Black-Box Model Comparison
    Theiss, Christoph
    Brust, Clemens-Alexander
    Denzler, Joachim
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE (ICPRAI 2018), 2018, : 622 - 626
  • [30] The black-box model for cryptographic primitives
    Schnorr, CP
    Vaudenay, S
    JOURNAL OF CRYPTOLOGY, 1998, 11 (02) : 125 - 140