Opening the Black-Box of Peer Review: An Agent-Based Model of Scientist Behaviour

被引:21
|
作者
Squazzoni, Flaminio [1 ]
Gandelli, Claudio [2 ]
机构
[1] Univ Brescia, Dept Econ & Management, I-25122 Brescia, Italy
[2] Univ Brescia, Dept Social Sci, I-25122 Brescia, Italy
关键词
Peer Review; Referees; Referee Behaviour; Reciprocity; Fairness; STANDS TODAY; JOURNALS; ECONOMICS;
D O I
10.18564/jasss.2128
中图分类号
C [社会科学总论];
学科分类号
03 ; 0303 ;
摘要
This paper investigates the impact of referee behaviour on the quality and efficiency of peer review. We focused on the importance of reciprocity motives in ensuring cooperation between all involved parties. We modelled peer review as a process based on knowledge asymmetries and subject to evaluation bias. We built various simulation scenarios in which we tested different interaction conditions and author and referee behaviour. We found that reciprocity cannot always have per se a positive effect on the quality of peer review, as it may tend to increase evaluation bias. It can have a positive effect only when reciprocity motives are inspired by disinterested standards of fairness.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] The Black-Box Model for Cryptographic Primitives
    Claus Peter Schnorr
    Serge Vaudenay
    Journal of Cryptology, 1998, 11 : 125 - 140
  • [32] A Black-Box and Contract-Based Verification of Model Transformations
    Lahrouni, Meriem
    Cariou, Eric
    El Fazziki, Abdelaziz
    INTERNATIONAL ARAB JOURNAL OF INFORMATION TECHNOLOGY, 2019, 16 (04) : 651 - 660
  • [33] EXPLORING THE SYNTHESIS OF INFORMATION IN DESIGN PROCESSES - OPENING THE BLACK-BOX
    Gumienny, Raja
    Lindberg, Tilmann
    Meinel, Christoph
    PROCEEDINGS OF THE 18TH INTERNATIONAL CONFERENCE ON ENGINEERING DESIGN (ICED 11): IMPACTING SOCIETY THROUGH ENGINEERING DESIGN, VOL 6: DESIGN INFORMATION AND KNOWLEDGE, 2011, 6 : 446 - 455
  • [34] Black-box membership inference attacks based on shadow model
    Zhen, Han
    Wen’An, Zhou
    Xiaoxuan, Han
    Jie, Wu
    Journal of China Universities of Posts and Telecommunications, 2024, 31 (04): : 1 - 16
  • [35] Behaviour Abstraction Coverage as Black-Box Adequacy Criteria
    Czemerinski, Hernan
    Braberman, Victor
    Uchitel, Sebastian
    2013 IEEE SIXTH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION (ICST 2013), 2013, : 222 - 231
  • [36] Black-box membership inference attacks based on shadow model
    Han Zhen
    Zhou Wen'an
    Han Xiaoxuan
    Wu Jie
    TheJournalofChinaUniversitiesofPostsandTelecommunications, 2024, 31 (04) : 1 - 16
  • [37] Black-Box Power Transformer Winding Model
    Horvat, M. F.
    Jurkovic, Z.
    Jurisic, B.
    Zupan, T.
    Cucic, B.
    2022 7TH INTERNATIONAL ADVANCED RESEARCH WORKSHOP ON TRANSFORMERS (ARWTR 2022), 2022, : 18 - 23
  • [38] Microcontroller Power Integrity Black-Box Model
    Yuan, Shih-Yi
    Chen, Cheng-Chang
    2013 1ST INTERNATIONAL FUTURE ENERGY ELECTRONICS CONFERENCE (IFEEC 2013), 2013, : 445 - 448
  • [39] Black-box model adaptation for semantic segmentation
    Zhou, Zhiheng
    Yue, Wanlin
    Cao, Yinglie
    Shen, Shifu
    IMAGE AND VISION COMPUTING, 2024, 150
  • [40] Programmatic detection of spatial behaviour in an agent-based model
    Chivers, William J.
    Gladstone, William
    Herbert, Ric D.
    INFORMATION TECHNOLOGY IN INDUSTRY, 2014, 2 (02): : 38 - 43