A multi-peer assessment platform for programming language learning: considering group non-consensus and personal radicalness
被引:17
|
作者:
Wang, Yanqing
论文数: 0引用数: 0
h-index: 0
机构:
Harbin Inst Technol, Sch Management, Harbin, Peoples R ChinaHarbin Inst Technol, Sch Management, Harbin, Peoples R China
Wang, Yanqing
[1
]
Liang, Yaowen
论文数: 0引用数: 0
h-index: 0
机构:
Harbin Inst Technol, Sch Management, Harbin, Peoples R ChinaHarbin Inst Technol, Sch Management, Harbin, Peoples R China
Liang, Yaowen
[1
]
Liu, Luning
论文数: 0引用数: 0
h-index: 0
机构:
Harbin Inst Technol, Sch Management, Harbin, Peoples R ChinaHarbin Inst Technol, Sch Management, Harbin, Peoples R China
Liu, Luning
[1
]
Liu, Ying
论文数: 0引用数: 0
h-index: 0
机构:
Calif State Univ Long Beach, Dept Informat Syst, Coll Business Adm, Long Beach, CA 90840 USAHarbin Inst Technol, Sch Management, Harbin, Peoples R China
Liu, Ying
[2
]
机构:
[1] Harbin Inst Technol, Sch Management, Harbin, Peoples R China
[2] Calif State Univ Long Beach, Dept Informat Syst, Coll Business Adm, Long Beach, CA 90840 USA
Multi-peer assessment has often been used by teachers to reduce personal bias and make the assessment more reliable. This study reviews the design and development of multi-peer assessment systems that detect and solve two common issues in such systems: non-consensus among group members and personal radicalness in some assessments. A multi-peer assessment model is proposed to address these issues. The model captures roles, activities, and data structures in a typical multi-peer assessment setting that can be generalized to other scenarios. We implemented the model in a multi-peer code review system and conducted several empirical experiments in programming language classes. The studies showed that the model can significantly improve student learning outcomes than in a single-peer assessment. Also,we used statistical measures to detect non-consensus and radicalness issues that often occur in the model. The results reveal many insights and provide valuable guidance for teachers to implement a multi-peer assessment system.