Rotating Item Banks versus Restriction of Maximum Exposure Rates in Computerized Adaptive Testing

被引:5
|
作者
Ramon Barrada, Juan [1 ]
Olea, Julio [2 ]
Jose Abad, Francisco [2 ]
机构
[1] Univ Autonoma Barcelona, Fac Psicol, Bellaterra 08193, Spain
[2] Univ Autonoma Madrid, E-28049 Madrid, Spain
来源
SPANISH JOURNAL OF PSYCHOLOGY | 2008年 / 11卷 / 02期
关键词
item bank security; overlap rate; accuracy; bank rotation; Sympson-Hetter method;
D O I
10.1017/S1138741600004625
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
If examinees were to know, beforehand, part of the content of a computerized adaptive test. their estimated trait levels would then have a marked positive bias. One of the strategies to avoid this consists of dividing a large item bank into several sub-banks and rotating the sub-bank employed (Ariel, Veldkamp & van der Linden, 2004). This strategy permits substantial improvements in exposure control at little cost to measurement accuracy. However, we do not know whether this option provides better results than using the master bank with greater restriction in the maximum exposure rates (Sympson & Hetter, 1985). In order to investigate this issue, we worked with several simulated banks of 2100 items, comparing them, for RMSE and overlap rate, with the same banks divided in two, three... up to seven sub-banks. By means of extensive manipulation of the maximum exposure rate in each bank, we found that the option of rotating banks slightly outperformed the option of restricting maximum exposure rate of the master bank by means of the Sympson-Hetter method.
引用
收藏
页码:618 / 625
页数:8
相关论文
共 50 条
  • [31] Components of the item selection algorithm in computerized adaptive testing
    Han, Kyung Tyek
    JOURNAL OF EDUCATIONAL EVALUATION FOR HEALTH PROFESSIONS, 2018, 15 : 7
  • [32] Item calibration error in Computerized Adaptive Testing (CAT)
    Yousfi, Safir
    INTERNATIONAL JOURNAL OF PSYCHOLOGY, 2008, 43 (3-4) : 620 - 620
  • [33] Accounting for item calibration error in computerized adaptive testing
    Fink, Aron
    Koenig, Christoph
    Frey, Andreas
    BEHAVIOR RESEARCH METHODS, 2025, 57 (05)
  • [34] Investigating item response times in computerized adaptive testing
    Hornke, LF
    DIAGNOSTICA, 1997, 43 (01): : 27 - 39
  • [35] Pretest Item Calibration in Computerized Multistage Adaptive Testing
    Karatoprak Ersen, Rabia
    Lee, Won-Chan
    JOURNAL OF EDUCATIONAL MEASUREMENT, 2023, 60 (03) : 379 - 401
  • [36] A COMPARISON OF ITEM CALIBRATION MEDIA IN COMPUTERIZED ADAPTIVE TESTING
    HETTER, RD
    SEGALL, DO
    BLOXOM, BM
    APPLIED PSYCHOLOGICAL MEASUREMENT, 1994, 18 (03) : 197 - 204
  • [37] A Comparability Approach to Item Reduction in Computerized Adaptive Testing
    Phuvipadawat, Swit
    Gulyanon, Warakorn
    Aimmanee, Pakinee
    Theeramunkong, Thanaruk
    2008 IEEE INTERNATIONAL CONFERENCE ON MANAGEMENT OF INNOVATION AND TECHNOLOGY, VOLS 1-3, 2008, : 1456 - 1460
  • [38] Some alternatives to Sympson-Hetter item-exposure control in computerized adaptive testing
    van der Linden, WJ
    JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS, 2003, 28 (03) : 249 - 265
  • [39] Binary Restrictive Threshold Method for Item Exposure Control in Cognitive Diagnostic Computerized Adaptive Testing
    Sun, Xiaojian
    Gao, Yizhu
    Xin, Tao
    Song, Naiqing
    FRONTIERS IN PSYCHOLOGY, 2021, 12
  • [40] The Effects of Item Exposure Control on Measurement Precision of Vocabulary Size Estimates in Computerized Adaptive Testing
    Tseng, Wen-Ta
    ENGLISH TEACHING AND LEARNING, 2021, 45 (02): : 217 - 236