Rotating Item Banks versus Restriction of Maximum Exposure Rates in Computerized Adaptive Testing

被引:5
|
作者
Ramon Barrada, Juan [1 ]
Olea, Julio [2 ]
Jose Abad, Francisco [2 ]
机构
[1] Univ Autonoma Barcelona, Fac Psicol, Bellaterra 08193, Spain
[2] Univ Autonoma Madrid, E-28049 Madrid, Spain
来源
SPANISH JOURNAL OF PSYCHOLOGY | 2008年 / 11卷 / 02期
关键词
item bank security; overlap rate; accuracy; bank rotation; Sympson-Hetter method;
D O I
10.1017/S1138741600004625
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
If examinees were to know, beforehand, part of the content of a computerized adaptive test. their estimated trait levels would then have a marked positive bias. One of the strategies to avoid this consists of dividing a large item bank into several sub-banks and rotating the sub-bank employed (Ariel, Veldkamp & van der Linden, 2004). This strategy permits substantial improvements in exposure control at little cost to measurement accuracy. However, we do not know whether this option provides better results than using the master bank with greater restriction in the maximum exposure rates (Sympson & Hetter, 1985). In order to investigate this issue, we worked with several simulated banks of 2100 items, comparing them, for RMSE and overlap rate, with the same banks divided in two, three... up to seven sub-banks. By means of extensive manipulation of the maximum exposure rate in each bank, we found that the option of rotating banks slightly outperformed the option of restricting maximum exposure rate of the master bank by means of the Sympson-Hetter method.
引用
收藏
页码:618 / 625
页数:8
相关论文
共 50 条
  • [21] A Continuous a-Stratification Index for Item Exposure Control in Computerized Adaptive Testing
    Huebner, Alan
    Wang, Chun
    Daly, Bridget
    Pinkelman, Colleen
    APPLIED PSYCHOLOGICAL MEASUREMENT, 2018, 42 (07) : 523 - 537
  • [22] A Knowledge-Based Approach for Item Exposure Control in Computerized Adaptive Testing
    Doong, Shing H.
    JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS, 2009, 34 (04) : 530 - 558
  • [23] The maximum priority index method for severely constrained item selection in computerized adaptive testing
    Cheng, Ying
    Chang, Hua-Hua
    BRITISH JOURNAL OF MATHEMATICAL & STATISTICAL PSYCHOLOGY, 2009, 62 : 369 - 383
  • [24] Item selection algorithms in computerized adaptive testing
    García, DA
    Cruz, CS
    Dorronsoro, JR
    Franco, VJR
    PSICOTHEMA, 2000, 12 : 12 - 14
  • [25] Compromised Item Detection for Computerized Adaptive Testing
    Liu, Cheng
    Han, Kyung T.
    Li, Jun
    FRONTIERS IN PSYCHOLOGY, 2019, 10
  • [26] Methodological issues for building item banks and computerized adaptive scales
    David Thissen
    Bryce B. Reeve
    Jakob Bue Bjorner
    Chih-Hung Chang
    Quality of Life Research, 2007, 16 : 109 - 119
  • [27] Methodological issues for building item banks and computerized adaptive scales
    Thissen, David
    Reeve, Bryce B.
    Bjorner, Jakob Bue
    Chang, Chih-Hung
    QUALITY OF LIFE RESEARCH, 2007, 16 (Suppl 1) : 109 - 119
  • [28] Strategies for controlling item exposure in computerized adaptive testing with the generalized partial credit model
    Davis, LL
    APPLIED PSYCHOLOGICAL MEASUREMENT, 2004, 28 (03) : 165 - 185
  • [29] Item Selection and Exposure Control Methods for Computerized Adaptive Testing with Multidimensional Ranking Items
    Chen, Chia-Wen
    Wang, Wen-Chung
    Chiu, Ming Ming
    Ro, Sage
    JOURNAL OF EDUCATIONAL MEASUREMENT, 2020, 57 (02) : 343 - 369
  • [30] Application of Binary Searching for Item Exposure Control in Cognitive Diagnostic Computerized Adaptive Testing
    Zheng, Chanjin
    Wang, Chun
    APPLIED PSYCHOLOGICAL MEASUREMENT, 2017, 41 (07) : 561 - 576