Rotating Item Banks versus Restriction of Maximum Exposure Rates in Computerized Adaptive Testing

被引:5
|
作者
Ramon Barrada, Juan [1 ]
Olea, Julio [2 ]
Jose Abad, Francisco [2 ]
机构
[1] Univ Autonoma Barcelona, Fac Psicol, Bellaterra 08193, Spain
[2] Univ Autonoma Madrid, E-28049 Madrid, Spain
来源
SPANISH JOURNAL OF PSYCHOLOGY | 2008年 / 11卷 / 02期
关键词
item bank security; overlap rate; accuracy; bank rotation; Sympson-Hetter method;
D O I
10.1017/S1138741600004625
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
If examinees were to know, beforehand, part of the content of a computerized adaptive test. their estimated trait levels would then have a marked positive bias. One of the strategies to avoid this consists of dividing a large item bank into several sub-banks and rotating the sub-bank employed (Ariel, Veldkamp & van der Linden, 2004). This strategy permits substantial improvements in exposure control at little cost to measurement accuracy. However, we do not know whether this option provides better results than using the master bank with greater restriction in the maximum exposure rates (Sympson & Hetter, 1985). In order to investigate this issue, we worked with several simulated banks of 2100 items, comparing them, for RMSE and overlap rate, with the same banks divided in two, three... up to seven sub-banks. By means of extensive manipulation of the maximum exposure rate in each bank, we found that the option of rotating banks slightly outperformed the option of restricting maximum exposure rate of the master bank by means of the Sympson-Hetter method.
引用
收藏
页码:618 / 625
页数:8
相关论文
共 50 条
  • [41] Psychometric Evaluation of Glaucoma Quality of Life Item Banks (GlauCAT) and Initial Assessment Using Computerized Adaptive Testing
    Man, Ryan Eyn Kidd
    Fenwick, Eva K.
    Khadka, Jyoti
    Wu, ZhiChao
    Skalicky, Simon
    Pesudovs, Konrad
    Lamoureux, Ecosse L.
    TRANSLATIONAL VISION SCIENCE & TECHNOLOGY, 2022, 11 (06):
  • [42] TESTING IN PSYCHOLOGY. THE THEORY OF RESPONSE TO AN ITEM AND COMPUTERIZED ADAPTIVE TESTING
    Halama, P.
    CESKOSLOVENSKA PSYCHOLOGIE, 2012, 56 (03): : 290 - 291
  • [43] ITEM-PRESENTATION CONTROLS FOR MULTIDIMENSIONAL ITEM POOLS IN COMPUTERIZED ADAPTIVE TESTING
    THOMAS, TJ
    BEHAVIOR RESEARCH METHODS INSTRUMENTS & COMPUTERS, 1990, 22 (02): : 247 - 252
  • [44] Constructing rotating item pools for constrained adaptive testing
    Ariel, A
    Veldkamp, BP
    van der Linden, WJ
    JOURNAL OF EDUCATIONAL MEASUREMENT, 2004, 41 (04) : 345 - 359
  • [45] Item Response Models in Computerized Adaptive Testing: A Simulation Study
    Ferrao, Maria Eugenia
    Prata, Paula
    COMPUTATIONAL SCIENCE AND ITS APPLICATIONS - ICCSA 2014, PT III, 2014, 8581 : 552 - 565
  • [46] On initial item selection in cognitive diagnostic computerized adaptive testing
    Xu, Gongjun
    Wang, Chun
    Shang, Zhuoran
    BRITISH JOURNAL OF MATHEMATICAL & STATISTICAL PSYCHOLOGY, 2016, 69 (03): : 291 - 315
  • [47] A Bayesian method for the detection of item preknowledge in computerized adaptive testing
    McLeod, L
    Lewis, C
    Thissen, D
    APPLIED PSYCHOLOGICAL MEASUREMENT, 2003, 27 (02) : 121 - 137
  • [48] Association Rules as a Item Selection Strategy in Computerized Adaptive Testing
    Pacheco Ortiz, Josue
    Rodriguez Mazahua, Lisbeth
    Alor Hernandez, Giner
    CIENCIA ERGO-SUM, 2022, 30 (02)
  • [49] Item Selection Rules in Computerized Adaptive Testing Accuracy and Security
    Ramon Barrada, Juan
    Olea, Julio
    Ponsoda, Vicente
    Jose Abad, Francisco
    METHODOLOGY-EUROPEAN JOURNAL OF RESEARCH METHODS FOR THE BEHAVIORAL AND SOCIAL SCIENCES, 2009, 5 (01) : 7 - 17
  • [50] A sharing item response theory model for computerized adaptive testing
    Segall, DO
    JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS, 2004, 29 (04) : 439 - 460