A Conditional Exposure Control Method for Multidimensional Adaptive Testing

被引:22
|
作者
Finkelman, Matthew [1 ]
Nering, Michael L. [2 ]
Roussos, Louis A. [2 ]
机构
[1] Tufts Univ, Sch Dent Med, Boston, MA 02215 USA
[2] Measured Progress, Dover, NH 03820 USA
关键词
ITEM SELECTION; ABILITY; MODELS;
D O I
10.1111/j.1745-3984.2009.01070.x
中图分类号
G44 [教育心理学];
学科分类号
0402 ; 040202 ;
摘要
In computerized adaptive testing (CAT), ensuring the security of test items is a crucial practical consideration. A common approach to reducing item theft is to define maximum item exposure rates, i.e., to limit the proportion of examinees to whom a given item can be administered. Numerous methods for controlling exposure rates have been proposed for tests employing the unidimensional 3-PL model. The present article explores the issues associated with controlling exposure rates when a multidimensional item response theory (MIRT) model is utilized and exposure rates must be controlled conditional upon ability. This situation is complicated by the exponentially increasing number of possible ability values in multiple dimensions. The article introduces a new procedure, called the generalized Stocking-Lewis method, that controls the exposure rate for students of comparable ability as well as with respect to the overall population. A realistic simulation set compares the new method with three other approaches: Kullback-Leibler information with no exposure control, Kullback-Leibler information with unconditional Sympson-Hetter exposure control, and random item selection.
引用
收藏
页码:84 / 103
页数:20
相关论文
共 50 条