Advances in CD-CAT: The General Nonparametric Item Selection Method

被引:0
|
作者
Chia-Yi Chiu
Yuan-Pei Chang
机构
[1] Rutgers,
[2] The State University of New Jersey,undefined
来源
Psychometrika | 2021年 / 86卷
关键词
Cognitive diagnosis; General nonparametric classification method; Computerized adaptive testing; CD-CAT; Nonparametric item selection;
D O I
暂无
中图分类号
学科分类号
摘要
Computerized adaptive testing (CAT) is characterized by its high estimation efficiency and accuracy, in contrast to the traditional paper-and-pencil format. CAT specifically for cognitive diagnosis (CD-CAT) carries the same advantages and has been seen as a tool for advancing the use of cognitive diagnosis (CD) assessment for educational practice. A powerful item selection method is the key to the success of a CD-CAT program, and to date, various parametric item selection methods have been proposed and well-researched. However, these parametric methods all require large samples, to secure high-precision calibration of the items in the item bank. Thus, at present, implementation of parametric methods in small-scale educational settings, such as classroom, remains challenging. In response to this issue, Chang, Chiu, and Tsai (Appl Psychol Meas 43:543–561, 2019) proposed the nonparametric item selection (NPS) method that does not require parameter calibration and outperforms the parametric methods for settings with only small or no calibration samples. Nevertheless, the NPS method is not without limitations; extra assumptions are required to guarantee a consistent estimator of the attribute profiles when data conform to complex models. To remedy this shortcoming, the general nonparametric item selection (GNPS) method that incorporates the newly developed general NPC (GNPC) method (Chiu et al. in Psychometrika 83:355–375, 2018) as the classification vehicle is proposed in this study. The inclusion of the GNPC method in the GNPS method relaxes the assumptions imposed on the NPS method. As a result, the GNPS method can be used with any model or multiple models without abandoning the advantage of being a small-sample technique. The legitimacy of using the GNPS method in the CD-CAT system is supported by Theorem 1 proposed in the study. The efficiency and effectiveness of the GNPS method are confirmed by the simulation study that shows the outperformance of the GNPS method over the compared parametric methods when the calibration samples are small.
引用
收藏
页码:1039 / 1057
页数:18
相关论文
共 50 条
  • [21] 多值评分CD-CAT的选题策略研究
    高旭亮
    王芳
    赵鹏娟
    心理科学, 2023, 46 (02) : 461 - 469
  • [22] 多级计分的CD-CAT曝光控制方法
    高椿雷
    罗照盛
    丁树良
    江西师范大学学报(自然科学版), 2019, 43 (01) : 59 - 67+101
  • [23] CD-CAT选题策略与终止规则研究
    艾国金
    李海燕
    胡丹
    信息技术与信息化, 2014, (05) : 188 - 189
  • [24] When Cognitive Diagnosis Meets Computerized Adaptive Testing: CD-CAT
    Ying Cheng
    Psychometrika, 2009, 74 : 619 - 632
  • [25] When Cognitive Diagnosis Meets Computerized Adaptive Testing: CD-CAT
    Cheng, Ying
    PSYCHOMETRIKA, 2009, 74 (04) : 619 - 632
  • [26] Development of a High-Accuracy and Effective Online Calibration Method in CD-CAT Based on Gini Index
    Tan, Qingrong
    Cai, Yan
    Luo, Fen
    Tu, Dongbo
    JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS, 2023, 48 (01) : 103 - 141
  • [27] 基于不同CDM视角的CD-CAT题库建设
    涂冬波
    高旭亮
    汪大勋
    蔡艳
    江西师范大学学报(自然科学版), 2018, 42 (04) : 366 - 373
  • [28] Attribute-level Item Selection Method for DCM-CAT
    Bao, Yu
    Bradshaw, Laine
    MEASUREMENT-INTERDISCIPLINARY RESEARCH AND PERSPECTIVES, 2018, 16 (04) : 209 - 225
  • [29] ONLINE CALIBRATION METHODS FOR THE DINA MODEL WITH INDEPENDENT ATTRIBUTES IN CD-CAT
    Chen, Ping
    Xin, Tao
    Wang, Chun
    Chang, Hua-Hua
    PSYCHOMETRIKA, 2012, 77 (02) : 201 - 222
  • [30] 非参数CD-CAT题库Q矩阵优化设计
    黄涛
    汪文义
    宋丽红
    江西师范大学学报(自然科学版), 2024, 48 (03) : 276 - 285