Considerations for the use of plausible values in large-scale assessments

被引:0
|
作者
Jewsbury, Paul A. [1 ]
Jia, Yue [1 ]
Gonzalez, Eugenio J. [2 ]
机构
[1] ETS, 660 Rosedale Rd, Princeton, NJ 08541 USA
[2] Boston Coll, 140 Commonwealth Ave, Chestnut Hill, MA 02467 USA
关键词
Plausible values; Large-scale assessments; Group-score assessments; Multiple imputation; MISSING-DATA; MULTIPLE-IMPUTATION; INFERENCE; VARIABLES;
D O I
10.1186/s40536-024-00213-y
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Large-scale assessments are rich sources of data that can inform a diverse range of research questions related to educational policy and practice. For this reason, datasets from large-scale assessments are available to enable secondary analysts to replicate and extend published reports of assessment results. These datasets include multiple imputed values for proficiency, known as plausible values. Plausible values enable the analysis of achievement in large-scale assessment data with complete-case statistical methods such as t-tests implemented in readily-available statistical software. However, researchers are often challenged by the complex and unfamiliar nature of plausible values, large-scale assessments, and their datasets. Misunderstandings and misuses of plausible values may therefore arise. The aims of this paper are to explain what plausible values are, why plausible values are used in large-scale assessments, and how plausible values should be used in secondary analysis of the data. Also provided are answers to secondary researchers' frequently asked questions about the use of plausible values in analysis gathered by the authors during their experience advising secondary users of these databases.
引用
收藏
页数:27
相关论文
共 50 条
  • [1] The Importance of Sample Weights and Plausible Values in Large-Scale Assessments
    Arikan, Serkan
    Ozer, Ferah
    Seker, Vuslat
    Ertas, Gunes
    JOURNAL OF MEASUREMENT AND EVALUATION IN EDUCATION AND PSYCHOLOGY-EPOD, 2020, 11 (01): : 43 - 60
  • [2] Using plausible values in secondary analysis in large-scale assessments
    Laukaityte, Inga
    Wiberg, Marie
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2017, 46 (22) : 11341 - 11357
  • [3] On Matrix Sampling and Imputation of Context Questionnaires With Implications for the Generation of Plausible Values in Large-Scale Assessments
    Kaplan, David
    Su, Dan
    JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS, 2016, 41 (01) : 57 - 80
  • [4] Efficiency Analysis with Educational Data: How to Deal with Plausible Values from International Large-Scale Assessments
    Aparicio, Juan
    Cordero, Jose M.
    Ortiz, Lidia
    MATHEMATICS, 2021, 9 (13)
  • [5] Concordance for Large-Scale Assessments
    Yin, Liqun
    Von Davier, Matthias
    Khorramdel, Lale
    Jung, Ji Yoon
    Foy, Pierre
    QUANTITATIVE PSYCHOLOGY, 2023, 422 : 17 - 30
  • [6] CONSIDERATIONS FOR THE USE AND LARGE-SCALE GROWTH OF METHANOGENIC BACTERIA
    DANIELS, L
    BELAY, N
    BISWARUP
    MUKHOPADAHYAY
    BIOTECHNOLOGY AND BIOENGINEERING, 1984, : 199 - 213
  • [7] The use of process data in large-scale assessments: a literature review
    Anghel, Ella
    Khorramdel, Lale
    von Davier, Matthias
    LARGE-SCALE ASSESSMENTS IN EDUCATION, 2024, 12 (01)
  • [8] LARGE-SCALE ASSESSMENTS AND READING THEORIES
    Hachey, Krystal K.
    2011 4TH INTERNATIONAL CONFERENCE OF EDUCATION, RESEARCH AND INNOVATION (ICERI), 2011, : 1019 - 1026
  • [9] Using plausible values when fitting multilevel models with large-scale assessment data using R
    Huang, Francis L.
    LARGE-SCALE ASSESSMENTS IN EDUCATION, 2024, 12 (01)
  • [10] Using plausible values when fitting multilevel models with large-scale assessment data using R
    Francis L. Huang
    Large-scale Assessments in Education, 12