The impact of students' test-taking effort on growth estimates in low-stakes educational assessments

被引:9
|
作者
Yildirim-Erbasli, Seyma Nur [1 ]
Bulut, Okan [2 ]
机构
[1] Univ Alberta, Dept Educ Psychol, Edmonton, AB, Canada
[2] Univ Alberta, Ctr Res Appl Measurement & Evaluat, Edmonton, AB, Canada
关键词
Growth; reading; test-taking effort; rapid guessing; slow responding; response time effort; RAPID-GUESSING BEHAVIOR; CURRICULUM-BASED MEASUREMENT; RESPONSE-TIME; MOTIVATION; DISENGAGEMENT; VALIDATION; SCHEDULE;
D O I
10.1080/13803611.2021.1977152
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
This study investigated the impact of students' test-taking effort on their growth estimates in reading. The sample consisted of 7,602 students (Grades 1 to 4) in the United States who participated in the fall and spring administrations of a computer-based reading assessment. First, a new response dataset was created by flagging both rapid-guessing and slow-responding behaviours and recoding these non-effortful responses as missing. Second, students' academic growth (i.e., daily increase in ability levels) from fall to spring was calculated based on their original responses and responses in the new dataset excluding non-effortful responses. The results indicated that students' growth estimates changed significantly after recoding non-effortful responses as missing. Also, the difference in the growth estimates varied depending on the grade level. Overall, students' test-taking effort appeared to be influential in the estimation of students' reading growth. Implications for practice were discussed.
引用
收藏
页码:368 / 386
页数:19
相关论文
共 47 条
  • [1] Pharmacy Students' Test-Taking Motivation-Effort on a Low-Stakes Standardized Test
    Waskiewicz, Rhonda A.
    AMERICAN JOURNAL OF PHARMACEUTICAL EDUCATION, 2011, 75 (03)
  • [2] TEST-TAKING EFFORT AS A PREDICTOR OF PERFORMANCE IN LOW-STAKES TESTS
    Silm, Gerli
    Must, Olev
    Taeht, Karin
    TRAMES-JOURNAL OF THE HUMANITIES AND SOCIAL SCIENCES, 2013, 17 (04): : 433 - 448
  • [3] Identifying low test-taking effort during low-stakes tests with the new Test-taking Effort Short Scale (TESS) - development and psychometrics
    Schuettpelz-Brauns, Katrin
    Kadmon, Martina
    Kiessling, Claudia
    Karay, Yassin
    Gestmann, Margarita
    Kaemmer, Juliane E.
    BMC MEDICAL EDUCATION, 2018, 18
  • [4] Student test-taking effort in low-stakes assessments: evidence from the English version of the PISA 2015 science test
    Elodie Pools
    Christian Monseur
    Large-scale Assessments in Education, 9
  • [5] Identifying low test-taking effort during low-stakes tests with the new Test-taking Effort Short Scale (TESS) – development and psychometrics
    Katrin Schüttpelz-Brauns
    Martina Kadmon
    Claudia Kiessling
    Yassin Karay
    Margarita Gestmann
    Juliane E. Kämmer
    BMC Medical Education, 18
  • [6] Student test-taking effort in low-stakes assessments: evidence from the English version of the PISA 2015 science test
    Pools, Elodie
    Monseur, Christian
    LARGE-SCALE ASSESSMENTS IN EDUCATION, 2021, 9 (01)
  • [7] Erratum to: Change in test-taking motivation and its relationship to test performance in low-stakes assessments
    Christiane Penk
    Dirk Richter
    Educational Assessment, Evaluation and Accountability, 2017, 29 : 81 - 82
  • [8] Do Examinees Have Similar Test-Taking Effort? A High-Stakes Question for Low-Stakes Testing
    Barry, Carol L.
    Horst, S. Jeanne
    Finney, Sara J.
    Brown, Allison R.
    Kopp, Jason P.
    INTERNATIONAL JOURNAL OF TESTING, 2010, 10 (04) : 342 - 363
  • [9] Improving Test-Taking Effort in Low-Stakes Group-Based Educational Testing: A Meta-Analysis of Interventions
    Rios, Joseph
    APPLIED MEASUREMENT IN EDUCATION, 2021, 34 (02) : 85 - 106
  • [10] The role of test-taking motivation for students’ performance in low-stakes assessments: an investigation of school-track-specific differences
    Penk C.
    Pöhlmann C.
    Roppelt A.
    Large-scale Assessments in Education, 2 (1)