Investigating the psychometric features of a locally designed computational thinking assessment for elementary students

Background and ContextEducators and researchers are interested in building the computational thinking (CT) skills of K-12 students. However, the availability of language-agnostic assessments for lower elementary graders remains limited.ObjectiveWe present preliminary insights into the reliability and validity of the Computational Thinking Assessment for Elementary Students (CTAES), a new assessment to measure 3rd-5th grade students' CT abilities.MethodThe CTAES was administered to 222 3rd-5th grade students. We conducted Rasch analyses, focusing on dimensionality, separation characteristics, and differential item functioning.FindingsThe CTAES appears to be unidimensional, primarily assessing students' CT skills. Students with lower CT proficiency demonstrate lower likelihood of correctly responding to assessment items compared to peers with higher CT proficiency levels. Preliminary evidence suggests that the assessment does not exhibit bias based on gender or racial/ethnic background.ImplicationsInitial findings suggest that the CTAES holds promise as a reliable and valid assessment tool, although there remain opportunities for further refinement.