COMATH: Development and Validation of a Cross-National Assessment Instrument for Computational Thinking in Primary and Secondary Education;




Dagiene, Valentina; Lehtonen, Daranee; Satomaa, Esa; Laakso, Mikko-Jussi

PublisherVilnius University, Institute of Mathematics and Informatics

2026

 Informatics in Education

25

1

59

108

1648-5831

2335-8971

DOIhttps://doi.org/10.15388/infedu.2602.022

https://infedu.vu.lt/journal/INFEDU/article/852/info

https://research.utu.fi/converis/portal/detail/Publication/523516149



Computational Thinking (CT) is widely recognised as a transversal competence essential for learning, problem solving, and knowledge transfer across disciplines. However, its effective integration into school education remains strongly dependent on the availability of assessment instruments that are pedagogically meaningful, psychometrically sound, and applicable across diverse educational contexts. This paper presents COMATH, a cross-national assessment instrument designed to evaluate CT in students aged 9–14. The instrument adopts a phase-based development and validation framework that integrates Bebras-inspired tasks, Item Response Theory, factor-analytic methods, learning analytics, and teacher and student feedback. The assessment was iteratively developed and piloted between 2023 and 2025 in six European countries, with data collected from 6,480 students and 155 teachers. The findings demonstrate that a phased assessment approach enables systematic calibration of task difficulty, robust evaluation of item functioning, and meaningful interpretation of student performance across age groups and national contexts. The results further highlight how well-designed CT assessment can support instructional decision-making rather than serve solely as a summative measure. The study argues for conceptualising CT assessment as a dynamic and iterative process that links measurement, psychometric validation, and pedagogical use in school education.




Assessment InstrumentCOMATHcomputational thinkingCross-National AssessmentFactor analysisitem response theoryTest Reliability and Validity


This work was co-funded by the European Union


Last updated on 22/05/2026 01:58:27 PM