A1 Refereed original research article in a scientific journal
COMATH: Development and Validation of a Cross-National Assessment Instrument for Computational Thinking in Primary and Secondary Education
Authors: Dagiene, Valentina; Lehtonen, Daranee; Satomaa, Esa; Laakso, Mikko-Jussi
Publisher: Vilnius University, Institute of Mathematics and Informatics
Publication year: 2026
Journal: Informatics in Education
Volume: 25
Issue: 1
First page : 59
Last page: 108
ISSN: 1648-5831
eISSN: 2335-8971
DOI: https://doi.org/10.15388/infedu.2602.022
Publication's open availability at the time of reporting: Open Access
Publication channel's open availability : Open Access publication channel
Web address : https://infedu.vu.lt/journal/INFEDU/article/852/info
Self-archived copy’s web address: https://research.utu.fi/converis/portal/detail/Publication/523516149
Self-archived copy's licence: CC BY
Self-archived copy's version: Publisher`s PDF
Computational Thinking (CT) is widely recognised as a transversal competence essential for learning, problem solving, and knowledge transfer across disciplines. However, its effective integration into school education remains strongly dependent on the availability of assessment instruments that are pedagogically meaningful, psychometrically sound, and applicable across diverse educational contexts. This paper presents COMATH, a cross-national assessment instrument designed to evaluate CT in students aged 9–14. The instrument adopts a phase-based development and validation framework that integrates Bebras-inspired tasks, Item Response Theory, factor-analytic methods, learning analytics, and teacher and student feedback. The assessment was iteratively developed and piloted between 2023 and 2025 in six European countries, with data collected from 6,480 students and 155 teachers. The findings demonstrate that a phased assessment approach enables systematic calibration of task difficulty, robust evaluation of item functioning, and meaningful interpretation of student performance across age groups and national contexts. The results further highlight how well-designed CT assessment can support instructional decision-making rather than serve solely as a summative measure. The study argues for conceptualising CT assessment as a dynamic and iterative process that links measurement, psychometric validation, and pedagogical use in school education.
Downloadable publication This is an electronic reprint of the original article. |
Funding information in the publication:
This work was co-funded by the European Union