A1 Refereed original research article in a scientific journal

COMATH: Development and Validation of a Cross-National Assessment Instrument for Computational Thinking in Primary and Secondary Education




AuthorsDagiene, Valentina; Lehtonen, Daranee; Satomaa, Esa; Laakso, Mikko-Jussi

PublisherVilnius University, Institute of Mathematics and Informatics

Publication year2026

Journal: Informatics in Education

Volume25

Issue1

First page 59

Last page108

ISSN1648-5831

eISSN2335-8971

DOIhttps://doi.org/10.15388/infedu.2602.022

Publication's open availability at the time of reportingOpen Access

Publication channel's open availability Open Access publication channel

Web address https://infedu.vu.lt/journal/INFEDU/article/852/info

Self-archived copy’s web addresshttps://research.utu.fi/converis/portal/detail/Publication/523516149

Self-archived copy's licenceCC BY

Self-archived copy's versionPublisher`s PDF


Abstract

Computational Thinking (CT) is widely recognised as a transversal competence essential for learning, problem solving, and knowledge transfer across disciplines. However, its effective integration into school education remains strongly dependent on the availability of assessment instruments that are pedagogically meaningful, psychometrically sound, and applicable across diverse educational contexts. This paper presents COMATH, a cross-national assessment instrument designed to evaluate CT in students aged 9–14. The instrument adopts a phase-based development and validation framework that integrates Bebras-inspired tasks, Item Response Theory, factor-analytic methods, learning analytics, and teacher and student feedback. The assessment was iteratively developed and piloted between 2023 and 2025 in six European countries, with data collected from 6,480 students and 155 teachers. The findings demonstrate that a phased assessment approach enables systematic calibration of task difficulty, robust evaluation of item functioning, and meaningful interpretation of student performance across age groups and national contexts. The results further highlight how well-designed CT assessment can support instructional decision-making rather than serve solely as a summative measure. The study argues for conceptualising CT assessment as a dynamic and iterative process that links measurement, psychometric validation, and pedagogical use in school education.


Downloadable publication

This is an electronic reprint of the original article.
This reprint may differ from the original in pagination and typographic detail. Please cite the original version.




Funding information in the publication
This work was co-funded by the European Union


Last updated on 22/05/2026 01:58:27 PM