A4 Refereed article in a conference publication

Breakpoints in Iterative Development and Interdisciplinary Collaboration of AI-Driven Automated Assessment




AuthorsHuang, Xiaoshan; Chang, Li-Hsin; Veermans, Koen; Ginter, Filip

EditorsN/A

Conference nameInternational Conference on Information Technology Based Higher Education and Training

Publication year2024

JournalInternational Conference on Information Technology Based Higher Education and Training

Book title 2024 21st International Conference on Information Technology Based Higher Education and Training (ITHET)

Volume21

ISBN979-8-3315-1664-2

eISBN979-8-3315-1663-5

ISSN2380-1603

eISSN2473-2060

DOIhttps://doi.org/10.1109/ITHET61869.2024.10837673

Web address https://ieeexplore.ieee.org/document/10837673

Self-archived copy’s web addresshttps://research.utu.fi/converis/portal/detail/Publication/477920859


Abstract

The rise of AI in education has led to significant advancements, promoting automated grading to reduce educator workload and to enhance pedagogy. However, its integration raises complex pedagogical, ethical, and technical questions. This systematic review examines the intersection of automated grading tool development and educational assessment through the lens of the activity theory. Our analysis, informed by literature since 2010, reveals a critical need for comprehensive evaluation frameworks addressing the iterative nature of technology development and interdisciplinary collaboration. Key breakpoints in existing studies include oversight of the reliability and validity of assessments, ethical considerations, coherent evaluation rules, interdisciplinary collaboration, and agentive and constructive roles of users. Addressing these issues requires a holistic approach that bridges technical and educational perspectives, fostering trust and supporting meaningful learning outcomes. Enhanced collaboration and ongoing professional development are crucial for creating AI-driven assessments.


Downloadable publication

This is an electronic reprint of the original article.
This reprint may differ from the original in pagination and typographic detail. Please cite the original version.





Last updated on 2025-17-04 at 13:51