Abstrakti

Interaction Analysis by Humans and AI: A Comparative Perspective




TekijätTeimouri, Maryam; Ginter, Filip; Suovuo, Tomi

ToimittajaN/A

Konferenssin vakiintunut nimiACM Interaction Design and Children Conference

KustantajaACM

Julkaisuvuosi2025

Kokoomateoksen nimiIDC '25: Proceedings of the 24th Interaction Design and Children

Aloitussivu1039

Lopetussivu1044

ISBN979-8-4007-1473-3

DOIhttps://doi.org/10.1145/3713043.3731527

Verkko-osoitehttps://doi.org/10.1145/3713043.3731527


Tiivistelmä

This paper explores how Mixed Reality (MR) and 2D video conferencing influence children’s communication during a gesture-based guessing game. Finnish-speaking participants engaged in a short collaborative task using two different setups: Microsoft HoloLens MR and Zoom. Audio-video recordings were transcribed and analyzed using Large Language Models (LLMs), enabling iterative correction, translation, and annotation. Despite limitations in annotations’ accuracy and agreement, automated approaches significantly reduced processing time and allowed non-Finnish-speaking researchers to participate in data analysis. Evaluations highlight both the efficiency and constraints of LLM-based analyses for capturing children’s interactions across these platforms. Initial findings indicate that MR fosters richer interaction, evidenced by higher emotional expression during annotation, and heightened engagement, while Zoom offers simplicity and accessibility. This study underscores the potential of MR to enhance collaborative learning experiences for children in distributed settings.



Last updated on 2025-02-09 at 11:27