Abstract

Interaction Analysis by Humans and AI: A Comparative Perspective




AuthorsTeimouri, Maryam; Ginter, Filip; Suovuo, Tomi

EditorsN/A

Conference nameACM Interaction Design and Children Conference

PublisherACM

Publication year2025

Book title IDC '25: Proceedings of the 24th Interaction Design and Children

First page 1039

Last page1044

ISBN979-8-4007-1473-3

DOIhttps://doi.org/10.1145/3713043.3731527

Web address https://doi.org/10.1145/3713043.3731527


Abstract

This paper explores how Mixed Reality (MR) and 2D video conferencing influence children’s communication during a gesture-based guessing game. Finnish-speaking participants engaged in a short collaborative task using two different setups: Microsoft HoloLens MR and Zoom. Audio-video recordings were transcribed and analyzed using Large Language Models (LLMs), enabling iterative correction, translation, and annotation. Despite limitations in annotations’ accuracy and agreement, automated approaches significantly reduced processing time and allowed non-Finnish-speaking researchers to participate in data analysis. Evaluations highlight both the efficiency and constraints of LLM-based analyses for capturing children’s interactions across these platforms. Initial findings indicate that MR fosters richer interaction, evidenced by higher emotional expression during annotation, and heightened engagement, while Zoom offers simplicity and accessibility. This study underscores the potential of MR to enhance collaborative learning experiences for children in distributed settings.



Last updated on 2025-02-09 at 11:27