A4 Refereed article in a conference publication
Code reviews in C++: Preliminary results from an eye tracking study
Authors: Florian Hauser, Stefan Schreistter, Rebecca Reuter, Jürgen Horst Mottok, Hans Gruber, Kenneth Holmqvist, Nick Schorr
Editors: Andreas Bulling, Anke Huckauf, Eakta Jain, Ralph Radach, Daniel Weiskopf
Conference name: ACM Symposium on Eye Tracking Research and Applications
Publisher: Association for Computing Machinery
Publication year: 2020
Book title : ETRA '20 Short Papers: ACM Symposium on Eye Tracking Research and Applications
Journal name in source: Eye Tracking Research and Applications Symposium (ETRA)
First page : 1
Last page: 5
ISBN: 978-1-4503-7134-6
DOI: https://doi.org/10.1145/3379156.3391980
Code reviews are an essential part of quality assurance in modern software projects. But despite their great importance, they are still carried out in a way that relies on human skills and decisions. During the last decade, there have been several publications on code reviews using eye tracking as a method, but only a few studies have focused on the performance differences between experts and novices. To get a deeper understanding of these differences, the following experiment was developed: This study surveys expertise-related differences in experts’, advanced programmers’, and novices’ eye movements during the review of eight short C++ code examples, including correct and erroneous codes. A sample of 35 participants (21 novices, 14 advanced and expert programmers) were recruited. A Tobii Spectrum 600 was used for the data collection. Measures included participants’ eye movements during the code review, demographic background data, and cued retrospective verbal comments on replays of their own eye movement recordings. Preliminary results give proof for experience-related differences between participants. Advanced and expert programmers performed significantly better in case of error detection and the eye tracking data implies a more efficient reviewing strategy.