MEASURING ICT SKILLS: RELATIONSHIP OF THE ITEM DIFFICULTY AND CHARACTERISTICS OF TEST ITEMS
: Kaarakainen Meri-Tuulia
: L. Gómez Chova, A. López Martínez, I. Candel Torres
: 12th International Technology, Education and Development Conference
: 2018
: INTED proceedings
: INTED2018 Proceedings 12th International Technology, Education and Development Conference March 5th - 7th, 2018 — Valencia, Spain
: 1354
: 1363
: 10
: 978-84-697-9480-7
: 2340-1079
DOI: https://doi.org/10.21125/inted.2018.0023(external)
: https://iated.org/inted/publications(external)
: https://research.utu.fi/converis/portal/detail/Publication/29816568(external)
In this paper the test item characteristics and validity of a performance-based test called the ICT skill test were examined. The test is developed to measure the information and communication technology skills of upper comprehensive and upper secondary school students in Finland. The paper offers a brief overview of ICT skills among upper comprehensive school students and examines what kind of effect the item characteristics have on item difficulty. Based on the results, students performed relatively well in items related to social networking and communication, content creation and using productivity software. Instead, the items requiring more technical skills were found to be challengingfor majority of the students. By means of item analysis, the ICT skill test was found to be reliable as a whole and its items being appropriately formed and having acceptable discrimination power. The examination of item characteristics exposed that question text length had no impact on item difficulty. The presence of images and formulas was found to increase item difficulty, whereas UI elements, use of simple text-based multiple-choice questions and on the other hand the possibility to interact with the system were found to decrease item difficulty.
UTU Research Portal