B3 Non-refereed article in a conference publication
MEASURING ICT SKILLS: RELATIONSHIP OF THE ITEM DIFFICULTY AND CHARACTERISTICS OF TEST ITEMS
Authors: Kaarakainen Meri-Tuulia
Editors: L. Gómez Chova, A. López Martínez, I. Candel Torres
Conference name: 12th International Technology, Education and Development Conference
Publication year: 2018
Journal: INTED proceedings
Book title : INTED2018 Proceedings 12th International Technology, Education and Development Conference March 5th - 7th, 2018 — Valencia, Spain
First page : 1354
Last page: 1363
Number of pages: 10
ISBN: 978-84-697-9480-7
ISSN: 2340-1079
DOI: https://doi.org/10.21125/inted.2018.0023
Web address : https://iated.org/inted/publications
Self-archived copy’s web address: https://research.utu.fi/converis/portal/detail/Publication/29816568
In this paper the test item characteristics and validity of a performance-based test called the ICT skill test were examined. The test is developed to measure the information and communication technology skills of upper comprehensive and upper secondary school students in Finland. The paper offers a brief overview of ICT skills among upper comprehensive school students and examines what kind of effect the item characteristics have on item difficulty. Based on the results, students performed relatively well in items related to social networking and communication, content creation and using productivity software. Instead, the items requiring more technical skills were found to be challengingfor majority of the students. By means of item analysis, the ICT skill test was found to be reliable as a whole and its items being appropriately formed and having acceptable discrimination power. The examination of item characteristics exposed that question text length had no impact on item difficulty. The presence of images and formulas was found to increase item difficulty, whereas UI elements, use of simple text-based multiple-choice questions and on the other hand the possibility to interact with the system were found to decrease item difficulty.
Downloadable publication This is an electronic reprint of the original article. |  |
