Conducting an empirical study “ICT literacy” using ITEMS

Since 2011, ITEMS has been one of the first projects to be constantly developed and supported by Cap3. The software was developed on behalf of the Kiel Leibniz Institute for Science and Mathematics Education (IPN), which carries out research on teaching and learning.
The ITEMS system makes it possible to create and archive tasks and to carry out tests for empirical educational research. As part of the ICT Literacy Study (Information and Communication Technology, ICT), a unique survey with test subjects from mainstream and special schools will take place in autumn this year. The abilities of 6th-8th graders in terms of their computer-related skills and handling of digital applications are tested, for example, using tasks in Excel, Word and PowerPoint. The tasks can be systematically planned and also empirically evaluated, which is a major advantage for both teachers and researchers. The safe use of the various office software programs is an important skill for learners today and is tested with the help of ITEMS. For example, sorting and summaries can be created in Excel or multiple choice tasks can be edited in Word, which deepens valuable practical experience. Especially for the requirements of the ICT literacy study, Cap3 has implemented the option of collecting process data during task processing. The processing times of the respective test subjects can therefore be calculated for each task or section. In addition, multi-stage tests can be carried out: During the survey, the answers of the test subjects are directly evaluated and the tasks are continuously adapted to the individual level of difficulty.
Plugins that allow you to create your own task types are also new. For ICT Literacy testing, the plugin type was used to simulate interfaces and functions of common office software programs (word processing or spreadsheet), for example. This is a plug-in item type that integrates items into JavaScript, HTML, and CSS.
More information about ITEMS is available here.