Item response analysis of computational thinking practices: Test characteristics and students’ learning abilities in visual programming contexts

Item response analysis of computational thinking practices: Test characteristics and students’ learning abilities in visual programming contexts

• Kong, Siu Cheung The Education University of Hong Kong
• Wang, Yi Qing The Education University of Hong Kong

Computers in Human Behavior, 122, 2021

Elsevier

2021

• C Psychology & Learning
  • CC Motivation of Learning
• F Learning & Teaching
  • FA General Teaching Strategies, Different Instructional Methods

Computational Thinking Education Computational Thinking Practices Item Response Theory Programming Education Test Development and Assessment

• Hong Kong

• 1997.7 onwards

• Primary Education

Computational thinking (CT) practices have gained increasing importance in primary school education. However, there are few tools to measure primary school students' CT practices that are based on rigorous psychometric approaches. This study developed an operational definition for CT practices by exploring the key dimensions of their composition and, more importantly, developed and validated a generic test tool that can effectively assess students’ CT practices. Items to measure CT practices were developed using the evidence-centered design (ECD) approach. These items prompted students to exhibit behaviors that demonstrated their skills in the four dimensions of CT practice, namely testing and debugging, algorithmic thinking, reusing and remixing, and abstracting and modularizing. A test consisting of these items was administered to 13,956 Grade 4–6 primary school students from 56 public schools in Hong Kong. The data were analyzed based on the item response theory (IRT) approach, together with other psychometric tests. A bi-factor three-parameter logistic model was ultimately adopted for test validation, as it fitted the data better than the corresponding two-parameter and one-parameter logistic models. The results validated the four-dimensional structure of the CT practices test. The reliability, test item characteristics, and CT practice abilities of students are also discussed. Copyright © 2021 Elsevier Ltd. All rights reserved.

• English

Journal Articles

• 07475632

• 10.1016/j.chb.2021.106836

https://bibliography.lib.eduhk.hk/bibs/d202e950

2021-07-15