Conference Papers
Applications of item response theory to identify and account for suspect rater data
- Applications of item response theory to identify and account for suspect rater data
- AARE 2006 International Education Research Conference: Adelaide: Papers collection
- Melbourne
- Australian Association for Research in Education
- 2007
- Australian Association for Research in Education (AARE). Conference (2006: Adelaide)
- Interrater Reliability Language Proficiency Measurement Techniques Methods Non English Speaking Background Primary School Students Research Methodology Second Language Learning Second Language Teaching Primary Education Year 1 Year 2 Hong Kong Profiles in English as a Second Language (ESL Profiles) Raters
-
- Hong Kong
-
- 1997.7 onwards
-
- Primary Education
- This paper describes a plausible values imputation approach for deriving population estimates on several language proficiency domains. The approach harnessed a multi-dimensional item response analysis combining student responses, rater judgements and student background variables. The target population comprised lower grade primary school students enrolled in the Hong Kong schooling system. The raters were local teachers of English employed within the sampled target schools. The consideration of student background variables in conjunction with student responses and rater judgements facilitated the process of "conditioning" (Reckase, 2002). The primary objective of this research was to impute plausible values for students where no data was provided or where rater data was deemed suspect. By necessity, a secondary objective of this study was to establish rules for justly excluding particular data on the basis of questionable validity. Surveys such as TIMSS, PISA and NAEP have used such "plausible value" methodologies to account for incomplete test designs and person non-response (Beaton & Johnson, 1990; Yamamoto & Kulick, 2000; Adams & Wu, 2002). The point of difference in this study was the use of item response theory (in particular plausible values imputation) to identify and correct for invalid rater judgements in a large-scale educational survey. [Copyright of Australian Association for Research in Education (AARE) at http://www.aare.edu.au]
-
- English
- Conference Papers
-
- 13249320 (CD ROM)
- 13249339 (eISSN)
- https://bibliography.lib.eduhk.hk/en/bibs/7615f9c8
- 2010-11-25
Recent Conference Papers
Conceptualizing and contextualizing innovation for educational change: Exploring the relationship between innovation, leadership, and capacity buildingConference Papers
Sharing of inter- and intra-school ARTS-/ SPORTS-STEM experiential learning activities: Reflections on leadership and ethical issuesConference Papers
Teacher education, agency, and change in a postcolonial Hong Kong: Forms, drivers, and influencesConference Papers
香港小學華語課堂的跨語言實踐研究Conference Papers
華語教育中的跨語言實踐:香港各類中文課程及所面對的挑戰與機遇Conference Papers
華語教育中的跨語言實踐:香港中學課堂一瞥Conference Papers
Researching L2 learner investment: Using techno-reflective narrative interviews in EFL and ESL contextsConference Papers
Cultivating multicultural awareness in Hong Kong: Pre-service teachers' perception on cultural differences in classroomsConference Papers