Implication of misfit items in Rasch Measurement for item setting: A case study in mathematics in a primary school

Implication of misfit items in Rasch Measurement for item setting: A case study in mathematics in a primary school

• Lau, Ching Heung The Hong Kong Institution of Education
• Chan, Sok Ching The Hong Kong Institution of Education
• Mok, Magdalena Mo Ching The Hong Kong Institution of Education

2006

Asia-Pacific Educational Research Association (APERA) International Conference 2006: Educational Research, Policy and Practice in an Era of Globalization (2006: The Hong Kong Institute of Education, Hong Kong)

• L Educational Measurement & Evaluation
  • LC Academic Achievement Tests
• G Curriculum, Teaching & Learning: Specific Disciplines
  • GC Mathematics & Statistics
• Q Philosophy of Education, Educational System & School At Different Levels
  • QC Primary Education

Educational Evaluation Primary Education

• Hong Kong

• 1997.7 onwards

• Primary Education

Learning is the focus of attention for any educational enterprise. Consequently, the quality of assessment of the extent to which learning has occurred is of crucial importance. Assessment plays an important role in education in Hong Kong as in other places. Nevertheless, how to design an assessment that is of high quality, or how to fully utilize the results of the assessment to understand more deeply about the ability of our students is a demanding task for most teachers. It is not uncommon for teachers to assume that those students who cannot get good assessment results are weak students or that they have learning problems. Teachers rarely question the quality of assessment items to be the source of problems. In other words, teachers seldom consider the possibilities that the items may be too difficult, or unsuitable for the students' levels. In fact, it is worth investigating both the students' and items' performances for the assessments in order to understand more about the ability of our students. Under such circumstances, Rasch Measurement Model is a tool that teachers may consider to assist them for interpreting and analyzing the alignment between student ability and assessment item difficulty. In Rasch modelling, the data are checked, using a set of procedures and criteria, for the extent to which they match with the theoretical model. In particular, the point-measure correlations, and the INFIT and OUTFIT statistics are used to assess the goodness of fit between model and data. This study aims to illustrate how teachers can make use of these statistics from Rasch modelling to support them in the implementation of learning oriented assessment. The study will be based on assessment data obtained from two classes of Primary Three Students in a local school in July 2006. In the study, we will focus on the implication of misfit persons and items by using Rasch Measurement Model so as to discuss ways for understanding our students and improving the items and setting process in designing assessment tasks.

Paper presented at the Asia-Pacific Educational Research Association (APERA) International Conference 2006: Educational Research, Policy and Practice in an Era of Globalization, The Hong Kong Institute of Education, Hong Kong.

• English

Conference Papers

https://bibliography.lib.eduhk.hk/bibs/fcf5218b

2015-02-25