In recent years, large-scale international assessments have been increasingly used to evaluate and compare the quality of education across regions and countries. However, measurement variance between different versions of these assessments often posts threats to the validity of such cross-cultural comparisons. In this study, we investigated the cross-language, cross-cultural validity of the Programme for International Student Assessment 2006 Science assessment via three differential item functioning (DIF) analyses between the USA and Canada, Chinese Hong Kong and mainland China, and between the USA and mainland China. Furthermore, we explored three plausible causes of DIF via content analysis, namely language, curriculum and cultural differences. Our results revealed that differential curriculum coverage was the most serious cause of DIF among the three factors we investigated in this study, and differential content familiarity also contributed to DIF here. We discussed the implications of the findings for future international assessment development, and for how to best define 'scientific literacy' for students around the world.
[Copyright of Educational Psychology is the property of Routledge. Full article may be available at the publisher's website:
http://dx.doi.org/10.1080/01443410.2014.946890]

Differential gender performance in standardized mathematics assessment has long been a heated topic. Gender gaps of varied magnitude have been identified on large-scale assessments in the United States. To continue the investigation, this study examined male and female performance on the Programme for International Student Assessment (PISA) 2003 mathematics along four in-depth dimensions (strand, content topics, competency cluster, and item format). Furthermore, to identify the shared and unique patterns of gender differences, students from Hong Kong were brought into the comparison. Males in both counties demonstrated superior performance, particularly on complex multiple choice items. Females scored higher on probability, algebra, and reproduction items. Hong Kong students showed a larger gender gap than U.S. students. However, the within-country gender differences were considered small compared with the significant between-country performance differences. (Some PISA participants are not countries, but education systems representative of countries (e.g., Hong Kong). However, for purpose of simplicity, instead of using "countries/systems" every time, the generic term "countries" was used to refer to countries or systems.) Hong Kong students predominantly outperformed U.S. students, including items that measure complex mathematical reasoning, an area well documented to favor U.S. students.
[Copyright of International Journal of Testing is the property of Lawrence Erlbaum Associates. Full article may be available at the publisher's website: http://dx.doi.org/10.1080/15305050902733547]