This demo/poster will report a web-based assessment database funded by a Teaching Development Grant given to the present researcher, who designed and maintained the database and made it freely-accessible to students, teachers, teacher educators and researchers. The purpose of the database is to improve preservice teachers’ language assessment literacy and enhance their skills to design assessment instruments with sufficient quality and variety. The database stores selected language assessment tasks innovated by cohorts of postgraduate and undergraduate TESL students enrolled in the language assessment courses taught by the present researcher in a university in Hong Kong. During the demo/poster, I will present the theoretical framework underlying the design and organization of the database, how the database is integrated into the assessment literacy courses given to pre-service teachers, and an analysis of students’ reflections on their experience of using the database to learn to adapt, design and evaluate assessment tasks, as well as to validate teacher-designed language tests. At the end, I will discuss the project’s implications for language assessment literacy education of pre-service teachers and potential areas of AL research. Copyright © 2020 LTRC.

Blended learning pedagogical practices supported by learning management systems have become an important part of higher education curricula. In most cases, these blended curricula are evaluated through multimodal formative assessments. Although assessments can strongly affect student outcomes, research on the topic is limited. In this paper, we adopted a learning analytics approach to explore student engagement with formative assessments and the power of these assessments to predict student outcomes in an English for Academic Purposes courses in a Hong Kong university. The study retrieved the data logs from 7,815 students and used the data to analyze student engagement with the formative assessments. The results suggested that the students put effort into completing the assessments. The degree to which assessments predict learning outcomes depend on students’ level of subject knowledge and their understanding of the relevance of the assessments. This study showed that learning analytics provided reliable evidence for understanding students’ engagement and identifying at-risk students. Therefore, learning analytics research has the potential to inform pedagogical practice. Copyright © 2022 The Author(s).

This sequential mixed-methods study investigates washback on learning in a high-stakes school exit examination by examining learner perceptions and reported behaviours in relation to learners' beliefs and language learning experience, the role of other stakeholders in the washback mechanism, and socio-educational forces. The focus is the graded approach of the Hong Kong Diploma of Secondary Education English Language Examination (HKDSE-English), incorporated in 2012, that allows test-takers to choose between easier and more difficult sections for reading and listening-integrated skills papers. Inductive coding of focus groups involving 12 secondary students fed into the development of the Washback on Students' Learning questionnaire, which was administered to another 150 learners. Exploratory factor analyses of identified washback effects revealed four major types straddling different settings (classrooms, tutorial schools, learners' personal environment), and seven categories of mediating variables pertaining to learners themselves, other stakeholders, and societal influences. Simultaneous multiple regressions identified influential clusters of mediating variables and showed the strongest predictors for each macro-level washback type varied. At least one intrinsic and one extrinsic factor category significantly contributed to all types, reaffirming learner washback as a socially situated, negotiated construct. Implications related to the consequences, use, and fairness of the graded approach are discussed. Copyright ©2021 SAGE Publications.

As many universities worldwide have incorporated holistic competency development into their course goals, developing assessment literacy in these competencies is placed high on the agenda. Yet, existing literatures on assessment literacy tend to focus on disciplinary knowledge, with little reference to holistic competencies. Based on 29 focus group interviews with 122 students from six universities in Hong Kong, this study first explores the extent to which previous conceptualisations of student assessment literacy also apply to assessing holistic competencies. Findings are subsequently used as a base for discussion towards a new framework of student assessment literacy in holistic competency development which constitutes four dimensions, i.e. knowledge, attitude, action and critique. The renewed framework incorporates features specific to holistic competency assessment, further highlights students' critical engagement with assessment, and understands learners as active agents who exercise discretion in holistic competency assessment. Copyright © 2021 Routledge.

As the content knowledge of English language learners and immigrant students is assessed in their less proficient language, the validity and fairness of assessments related to those students have been widely discussed. However, such assessment issues have not received much attention in rapidly expanding bilingual education programmes, where students learn content subjects through a second/foreign/additional language (L2) and are often assessed in that language. This paper addresses this research gap by examining the mediating effect of language of testing on students’ performance in content subject assessments. 387 question items in the Biology papers of a public examination in Hong Kong were analysed according to their cognitive and linguistic demands. The performance of 480 students (half taking the test in their first language and half in their L2) on the questions with different demands was then analysed with MANOVA and multiple regression. The results show that linguistic demands, especially productive linguistic demands (e.g. writing sentences and texts), had a more significant effect on the performance of students taking the test in their L2. These results underscore the role played by language in the academic achievement of bilingual education students, which in turn illuminate valid assessment design and pedagogy in these programmes. Copyright © 2021 Informa UK Limited, trading as Taylor & Francis Group.

This paper describes Hong Kong’s borrowing, primarily from the UK, of the assessment for learning policy, in the context of prolonged use of formal summative public examinations. The narrative review and analysis are guided by a social positivist critique of the assessment for learning policy in the Hong Kong context. This paper concludes that Hong Kong’s attempts to implement assessment for learning are ambitious but somewhat futile because of persistent use of public examinations for important decision-making. Change in Hong Kong may only happen through a gradual implementation of assessment for learning practices that takes into account cultural, societal, and historic norms. Critical issues are identified and recommendations are proposed for further implementation of assessment for learning in Hong Kong. Copyright © 2021 Elsevier Ltd.

In alignment with the New Academic Structure, the Hong Kong Diploma of Secondary Education Examination (HKDSE) was launched in 2012 to replace the former Hong Kong Certificate of Education Examination (HKCEE) as certification for completion of secondary education, and the Hong Kong Advanced Level Examination (HKALE) as the main credentials for university admission in Hong Kong. Standards-referenced reporting is adopted for the HKDSE with the objective of reporting candidates' results against a set of prescribed levels of achievement based on typical performances at those levels. Clearly defined standards facilitate learning and teaching as well as enable users of the qualification, including tertiary institutions and employers, to set appropriate entrance/job requirements. The standards are set and maintained by expert judgement supported by psychometric data to ensure fairness and consistency of standards across subjects and across cohorts. Systemic and implementation issues and their resolutions are discussed in the context of the education reform in Hong Kong. Copyright ©Routledge.

In Content and Language Integrated Learning (CLIL) programmes, students learn content knowledge and a second/foreign language (L2) simultaneously. It follows that both content and language are assessed, although research on how to do so remains scarce. This study explores the interplay between cognitive and linguistic demands of CLIL assessments. Having analysed over 4900 questions in Science/Biology textbooks, workbooks and examination papers in Hong Kong, we observed that junior secondary assessments were dominated by low-level cognitive (i.e. recall of knowledge) and linguistic (i.e. no production or word-level production) demands, whereas senior secondary assessments required higher-order thinking skills (i.e. application and analysis of knowledge) expressed in sentences or even texts. Also, based on the analysis of 70 junior secondary students' performance in school examination papers, we noticed a potential hindrance of linguistic demands to students' performance in CLIL assessments. These findings together underscore the integral role of language in CLIL assessments and raise questions about the adequacy of existing pedagogical practices in preparing students to tackle both cognitive and linguistic demands in CLIL assessments, particularly when they proceed to higher grade levels where the demands in both dimensions leap. These have significant implications for CLIL assessment design, pedagogy and teacher education. Copyright ©Routledge.

This paper aims to report a case study of exploring the effect of "assessment for learning" on improving student learning and facilitating teachers' professional development in the examination-oriented context of Hong Kong. By adopting Variation Theory of the Lesson Study approach, data were collected through pre- and post-tests, interviews with students and teacher participants and observation field-notes in order to help diagnose students' learning difficulties and provide evidence for teachers to refine their teaching strategies to enhance students' learning effectiveness. The students' improvement in learning performance informed the teacher participants of the usefulness of 'assessment for learning' in the classroom. Copyright © Sage Publications Ltd.

The study examined the factor structure, reliability and validity of a Chinese version of the Constructivist Learning Environment Survey (C-CLES), an instrument for assessing students' perceptions of the extent of constructivist approaches prevalent in classrooms. A convenience sample of 967 students in Secondary Three (Grade 9) in Hong Kong participated in this study by completing a self-administered questionnaire in their class time. Exploratory and confirmatory factor analyses supported the hypothesised factor structure, indicating five theoretical constructivist environment dimensions that showed goodness-of-fit to 25 items: Personal Relevance, Uncertainty, Critical Voice, Shared Control, and Student Negotiation. Criterion-related validity, involving evidence based on relations to other variables, was assessed by correlations between the constructivist environment dimensions and cognitive strategies and academic ability. Most correlations were statistically significant and in the positive direction. The C-CLES with 25 items provides a useful measure for educational practice and research among school students. Copyright © Springer.