The study explores the unaddressed washback on the English-speaking test of the Hong Kong Diploma of Secondary Education Examination (HKDSE-English Language Paper 4). The HKDSE is a university entrance exam in Hong Kong which includes a group discussion speaking test known as English Language Paper 4. To identify ongoing washback effects, including sociocultural perspectives, the study analyses ongoing student washback of test-specific and non-specific preparation and how the mediating factors affect these preparations. One-hundred and ninety-nine secondary 4th to 6th grade students provided the questionnaire data in two rounds. Results from exploratory factor analysis indicate six major types of test preparation, which are categorised as two test specific, three non-specific, and one integrated type of preparation. Mediating factors comprise five categories of learner characteristics and stakeholders in and out of school. The cluster analyses identified four students' groups intertwined with the involvement of washback and the mediating factors. A strong relationship between extrinsic factors and explicit learning and intrinsic factors and implicit learning was found. The study concludes that students' washback is affected by mediating factors aside from the test; learning method choice by students (e.g. learning from entertainment content) has a strong relationship with specific mediating factors (e.g. interest in English). Copyright © 2023 Springer Nature.

Despite the increasing use of virtual modalities in schools since the COVID-19 pandemic, no systematic tools exist to evaluate the process of online learning. We developed and validated an Online Learning Process Questionnaire (OLPQ) for assessing online at-home learning among 219 Hong Kong primary-school students and 474 caregivers. Exploratory and confirmatory factor analyses of caregivers' data classified the 58-item OLPQ into 11 subscales: (1) learning aims, (2) environmental structuring, (3) learning environment, (4) time management, (5) engagement in learning activities, (6) persistence, (7) interaction between teachers and students, (8) interaction among students, (9) feedback from the interface, (10) application of learning, and (11) meaning of learning under three learning phases. Confirmatory factor analysis of students' data further categorized the 11-subscale framework into three learning phases: preparatory, performance, and transfer. The OLPQ demonstrated excellent reliability and discriminant validity across caregiver (Cronbach's alpha = 0.98) and student samples (alpha = 0.98). These findings indicate that the OLPQ is a valid and reliable instrument for assessing the online at-home learning process among both students and their caregivers. Copyright © 2023 Springer Nature.

Despite the increasing popularity of online learning in elementary and primary schools, it is unclear to which extent that students' attitudes toward online learning influence their learning progress and outcomes. In this study, the Online Learning Attitude Questionnaire (OLAQ) was developed and validated to measure students' online learning attitudes among 383 caregivers and 172 primary school students in Hong Kong. The caregiver data were analysed using exploratory and confirmatory factor analysis, and reliability analysis to establish the factor structure, reliability. and discriminant validity of the OLAQ questionnaire. The student data were analyzed using confirmatory factor analysis and reliability analysis to cross-validate the factor structure and confirm the reliability and discriminant validity of the OLAQ. The final 34-item OLAQ questionnaire comprises five subscales including (1) enjoyment, (2) development, (3) motivation, (4) utilization, and (5) anxiety. These results indicate that the OLAQ is a valid and reliable instrument for assessing primary school students' attitudes toward online learning. Copyright © 2023 Taylor & Francis.

Synchronous online teaching through video-conferencing software (VCS) has become a common mode of instruction during the COVID-19 pandemic. This mode brings unique challenges for teachers that require specific professional digital competences. One such challenge is conducting formative assessment. Through the use of in-depth interviews with nine Hong Kong university teachers who had taught synchronously online for one semester, this exploratory study explored the challenges of conducting formative assessment during synchronous online lessons and the strategies teachers deploy to conduct formative assessment. The findings indicate that the key difficulties include gathering information on students' needs, checking students' understanding, giving individual feedback, and building relationships with students. To address these challenges, the teachers suggested four pedagogical strategies: (1) Combine synchronous with asynchronous approaches; (2) Utilise breakout rooms; (3) Utilise poll functions of the VCS and combine it with other online platforms; and (4) Provide time before or after lessons for informal conversations. The findings suggest that teachers need to develop specific pedagogical strategies to conduct formative assessment. This provides an initial conceptualisation of one important dimension of Professional Digital Competence, teaching using digital technologies, and one aspect of that dimension, how teachers use digital tools and strategies to conduct formative assessment. Copyright © 2023 Taylor & Francis.

Purpose: This study aims to examine the impact of the transformation of an assessment on students' performance and perspectives in an English for Academic Purposes course in Hong Kong. The assessment was changed from the traditional pen-and-paper mode to an unproctored online mode. Design/methodology/approach: Using mixed methods, the research team analysed the differences between the assessment performances of those who took the course before the pandemic (n = 664) and those who took it during the pandemic (n = 702). Furthermore, focus group interviews were conducted with seven students regarding their perspectives on the unproctored assessment. Findings: The results revealed that, although there were no major differences in the overall grades of the two groups, students who were assessed online during the pandemic performed significantly better in terms of their English use. Nevertheless, the shift to online assessment had several negative effects on the students. Originality/value: Previous studies on unproctored online assessments (UOA) were concerned with potential learning quality issues, such as plagiarism and grade inflation. This study, however, provided empirical evidence that high-quality assessment delivery can be provided via UOA if the question types and assessment arrangements are carefully decided. Copyright © 2023 Emerald.

Despite research studies on TESOL materials and textbooks addressing a wide range of pedagogical issues as well as evaluation strategies, reference books for examination preparation have received little attention from TESOL researchers. This study reports an attempt to develop a checklist for evaluating the reference books for the examination for the Hong Kong Diploma of Secondary Education (HKDSE, the college entrance requirement for secondary school students in Hong Kong), with a particular focus on books for the English writing examination. The researchers acquired a total of 39 reference books on DSE English writing and examined them against the reports and documents of the Hong Kong Examinations and Assessment Authority as well as the Education Bureau. After identifying the most concerning issues in the reference books, the researchers developed a checklist for evaluating future reference books using the framework suggested by McGrath (2002), taking into account the Education Bureau's guidelines for local school textbook evaluation. The authors conclude by briefly discussing implications and how their findings could be shared with HKDSE candidates through engaging the Hong Kong government. Copyright © 2023 Wiley-Blackwell.

Research reveals that generic skills are essential for supporting students to not only finish school education but also achieve transition to the workplace and adult life. However, a comprehensive literature review found limited studies have been done to develop an assessment tool for examining the generic skills of students with special educational needs (SEN). Based on two sub-studies, the current study aimed to develop a short form of the Generic Skills Teacher-Rating Scale (GSTS) to assess six generic skills (i.e., Collaboration, Communication, Problem-solving, Self-management, Information Technology, Critical thinking) of SEN students. A total of 231 Hong Kong students from six special schools (including primary and secondary levels) participated in the two studies. Both CFA and Rasch analyses support a six-factor solution of the GSTS with reasonably good model fit indices. Researchers and educators may view the GSTS as an assessment tool, adding more information on SEN students’ generic skills beyond classroom settings to understand the daily-life functioning of students in special education and inclusive education settings. Implications of the results and future directions are also discussed. Copyright © 2022 The Special Education Society of Hong Kong Ltd.

This study investigated how English learners complete multimodal formative quizzes. Participants included 17,950 students enrolled in a mandatory English for Academic Purposes course at a university in Hong Kong. We retrieved data from Blackboard, a learning management system, and conducted a two-step cluster analysis to examine student self-regulated learning (SRL) profiles with the quizzes. We first identified five clusters of learners with distinctively different self-regulated learning patterns. Then, we performed a multivariate analysis of variance (MANOVA) to further explore their differences in SRL, in terms of start day, days started before deadline, differences in scores between first and last attempt, and scores in language learning activities. Our findings echoed those of previous studies on the relationship between self-regulated learning and academic success. This research enables us to better understand the needs of EAP students in Hong Kong. Copyright © 2023 International Forum of Educational Technology & Society.

Successful implementation of formative assessment in classrooms relies on teachers’ formative assessment literacy, which is typically supported by professional development programs. This study reports on the impact of a professional development program on a group of in-service primary teachers in Hong Kong. The authors investigated the effectiveness of the program in developing teachers’ formative assessment literacy and how far the program assisted them in addressing the challenges they faced when implementing formative assessment in classrooms. With a mixed-method design, quantitative data were collected with a pre- and post-program survey (N = 27); qualitative data were collected with open-ended survey questions and a focus group with six participating teachers. The results provide evidence of the program’s success in developing teachers’ formative assessment literacy and equipping them with the necessary skills to address the challenges in implementation. The features of professional learning communities embedded in the program contributed to the positive impact of the program. Copyright © 2023 Teacher Development.

Few studies have explored primary school teachers’ e-assessment practices in conditions of emergency remote teaching caused by the COVID-19 lockdowns. This study explored Hong Kong primary school teachers’ e-assessment practices during the fifth wave of the COVID-19 pandemic from late January to March 2022, when all primary schools were closed and transitioned rapidly to online teaching. 48 teachers from different schools were individually interviewed. The participants reported a variety of e-assessment practices, which were categorised into three types: e-tests/exercises, alternative e-assessments and e-teacher feedback. It was found that participants cautiously approached e-tests for summative purposes but majorly for formative purposes. It was also found that the participants less frequently used alternative e-assessments and tried out e-feedback. The participants’ e-assessment practices were influenced by their own conceptions of the usefulness of e-assessment, others’ attitudes towards its use, and perceived behavioural control. Crises such as pandemics and climate disasters will inevitably disrupt education again in the future. The findings of this study encourage policy makers, researchers and teachers to rethink the purposes and process of e-assessment in primary classrooms, thus sustaining, deepening and focusing on learning in the ‘new normal’. COVID-19 pandemic provides an opportunity to break away from content-heavy summative assessment and to make effective use of technology to enhance formative assessment. Copyright © 2023 ICLT.