AQA on-screen assessment pilots: insights from focus groups

Abstract

This report presents research findings from AQA’s first series of summative on-screen assessment (OSA) pilots, which took place during April to May 2022 and featured tests in GCSE English Language, GCSE Science (Biology and Chemistry) and GCSE Mathematics.

The objective of the research study was to investigate teachers’ perspectives on OSA and the OSA delivery process, and to evaluate students’ experiences of interacting with OSA items. Interviews and focus groups were held in respect of each subject and a thematic analysis of the data was carried out.

Participants reported that adequate preparation, ideally from Year 7 onwards, and improved infrastructure would be essential in advance of any digital exams being introduced. With regard to the functionality of OSA, there was mixed feedback, with some elements viewed positively (eg in English, the facility to highlight text) and others seen as problematic (eg difficulty inputting symbols when responding to maths items). Fairness also emerged as an important concern, with students and teachers keenly aware of the digital divide and the potential for students who have less access to technology and resources to be placed at a disadvantage when it comes to high-stakes OSA.