Assessment

Digital exams: A chance to make assessment more accessible for all

A recent symposium on inclusive educational assessment at Hughes Hall, Cambridge, attracted experts from across the country. AQA lead researcher Dr Katy Finch was in the audience listening to leading academics from the fields of social exclusion, autism, dyslexia and neurodiversity. In this blog, Dr Finch draws on ideas discussed that day to deliberate on the opportunities digitising assessment offers those facing barriers in mainstream education and asks: Can we use Digital Exams as a chance to make assessment more inclusive for everyone?

Date16/11/23

AuthorDr Katy Finch

Digital exams are a chance for something new to emerge
Photo: Bankim Desai/Unsplash

As part of AQA’s team working on accessibility in assessment, I leapt at the opportunity to attend this symposium at Hughes Hall and listen to a pool of acknowledged experts including Professors Bryan Maddox, Nidhi Singal and Dr Paul Englehardt.

Having so many people invested in the field in one room led to interesting and well-informed discussion.

It left me with the realisation that, although digitising exams is a major point in the evolution of assessment for all students, for those with SEND it can be a game changer.

Digitising exams is an opportunity to build in accessibility for students with SEND

At the moment, diversity is viewed as a hurdle to be overcome by students who fall outside of the mainstream categories.

The advent of digital exams and the process of redesigning papers for that format is a tremendous opportunity to change that.

Our assessment experts will test every item’s layout, language and style to measure their accessibility when students use keyboard and mouse to interact with them on screen.

As Professor Nidhi Singal said, we can use this moment to ensure diversity and accessibility is built in rather than added on.

That way students with special needs or who face other barriers, such as linguistic ones, will have a better exam experience.

Monitoring how students work on-screen can improve assessments for SEND groups

Digital exam platforms will give us access to a wealth of data that traditional paper exams cannot.

Sophisticated eye-tracking software can see exactly how students work on screen.

Dr Englehardt’s work showed that while those with dyslexia may require longer to complete reading tasks than non-dyslexics, giving them extra time may not necessarily end with a correct answer.

His eye-tracking programs showed that those with dyslexia have twice as many fixations on a single word as those without; they re-read words more often and look at words for longer periods.

Ambiguous sentences and metaphors emerged as particularly problematic.
This showed that these students may not only have issues with their working memory and processing words mentally (phonological processing), but also ascribing meaning to those words (semantic processing).

This new research reinforces the need for removing low-frequency words and unnecessary metaphors by showing how the SEND cohort in particular will benefit from those adjustments.

Digital exams can have a range of accessibility features in-built

At the moment, many students with SEND are given extra time to complete their exams.

Dr Yasmine El Masri found 65% of all access arrangements are extra time, but many students do not have a chance to practise using it.

Is asking those who find reading or writing difficult to do it for longer the best solution?

Will they suffer from fatigue? Are other solutions such as different types of rest breaks, increasing font size or using subtitles more effective?

Digital exams, unlike the traditional paper format, can record exactly how students work through an assessment.

For example, if a paper is unfinished, we can see if the student ran out of time or were unable to answer questions.

Assessment designers will pore over this data and help us see beyond extra time as a fix all.

It can inform decisions about using accessibility features such as screen readers, subtitles, colour schemes or font sizes.

With all the aids at their disposal, students with SEND and their teachers have the opportunity to choose which is most suitable.

Beyond that, all students, regardless of diagnosis or condition, can have more influence over how assessments meet their needs.

The current system where assessments are designed for mainstream access then modified for students with additional needs can be very complex.

Those with the same condition may have differing needs while those with different conditions may have similar needs.

My take-away from the symposium

The introduction of digital assessment is a key opportunity to embed accessible design for all, increase student autonomy and give those in assessment greater insight into how young people interact with exams.

But as Professor Bryan Maddox cautioned, this is not the complete solution and we have to continue analysing and adapting assessments to keep improving students’ experience.

Assessment

Assessing oracy: Is Comparative Judgement the answer?

Oracy skills are vital to success in school and life. And yet, for many children, opportunities to develop them are missed. Educationalists are engaging in a growing debate about where oracy fits into the school system. Labour has put it at the heart of its plans to improve social mobility and an independent commission is looking at how it is taught in the classroom. This renewed focus on oracy means it is more important than ever that teachers have a way to reliably assess and understand their students’ attainment and progression. Amanda Moorghen of oracy education charity Voice 21 explains how Comparative Judgement can help with that and why it may be a game changer.

Education

TV subtitles as an aid to literacy: What does the research say?

Jack Black is probably best known in educational circles for playing a renegade substitute teacher in School of Rock. But the Hollywood star has made a more conventional foray into education by backing the use of TV subtitles to improve child literacy. Stephen Fry and the World Literacy Foundation also want parents to use their TV remotes to get children reading. So, could this simple click of a button be a solution to boost pupils’ reading skills? AQA’s resident expert on language teaching, Dr Katy Finch, casts her eye over the research to see whether it stacks up.

Data Analysis

What is left behind now education’s Data Wave has receded?

Is data the solution to all education’s issues? About a decade ago the prevailing wisdom said it was. Advocates of this Data Wave argued that harvesting internal statistics would help schools solve issues such as teacher accountability and attainment gaps. As with all waves, after crashing onto the beach they recede, leaving space for another to roll in. In this blog, teacher, author and data analyst Richard Selfridge looks at the legacy of the Data Wave to see what schools can take from it.

International Approaches

Finland & PISA – A fall from grace but still a high performer?

Finland was once recognised as one of the most successful educational systems in the world. At the turn of the millennium, it topped the PISA rankings in reading, maths and science. But by 2012, decline set in. The last set of results showed performances in maths, reading and science were at an all-time low. In this blog Dr Jonathan Doherty of Leeds Trinity University outlines some reasons that may account for the slide.

Briefing

PISA, TIMSS and PIRLS: What actually are they and what do they tell us?

According to the latest PISA results, England’s science scores are still on a downward trajectory that started a decade ago. Yet TIMSS, another respected study, has science performances rising. Which of them is right? Is one more valid than the other? In this blog AQi examines three International Large-Scale Assessments and finds that, although they may look the same from a distance, get up close and you’ll find they are very different beasts.

Adaptive Assessment

Adaptive Assessment: A missing ingredient in the resit recipe?

The number of students resitting their maths GCSE is growing, but the proportion getting a grade 4 or higher is falling. This situation is not only dispiriting for the young people striving to get the qualifications they need, but also for the teachers working hard to help them. How can outcomes for this cohort be improved? Bart Crisp, associate director at the Centre for the Use of Research and Evidence in Education, thinks adaptive assessment may be part of the solution.

SEND

Student success: Every milestone matters

Baroness Morgan is calling for students to be given ‘self-belief’ lessons as a way of developing their characters and preparing them for the future. She is not the first to notice that a student’s sense of their own ability and their level of success are part of a virtuous circle. But how can teachers get the snowball rolling for students with SEND or in alternative provision? In this blog, former headteacher, John Tomsett, pulls out a swimming certificate he earned more than half a century ago to use as an inspiration for others.

Assessment

Progress 8 – How much can it flex?

Progress 8 has come in for criticism in recent months for the way it combines with the Ebacc to skew schools’ focus towards academic subjects at the expense of creative and technical options. Both Labour and a Lords committee have called for reform to boost uptake of declining subjects such as D&T, dance and drama. In the second of two blogs looking at Progress 8, AQi examines whether the accountability measure could be realigned to address these concerns and if so, how could that be done?

Assessment

Progress 8 – Schools’ flexible friend?

Eight years after Progress 8 came into existence it is facing calls to be updated. Some say reforming the schools accountability measure can halt the decline in take up of the arts, while others want it to boost numbers taking vocational and technical subjects. Are its shoulders broad enough to take on such a load? In the first of two blogs on Progress 8, AQi looks at how it came into being, what problems it was designed to solve and whether it is flexible enough to be reformed.

Assessment

2023: A year in review

As we wrap up a year full of exciting developments in education, it is the perfect time to take stock of what has gone on. In this blog, editor of AQi, Anil Dawar, reflects on some of his highlights for 2023.

Download a PDF version.

Download a copy of this content to your device as a PDF file. We generate PDF versions for the convenience of offline reading, but we recommend sharing this link if you'd like to send it to someone else.

Digital exams: A chance to make assessment more accessible for all

Digitising exams is an opportunity to build in accessibility for students with SEND

Monitoring how students work on-screen can improve assessments for SEND groups

Digital exams can have a range of accessibility features in-built

My take-away from the symposium

Assessing oracy: Is Comparative Judgement the answer?

TV subtitles as an aid to literacy: What does the research say?

What is left behind now education’s Data Wave has receded?

Finland & PISA – A fall from grace but still a high performer?

PISA, TIMSS and PIRLS: What actually are they and what do they tell us?

Adaptive Assessment: A missing ingredient in the resit recipe?

Student success: Every milestone matters

Progress 8 – How much can it flex?

Progress 8 – Schools’ flexible friend?

2023: A year in review

Join the conversation on Twitter

Download a PDF version.

Sign up to our newsletter