Adaptive Assessment

Adaptive Assessment: A missing ingredient in the resit recipe?

The number of students resitting their maths GCSE is growing, but the proportion getting a grade 4 or higher is falling. This situation is not only dispiriting for the young people striving to get the qualifications they need, but also for the teachers working hard to help them. How can outcomes for this cohort be improved? Bart Crisp, associate director at the Centre for the Use of Research and Evidence in Education, thinks adaptive assessment may be part of the solution.

Date13/02/24

AuthorBart Crisp

Photo: Akhilesh Sharma/Unsplash

What is the issue with resits?

In the last November GCSE resits, just under 61,000 students sat maths after previously falling short of a good pass (Grade 4). Of those, about 14,000 (less than a quarter) reached that mark second time around.

That leaves a very significant number still without a ‘good pass’ in GCSE maths.

This does not mean that they are unable to get a Grade 4 or that their teachers have failed them.

But it does show that the resit system could be substantially improved.

One way in which that could be done is by using Artificial Intelligence for formative assessment from the outset of any resit course.

Source: JCQ

What added difficulties do resit students and their teachers face?

While I was with the Centre for Education & Youth, we and Warwick University looked at the post-16 cohort involved in resitting GCSE maths in Further Education, and found that the deck is stacked against learners doing resits.

There are two particularly important factors at play here.

The impact of learning environment and motivation on resits

Firstly, these students, who frequently need additional support (many are eligible for Free School Meals, face language barriers, or have SEND), are further hindered by the disruption of moving to a new learning environment.

Secondly, they may lack the motivation to continue with a subject where they have already been deemed “failures”.

Both these factors become heightened if a student, who may only need help in one or two specific areas, has to revisit topics they already understand instead of those they really need to focus on.

Can not knowing students' strengths and weaknesses hamper teachers?

For teachers tasked with helping these students get the right grade, the situation is similarly constrained.

A study showed that the FE sector is struggling to recruit and retain appropriately qualified staff.

When FE maths teachers enter the classroom at the beginning of the new academic year, they will be greeted by maybe 30 new faces, each with their own preferences, knowledge gaps and motivations.

Given that disadvantaged and students with SEND make up a disproportionately high number of resit entries – 39% of this group as opposed to representing 26% of total students – and that those with SEND are around 40% less likely to get a ‘good pass’ in maths, teachers will also have to adapt their teaching to meet the needs of these students.

This is more difficult for the less experienced.

The prospects for greater funding to improve this situation anytime soon appear slim.

Can Adaptive Assessment aid students and teachers involved in resits?

However, there is hope that new technology, in particular Artificial Intelligence, will give educators more “bang for their buck” in terms of impact.

The CfEY’s research found that teachers believe technology could be a key aid for understanding their students’ needs and therefore improve learning outcomes.

In the last year there has been a massive shift in the accessibility and use of tools which can process information with minimal direction, including establishing the baseline of where students are at.

Adaptive assessment could be used to overcome the “resit” issue and be a huge boon to busy educators.

How does Adaptive Assessment work?

The way this works is that students sit a digital assessment which begins with a random selection of mid-difficulty questions across the range of topics within a given subject.

The student’s responses allow the AI to make an initial assessment of their proficiency.

From there the difficulty of the questions are set in relation to that estimate so that they are challenging but not too difficult.

That challenge level is constantly being reassessed based on the student's responses to previous questions.

At the end of the assessment, the teacher will have a solid idea of the student’s ability level, and their knowledge gaps clearly identified.

How do teachers use Adaptive Assessment results?

The teacher can then set about devising a learning plan that clearly focuses on the areas where the student needs it, rather than a scatter gun approach.

However, it is important to note that while technology can support good teaching, it cannot replace it.

We must never forget that teachers are the ones who implement educational strategies and interventions.

For this to be done effectively, there needs to be consistent Continuing Professional Development support, including for assessment for learning.

This was something the FE teachers we spoke to said they struggled to access.

Teachers need support to get the best out of Adaptive Assessment

AI can help them, as long as they are given good support through CPD to understand how to use a strategy or intervention effectively.

Most importantly, AI must be shown to be a tool to support, not replace them.

Bart Crisp is an expert in teacher professional development, school development and literacy.

As part of AQi’s work, we are inviting people from a wide range of viewpoints to engage with us on a wide range of topics. We welcome alternative views to help stimulate discussion and ideas. The views of external contributors do not necessarily represent the views of AQi or AQA.

Assessment

Assessing oracy: Is Comparative Judgement the answer?

Oracy skills are vital to success in school and life. And yet, for many children, opportunities to develop them are missed. Educationalists are engaging in a growing debate about where oracy fits into the school system. Labour has put it at the heart of its plans to improve social mobility and an independent commission is looking at how it is taught in the classroom. This renewed focus on oracy means it is more important than ever that teachers have a way to reliably assess and understand their students’ attainment and progression. Amanda Moorghen of oracy education charity Voice 21 explains how Comparative Judgement can help with that and why it may be a game changer.

Education

TV subtitles as an aid to literacy: What does the research say?

Jack Black is probably best known in educational circles for playing a renegade substitute teacher in School of Rock. But the Hollywood star has made a more conventional foray into education by backing the use of TV subtitles to improve child literacy. Stephen Fry and the World Literacy Foundation also want parents to use their TV remotes to get children reading. So, could this simple click of a button be a solution to boost pupils’ reading skills? AQA’s resident expert on language teaching, Dr Katy Finch, casts her eye over the research to see whether it stacks up.

Data Analysis

What is left behind now education’s Data Wave has receded?

Is data the solution to all education’s issues? About a decade ago the prevailing wisdom said it was. Advocates of this Data Wave argued that harvesting internal statistics would help schools solve issues such as teacher accountability and attainment gaps. As with all waves, after crashing onto the beach they recede, leaving space for another to roll in. In this blog, teacher, author and data analyst Richard Selfridge looks at the legacy of the Data Wave to see what schools can take from it.

International Approaches

Finland & PISA – A fall from grace but still a high performer?

Finland was once recognised as one of the most successful educational systems in the world. At the turn of the millennium, it topped the PISA rankings in reading, maths and science. But by 2012, decline set in. The last set of results showed performances in maths, reading and science were at an all-time low. In this blog Dr Jonathan Doherty of Leeds Trinity University outlines some reasons that may account for the slide.

Briefing

PISA, TIMSS and PIRLS: What actually are they and what do they tell us?

According to the latest PISA results, England’s science scores are still on a downward trajectory that started a decade ago. Yet TIMSS, another respected study, has science performances rising. Which of them is right? Is one more valid than the other? In this blog AQi examines three International Large-Scale Assessments and finds that, although they may look the same from a distance, get up close and you’ll find they are very different beasts.

Adaptive Assessment

Adaptive Assessment: A missing ingredient in the resit recipe?

SEND

Student success: Every milestone matters

Baroness Morgan is calling for students to be given ‘self-belief’ lessons as a way of developing their characters and preparing them for the future. She is not the first to notice that a student’s sense of their own ability and their level of success are part of a virtuous circle. But how can teachers get the snowball rolling for students with SEND or in alternative provision? In this blog, former headteacher, John Tomsett, pulls out a swimming certificate he earned more than half a century ago to use as an inspiration for others.

Assessment

Progress 8 – How much can it flex?

Progress 8 has come in for criticism in recent months for the way it combines with the Ebacc to skew schools’ focus towards academic subjects at the expense of creative and technical options. Both Labour and a Lords committee have called for reform to boost uptake of declining subjects such as D&T, dance and drama. In the second of two blogs looking at Progress 8, AQi examines whether the accountability measure could be realigned to address these concerns and if so, how could that be done?

Assessment

Progress 8 – Schools’ flexible friend?

Eight years after Progress 8 came into existence it is facing calls to be updated. Some say reforming the schools accountability measure can halt the decline in take up of the arts, while others want it to boost numbers taking vocational and technical subjects. Are its shoulders broad enough to take on such a load? In the first of two blogs on Progress 8, AQi looks at how it came into being, what problems it was designed to solve and whether it is flexible enough to be reformed.

Assessment

2023: A year in review

As we wrap up a year full of exciting developments in education, it is the perfect time to take stock of what has gone on. In this blog, editor of AQi, Anil Dawar, reflects on some of his highlights for 2023.

Download a PDF version.

Download a copy of this content to your device as a PDF file. We generate PDF versions for the convenience of offline reading, but we recommend sharing this link if you'd like to send it to someone else.

Adaptive Assessment: A missing ingredient in the resit recipe?

What is the issue with resits?

What added difficulties do resit students and their teachers face?

The impact of learning environment and motivation on resits

Can not knowing students' strengths and weaknesses hamper teachers?

Can Adaptive Assessment aid students and teachers involved in resits?

How does Adaptive Assessment work?

How do teachers use Adaptive Assessment results?

Teachers need support to get the best out of Adaptive Assessment

Assessing oracy: Is Comparative Judgement the answer?

TV subtitles as an aid to literacy: What does the research say?

What is left behind now education’s Data Wave has receded?

Finland & PISA – A fall from grace but still a high performer?

PISA, TIMSS and PIRLS: What actually are they and what do they tell us?

Adaptive Assessment: A missing ingredient in the resit recipe?

Student success: Every milestone matters

Progress 8 – How much can it flex?

Progress 8 – Schools’ flexible friend?

2023: A year in review

Join the conversation on Twitter

Download a PDF version.

Sign up to our newsletter