Assessment

A level results: Don’t forget cohort size matters

The sight of thousands of 6th Formers nervously opening their A Level results invariably provokes nostalgia in older generations which emerges in two well-worn phrases: ‘I did terribly in my A-levels and I did all right’ and ‘Everyone gets A’s these days.’ But do these inter-generational comparisons really hold up? AQA's Adam Steedman Thake digs into the stats to find out.

Date18/08/23

AuthorAdam Steedman Thake

The past is a foreign country: they do things differently there

A levels: Were they harder then or marked more leniently now?

A level results day is all about the future for the young people involved.
But for the older generation it is about the past.

For them, 'exams were much harder in my day’.

The two sides of that coin are firstly, they got worse results than today’s students and secondly, everyone is getting A’s these days.

But how much scrutiny can these arguments stand?

A level: The numbers taking them now distort perceptions

On the first point, Jeremy Clarkson famously – as he has told us every A-level results day since 2014 – left school with A level grades C, U and U.
He says that it was no barrier to getting an expensive car, being on a boat, or doing whatever jet-set activity he is up to this year.

In that very specific and narrow way, he is correct, but as you probably expect it’s much more complicated than that.

One key fact which I don’t see many people talking about is the change in how many people take A levels.

From the 1960s through to the mid-1980s, only around 5-10% of students undertook A level study.

Nowadays it is closer to half.

It means that those who took A levels between 1963 and 1987 and walked away with a C and two U grades, were in the top 10% of most qualified people in the country.

If they were to get similar marks today that would put them closer to the 50^th percentile of the highest qualified.

That is the effect of not having the luxury of being part of a small cohort.

So, the meaning of A level results is far different today than it was in the past for the lower achievers.

But what about the second lament? Does ‘everyone get A’s these days’?

Are A levels being marked more leniently now?

To get to the bottom of this, we need to take a little stroll through the history of how grades were awarded.

How do you get an A?

From 1963 until 1987, a grade allocation quota system existed whereby 10% of A level candidates would get an A, 15% a B, 10% a C and so on.

This ensured only a relatively small number would achieve the top grades. It also meant the standard of an A grade may fluctuate each year according to the cohort’s level of attainment.

Nowadays, A level grades are calculated in a different way: neither fully norm-referenced nor fully criterion-referenced.

As I mentioned earlier, A levels used to be for only the highest-achieving 10%, whereas today around 50% of the population sit them.

As Daisy Christodoulou notes, keeping the gradeset at the same standard after such an expansion in numbers would mean a large chunk of students failing the exam.

Is it harder to get top A levels today?

This year, around one in 11 (8.9%) of entries received an A*.

Doing some quick maths, 8.9% of 50% works out at less than 4.5% of the overall population getting highest grades, compared to 1% back in the day.

On the surface this may look like a big change, but we need to consider that in previous generations, some students who didn't do A-levels would have been perfectly capable of succeeding on the course and getting high marks.

Applying the old framework of the top 10% get the highest mark would mean that closer to 5% of 18-year-olds would get an A*, which is not too far off the 4.5% figure of today.

So, it simply is not the case that “everyone gets As” these days.

What is under-examined is the sheer demographic change.

More people are achieving top grade A levels than in the past, because more people are sitting them, but the proportions of top grades are comparable.

So, it seems that A level standards haven’t changed that much, after all.

What has changed is the sheer size of the cohort sitting them. A levels have changed what they do and who they are for.

Perhaps some commentators would do well to brush up on their percentages.

One final point, well done to everyone on their results whether they got a Clarksonesque CUU or A*A*A* - neither of which I achieved.

Education Policy

Through the looking glass: How polling the public can help policymakers learn about themselves

Public attitude data is key to effective policymaking. Proper polling can reveal what people think about existing policies and what they want for the future. But, if looked at from a different angle, it can also help policymakers question themselves and their assumptions about the public. In this blog, AQA’s Policy and Evidence Manager Adam Steedman-Thake, reveals the lessons he learned about himself while reading a recent public attitude survey.

Assessment

Assessing oracy: Is Comparative Judgement the answer?

Oracy skills are vital to success in school and life. And yet, for many children, opportunities to develop them are missed. Educationalists are engaging in a growing debate about where oracy fits into the school system. Labour has put it at the heart of its plans to improve social mobility and an independent commission is looking at how it is taught in the classroom. This renewed focus on oracy means it is more important than ever that teachers have a way to reliably assess and understand their students’ attainment and progression. Amanda Moorghen of oracy education charity Voice 21 explains how Comparative Judgement can help with that and why it may be a game changer.

Education

TV subtitles as an aid to literacy: What does the research say?

Jack Black is probably best known in educational circles for playing a renegade substitute teacher in School of Rock. But the Hollywood star has made a more conventional foray into education by backing the use of TV subtitles to improve child literacy. Stephen Fry and the World Literacy Foundation also want parents to use their TV remotes to get children reading. So, could this simple click of a button be a solution to boost pupils’ reading skills? AQA’s resident expert on language teaching, Dr Katy Finch, casts her eye over the research to see whether it stacks up.

Data Analysis

What is left behind now education’s Data Wave has receded?

Is data the solution to all education’s issues? About a decade ago the prevailing wisdom said it was. Advocates of this Data Wave argued that harvesting internal statistics would help schools solve issues such as teacher accountability and attainment gaps. As with all waves, after crashing onto the beach they recede, leaving space for another to roll in. In this blog, teacher, author and data analyst Richard Selfridge looks at the legacy of the Data Wave to see what schools can take from it.

International Approaches

Finland & PISA – A fall from grace but still a high performer?

Finland was once recognised as one of the most successful educational systems in the world. At the turn of the millennium, it topped the PISA rankings in reading, maths and science. But by 2012, decline set in. The last set of results showed performances in maths, reading and science were at an all-time low. In this blog Dr Jonathan Doherty of Leeds Trinity University outlines some reasons that may account for the slide.

Briefing

PISA, TIMSS and PIRLS: What actually are they and what do they tell us?

According to the latest PISA results, England’s science scores are still on a downward trajectory that started a decade ago. Yet TIMSS, another respected study, has science performances rising. Which of them is right? Is one more valid than the other? In this blog AQi examines three International Large-Scale Assessments and finds that, although they may look the same from a distance, get up close and you’ll find they are very different beasts.

Adaptive Assessment

Adaptive Assessment: A missing ingredient in the resit recipe?

The number of students resitting their maths GCSE is growing, but the proportion getting a grade 4 or higher is falling. This situation is not only dispiriting for the young people striving to get the qualifications they need, but also for the teachers working hard to help them. How can outcomes for this cohort be improved? Bart Crisp, associate director at the Centre for the Use of Research and Evidence in Education, thinks adaptive assessment may be part of the solution.

SEND

Student success: Every milestone matters

Baroness Morgan is calling for students to be given ‘self-belief’ lessons as a way of developing their characters and preparing them for the future. She is not the first to notice that a student’s sense of their own ability and their level of success are part of a virtuous circle. But how can teachers get the snowball rolling for students with SEND or in alternative provision? In this blog, former headteacher, John Tomsett, pulls out a swimming certificate he earned more than half a century ago to use as an inspiration for others.

Assessment

Progress 8 – How much can it flex?

Progress 8 has come in for criticism in recent months for the way it combines with the Ebacc to skew schools’ focus towards academic subjects at the expense of creative and technical options. Both Labour and a Lords committee have called for reform to boost uptake of declining subjects such as D&T, dance and drama. In the second of two blogs looking at Progress 8, AQi examines whether the accountability measure could be realigned to address these concerns and if so, how could that be done?

Assessment

Progress 8 – Schools’ flexible friend?

Eight years after Progress 8 came into existence it is facing calls to be updated. Some say reforming the schools accountability measure can halt the decline in take up of the arts, while others want it to boost numbers taking vocational and technical subjects. Are its shoulders broad enough to take on such a load? In the first of two blogs on Progress 8, AQi looks at how it came into being, what problems it was designed to solve and whether it is flexible enough to be reformed.

Download a PDF version.

Download a copy of this content to your device as a PDF file. We generate PDF versions for the convenience of offline reading, but we recommend sharing this link if you'd like to send it to someone else.

A level results: Don’t forget cohort size matters

A levels: Were they harder then or marked more leniently now?

Through the looking glass: How polling the public can help policymakers learn about themselves

Assessing oracy: Is Comparative Judgement the answer?

TV subtitles as an aid to literacy: What does the research say?

What is left behind now education’s Data Wave has receded?

Finland & PISA – A fall from grace but still a high performer?

PISA, TIMSS and PIRLS: What actually are they and what do they tell us?

Adaptive Assessment: A missing ingredient in the resit recipe?

Student success: Every milestone matters

Progress 8 – How much can it flex?

Progress 8 – Schools’ flexible friend?

Join the conversation on Twitter

Download a PDF version.

Sign up to our newsletter