Skip to main content

TWO: What of fairness and equality?

Considerable fears remain in many quarters that fairness and equality will elude the government and Ofqual. The current system appears to be trying to chase ‘ghosts’ that cannot be caught or assessed using current methods. A new way to assess students will be needed that gathers the attributes of students in the context of their situation. Of course, ensuring equal access to education on a level playing field would be a better way to give all of them same chance. 

There is little doubt that the Centre Assessment Grade (CAG) methodology used by Ofqual this summer was crudely designed to ensure as little grade inflation as possible. By achieving this goal, it is only logical to assume that any existing inequalities would remain in place as standards remained the same across the board. Schools and colleges with a good past record would be guaranteed to continue to maintain this position in 2020. Others with a lesser record would stay at the back as before. 

Sure enough, with ‘Student-level equalities analyses for GCSE and A level Summer 2020’, Ofqual has excelled itself with the conclusion “for GCSEs and A Levels, there is no evidence that either the calculated grades or the final grades awarded this year were systematically biased against candidates with protected characteristics or from disadvantaged backgrounds.” 

The 180 pages of the .pfd document are packed with multivariate analysis tables comparing actual results from 2018 and 2019 with the Centre assessment grade (CAG) determinations from 2020. 

The report largely reiterates the same conclusions reached in August with ‘Awarding GCSE, AS, A level, advanced extension awards and extended project qualifications in summer 2020: interim report August 2020’. It concluded “The analyses show no evidence that this year’s process of awarding grades has introduced bias”. 

Hiding a problem. 

Both reports consider the possible effect on results based on gender, ethnicity, free school meals and socioeconomic status. Socioeconomic status (SES) is categorised into low, medium, and high groups for convenience. This is a common classification system that consolidates many different measures. These are not fully defined in the report, but the assumption might be that students and their families are placed into one of these categories based on combined income, education, and occupation. The IFS has a good explanation from 2019 in ‘A comparison of commonly used socio-economic indicators’. However, an earlier report by Ofqual in August defined the three SES groups in equal proportions in a ranking based upon family income and the ‘Income deprivation affecting children index (IDACI)’ that forms part of the ‘English Indices of Deprivation 2019’ . These are usually ranked by decile in the National Pupil Database

Thus, the differential between the very top and bottom of the index is somewhat diluted due to the methodology used by Ofqual. 

One wonders if there might have been a more pronounced bias against the disadvantaged at the extreme ends of the IDACI spectrum. By division into three groups instead of ten, this effect may have been hidden. 

Two very important existing effects on fairness and equality are not considered in the report. The first is the inherent unreliability and possible inaccuracy of the examination assessments and the second is the existing inequality that standardisation using CAGs managed to maintain. 

There is a pressing need to look again at the examination assessment methodology. This must be accompanied by a serious look at the extent of inequality in education provision. Seeking ways to hide this in the data is not a serious way forward. 

Mike Larkin, retired from Queen's University Belfast after 37 years teaching Microbiology, Biochemistry and Genetics. He has served on the Senate and Finance and planning committee of a Russell Group University.


Popular posts from this blog

A radical overhaul of examinations is needed as soon as possible: UPDATE

UPDATE 23rd March 2021 Since this idea was posted in January, there has been considerable thought across the sector about what would be best for the future. These are very well laid out in a collection of short essays reported last week by the Higher Education Policy Institute (HEPI). The twelve essays, from different authors and different perspectives, in  ‘Where next for university admissions? ’ are edited by Rachel Hewitt  who sets out the many pitfalls surrounding examinations and university admissions. It seems there are those in favour of post qualification admission (PQA) to university as it should help the least advantaged students. However, arguments against this are presented that means caution must be taken. A powerful response to the HEPI report by the  'The Fair Access Coalition: 10 requirements for a fair admissions process' adds further to the debate. The suggestions are sensible but falls short on demanding adequate resources for students throughout their studi

Qfqual builds a concrete wall: UPDATED

UPDATE 8th August 2020 Things are moving fast today with severe criticism mounting about Ofqual and SQA, and urgent action is needed. TEFS has laid out ten points that should be considered to reverse out of the crumbling mess. Fairness should replace 'maintaining standards' as the primary objective. The government must cease trying to defend a system that acts as a barrier to the less advantaged. Since posting yesterday, things have been moving fast. Today the Guardian put the examinations issue in large print on its front page with ‘Nearly 40% of A-level result predictions to be downgraded in England’ . This conclusion came about after some great detective work by former medical statistician, Huy Duong, who analysed the data available and reconciled this with the Ofqual announcement that there could have been a 12% inflation in higher grades. It seems that Ofqual have been caught red handed and "Duong’s findings were privately confirmed to the Guardian by ex

The next labour of Ofqual is announced: Social mobility UPDATE

UPDATE 1st March2021  Since writing this post, there has been valuable analysis added to the worsening situation by Lee Elliot-Major, Chair of Social Mobility at Exeter University and former head of the Sutton Trust. His article in The Guardian today, ‘How do we ensure disadvantaged kids don't lose out in England's new exam system?’  concludes that “it will be long after this summer’s exam grade battles that we will comprehend the full consequences this pandemic has had on young people.” That could be an understatement as the idea of ‘social mobility’ unravels fast. He cites a recent research publication with colleagues at the LSE Centre for Economic Performance  entitled  ‘Unequal learning and labour market losses in the crisis: consequences for social mobility’ . This is a detailed and rigorous analysis and survey that should set alarm bells ringing in government in the run-up to the budget this week. The evidence is stark as the “education and labour market losses due to C