Skip to main content

TWO: What of fairness and equality?

Considerable fears remain in many quarters that fairness and equality will elude the government and Ofqual. The current system appears to be trying to chase ‘ghosts’ that cannot be caught or assessed using current methods. A new way to assess students will be needed that gathers the attributes of students in the context of their situation. Of course, ensuring equal access to education on a level playing field would be a better way to give all of them same chance. 

There is little doubt that the Centre Assessment Grade (CAG) methodology used by Ofqual this summer was crudely designed to ensure as little grade inflation as possible. By achieving this goal, it is only logical to assume that any existing inequalities would remain in place as standards remained the same across the board. Schools and colleges with a good past record would be guaranteed to continue to maintain this position in 2020. Others with a lesser record would stay at the back as before. 

Sure enough, with ‘Student-level equalities analyses for GCSE and A level Summer 2020’, Ofqual has excelled itself with the conclusion “for GCSEs and A Levels, there is no evidence that either the calculated grades or the final grades awarded this year were systematically biased against candidates with protected characteristics or from disadvantaged backgrounds.” 

The 180 pages of the .pfd document are packed with multivariate analysis tables comparing actual results from 2018 and 2019 with the Centre assessment grade (CAG) determinations from 2020. 

The report largely reiterates the same conclusions reached in August with ‘Awarding GCSE, AS, A level, advanced extension awards and extended project qualifications in summer 2020: interim report August 2020’. It concluded “The analyses show no evidence that this year’s process of awarding grades has introduced bias”. 

Hiding a problem. 

Both reports consider the possible effect on results based on gender, ethnicity, free school meals and socioeconomic status. Socioeconomic status (SES) is categorised into low, medium, and high groups for convenience. This is a common classification system that consolidates many different measures. These are not fully defined in the report, but the assumption might be that students and their families are placed into one of these categories based on combined income, education, and occupation. The IFS has a good explanation from 2019 in ‘A comparison of commonly used socio-economic indicators’. However, an earlier report by Ofqual in August defined the three SES groups in equal proportions in a ranking based upon family income and the ‘Income deprivation affecting children index (IDACI)’ that forms part of the ‘English Indices of Deprivation 2019’ . These are usually ranked by decile in the National Pupil Database

Thus, the differential between the very top and bottom of the index is somewhat diluted due to the methodology used by Ofqual. 

One wonders if there might have been a more pronounced bias against the disadvantaged at the extreme ends of the IDACI spectrum. By division into three groups instead of ten, this effect may have been hidden. 

Two very important existing effects on fairness and equality are not considered in the report. The first is the inherent unreliability and possible inaccuracy of the examination assessments and the second is the existing inequality that standardisation using CAGs managed to maintain. 

There is a pressing need to look again at the examination assessment methodology. This must be accompanied by a serious look at the extent of inequality in education provision. Seeking ways to hide this in the data is not a serious way forward. 

Mike Larkin, retired from Queen's University Belfast after 37 years teaching Microbiology, Biochemistry and Genetics. He has served on the Senate and Finance and planning committee of a Russell Group University.



Comments

Popular posts from this blog

Qfqual builds a concrete wall: UPDATED

UPDATE 8th August 2020 Things are moving fast today with severe criticism mounting about Ofqual and SQA, and urgent action is needed. TEFS has laid out ten points that should be considered to reverse out of the crumbling mess. Fairness should replace 'maintaining standards' as the primary objective. The government must cease trying to defend a system that acts as a barrier to the less advantaged. Since posting yesterday, things have been moving fast. Today the Guardian put the examinations issue in large print on its front page with ‘Nearly 40% of A-level result predictions to be downgraded in England’ . This conclusion came about after some great detective work by former medical statistician, Huy Duong, who analysed the data available and reconciled this with the Ofqual announcement that there could have been a 12% inflation in higher grades. It seems that Ofqual have been caught red handed and "Duong’s findings were privately confirmed to the Guardian by ex

Ofqual and the finger of blame

This week confirmed beyond any doubt that Ofqual is pointing the finger of blame for the public examinations chaos this summer firmly at the government and its ministers. The positions of Schools Minister, Nick Gibb and Education Secretary, Gavin Williamson must be on the line. When Williamson is confronted by the Education Committee next week, like Momus he may find his mask has slipped and cannot lay blame anywhere else. He might be meeting his Nemesis and find he is expelled from his lofty position.  Called to account.  On Wednesday morning, Education Secretary, Gavin Williamson, Education Permanent Secretary, Susan Acland-Hood, and Director for Qualifications, Michelle Dyson, will be called to account by the Education Committee. With the redoubtable Robert Halfon in the chair, they will face a hard time. This is because Halfon and his colleagues will be armed with more documentary evidence from Ofqual and others that look bad for both ministers. All of the correspo

A radical overhaul of examinations is needed as soon as possible: UPDATE

UPDATE 23rd March 2021 Since this idea was posted in January, there has been considerable thought across the sector about what would be best for the future. These are very well laid out in a collection of short essays reported last week by the Higher Education Policy Institute (HEPI). The twelve essays, from different authors and different perspectives, in  ‘Where next for university admissions? ’ are edited by Rachel Hewitt  who sets out the many pitfalls surrounding examinations and university admissions. It seems there are those in favour of post qualification admission (PQA) to university as it should help the least advantaged students. However, arguments against this are presented that means caution must be taken. A powerful response to the HEPI report by the  'The Fair Access Coalition: 10 requirements for a fair admissions process' adds further to the debate. The suggestions are sensible but falls short on demanding adequate resources for students throughout their studi