Skip to main content

Examinations and ‘the ghost in the machine’

The title refers to the false notion that it is possible to fairly and reliably assess the ability of students to decide on who gets a university place. The COVID crisis has revealed serious shortcomings in how we might assess the ability and potential of students in an unequal education system that favours attainment achieved by those with better resources. Measuring the 'ghost in the machine’ that is someone’s real ability taken in context is not considered and this disadvantages those with fewer learning resources or support at home. 

Here are a series of posts relating to the final school and college examinations in the UK that determine transition to higher education. Whilst the governments in Scotland and Wales have cancelled their summer higher, advanced higher and A-level examinations, the governments in England and Northern Ireland will press on with examinations delayed by a few weeks next summer. The Northern Ireland government may have little choice since many students take A-level examinations set by the various boards in England. The decision therefore rests with the Government in England. At a hearing of the Education Committee this week, Schools Minister, Nick Gibb and acting Chief Regulator at Ofqual, Glenys Stacey pressed home their determination to proceed in the face of considerable criticism levelled about the impacts on disadvantaged students. The poor supply of computers needed for those learning from home was not defended well. 

Looks at the defence by Ofqual of its procedures this summer in the context of the current situation in the UK. It appears that Ofqual are still steering policy and are exerting their influence. This provides context for the decisions made by the government in England to carry on with examinations next summer. The signs are not good, and if examinations are cancelled again, it seems the same mistakes could be made.

Considers why Ofqual thinks its methods this summer were fair and did not show bias against disadvantaged groups. However, a closer look shows this may remain hidden in the way the data is presented and the lack of reliability in the examination marking process itself. Ofqual should be more open in how it looks at the data.

Looks at the inherent problem of the examination marking processes being unreliable. The COVID crisis and move to Centre Assessment Grades (CAGs) uncovered uncomfortable facts about how it is done in 'normal' times. The goal of maintaining standards as the main aim, at the expense of equality and fairness, has led to a waning of confidence in the system. 

Is a question we must ask. The answer appears to be that schools or colleges and their teachers are really being assessed in examinations taken by their students. This idea emerged with the use of CAGs that determined the grades of individual students based upon the past performance of the school or college. Observations by Ofqual of a ‘sawtooth’ effect in performance before and after reforms of examinations illustrates the extent to which the effectiveness of teachers and schools influences results. 

Examines the ‘behaviourist’ philosophy that appears to underpin the blind reliance on single examinations. It presupposes that there is an inherent ability in every individual student that can be readily measured. This manifests itself in looking narrowly at attainment that is tested in a single ‘one-off’ examination. But the conclusion that marking examinations is unreliable was bound to emerge. It ignores other data available on a student, the context of the learning environment and the many less tangible attributes that make us who we are. It seems the ‘ghost in the machine’ is ignored and left sitting on the bench waiting to be called upon to show its ability.

Mike Larkin, retired from Queen's University Belfast after 37 years teaching Microbiology, Biochemistry and Genetics. He has served on the Senate and Finance and planning committee of a Russell Group University.


Popular posts from this blog

Qfqual builds a concrete wall: UPDATED

UPDATE 8th August 2020 Things are moving fast today with severe criticism mounting about Ofqual and SQA, and urgent action is needed. TEFS has laid out ten points that should be considered to reverse out of the crumbling mess. Fairness should replace 'maintaining standards' as the primary objective. The government must cease trying to defend a system that acts as a barrier to the less advantaged. Since posting yesterday, things have been moving fast. Today the Guardian put the examinations issue in large print on its front page with ‘Nearly 40% of A-level result predictions to be downgraded in England’ . This conclusion came about after some great detective work by former medical statistician, Huy Duong, who analysed the data available and reconciled this with the Ofqual announcement that there could have been a 12% inflation in higher grades. It seems that Ofqual have been caught red handed and "Duong’s findings were privately confirmed to the Guardian by ex

Ofqual and the finger of blame

This week confirmed beyond any doubt that Ofqual is pointing the finger of blame for the public examinations chaos this summer firmly at the government and its ministers. The positions of Schools Minister, Nick Gibb and Education Secretary, Gavin Williamson must be on the line. When Williamson is confronted by the Education Committee next week, like Momus he may find his mask has slipped and cannot lay blame anywhere else. He might be meeting his Nemesis and find he is expelled from his lofty position.  Called to account.  On Wednesday morning, Education Secretary, Gavin Williamson, Education Permanent Secretary, Susan Acland-Hood, and Director for Qualifications, Michelle Dyson, will be called to account by the Education Committee. With the redoubtable Robert Halfon in the chair, they will face a hard time. This is because Halfon and his colleagues will be armed with more documentary evidence from Ofqual and others that look bad for both ministers. All of the correspo

Bring back Augar and put students first to offer hope: UPDATE Augar speaks out

UPDATE: Augar Speaks out Today, Friday 8th May 2020, Philip Augar broke cover and commented on the financial crisis in our universities in the Financial Times. With ' The time is ripe to reform UK university finance' he acknowledged that "Covid-19-related disruption may now mean that such a fee cut would be too destabilising" .  He is looking to a new post-COVID-19 world and he must be listened to. The likelihood of the government's response to his report last year diverging far from its recommendations looms. Augar has offered alternative options for funding Universities in his article for the Financial Times today (8th May 2020). His input is welcome at this time and the government should be bringing him into the fold again. TEFS has argued for a comprehensive review of university finances that goes well beyond simply looking at students and fees with: "Therefore, a working group involving students (such as NUS), staff (such as UCU) universi