Ian Bauckham
Ofqual · GBR
Track record: No forecast checked yet (9 not due, 17 being checked).
26forecasts & commitments on the record
4%can be checked as stated
39average ambiguity (0-100)
0goalpost moves recorded
0confirmed U-turns
Timeline
came true partly did not not due / being checked / too vague
Calibration score: shown after 10 checked forecasts with a stated likelihood (now 0).
How they speak about the future: based on data 16, stated on authority 10.
Kinds of claim: forecast 17, mixed claim 6, commitment 2, scenario (if… then) 1. · Download this report card as a picture
In the nine words
πρόγνωσιςInference from evidence13 · 50%μαντείαInspired knowledge10 · 38%προαναγγελίαPublic pre-announcement2 · 8%πρόνοιαPreparing for the future1 · 4%
How to read this
Each box is one sentence a public figure or institution said about the future, word for word, with a link to the official text. Can be checked means it names what will happen, by when, and how likely - so it can be compared with official figures later. Too vague to check means it does not. Ambiguity (0-100) is how many different ways the sentence can be read. When the date passes, the forecast is compared with official data and marked came true, partly or did not come true. Labels judge the sentence, never the person. Full guide and glossary.On the record (26)
I expect to see this in place, right across the country, in time for the 2027 summer series.
The evidence from that test continued to show this year a sustained improvement in maths performance, beyond the normal variations that we might see in the subject year on year.
The second, much larger tranche, will follow the next year.
So, the first 3 V Levels will be in education and early years, accounting and finance, and digital systems and data, and will be available for first teaching in September 2027.
The introduction of V Levels from 2027 will create a stronger vocational route for post-16 students.
So the first 3 V Levels will be in education in early years, accounting and finance, and digital systems and data, and they’ll be available for first teaching in September 2027 - and the second much larger tranche will follow next year.
So that means students in 2023 will be protected in grading terms if their examination performance in 2023 is a little lower than it might have been had the pandemic not taken place.
UCAS wrote out to all schools just after Ofqual announced our grading decision, to explain how offers will be made this year, and to confirm that universities would take our grading decision into account.
In so doing, however, we’re going to provide the 2023 cohort with the same protections against any impact of COVID-19 disruption that we did for earlier cohorts during the reform years.
We expect predicted grades for summer 2023 to be much closer to those seen in the pre-pandemic years.
We do expect therefore that overall results in 2023 will be much closer to the pre-pandemic years than results since 2020.
Broadly speaking, therefore, a typical student who would have achieved an A grade in their A level geography before the pandemic will be just as likely to get an A next summer, even if their performance in the assessments is a little weaker in 2023 than it would have been before the pandemic.
That means the 2023 cohort will be protected in grading terms if their exam performance is a little lower than it might have been before the pandemic.
You will need to factor that in when giving indicative grades for candidates being examined from 2023 onwards.
As most teachers and schools will know by now, the quality assurance process this year will have three main stages.
But their core purpose, and effectively the only one that matters this year, given that all qualifications-based accountability has been set aside, the only purpose that matters is what I will call the passport function.
Despite all this, we are facing a cohort of young people taking qualifications this year, many of whom will not have covered either as much content as normal, or will have covered it in less depth than usual.
We will want to think hard about how we bring together the experience of the pandemic and the wider, fast developing evidence we now have in areas such as curriculum design, evidence-based pedagogy and assessment, our growing knowledge of the capabilities of technology, and how all these interact, to ensure we have the best possible system in the future.
This year, there may be several pieces of evidence to review, the evidence will look different from one centre to the next, will need to be submitted to the board when the appeal is made, so the whole process will take longer.
Of course, that will vary from school to school but that is a variation we are prepared to accept this year in order to give a fair chance to everyone.
Since the return to school of all students last week, questions have been raised about the evidence teachers will need for this year’s grading.
Making this year’s qualifications successful will, ultimately, be a collective effort.
This year, though, as everyone listening to this will know, differential disruption to education is very high on our worry list.
We will want to think hard about how we bring together the experience of the pandemic and the wider fast-developing evidence we now have in areas such as curriculum design, evidence-based pedagogy and assessment, our growing knowledge of the capabilities of technology, and how all these interact, to ensure we have the best possible system in the future.
Questions have also been asked about the impact this year’s approach will have on grade inflation.
But to do so, we will need to be at the point where we can again offer fully regulated national examinations, and this year we cannot.
Also said - not checkable as stated (12 newest)
Remarks about the future with no date, figure or likelihood that could be checked. They are kept on the record and shown here, but not scored.
We will soon be at the limits of what AI detection can achieve and the question will move from how we can detect AI use, to how we can secure assessment integrity through assessment design.
And then before we know it, we will have a generation of young people who are incapable of thinking for themselves.
So we will therefore soon bring forward proposals for design changes to how the most vulnerable qualifications are assessed.
We cannot, clearly, in the interests of fairness, have multiple standards of training or expect every school to have to create its own training resources.
Colleagues, we won’t need less education, we will need more, and we will still need qualifications both to frame it and accredit it.
We are looking at all these issues as we decide how we will regulate the arrival of on screen assessment in England’s schools.
You may be frustrated when a review of marking means that an examiner error is uncovered and a grade has to be corrected.
And incidentally, one of the areas where we will need to educate humans better is about AI itself, so the content of AI itself.
So as we design new 16 to 18-year-old qualifications and reform existing ones, you should expect to see a far, far higher level of scrutiny for any proposals for extended writing coursework because, for the qualifications to be worth more than the paper they’re written on, we simply cannot normalise the idea that AI-generated output is somehow a substitute for …
AI will have an important place, but we must remain in charge and we must legislate and regulate to create clarity about what AI can be allowed to do, to bring about benefits for humans, and what it absolutely cannot be allowed to do.
My conclusion at the end of all of this is that there are fundamental ethical questions that need to be confronted if we’re going to deal with the AI revolution well, and they go beyond cost efficiency and accuracy.
And look, sure, all qualifications have to be approved by the government if they’re going to get public funding, but Pearson like any other board operating in this area currently has significant freedom to determine what is taught in a BTEC, in common with other boards and courses at this level.