Ian Stockford
Ofqual · GBR
Track record: No forecast checked yet (1 not due, 2 being checked).
3forecasts & commitments on the record
0%can be checked as stated
36average ambiguity (0-100)
0goalpost moves recorded
0confirmed U-turns
Timeline
came true partly did not not due / being checked / too vague
Calibration score: shown after 10 checked forecasts with a stated likelihood (now 0).
How they speak about the future: based on data 3.
Kinds of claim: mixed claim 2, forecast 1.
In the nine words
How to read this
Each box is one sentence a public figure or institution said about the future, word for word, with a link to the official text. Can be checked means it names what will happen, by when, and how likely - so it can be compared with official figures later. Too vague to check means it does not. Ambiguity (0-100) is how many different ways the sentence can be read. When the date passes, the forecast is compared with official data and marked came true, partly or did not come true. Labels judge the sentence, never the person. Full guide and glossary.On the record (3)
We will report data for this year’s enquiries about results in December, but they have risen year on year, and I probably won’t be giving too much away in anticipating a continuation of that picture this year.
These will be awarded for the first time in summer 2017.
Unless our research provides sound evidence to the contrary, we will remain confident in the judgements made during accreditation.
Also said - not checkable as stated (7 newest)
Remarks about the future with no date, figure or likelihood that could be checked. They are kept on the record and shown here, but not scored.
I know that marker capacity and planning are being actively considered by exam boards and we will continue to engage with them to assure us of their ability to get the job done and to the highest possible quality.
We will be taking a keen interest in the way that the exam boards are addressing these challenges and managing any risks that exist.
To reflect these findings, we will soon be holding a public consultation on proposed changes to be made to our regulation of the enquiries about results system and I hope you will engage with that consultation process.
For example, we are going to identify metrics which will help us to more directly measure the quality of marking avoiding the current reliance on enquiries data as a proxy.
We are conducting research in this area and when we have developed some proposals for this suite of metrics we will invite exam boards and other stakeholders to agree the best approach for measuring and reporting on marking quality.
This work included the development of guidance and rules for how assessments should be designed and you might have seen some of these and commented on parts of them as part of our earlier consultations.
So that’s all for now, but we will provide more information on our research as it progresses.