Sally Collier
Ofqual · GBR
Track record: No forecast checked yet (1 not due, 6 being checked).
7forecasts & commitments on the record
0%can be checked as stated
36average ambiguity (0-100)
0goalpost moves recorded
0confirmed U-turns
Timeline
came true partly did not not due / being checked / too vague
Calibration score: shown after 10 checked forecasts with a stated likelihood (now 0).
How they speak about the future: stated on authority 4, based on data 2, educated guess 1.
Kinds of claim: forecast 4, mixed claim 2, commitment 1. · Download this report card as a picture
In the nine words
μαντείαInspired knowledge3 · 43%πρόγνωσιςInference from evidence2 · 29%εἰκασίαConjecture1 · 14%προαναγγελίαPublic pre-announcement1 · 14%
How to read this
Each box is one sentence a public figure or institution said about the future, word for word, with a link to the official text. Can be checked means it names what will happen, by when, and how likely - so it can be compared with official figures later. Too vague to check means it does not. Ambiguity (0-100) is how many different ways the sentence can be read. When the date passes, the forecast is compared with official data and marked came true, partly or did not come true. Labels judge the sentence, never the person. Full guide and glossary.On the record (7)
But all of you will need to introduce Centre Assessment Standards Scrutiny (CASS) processes by no later than September 2021.
You will be aware, we launched a programme of work this year looking at centre controls, where awarding organisations delegate aspects of delivery to their centres under arrangements often referred to as “direct claim status.” We’re extremely grateful to the Federation of Awarding Bodies for helping us understand how these controls work in practice.
Maybe when I am here next year, if you invite me back next year, we will have come a lot farther down the road on T levels.
We expect to be consulting next year on the new qualifications.
Secondly, you will be aware that the 9 to 1 qualifications in maths and English begin next year and, thereafter, in a wider range of qualifications.
Everybody has learnt, but we will not lower the standards for getting subjects accredited.
You will be interested, I know, in accreditation of new qualifications, where a lot has been learnt by all parties involved in accrediting subjects for teaching last year and for teaching this year.
Also said - not checkable as stated (12 newest)
Remarks about the future with no date, figure or likelihood that could be checked. They are kept on the record and shown here, but not scored.
Being clear what learners and centres can expect, and sticking to commitments made, is an important part of maintaining public confidence – and we need to avoid a situation where this comes into conflict with your obligation to maintain standards.
For our part, we have already included tweaks to our guidance which will answer some of the points raised around conflicts of personal interest and what constitutes malpractice and maladministration; we will work with JCQ and FAB to consider whether other changes to rules or guidance are needed.
As part of your consideration, you will need to think carefully about how you approve centres to make these judgements on your behalf and how you use the data and evidence available to monitor that they are doing so effectively.
As many of you will know, we are working with the Department on how we regulate vocational and technical qualifications that appear in Key Stage 4 Performance Tables – in order to ensure that they reliably and validly represent the knowledge and skills that students should be able to possess from studying such qualifications.
We will shortly be launching a consultation on proposals for a new framework that aims to enhance validity and support a more rigorous process, but which affords an appropriate degree of flexibility and eliminates the overlap between our Conditions and the Department’s Performance Tables requirements.
We must set out our expectations clearly, so that those who play a part in developing, delivering and awarding qualifications understand very clearly what is expected of them.
Of course, we hope we don’t have to use them, but when we do, we use them proportionately, and in combinations that will have the best effect.
If they can demonstrate to us that they have sufficient resources and processes in place to deliver valid assessments, and are capable of ongoing compliance, then we will find a way to recognise them and support them to develop a full understanding of our rules.
In particular, we know that they are finding it challenging to access the data they need to accurately forecast end-point assessment demand, and therefore to be able to arrange and resource assessment appropriately.
We will continue to keep this area under review as volumes of end-point assessments increase.
And we will continue to undertake proactive, thematic reviews wherever appropriate and share that intelligence.
I would be absolutely delighted if you could tell us how you want to be communicated with, where are we getting it right, but perhaps more importantly, do we need to change it.