Analysis · Digital transformation, data and AI · United Kingdom
Office for Students to require valid assessments, often AI-free, after AI research
Research by the Office for Students and Advance HE finds AI can undermine unsupervised assessment. The regulator says institutions must ensure assessments reliably measure students' knowledge, in many cases through secure AI-free formats.
Why it matters: Universities and colleges regulated by the Office for Students that use unsupervised assessments could face its regulatory levers if those assessments are not valid measures of students' skills.
The Office for Students (OfS), which refers to itself as the regulator, and Advance HE published research based on roundtables and interviews about how AI is changing students' experience of higher education.
According to the research, many institutions still use unsupervised assessments that AI tools can complete to a high standard, and students described peers using large language models, sometimes within minutes, to earn grades similar to those who did the work themselves.
The OfS said it will require assessments to be valid and reliable measures of knowledge and skills, which in many cases will mean secure AI-free assessment, and that where institutions fall short its levers include specific registration conditions, monetary penalties or suspension of student support and OfS grant funding.
Advance HE said it will launch an AI-focused Change Academy peer-learning programme for member institutions early in 2027, while the research found staff AI literacy training is often limited and generally voluntary, with typically low participation.
Why it matters
Because the OfS links assessment validity to its existing regulatory levers, institutions whose unsupervised assessments can be completed with AI tools may face those levers if they cannot show the assessments reliably measure students' knowledge and skills.
The findings that many students find AI policies hard to understand and that staff training is mostly voluntary relate directly to the role Advance HE's deputy chief executive described for senior leaders: setting a shared AI vision, consistent guidance and regular discussion at executive and board level.
Editor’s view
Richard Davies, Policy and Finance Editor
Josh Fleming, the OfS Director of Strategy and Delivery, described AI as a generational risk to the system as it stands and called for far greater use of AI-free assessment; alongside the report, the OfS has set out how institutions can comply with its regulation in the context of AI.
If institutions regulated by the OfS cannot show that their assessments reliably demonstrate intended learning outcomes, they risk the sanctions the regulator lists; the report says closed-book exams, presentations, practical assessments and performances are, in many cases, likely to provide the most valid measure of attainment.
The next stated milestone is the launch of Advance HE's AI Change Academy early in 2027, alongside further OfS research.
What to watch
- Advance HE's AI-focused Change Academy programme for member institutions is due to launch early in 2027.
- The OfS said it will carry out further structured research on the scale and nature of AI-driven change in higher education.