Artificial intelligence may help trainee teachers with assessments – study

11 April 2022, 07:14 | Updated: 25 July 2023, 11:51

Royal High School
Royal High School. Picture: PA

Researchers said AI could be an “effective substitute” when personal feedback is not immediately available

Artificial intelligence (AI) could be used to mark the work of trainee teachers who are trying to identify pupils with potential learning difficulties, a study suggests.

Researchers said it could be an “effective substitute” when personal feedback is not readily available.

In a trial, 178 German trainee teachers were asked to assess six fictionalised pupils to decide whether they had learning difficulties such as dyslexia or Attention Deficit Hyperactivity Disorder (ADHD), and to explain their reasoning.

They were given examples of their schoolwork, as well as other information such as behaviour records and transcriptions of conversations with parents.

Immediately after submitting their answers, half of the trainees received a prototype ‘expert solution’, written in advance by a qualified professional, to compare with their own.

This is typical of the practice material that German trainee teachers usually receive outside taught classes.

The others received AI-generated feedback, which highlighted the correct parts of their solution and flagged aspects they might have improved.

The tests were scored by researchers, who assessed both their diagnostic accuracy – whether the trainees had correctly identified cases of dyslexia or ADHD – and their diagnostic reasoning: how well they had used the available evidence to make this judgement.

The average score for diagnostic reasoning among trainees who had received AI feedback during the six preliminary exercises was an estimated 10 percentage points higher than those who had worked with the pre-written expert solutions.

The reason for this may be the ‘adaptive’ nature of the AI, according to the study, led by academics at Cambridge University and Ludwig Maximilian University in Munich

Because it analysed the trainee teachers’ own work, rather than asking them to compare it with an expert version, the researchers believe the feedback was clearer.

There is no evidence, therefore, that AI of this type would improve on one-to-one feedback from a human tutor or high-quality mentor, but if such close support was not readily available, it could have benefits, particularly for trainees on larger courses.

Dr Michael Sailer, from LMU Munich, said: “Obviously we are not arguing that AI should replace teacher-educators: new teachers still need expert guidance on how to recognise learning difficulties in the first place.

“It does seem, however, that AI-generated feedback helped these trainees to focus on what they really needed to learn.

“Where personal feedback is not readily available, it could be an effective substitute.”

The study used a system capable of analysing human language and spotting certain phrases, ideas, hypotheses or evaluations in the trainees’ text.

It was created using the responses of an earlier cohort of pre-service teachers to a similar exercise.

By segmenting and coding these responses, the team ‘trained’ the AI system to recognise the presence or absence of key points in the solutions provided by trainees during the trial.

The system then selected pre-written blocks of text to give the participants appropriate feedback.

Riikka Hofmann, associate professor at Cambridge University’s Faculty of Education, said: “Teachers play a critical role in recognising the signs of disorders and learning difficulties in pupils and referring them to specialists.

“Our findings suggest that AI could provide an extra level of individualised feedback to help them develop these essential competencies.”

The research is published in the journal Learning and Instruction.

By Press Association

More Technology News

See more More Technology News

This super speedy acceleration makes "not an especially nice noise", with the journalist saying it is "bowel loosening".

Jeremy Clarkson brands supercars 'too difficult' after driving new £308k vehicle

A Google building

Inaccurate images generated by AI chatbot were ‘unacceptable’, says Google boss

An Apple store

Apple shuts down electric car project – reports

Sage sign

AI will ‘change nature’ of accounting, says Sage boss

A child using a laptop computer (PA)

More guidance needed on AI in schools, report says

Most influential Scots on TikTok

Gen Z ushering in ‘post-truth media age’, says former No 10 communications chief

UK mobile phone networks stock

Vodafone completes 3G network switch off

Sony PlayStation 5

Sony to close London studio as part of 900 PlayStation job cuts

James Cleverly visit to US

Use of AI for medical diagnoses and police work discussed by Home Secretary

A wallet containing cash and cards

80% of 85 to 95-year-olds now pay with contactless, says Barclays

Woman using a laptop computer

More small digital firms making £100,000-plus across the UK, data shows

James Cleverly

Deepfakes provide ‘perfect storm’ for hijackers in general election – Cleverly

Jack Ritchie inquest

Online slot games ‘highly addictive’ despite new limits, say bereaved parents

The Spotify app is shown in an Apple iPad mini

Apple hits out at Spotify over ongoing EU competition complaint

Serco signage

Serco Leisure ordered to stop using facial recognition tech on workers

Smartphone and credit card

New maximum online slots stakes ‘a landmark moment’ for gambling reform