Artificial intelligence may help trainee teachers with assessments – study

11 April 2022, 07:14 | Updated: 25 July 2023, 11:51

Royal High School
Royal High School. Picture: PA

Researchers said AI could be an “effective substitute” when personal feedback is not immediately available

Artificial intelligence (AI) could be used to mark the work of trainee teachers who are trying to identify pupils with potential learning difficulties, a study suggests.

Researchers said it could be an “effective substitute” when personal feedback is not readily available.

In a trial, 178 German trainee teachers were asked to assess six fictionalised pupils to decide whether they had learning difficulties such as dyslexia or Attention Deficit Hyperactivity Disorder (ADHD), and to explain their reasoning.

They were given examples of their schoolwork, as well as other information such as behaviour records and transcriptions of conversations with parents.

It does seem that AI-generated feedback helped these trainees to focus on what they really needed to learn

Dr Michael Sailer, LMU Munich

Immediately after submitting their answers, half of the trainees received a prototype ‘expert solution’, written in advance by a qualified professional, to compare with their own.

This is typical of the practice material that German trainee teachers usually receive outside taught classes.

The others received AI-generated feedback, which highlighted the correct parts of their solution and flagged aspects they might have improved.

The tests were scored by researchers, who assessed both their diagnostic accuracy – whether the trainees had correctly identified cases of dyslexia or ADHD – and their diagnostic reasoning: how well they had used the available evidence to make this judgement.

The average score for diagnostic reasoning among trainees who had received AI feedback during the six preliminary exercises was an estimated 10 percentage points higher than those who had worked with the pre-written expert solutions.

The reason for this may be the ‘adaptive’ nature of the AI, according to the study, led by academics at Cambridge University and Ludwig Maximilian University in Munich

Because it analysed the trainee teachers’ own work, rather than asking them to compare it with an expert version, the researchers believe the feedback was clearer.

There is no evidence, therefore, that AI of this type would improve on one-to-one feedback from a human tutor or high-quality mentor, but if such close support was not readily available, it could have benefits, particularly for trainees on larger courses.

Dr Michael Sailer, from LMU Munich, said: “Obviously we are not arguing that AI should replace teacher-educators: new teachers still need expert guidance on how to recognise learning difficulties in the first place.

“It does seem, however, that AI-generated feedback helped these trainees to focus on what they really needed to learn.

“Where personal feedback is not readily available, it could be an effective substitute.”

The study used a system capable of analysing human language and spotting certain phrases, ideas, hypotheses or evaluations in the trainees’ text.

Teachers play a critical role in recognising the signs of disorders and learning difficulties in pupils and referring them to specialists

Riikka Hofmann, Cambridge University

It was created using the responses of an earlier cohort of pre-service teachers to a similar exercise.

By segmenting and coding these responses, the team ‘trained’ the AI system to recognise the presence or absence of key points in the solutions provided by trainees during the trial.

The system then selected pre-written blocks of text to give the participants appropriate feedback.

Riikka Hofmann, associate professor at Cambridge University’s Faculty of Education, said: “Teachers play a critical role in recognising the signs of disorders and learning difficulties in pupils and referring them to specialists.

“Our findings suggest that AI could provide an extra level of individualised feedback to help them develop these essential competencies.”

The research is published in the journal Learning and Instruction.

By Press Association

More Technology News

See more More Technology News

People ride an upward escalator next to the Dior store at the Icon Siam shopping mall on June 12, 2024 in Bangkok, Thailand.

Luxury fashion giant Dior latest high-profile retailer to be hit by cyber attack as customer data accessed

A plane spotter with binoculars from behind watching a British Airways plane landing

‘Flying taxis’ could appear in UK skies as early as 2028, minister says

Apple App Store

Take on Apple and Google to boost UK economy, think tank says

A survey of more than 1,000 employers found that around one in eight thought AI would give them a competitive edge and would lead to fewer staff.

One in three employers believe AI will boost productivity, research finds

Hands on a laptop showing an AI search

One in three employers believe AI will boost productivity, research finds

Music creators and politicians take part in a protest calling on the Government to ditch plans to allow AI tech firms to steal their work without payment or permission opposite the Houses of Parliament in London.

Creatives face a 'kind-of apocalyptic moment’ over AI concerns, minister says

Ngamba Island Chimpanzee Sanctuary on Lake Victoria, Uganda

Chimps use medicinal plants to treat each other's wounds and practice 'self-care' as scientists hail fascinating discovery

Close up of a person's hands on the laptop keyboard

Ofcom investigating pornography site over alleged Online Safety Act breaches

The Monzo app on a smartphone

Monzo customers can cancel bank transfers if they quickly spot an error

Co-op sign

Co-op to re-stock empty shelves as it recovers from major hack

The study said that it was often too easy for adult strangers to pick out girls online and send them unsolicited messages.

Social media platforms are failing to protect women and girls from harm, new research reveals

Peter Kyle leaves 10 Downing Street, London

Government-built AI tool used to cut admin work for human staff

In its last reported annual headcount in June 2024, Microsoft employed 228,000 full-time workers

Microsoft axes 6,000 jobs despite strong profits in recent quarters

Airbnb logo

Airbnb unveils revamp as it expands ‘beyond stays’ to challenge hotel sector

A car key on top of a Certificate of Motor Insurance and Policy Schedule

Drivers losing thousands to ghost broker scams – the red flags to watch out for

Marks and Spencer cyber attack

M&S customers urged to ‘stay vigilant’ for fraud after data breach confirmed