Essays written with ChatGPT feature repetition of words and ideas – study

28 March 2024, 06:44

AI warning
AI warning. Picture: PA

The writing style of the AI tool is ‘bland’ and ‘journalistic’, according to Cambridge University Press and Assessment researchers.

Repetition of words, tautology and paragraphs starting with “however” are some tell-tale features of ChatGPT’s writing style, researchers have found.

The writing style of the artificial intelligence tool is “bland” and “journalistic”, according to a Cambridge University Press and Assessment study.

It comes after the rise of generative AI tools, like ChatGPT, has sparked concerns about cheating among pupils in the education sector.

Researchers compared essays written by three first-year undergraduate students, with the aid of ChatGPT, with 164 essays written by IGCSE students.

These essays were marked by examiners and the undergraduates were then interviewed and their essays were analysed.

A student writing an essay
The study compared essays by three first year undergraduate students with the help of ChatGPT with 164 essays written by IGCSE students (Alamy/PA)

The study found essays written with the help of ChatGPT performed poorly on analysis and comparison skills compared to non-ChatGPT-assisted essays.

But ChatGPT-assisted essays performed strongly on information and reflection skills.

Researchers identified a number of key features of the ChatGPT writing style, which included the use of Latinate vocabulary, repetition of words or phrases and ideas, and pleonasms.

Essays written with the help of ChatGPT were also more likely to use paragraphs starting with discourse markers like “however”, “moreover”, and “overall”, and numbered lists with items.

The researchers said ChatGPT’s default writing style “echoes the bland, clipped, and objective style that characterises much generic journalistic writing found on the internet”.

The report said: “The students found ChatGPT useful for gathering information quickly.

“However, they considered that complete reliance on this technology would produce essays of a low academic standard.”

Lead researcher Jude Brady, of Cambridge University Press and Assessment, said: “Our findings offer insights into the growing area of generative AI and assessment, which is still largely uncharted territory.

“Despite the small sample size, we are excited about these findings as they have the capacity to inform the work of teachers as well as students.”

She added: “We hope our research might help people to identify when a piece of text has been written by ChatGPT.

“For students and the wider population, learning to use and detect generative AI forms an increasingly important aspect of digital literacy.”

By Press Association

More Technology News

See more More Technology News

iPhone 16e

How does the 16e compare to the rest of the iPhone line-up?

The Tesco website is pictured on a laptop with a bank card.

Tesco fixes online shopping basket glitch

iPhone 16e

Apple unveils new budget iPhone 16e

The Tesco website is pictured on a laptop

Tesco customers hit by online shopping glitch

A woman using a mobile phone

Digital wallets used for 29% of card transactions in 2023

Georgia Harrison attending the Bafta TV Awards 2024 (PA)

Georgia Harrison targets individuals profiteering from deepfake porn industry

Signage on the side of an Uber car

Meta and Uber among firms ‘linked’ to alleged corporate migrant worker abuse

Zara Mohammed comments

Elon Musk’s X looking for cash from investors – report

Studio

University launches multimillion-pound creative industry studio

Disposable vapes of varying flavours on sale in a store

Campaign to warn teenagers about vaping addiction

The X logo is seen on a smartphone screen

Irish Independent publisher takes legal action against X over ‘fake ads’

Elon Musk

Police quash claims armed ‘migrant mob’ stormed hospital after Elon Musk reposts fake AI-generated image

A DeepSeek page seen on a smartphone screen

DeepSeek accused of sharing user data with TikTok owner ByteDance

(L to R) Napier AI boss Greg Watson, Economy Minister Caoimhe Archibald and Invest NI chief Kieran Donoghue in Belfast

London AI firm announces 106 jobs for Belfast

A man lying in bed, looking tired

Scientists develop smart pyjamas to monitor sleep conditions at home

E-scooters are currently illegal to use on the public highways including pavements.

E-scooters blamed for 'shocking' surge in uninsured teen riders with 2,000% increase in offences