Action needed to protect election from AI disinformation, study says

29 May 2024, 00:04

AI study
AI study. Picture: PA

The Alan Turing Institute’s Centre for Emerging Technology and Security said AI disinformation could be used to undermine democratic processes.

Artificial intelligence-generated deepfakes could be used to create fake political endorsements ahead of the General Election, or be used to sow broader confusion among voters, a study has warned.

Research by The Alan Turing Institute’s Centre for Emerging Technology and Security (Cetas) urged Ofcom and the Electoral Commission to address the use of AI to mislead the public, warning it was eroding trust in the integrity of elections.

The study said that while there was, so far, limited evidence that AI will directly impact election results, the researchers warned that there were early signs of damage to the broader democratic system, particularly through deepfakes causing confusion, or AI being used to incite hate or spread disinformation online.

It said the Electoral Commission and Ofcom should create guidelines and request voluntary agreements for political parties setting out how they should use AI for campaigning, and require AI-generated election material to be clearly marked as such.

The research team warned that currently, there was “no clear guidance” on preventing AI being used to create misleading content around elections.

Some social media platforms have already begun labelling AI-generated material in response to concerns about deepfakes and misinformation, and in the wake of a number of incidents of AI being used to create or alter images, audio or video of senior politicians.

In its study, Cetas said it had created a timeline of how AI could be used in the run-up to an election, suggesting it could be used to undermine the reputation of candidates, falsely claim that they have withdrawn or use disinformation to shape voter attitudes on a particular issue.

The study also said misinformation around how, when or where to vote could be used to undermine the electoral process.

Sam Stockwell, research associate at the Alan Turing Institute and the study’s lead author, said: “With a general election just weeks away, political parties are already in the midst of a busy campaigning period.

“Right now, there is no clear guidance or expectations for preventing AI being used to create false or misleading electoral information.

“That’s why it’s so important for regulators to act quickly before it’s too late.”

Dr Alexander Babuta, director of Cetas, said: “While we shouldn’t overplay the idea that our elections are no longer secure, particularly as worldwide evidence demonstrates no clear evidence of a result being changed by AI, we nevertheless must use this moment to act and make our elections resilient to the threats we face.

“Regulators can do more to help the public distinguish fact from fiction and ensure voters don’t lose faith in the democratic process.”

By Press Association

More Technology News

See more More Technology News

A mobile phone showing the TikTok app

Q&A: What does the future hold for TikTok?

TikTok has been banned in the US.

TikTok to be banned in the US from Sunday, Supreme Court rules

Apple artificial intelligence

Apple pauses AI-generated news alerts over inaccuracy issues

The Nintendo Switch console (Game/PA)The Nintendo Switch console (Game/PA)

Lisa Nandy reveals she has ‘put a lot of hours’ into video game Animal Crossing

Nintendo Switch 2

Nintendo Switch 2 to be released in 2025

A child using a mobile phone

Age verification to be required on any site hosting pornography, Ofcom says

A general view of Chat GPT website

ChatGPT users can now give it tasks to do in the future

A phone displaying the Twitter account for Elon Musk

Elon Musk sued by US markets regulator over Twitter stake disclosure

Elon Musk is being sued for failing to disclose his purchase of Twitter stocks before buying the company in 2022, which ‘allowed him to underpay’ by at least $150m (£123m).

US sues Musk for failing to disclose Twitter stock holdings to buy platform at ‘artificially low prices’

The back of an ambulance

IBM to supply tech for new Emergency Services Network

A laptop user

Cyber security is biggest concern among IT leaders – poll

Meta sign outside the company's base in Dublin

Meta ‘plans to cut 5% of lowest performing staff’ as Zuckerberg ‘raises the bar’

Cara Hunter MLA

Stormont MLA targeted by deepfake video urges legal clampdown

Technology

‘Millions’ in taxpayer money paid to cyber criminals in recent years – minister

Hand holding a mobile phone showing Google search engine

Competition regulator to examine Google services under new digital market laws

The report follows an eight-month inquiry into engineering biology (PA)

UK must do more to lead innovation in bio-tech sector, Lords committee says