OpenAI and Microsoft disrupt state-backed hackers using ChatGPT

15 February 2024, 10:14

The ChatGPT website
Higher Education Policy Institute report. Picture: PA

The AI firm said hacker groups backed by China, Iran, North Korea and Russia had been found and removed from the chatbot.

ChatGPT maker OpenAI says it has disrupted multiple networks of state-backed hackers trying to use the AI chatbot to further their “malicious” activities.

The company said that alongside Microsoft, it had disrupted five groups from China, Iran, North Korea and Russia.

OpenAI said the different state-linked groups had used its AI services to carry out research, translation, find coding errors and run basic coding tasks to support their activities.

The ChatGPT maker said the identified accounts associated with the various groups had been terminated.

“We build AI tools that improve lives and help solve complex challenges, but we know that malicious actors will sometimes try to abuse our tools to harm others, including in furtherance of cyber operations,” OpenAI said.

“Among those malicious actors, state-affiliated groups – which may have access to advanced technology, large financial resources, and skilled personnel – can pose unique risks to the digital ecosystem and human welfare.

“In partnership with Microsoft Threat Intelligence, we have disrupted five state-affiliated actors that sought to use AI services in support of malicious cyber activities.

“The activities of these actors are consistent with previous red team assessments we conducted in partnership with external cybersecurity experts, which found that GPT-4 offers only limited, incremental capabilities for malicious cybersecurity tasks beyond what is already achievable with publicly available, non-AI powered tools.”

During the UK-hosted AI Safety Summit last year, world leaders and tech companies discussed the potential dangers of bad actors using generative AI applications to help assist them in carrying out cyber attacks and other nefarious activities.

The UK’s National Cyber Security Centre (NCSC) has also warned that more amateur and low-skilled hackers were already using generative AI tools to help upskill and create more effective and convincing spam and phishing attacks.

OpenAI noted that several of the groups it has disrupted have been using its services to draft and create content “that could be used in phishing campaigns”.

By Press Association

More Technology News

See more More Technology News

A-level students sat at desks for an exam inside a sports hall

AI could be used to help generate exam question papers, Ofqual chief says

Bafta has released the full longlist of 58 games that have been voted as the best titles of 2024 (PA)

Call Of Duty: Black Ops 6 among titles on longlist for 2025 Bafta Game Awards

Luke Littler gesturing to the crowd

Luke Littler and Oasis among top-trending Google searches in UK in 2024

A ChapGPT logo on a smartphone

OpenAI launches video generation tool Sora

An Amazon Echo Show device on a wall

Taylor Swift and Bitcoin named among the most popular Alexa queries of 2024

The Chat GPT website

OpenAI unveils new 200 dollars-a-month ChatGPT Pro subscription

The lights on the front panel of a broadband internet router

Full-fibre broadband reaches nearly 70% of UK homes – Ofcom

UK trials first interactive public breathalyser to curb drink-driving during festive season.

UK pub debuts first interactive breathalyser to help tackle drink-driving during festive season

A child using a mobile phone

Parents urged to be vigilant about children’s online safety over Christmas

Alder Hey Children's Hospital in Liverpool

Data from hospital cyber attack ‘could be released before NHS can investigate’

British singer Charli XCX dressed in a black dress and dark sunglasses at the Royal Academy of Arts Summer Exhibition Preview Party 2023 – London

Brat summer and ‘demure’ make-up feature in TikTok’s top trends of 2024

A woman using her mobile phone

Virgin Media O2 expands National Databank access to all O2 stores

Exclusive
Ministers are looking at relaxing the Tory government's TikTok ban in a bid to woo younger voters online, LBC understands.

Ministers eye TikTok comeback to reach younger voters despite security concerns

Telegram Messenger stock

Telegram to work with internet watchdog on child sexual abuse material crackdown

The GCHQ building in Cheltenham (GCHQ)

‘Broader and deeper’ online risk to UK from criminals and state-backed hackers

Riot police at a demonstration outside a hotel in Rotherham (

Oversight Board to examine Facebook posts about summer riots