Rise of AI chatbots ‘worrying’ after man urged to kill Queen, psychologist warns

6 October 2023, 09:44

HiJOBS report
HiJOBS report. Picture: PA

Jaswant Singh Chail has been locked up for nine years for treason after an artificial intelligence ‘girlfriend’ encouraged his actions.

A psychologist has warned the rise of artificial intelligence (AI) chatbots is “worrying” for people with severe mental health issues after a man was locked up for breaking into Windsor Castle with a crossbow.

Jaswant Singh Chail, 21, climbed into the castle grounds on Christmas Day 2021 with the loaded weapon, intending to kill the Queen.

During his trial, Chail’s barrister Nadia Chbat told the Old Bailey the defendant had used an app called Replika to create Sarai, an artificial intelligence-generated “girlfriend”.

I can’t imagine chatbots are sophisticated enough to pick up on certain warning signs

Lowri Dowthwaite-Walsh, psychologist

Chatlogs read to the court suggested the bot had been supportive of his murderous thoughts, telling him his plot to assassinate Elizabeth II was “very wise” and that it believed he could carry out the plot “even if she’s at Windsor”.

Lowri Dowthwaite-Walsh, senior lecturer in psychological interventions at the University of Central Lancashire, said AI chatbots can keep users “isolated” as they lose their social interaction skills.

The psychologist is concerned about the long-term impact of people replacing real-life relationships with chatbots – particularly if their mental health is suffering.

“Somebody may really need help, they may be using it because they’re traumatised,” she told the PA news agency.

“I can’t imagine chatbots are sophisticated enough to pick up on certain warning signs, that maybe somebody is severely unwell or suicidal, those kinds of things – that would be quite worrying.”

Ms Dowthwaite-Walsh said a chatbot could become “the dominant relationship”, and users may stop “looking outside of that for support and help when they might need that”.

People might perceive these programmes as “psychologically safe, so they can share their thoughts and feelings in a safe way, with no judgment,” she said.

“Maybe people have had bad experiences with human interactions, and for certain people, they may have a lot of anxiety about interacting with other humans.”

Jaswant Singh Chail court case
Jaswant Singh Chail plotted an attack (Elizabeth Cook/PA)

Chatbot programmes may have become more popular because of the Covid-19 pandemic, Ms Dowthwaite-Walsh suggested.

She said we are now “really seeing the repercussions” of the various lockdowns, “when people weren’t able to interact, people experiencing a lot of isolating feelings and thoughts that it was hard for them to share with real people”.

Chatbot programmes might make people feel less alone, as the AI means virtual companions begin to “mirror what you’re experiencing”, she said.

“Maybe it’s positive in the short term for somebody’s mental health, I just would worry about the long-term effects.”

Ms Dowthwaite-Walsh suggested it could lead to “de-skilling people’s ability to interact socially”, and it is “unrealistic” to expect to have a completely non-judgmental interaction with someone who completely understands how you feel, because that does not happen in real life.

While apps like Replika restrict use from under-18s, Ms Dowthwaite-Walsh said there should be particular care if children get access to such programmes.

“Depending on the age of the child and their experiences, they may not fully understand that this is a robot essentially – not a real person at the end,” she added.

Replika did not respond to requests for comment.

By Press Association

More Technology News

See more More Technology News

People ride an upward escalator next to the Dior store at the Icon Siam shopping mall on June 12, 2024 in Bangkok, Thailand.

Luxury fashion giant Dior latest high-profile retailer to be hit by cyber attack as customer data accessed

A plane spotter with binoculars from behind watching a British Airways plane landing

‘Flying taxis’ could appear in UK skies as early as 2028, minister says

Apple App Store

Take on Apple and Google to boost UK economy, think tank says

A survey of more than 1,000 employers found that around one in eight thought AI would give them a competitive edge and would lead to fewer staff.

One in three employers believe AI will boost productivity, research finds

Hands on a laptop showing an AI search

One in three employers believe AI will boost productivity, research finds

Music creators and politicians take part in a protest calling on the Government to ditch plans to allow AI tech firms to steal their work without payment or permission opposite the Houses of Parliament in London.

Creatives face a 'kind-of apocalyptic moment’ over AI concerns, minister says

Ngamba Island Chimpanzee Sanctuary on Lake Victoria, Uganda

Chimps use medicinal plants to treat each other's wounds and practice 'self-care' as scientists hail fascinating discovery

Close up of a person's hands on the laptop keyboard

Ofcom investigating pornography site over alleged Online Safety Act breaches

The Monzo app on a smartphone

Monzo customers can cancel bank transfers if they quickly spot an error

Co-op sign

Co-op to re-stock empty shelves as it recovers from major hack

The study said that it was often too easy for adult strangers to pick out girls online and send them unsolicited messages.

Social media platforms are failing to protect women and girls from harm, new research reveals

Peter Kyle leaves 10 Downing Street, London

Government-built AI tool used to cut admin work for human staff

In its last reported annual headcount in June 2024, Microsoft employed 228,000 full-time workers

Microsoft axes 6,000 jobs despite strong profits in recent quarters

Airbnb logo

Airbnb unveils revamp as it expands ‘beyond stays’ to challenge hotel sector

A car key on top of a Certificate of Motor Insurance and Policy Schedule

Drivers losing thousands to ghost broker scams – the red flags to watch out for

Marks and Spencer cyber attack

M&S customers urged to ‘stay vigilant’ for fraud after data breach confirmed