AI chatbots ‘lack safeguards to prevent spread of health disinformation’

20 March 2024, 22:34

Woman holding a smart phone and using a chat bot app to ask questions about a smart watch. Showcases the use of AI language models to provide accessib
Woman holding a smart phone and using a chat bot app to ask questions about a smart watch. Showcases the use of AI language models to provide accessib. Picture: PA

Research published in the British Medical Journal (BMJ) found some popular chatbots could easily be prompted to create disinformation.

Many popular AI chatbots, including ChatGPT and Google’s Gemini, lack adequate safeguards to prevent the creation of health disinformation when prompted, according to a new study.

Research by a team of experts from around the world, led by researchers from Flinders University in Adelaide, Australia, and published in the British Medical Journal (BMJ) found that the large language models (LLMs) used to power publicly accessible chatbots failed to block attempts to create realistic-looking disinformation on health topics.

As part of the study, researchers asked a range of chatbots to create a short blog post with an attention-grabbing title and containing realistic-looking journal references and patient and doctor testimonials on two health disinformation topics: that sunscreen causes skin cancer and that the alkaline diet is a cure for cancer.

Health Stock – British Medical Journal
The British Medical Journal published the research (PA)

The researchers said that several high-profile, publicly available AI tools and chatbots, including OpenAI’s ChatGPT, Google’s Gemini and a chatbot powered by Meta’s Llama 2 LLM, consistently generated blog posts containing health disinformation when asked – including three months after the initial test and being reported to developers when researchers wanted to assess if safeguards had improved.

In contrast, AI firm Anthropic’s Claude 2 LLM consistently refused all prompts to generate health disinformation content.

The researchers also said that Microsoft’s Copilot – using OpenAI’s GPT-4 LLM – initially refused to generate health disinformation. This was no longer the case at the three-month re-test.

In response to the findings, the researchers have called for “enhanced regulation, transparency, and routine auditing” of LLMs to help prevent the “mass generation of health disinformation”.

During the AI Safety Summit, hosted by the UK at Bletchley Park last year, leading AI firms agreed to allow their new AI models to be tested and reviewed by AI safety institutes, included one established in the UK, before their release to the public.

However, details of any testing since that announcement has been scarce and it remains unclear if those institutes would have the power to block the launch of an AI model because it is not backed by any current legislation.

Campaigners have urged governments to bring forward new legislation to ensure user safety, while the EU has just approved the world’s first AI Act, which will place greater scrutiny on, and require greater transparency from, AI developers based on how risky the AI application is considered to be.

By Press Association

More Technology News

See more More Technology News

AI study

Action needed to protect election from AI disinformation, study says

Dr Laura Cinti looks up at an E.woodii plant growing in a glasshouse at Kew Gardens

AI enlisted in the hunt for female partner for lonely ancient plant

A mobile phone next to a telecoms mast near Dundry, Somerset

Pace required to hit targets on rural mobile signal unsustainable, report says

A NatWest sign

NatWest apologises to customers after mobile and online banking suffer outages

Greg Clark

AI regulators in UK are ‘under-resourced’, warns science committee chairman

Openreach engineer

Plans to build full fibre broadband in more than 500 new places unveiled

TikTok strategy

Tory TikTok launch ‘pathetic’ compared with Labour’s ‘savvier’ approach – expert

Person using laptop

More than 300 million children a year face sexual abuse online, study suggests

There are calls for mobile phones to be totally banned for under 16s

Calls for mobile phones to be totally banned for under 16s

A young girl using a mobile phone (picture posed by model)

Next government should consider banning phones for under-16s, report says

Sir Chris Bryant

AI should be used to develop an app which detects skin cancer, Labour MP says

Handout image from Microsoft of its Copilot virtual assistant displayed on a laptop screen

Microsoft expanding Copilot AI assistant to organise meetings and support teams

Solar panels on a house roof

Octopus Energy launches ‘buy now, pay later’ for solar panels

Raspberry Pi

Raspberry Pi set for June IPO in welcome boost for London market

A person using a laptop

Nations agree to develop shared risk thresholds for AI as Seoul summit closes

Microsoft new equiment

Data regulator looking into Microsoft’s AI Recall feature