Search engines can be ‘one-click gateways’ to harmful content, Ofcom warns

31 January 2024, 12:34

A woman's hands on a laptop keyboard
Government safety checks. Picture: PA

The regulator analysed thousands of search results based on terms linked to self-harm and suicide as part of a new study into online harms content.

Content that glorifies or celebrates self-harm and suicide is widely available via internet search engines, Ofcom has warned.

The regulator said research carried out on its behalf by the Network Contagion Research Institute found that one in every five links (22%) in the search results it analysed led to content which gloried or offered instruction about self-harm, suicide or eating disorders.

The researchers entered common search terms linked to self-injury, as well as more cryptic phrases used by online communities to conceal their true meaning in order to generate their results, and analysed more than 37,000 result links on five major search engines – Google, Microsoft Bing, DuckDuckGo, Yahoo and AOL.

According to the research, image searches provided the highest proportion of harmful results, with 50% of results being considered extreme.

Ofcom noted that previous research has shown that images are harder for detection algorithms to filter out as it can be difficult to distinguish between visuals glorifying self-harm and those shared in a medical or recovery context.

The study also found that the cryptic search terms returned more harmful content, with users six times more likely to find dangerous content about self-harm when using deliberately obscure search terms.

However, the research did note that help, support and educational content was available and signposted – with one in five search results linking to content focused on getting people help.

Ofcom also acknowledged that some search engines offer safety measures, such as a safe search mode, which restricts inappropriate content, and these were not used by the researchers in the study.

The regulator warned that search engines must act to ensure they are ready to fulfil their requirements under the Online Safety Act, which legally requires internet companies to protect children from harmful content.

Ofcom’s online safety policy development director, Almudena Lara, said: “Search engines are often the starting point for people’s online experience, and we’re concerned they can act as one-click gateways to seriously harmful self-injury content.

“Search services need to understand their potential risks and the effectiveness of their protection measures – particularly for keeping children safe online – ahead of our wide-ranging consultation due in spring.”

In response, a Google spokesperson said: “We are fully committed to keeping people safe online. Ofcom’s study does not reflect the safeguards that we have in place on Google Search and references terms that are rarely used on Search.

“Our SafeSearch feature, which filters harmful and shocking search results, is on by default for users under 18, whilst the SafeSearch blur setting – a feature which blurs explicit imagery, such as self-harm content – is on by default for all accounts.

“We also work closely with expert organisations and charities to ensure that when people come to Google Search for information about suicide, self-harm or eating disorders, crisis support resource panels appear at the top of the page.”

A spokesperson for Microsoft said: “Microsoft is deeply committed to creating safe experiences online, and we take seriously the responsibility to protect our users, particularly children, from harmful content and conduct online.

“We are mindful of our heightened responsibilities as a major technology company and will continue to work with Ofcom to take action against harmful content in search results.”

A DuckDuckGo spokesperson said: “While DuckDuckGo gets its results from many sources, our primary source for traditional web links and image results is Bing.

“For issues in search results or problematic content, we encourage people to submit feedback directly on our search engine results page – by clicking on ‘Share Feedback’, which can be found at the bottom right corner of the page.”

Yahoo and AOL have been approached for comment.

By Press Association

More Technology News

See more More Technology News

Person on laptop

UK cybersecurity firm Darktrace to be bought by US private equity firm

Mint Butterfield is missing in the Tenerd

Billionaire heiress, 16, disappears in San Francisco neighbourhood known for drugs and crime

A woman’s hand presses a key of a laptop keyboard

Competition watchdog seeks views on big tech AI partnerships

A woman's hands on a laptop keyboard

UK-based cybersecurity firm Egress to be acquired by US giant KnowBe4

TikTok�s campaign

What next for TikTok as US ban moves step closer?

A laptop user with their hood up

Deepfakes a major concern for general election, say IT professionals

A woman using a mobile phone

Which? urges banks to address online security ‘loopholes’

Child online safety report

Tech giants agree to child safety principles around generative AI

Holyrood exterior

MSPs to receive cyber security training

Online child abuse

Children as young as three ‘coerced into sexual abuse acts online’

Big tech firms and financial data

Financial regulator to take closer look at tech firms and data sharing

Woman working on laptop

Pilot scheme to give AI regulation advice to businesses

Vehicles on the M4 smart motorway

Smart motorway safety systems frequently fail, investigation finds

National Cyber Security Centre launch

National Cyber Security Centre names Richard Horne as new chief executive

The lights on the front panel of a broadband internet router, London.

Virgin Media remains most complained about broadband and landline provider

A person using a laptop

£14,000 being lost to investment scams on average, says Barclays