Apple brings child sexual abuse detection tools to the UK

20 April 2022, 18:24

Apple's communications safety in Messages tool, which is launching in the UK
thumbnail_Communication Safety in Messages. Picture: PA

Alerts will warn children when they receive or attempt to send an image believed to contain nudity and offer them support and guidance.

A feature in Apple’s Messages app that can spot and warn children when sexually explicit images are received or about to be sent is to be introduced in the UK.

First launched in the United States last year, the tool blurs out images received that are believed to contain nudity and shows an alert to children which warns them about the image, offers them helpful resources and reassures them it is okay to choose not to view the image, while a similar alert also appears if a child attempts to send photos which contain nudity.

The feature is powered by on-device artificial intelligence, Apple says, with the interventions all processed on-device and without notifying Apple or anyone else in order to protect privacy. However, the feature does include an option for children to message a trusted contact for help if they so choose.

The feature will be rolled out as part of a software update in the coming weeks, Apple confirmed, and will be available in the Messages app on iPhone, iPad and Mac computers.

It is not turned on by default and parents must opt-in in order to use it, the company said, and can only be used for child accounts set up as families in iCloud as part of a Family Sharing plan.

The tool will be joined by other on-screen interventions in searches on Apple’s Safari web browser and those done via virtual assistant Siri or the Spotlight tool, which appear when users search for themes related to child exploitation – a feature that has also previously launched in the US and now comes to the UK for the first time.

The pop-ups explain to users that these topics are harmful and problematic and offer resources from third-party organisations for further help and guidance on the issue.

However, a third proposed protection tool – which was also initially announced alongside the others last year before being delayed after some campaigners raised privacy concerns – remains in development with Apple saying it is continuing to collect feedback and make improvements to it.

That feature uses new systems which would detect child sexual abuse imagery when someone tried to upload it to iCloud, and report it to authorities.

Apple said the process would be done securely and would not regularly scan a user’s camera roll, however, privacy campaigners raised concerns over the plans, with some suggesting the technology could be hijacked by authoritarian governments to look for other types of imagery – something Apple said it would not allow.

The UK rollout of the child protection tools is the latest in a series of major updates from the iPhone maker which it says are aimed at improving user safety, following a number of security updates rolled out over the last year designed to cut down on third-party data collection and improve user privacy when they use an iPhone or other Apple device.

In response to the announcement, online safety group the Internet Watch Foundation (IWF) said it welcomed the move to boost child safety.

“We’re pleased to see Apple expanding the communication safety in Messages feature to the UK,” IWF communications director Emma Hardy said.

“At IWF, we’re concerned about preventing the creation of ‘self-generated’ child sexual abuse images and videos.

“Research shows that the best way to do this is to empower families, and particularly children and young people, to make good decisions. This, plus regularly talking about how to use technology as a family are good strategies for keeping safe online.”

By Press Association

More Technology News

See more More Technology News

Person on laptop

UK cybersecurity firm Darktrace to be bought by US private equity firm

Mint Butterfield is missing in the Tenerd

Billionaire heiress, 16, disappears in San Francisco neighbourhood known for drugs and crime

A woman’s hand presses a key of a laptop keyboard

Competition watchdog seeks views on big tech AI partnerships

A woman's hands on a laptop keyboard

UK-based cybersecurity firm Egress to be acquired by US giant KnowBe4

TikTok�s campaign

What next for TikTok as US ban moves step closer?

A laptop user with their hood up

Deepfakes a major concern for general election, say IT professionals

A woman using a mobile phone

Which? urges banks to address online security ‘loopholes’

Child online safety report

Tech giants agree to child safety principles around generative AI

Holyrood exterior

MSPs to receive cyber security training

Online child abuse

Children as young as three ‘coerced into sexual abuse acts online’

Big tech firms and financial data

Financial regulator to take closer look at tech firms and data sharing

Woman working on laptop

Pilot scheme to give AI regulation advice to businesses

Vehicles on the M4 smart motorway

Smart motorway safety systems frequently fail, investigation finds

National Cyber Security Centre launch

National Cyber Security Centre names Richard Horne as new chief executive

The lights on the front panel of a broadband internet router, London.

Virgin Media remains most complained about broadband and landline provider

A person using a laptop

£14,000 being lost to investment scams on average, says Barclays