Apple brings eye tracking to iPhone and iPad in accessibility update

15 May 2024, 17:54

Apple iPhone 15s on display
iPhone repairs. Picture: PA

Users with physical disabilities will now be able to control their iPhone or iPad using eye movements.

Apple is to enable eye tracking on the iPhone and iPad as part of a new range of accessibility tools aimed at helping those with physical disabilities to more easily use their devices.

Using artificial intelligence, it will allow users to navigate their Apple device using just their eyes.

The new feature is joined by a new Music Haptics tool, which uses the taptic engine in the iPhone – which powers the vibrations on the device – to enable those who are deaf or hard of hearing to experience music vibrating to the audio of the music.

Apple said it was also introducing new speech features which enable users to assign custom utterances to virtual assistant Siri to help with shortcuts to apps, aimed at those with conditions that affect their speech.

The eye-tracking tool uses the front-facing camera on the iPhone or iPad to set up and calibrate, and does not require any additional hardware or software.

The AI processing to enable eye tracking also takes place on-device, Apple said.

“We believe deeply in the transformative power of innovation to enrich lives,” Apple chief executive Tim Cook said.

“That’s why for nearly 40 years, Apple has championed inclusive design by embedding accessibility at the core of our hardware and software.

“We’re continuously pushing the boundaries of technology, and these new features reflect our long-standing commitment to delivering the best possible experience to all of our users.”

Also among the suite of new features announced by the tech giant was a feature the firm says could reduce motion sickness for passengers in moving vehicles.

Apple said research has shown that motion sickness is commonly caused by sensory conflict between what a person sees and what they feel, but said its new Vehicle Motion Cues feature, which places animated dots on the edges of the screen to represent changes in vehicle motion, can help to reduce sensory conflict and therefore motion sickness.

By Press Association

More Technology News

See more More Technology News

A young girl using a mobile phone (picture posed by model)

Next government should consider banning phones for under-16s, report says

Sir Chris Bryant

AI should be used to develop an app which detects skin cancer, Labour MP says

Handout image from Microsoft of its Copilot virtual assistant displayed on a laptop screen

Microsoft expanding Copilot AI assistant to organise meetings and support teams

Solar panels on a house roof

Octopus Energy launches ‘buy now, pay later’ for solar panels

Raspberry Pi

Raspberry Pi set for June IPO in welcome boost for London market

A person using a laptop

Nations agree to develop shared risk thresholds for AI as Seoul summit closes

Microsoft new equiment

Data regulator looking into Microsoft’s AI Recall feature

An easyJet plane

EasyJet uses AI to better manage flights from new control centre

Cabinet meeting

AI safety summits could help shape UK legislation, Technology Secretary says

Someone at a laptop

Safety institutes to form ‘international network’ to boost AI research and tests

Soldiers' boots

Army personnel feel ‘let down’ after MoD cyber attack

Person uses laptop

Global AI tech companies agree to set of safety outcomes in ‘world first’

AI safety summit

World leaders need to ‘get serious’ about AI, experts warn as summit opens

76th Cannes Film Festival

Scarlett Johansson: ChatGPT voice sounds ‘eerily similar’ to mine

UK’s economy

UK workers with AI skills get 14% wage premium, research suggests

Social media apps

Tech firms falling short on misinformation ahead of general election – committee