Uber Eats driver wins payout over discriminatory facial recognition checks

26 March 2024, 20:24

An Uber Eats driver
Uber Eats. Picture: PA

Pa Edrissa Manjang was removed from the delivery firm’s platform after its facial recognition system failed to recognise him.

An Uber Eats driver has received a payout to end a legal claim following allegations that the platform’s AI-powered facial recognition checks required to work for the delivery firm were racially discriminatory.

In 2021, Pa Edrissa Manjang was told he was being removed from working for the platform because of “continued mismatches” in the photos he submitted to the facial recognition system required for drivers to access the platform and work.

Mr Manjang, who is black, said he had experienced continuous difficulties with the verification process and was regularly asked to resubmit selfie images of himself to the platform as it did not recognise him, despite no change to his appearance.

Following his dismissal, he launched a legal claim with support and funding from the Equality and Human Rights Commission (EHRC) and the App Drivers and Couriers Union (ADCU), who said they were concerned by the use of artificial intelligence and automation in the case, particularly how it could be used to permanently suspend a driver’s access to the app, and therefore, work.

Baroness Kishwer Falkner, chairwoman of the EHRC, said: “I am pleased that Pa Edrissa Manjang was able to settle his case with Uber Eats, but he should never have had to bring a legal claim in order to understand the opaque processes that affected his work.

“AI is complex, and presents unique challenges for employers, lawyers and regulators. It is important to understand that as AI usage increases, the technology can lead to discrimination and human rights abuses.

“We are particularly concerned that Mr Manjang was not made aware that his account was in the process of deactivation, nor provided any clear and effective route to challenge the technology. More needs to be done to ensure employers are transparent and open with their workforces about when and how they use AI.

“Every employer should take note of this, even major companies like Uber. When such companies rely on automation to help manage their staff they need to guard against unlawful discrimination.”

Mr Manjang said: “My case shines a spotlight on the potential problems with the use of AI, particularly for low paid workers in the gig economy who want to understand how decisions are being taken which affect their livelihoods. This marks the end of a long and difficult case.

“I am sure the EHRC will use the learnings and experience of this case to move towards strengthening the rights and protections of workers in relation to AI, particularly ethnic minorities.”

An Uber spokesperson said: “Our Real Time ID check is designed to help keep everyone who uses our app safe, and includes robust human review to make sure that we’re not making decisions about someone’s livelihood in a vacuum, without oversight.

“Automated facial verification was not the reason for Mr Manjang’s temporary loss of access to his courier account.”

By Press Association

More Technology News

See more More Technology News

AI study

Action needed to protect election from AI disinformation, study says

Dr Laura Cinti looks up at an E.woodii plant growing in a glasshouse at Kew Gardens

AI enlisted in the hunt for female partner for lonely ancient plant

A mobile phone next to a telecoms mast near Dundry, Somerset

Pace required to hit targets on rural mobile signal unsustainable, report says

A NatWest sign

NatWest apologises to customers after mobile and online banking suffer outages

Greg Clark

AI regulators in UK are ‘under-resourced’, warns science committee chairman

Openreach engineer

Plans to build full fibre broadband in more than 500 new places unveiled

TikTok strategy

Tory TikTok launch ‘pathetic’ compared with Labour’s ‘savvier’ approach – expert

Person using laptop

More than 300 million children a year face sexual abuse online, study suggests

There are calls for mobile phones to be totally banned for under 16s

Calls for mobile phones to be totally banned for under 16s

A young girl using a mobile phone (picture posed by model)

Next government should consider banning phones for under-16s, report says

Sir Chris Bryant

AI should be used to develop an app which detects skin cancer, Labour MP says

Handout image from Microsoft of its Copilot virtual assistant displayed on a laptop screen

Microsoft expanding Copilot AI assistant to organise meetings and support teams

Solar panels on a house roof

Octopus Energy launches ‘buy now, pay later’ for solar panels

Raspberry Pi

Raspberry Pi set for June IPO in welcome boost for London market

A person using a laptop

Nations agree to develop shared risk thresholds for AI as Seoul summit closes

Microsoft new equiment

Data regulator looking into Microsoft’s AI Recall feature