IT experts ‘surprised’ at PHE use of Excel for Covid-19 data

5 October 2020, 16:24

Coronavirus test kit
IT experts ‘surprised’ at PHE use of Excel for Covid-19 data following error. Picture: PA

A spreadsheet error led to nearly 16,000 cases going unreported.

IT experts have questioned why Public Health England used Excel for a scheme as large as NHS Test and Trace after a technical error led to nearly 16,000 cases going unreported.

The issue occurred when people who tested positive were not recorded once an Excel spreadsheet reached its maximum size, a spokesman for Public Health England (PHE) told the PA news agency on Monday morning.

This resulted in 15,841 cases between September 25 and October 2 being left out of the reported daily coronavirus cases, causing a delay in efforts by NHS Test and Trace to find the contacts of those who tested positive for the virus.

Computing experts and academics told PA it is “very surprising” that Excel was used for something of this scale and said such a system should have been adequately tested.

HEALTH Coronavirus
(PA Graphics)

“It is very surprising to hear that an enterprise scale system, presumably developed by professional technologists, is expected to run on Excel,” said Adam Leon Smith, fellow of BCS, The Chartered Institute for IT, and chair of BCS’s special interest group in software testing.

“Many large organisations refer disparagingly to Excel-based applications as ‘end-user driven architectures’ and spend lots of time trying to decommission them for reasons relating to security, control and stability.

“This is mostly because Excel is designed for end-users not complex systems, has well-known scalability limits, and will not handle unexpected situations in a way that interacting systems will be able to recognise.

“It sounds like these limitations have manifested in real problems in this case, and this is exactly why databases are normally used in enterprise applications.

“Even if presented with a system that did rely on Excel, one of the first things that should have been identified through a testing process was a limit to the data volume it could process.”

Dr Peter Bannister, executive chair for the Institution of Engineering and Technology Healthcare Sector, said limitations of commercial off-the-shelf products such as Excel for medical uses are well-known.

“It’s disappointing to read that a lack of awareness around the limitations of a consumer software product has led to such a negative impact for all those who are relying on the Covid testing programme,” he said.

“It’s widely known within medical device development that the use of commercial off-the-shelf products, such as Excel, requires additional testing to ensure that they are able to meet the stringent requirements of use in a healthcare setting.”

The Excel spreadsheet reached its maximum file size, which stopped new names being added in an automated process, PA was told.

The files have now been split into smaller multiple files to prevent the issue happening again.

Jon Crowcroft, Marconi Professor of communications systems from the University of Cambridge, said file size is a “basic consideration”.

“One would think that a software engineer would have considered a worst-case test scenario for any system design – on paper before you even get to writing code – just to make sure it wouldn’t blow up in any way like this,” he explained.

“The limitations of Excel in terms of big data, which is generally a very decent piece of software, are well-known – if you look at how many people are expressing astonishment at this online, you can see that.”

He continued: “There are many big systems in Government (eg DVLA’s or HMRC’s) that work at this scale so there’s no excuse.

“Also, a simple sanity check on the data or error checks in the system might have told them when they hit this limit instead of discovering it after the event.

“This sort of thing is standard in sixth form or undergraduate computer science training too.”

By Press Association

More Technology News

See more More Technology News

A laptop

Millions of older people being cut off by lack of basic internet skills – Age UK

A computer screen

Leading AI figures awarded honours

AI warning

Essays written with ChatGPT feature repetition of words and ideas – study

A broadband router

Big four broadband firms beaten by smaller rivals in latest Which? survey

A person pressing on the Tik Tok logo on the screen of a smartphone

TikTok to launch online election centres to counter misinformation

A person using a laptop

Up to eight million UK jobs at risk from AI, report says

Smartphone showing apps

One in six adolescents have experienced cyberbullying, global study finds

An Uber Eats driver

Uber Eats driver wins payout over discriminatory facial recognition checks

Rishi Sunak visits Cumbria

Sunak says UK ‘more robust’ on China than most allies

Chinese President state visit – Preparations

Minister calls China ‘security threat’ after UK and US blame Beijing for hacking

China

UK and US accuse China of ‘malicious’ global cyber attacks

A hand on a laptop

Tougher action needed to combat copycat banking websites, says Which?

Dowden

Dowden guarantees UK elections will be safe from Chinese cyber attacks

A woman’s hand pressing a key of a laptop keyboard

Cyber security agency says China behind ‘malicious’ cyber attacks on UK

A young girl uses the TikTok app on a smartphone

TikTok Youth Council holds first meetings on better online safety for teenagers

Margrethe Vestager

EU opens competition investigations into Apple, Google and Meta