05/07/2017
BBC
Accessibility links
Skip to contentAccessibility Help
Sign inNotifications
BBC navigation
Home
More
Search
News navigation Sections
Technology
Google NHS deal rebuked again by DeepMind panel
By Jane Wakefield
Technology reporter
5 July 2017
These are external links and will open in a new window Share this with Facebook Share this with Twitter Share
Nurses using Streams appImage copyrightDEEPMIND
Image caption
The Streams app is saving nurses hours each day, says DeepMind
An independent panel set up to oversee the activities of Google's DeepMind has agreed that its initial deal with a UK hospital was "illegal".
The Information Commission (ICO) ruled on Monday that the Royal Free NHS Foundation Trust had not done enough to safeguard patient data.
The controversy is over an app DeepMind developed to identify patients at risk of kidney disease.
The NHS shared 1.6 million patient data records with the company.
Dr Julian Huppert, who chairs the DeepMind Health Independent Review Panel, said that the initial data-sharing contract signed with the Royal Free Hospital Trust had had "deficiencies" and that a revised version, written after the controversy hit the media, needed "a lot of changes".
The panel also acknowledged that this first contract had differed from the standard ones the NHS signed with third-parties despite the fact that DeepMind had said its deal was "no different" from the multitude of other data-sharing deals done within the NHS.
Although most of the ICO's criticism was of the Royal Free, which controlled patient data, the panel had the following advice for DeepMind.
"It would be well-advised to remind partners of their responsibilities," said Dr Huppert.
"People are concerned about the power of big technology firms, and we felt that we should hold DeepMind to a very high standard because of its link to Google," he said, as the panel released its first annual report.
Patient recordsImage copyrightGETTY IMAGES
Image caption
The records collected by DeepMind went back over the past five years
It concluded that DeepMind itself had not broken any laws over the data agreements.
DeepMind is an artificial intelligence company with a health division and a division exploring how to use AI in other walks of life.
But it has previously said that no element of artificial intelligence was used in the development of the Streams app.
On this, Dr Huppert said: "DeepMind could use AI to help with healthcare, but I think that it found that the state of data in the NHS was not as good as it had hoped so it had to step back from this."
The panel did not look at DeepMind's business model, saying it was something to consider for the next report, but, when questioned by journalists, Dr Huppert said that the app was currently offered to the NHS for free.
"It is not sustainable to offer the app for free, and I suspect DeepMind intends to make money but whether that is in the UK or not we don't know," he said.
A hospital corridorImage copyrightTHINKSTOCK
DeepMind has previously said that it wanted to be paid on the outcomes it delivers.
The panel also appointed a team of experts to look at the security of the patient data being held by DeepMind, and they concluded that there were 11 data vulnerabilities, most of them low risk.
These included a flaw in the data centre that meant anyone with access to the system could overwrite data and potentially introduce malware.
And the the experts suggested devices used by healthcare professionals to access patient data could be more locked down.
DeepMind said that it was addressing the vulnerabilities.
They also found that the data being kept by DeepMind was completely separate from Google.
In a blogpost, DeepMind acknowledged its mistakes.
"Ultimately, if we want to build technology to support a vital social institution like the NHS, then we have to make sure we serve society's priorities and not outrun them," said DeepMind co-founder Mustafa Suleyman.
"There's a fine line between finding exciting new ways to improve care, and moving ahead of patients' expectations. We know that we fell short at this when our work in health began, and we'll keep listening and learning about how to get better at this."
Share this story About sharing
Email
Facebook
Messenger
Twitter
Pinterest
WhatsApp
LinkedIn
More on this story
Google DeepMind NHS app test broke UK privacy law
3 July 2017
Google DeepMind's NHS deal under scrutiny
17 March 2017
Technology
S*x robots
Call for a ban on child s*x robots
5 July 2017
From the section Technology
Full article Call for a ban on child s*x robots
Bitcoin
Hackers steal funds from Bitcoin traders
5 July 2017
From the section Technology
Full article Hackers steal funds from Bitcoin traders
Two members of the Afghan robot team
Afghan girl roboticists denied US visas
5 July 2017
From the section Technology
Full article Afghan girl roboticists denied US visas
Top Stories
Government sends in Grenfell 'taskforce'
Saudi 'chief promoter of UK extremism'
Prime Minister's Questions
Features
Weddell Sea berg
Giant 'white wanderer' poised to break free
Sid-Ali Atmani and daughter Hayam VIDEO
Grenfell child: 'Give us houses we want'
Georgia Macqueen Black holding a photo of a policeman
Pain beneath the surface
Small pile of long grain white rice over a wooden surface
Why people believe the myth of 'plastic rice'
Eche Ogbuono
Is there institutional racism in mental health care?
North Korean leader Kim Jong-un (right) reacts during the test of the Hwasong-14 missile in this undated photo released by North Korea's KCNA news agency on 4 July 2017
N Korea new missile test: A game-changer?
US President Donald Trump waves to the press after escorting Indian Prime Minister Narendra Modi to his car on the South Lawn of the White House in Washington, DC, June 26, 2017, following meetings and dinner.
Why is Donald Trump going to Poland?
Mark MacLaine
The lucrative world of 'the super tutor'
China's plans for a forest city VIDEO
China's forest city
Most Read
1
Volvo to phase out traditional engines
2
Jacob Rees-Mogg announces baby Sixtus
3
HMRC wins Rangers 'big tax case' ruling
4
Giant 'white wanderer' poised to break free
5
Grenfell Tower: Government sends in 'taskforce'
6
Why people believe the myth of 'plastic rice'
7
Saudi Arabia has 'clear link' to UK extremism, report says
8
Bijan Ebrahimi: Police 'failed' murdered man for years
9
Charlie Gard: Vatican children's hospital offers help
10
North Korea ICBM launch: US and S Korea respond with drill
News navigationSections
BBC News Services
On your mobile
On your connected tv
Get news alerts
Contact BBC News
This Week on BBC Two
Video
What's happening in Ripper Street?
BBC TWO
Video
How different is Wales from Tennessee?
BBC TWO
Iplayer
White Gold: Watch the full series
BBC IPLAYER
Video
Lemn Sissay: Behind the scenes at MIF
BBC TWO
Previous
Next
Home
News
Sport
Weather
iPlayer
TV
Radio
CBBC
CBeebies
Food
iWonder
Bitesize
Travel
Music
Earth
Arts
Make It Digital
Taster
Local
Terms of Use
About the BBC
Privacy Policy
Cookies
Accessibility Help
Parental Guidance
Contact the BBC
Copyright © 2017 BBC. The BBC is not responsible for the content of external sites. Read about our approach to external linking.