A woman with late-stage breast cancer came to a city hospital, fluids already flooding her lungs. She saw two doctors and got a radiology scan. The hospital’s computers read her vital signs and estimated a 9.3 percent chance she would die during her stay.
Then came Google’s turn. A new type of algorithm created by the company read up on the woman — 175,639 data points — and rendered its assessment of her death risk: 19.9 percent. She passed away in a matter of days.
The harrowing account of the unidentified woman’s death was published by Google last month in research highlighting the healthcare potential of neural networks, a form of artificial intelligence (AI) software that is particularly good at using data to automatically learn and improve.
Illustration: Mountain people
Google had created a tool that could forecast a host of patient outcomes, including how long people might stay in hospitals, their odds of readmission and chances they would soon die.
What impressed medical experts most was Google’s ability to sift through data previously out of reach: notes buried in PDFs or scribbled on old charts. The neural net gobbled up all this unruly information then spat out predictions — and it did it far faster and more accurately than existing techniques.
Google’s system even showed which records led it to conclusions.
Hospitals, doctors and other healthcare providers have been trying for years to better use stockpiles of electronic health records and other patient data. More information shared and highlighted at the right time could save lives — and at the very least help medical workers spend less time on paperwork and more time on patient care.
However, current methods of mining health data are costly, cumbersome and time-consuming.
As much as 80 percent of the time spent on today’s predictive models goes to the “scut work” of making the data presentable, said Nigam Shah, an associate professor at Stanford University who coauthored Google’s research paper, published in the journal Nature.
Google’s approach avoids this.
“You can throw in the kitchen sink and not have to worry about it,” Shah said.
Google’s next step is moving this predictive system into clinics, AI chief Jeff Dean told Bloomberg News last month.
Dean’s health research unit — sometimes referred to as Medical Brain — is working on a slew of AI tools that can predict symptoms and disease with a level of accuracy that is being met with hope as well as alarm.
Inside the company, there is a lot of excitement about the initiative.
“They’ve finally found a new application for AI that has commercial promise,” one Google employee said.
Since Alphabet Inc’s Google declared itself an “AI-first” company in 2016, much of its work in this area has gone to improve existing Internet services. The advances coming from the Medical Brain team give Google the chance to break into a new market — something cofounders Larry Page and Sergey Brin have tried over and over again.
Software in healthcare is largely coded by hand these days.
In contrast, Google’s approach, where machines learn to parse data on their own, “can just leapfrog everything else,” said Vik Bajaj, a former executive at Verily, an Alphabet healthcare arm, and managing director of investment firm Foresite Capital.
“They understand what problems are worth solving,” he said. “They’ve now done enough small experiments to know exactly what the fruitful directions are.”
Dean envisions the AI system steering doctors toward certain medications and diagnoses.
Another Google researcher said existing models miss obvious medical events, including whether a patient had prior surgery.
Existing hand-coded models are “an obvious, gigantic roadblock” in healthcare, the person said, asking not to be identified as they were discussing work in progress.
For all the optimism over Google’s potential, harnessing AI to improve healthcare outcomes remains a huge challenge.
Other companies, notably IBM’s Watson unit, have tried to apply AI to medicine, but have had limited success saving money and integrating the technology into reimbursement systems.
Google has long sought access to digital medical records, also with mixed results. For its recent research, the Internet giant cut deals with the University of California, San Francisco, and the University of Chicago for 46 billion pieces of anonymous patient data. Google’s AI system created predictive models for each hospital, not one that parses data across the two, a harder problem.
A solution for all hospitals would be even more challenging. Google is working to secure new partners for access to more records.
A deeper dive into health would only add to the vast amounts of information Google already has on us.
“Companies like Google and other tech giants are going to have a unique, almost monopolistic, ability to capitalize on all the data we generate,” said Andrew Burt, chief privacy officer for data company Immuta.
He and pediatric oncologist Samuel Volchenboum wrote a recent column arguing governments should prevent this data from becoming “the province of only a few companies,” such as in online advertising where Google reigns.
Google is treading carefully when it comes to patient information, particularly as public scrutiny over data collection rises.
Last year, British regulators slapped DeepMind, another Alphabet AI lab, for testing an app that analyzed public medical records without telling patients that their information would be used like this.
With the latest study, Google and its hospital partners insist their data is anonymous, secure and used with patient permission.
Volchenboum said the company might have a more difficult time maintaining that data rigor if it expands to smaller hospitals and healthcare networks.
Still, Volchenboum believes these algorithms could save lives and money. He hopes health records will be mixed with a sea of other stats.
Eventually, AI models could include information on local weather and traffic — other factors that influence patient outcomes.
“It’s almost like the hospital is an organism,” he said.
Few companies are better poised to analyze this organism than Google. The company and its Alphabet cousin, Verily, are developing devices to track far more biological signals.
Even if consumers do not take up wearable health trackers en masse, Google has plenty of other data wells to tap. It knows the weather and traffic. Google’s Android phones track things such as how people walk, valuable information for measuring mental decline and some other ailments. All that could be thrown into the medical algorithmic soup.
Medical records are just part of Google’s AI healthcare plans. Its Medical Brain has unfurled AI systems for radiology, ophthalmology and cardiology. It is flirting with dermatology, too. Staff created an app for spotting malignant skin lesions; a product manager walks around the office with 15 fake tattoos on her arms to test it.
Dean said this experimentation relies on serious medical counsel, not just curious software coders.
Google is starting a new trial in India that uses its AI software to screen images of eyes for early signs of a condition called diabetic retinopathy.
Before releasing it, Google had three retinal specialists furiously debate the early research results, Dean said.
Over time, Google could license these systems to clinics, or sell them through the company’s cloud-computing division as a sort of diagnostics-as-a-service.
Microsoft Corp, a top cloud rival, is also working on predictive AI services.
To commercialize an offering, Google would first need to get its hands on more records, which tend to vary widely across health providers. Google could buy them, but that might not sit well with regulators or consumers.
The deals with University of California, San Francisco, and the University of Chicago are not commercial.
For now, the company says it is too early to settle on a business model.
At Google’s annual developer conference last month, Lily Peng, a member of Medical Brain, walked through the team’s research outmatching humans in spotting heart disease risk.
“Again,” she said. “I want to emphasize that this is really early on.”
Saudi Arabian largesse is flooding Egypt’s cultural scene, but the reception is mixed. Some welcome new “cooperation” between two regional powerhouses, while others fear a hostile takeover by Riyadh. In Cairo, historically the cultural capital of the Arab world, Egyptian Minister of Culture Nevine al-Kilany recently hosted Saudi Arabian General Entertainment Authority chairman Turki al-Sheikh. The deep-pocketed al-Sheikh has emerged as a Medici-like patron for Egypt’s cultural elite, courted by Cairo’s top talent to produce a slew of forthcoming films. A new three-way agreement between al-Sheikh, Kilany and United Media Services — a multi-media conglomerate linked to state intelligence that owns much of
The US and other countries should take concrete steps to confront the threats from Beijing to avoid war, US Representative Mario Diaz-Balart said in an interview with Voice of America on March 13. The US should use “every diplomatic economic tool at our disposal to treat China as what it is... to avoid war,” Diaz-Balart said. Giving an example of what the US could do, he said that it has to be more aggressive in its military sales to Taiwan. Actions by cross-party US lawmakers in the past few years such as meeting with Taiwanese officials in Washington and Taipei, and
The Republic of China (ROC) on Taiwan has no official diplomatic allies in the EU. With the exception of the Vatican, it has no official allies in Europe at all. This does not prevent the ROC — Taiwan — from having close relations with EU member states and other European countries. The exact nature of the relationship does bear revisiting, if only to clarify what is a very complicated and sensitive idea, the details of which leave considerable room for misunderstanding, misrepresentation and disagreement. Only this week, President Tsai Ing-wen (蔡英文) received members of the European Parliament’s Delegation for Relations
Denmark’s “one China” policy more and more resembles Beijing’s “one China” principle. At least, this is how things appear. In recent interactions with the Danish state, such as applying for residency permits, a Taiwanese’s nationality would be listed as “China.” That designation occurs for a Taiwanese student coming to Denmark or a Danish citizen arriving in Denmark with, for example, their Taiwanese partner. Details of this were published on Sunday in an article in the Danish daily Berlingske written by Alexander Sjoberg and Tobias Reinwald. The pretext for this new practice is that Denmark does not recognize Taiwan as a state under