Scientists have picked up fragments of people’s thoughts by decoding the brain activity caused by words that they hear.
The feat has given researchers fresh insight into how the brain processes language and raises the prospect of devices that can return speech to the speechless.
Though in its infancy, the work paves the way for brain implants that could monitor a person’s thoughts and speak words and sentences as they imagine them.
Such devices could transform the lives of thousands of people who lose the ability to speak as a result of a stroke or other medical conditions.
Experiments on 15 patients in the US showed that a computer could decipher their brain activity and play back words they heard, though at times the words were difficult to recognize.
“This is exciting in terms of the basic science of how the brain decodes what we hear,” said Robert Knight, a senior member of the team and director of the Helen Wills Neuroscience Institute at the University of California, Berkeley. “The next step is to test whether we can decode a word when a person imagines it. That might sound spooky, but this could really help patients. Perhaps in 10 years it will be as common as grandmother getting a new hip.”
The study is published in the journal PLoS Biology.
The scientists ran tests on patients who were already in hospital for an operation to treat intractable epilepsy. In that procedure, patients have the top of their skull removed and a net of electrodes laid across the surface of their brain. Doctors use the electrodes to identify the precise trigger point of the patient’s fit, before removing the tissue. Sometimes, patients wait for days before they have enough seizures to locate the source of the problem.
Scientist Brian Pasley enrolled 15 patients to take part. He played each a series of words for five to 10 minutes while recording their brain activity. He then created computer programs that could recognize sounds encoded in the brain waves.
He next played a collection of new words to the patients to see if the algorithms could pick out and repeat recognizable words.
The scientists got their best results when they recorded activity in the superior temporal gyrus, part of the brain that sits to one side, above the ear.
“I didn’t think it could possibly work, but Brian did it,” Knight said. “His model can reproduce the sound the patient heard and you can actually recognize the word, though not at a perfect level.”
The prospect of reading minds has led to ethical concerns that the technology could be used covertly or to interrogate criminals and terrorists.
Knight said that is in the realm of science fiction.
“To reproduce what we did, you would have to open up someone’s skull and they would have to cooperate,” he said.
VULNERABLE: Many women do not report sexual harassment by their landlord over fears they could lose the roof over their head, an expert said A growing number of landlords are asking tenants for sex in exchange for housing as COVID-19 lockdowns and job cuts have left many struggling to pay their rent, housing experts said. A survey by the National Fair Housing Alliance of more than 100 fair housing groups combating discrimination across the US found that 13 percent had seen an increase in sexual harassment complaints during the pandemic. “If I did not have sex with him, he was going to put me out,” one woman facing eviction by her property manager told the alliance in an podcast on its Web site. “As a single
‘OBVIOUS DIFFERENCE’: The Wuhan Institute of Virology has been researching bat coronaviruses to trace the SARS pathogen, which is 80 percent similar to SARS-CoV-2 The Chinese virology institute in the city where COVID-19 first emerged has three live strains of bat coronavirus on-site, but none match the new contagion wreaking havoc around the world, its director has said. Scientists think COVID-19 — which first emerged in Wuhan and has killed more than 340,000 people worldwide — originated in bats and could have been transmitted to people via another mammal. However, the director of the Wuhan Institute of Virology told state broadcaster China Global Television Network that claims made by US President Donald Trump and others that the novel coronavirus could have escaped from the facility were
HUMAN RIGHTS ABUSES? An institute of the Chinese Ministry of Public Security and a company are to be sanctioned over ‘human rights violations and abuses’ The US Department of Commerce on Friday said that it would sanction a Chinese government institute and eight companies over alleged human rights abuses against Uighurs and other minorities in China’s western Xinjiang region. “These nine parties are complicit in human rights violations and abuses committed in China’s campaign of repression, mass arbitrary detention, forced labor and high-technology surveillance against Uighurs, ethnic Kazakhs and other members of Muslim minority groups in the Xinjiang Uighur Autonomous Region,” the department said in a statement. The Chinese Ministry of Public Security’s Institute of Forensic Science and Aksu Huafu Textiles Co are to be sanctioned “for
SPACE RACE: The China Aerospace Science and Technology Corp mission aims to land a robotic rover and put a probe into orbit around the planet China is targeting a July launch for its ambitious Mars mission, which includes landing a remote-controlled robot on the surface of the Red Planet, the company in charge of the project has said. Beijing has invested billions of dollars in its space program in an effort to catch up with its rival, the US, and affirm its status as a major world power. The Mars mission is among a number of new space projects China is pursuing, including putting Chinese astronauts on the moon and having a space station by 2022. Beijing had been planning the Mars mission for some time this year,