Imagine being able to control a robotic arm from a distance, using only your mind. Now imagine being able to feel when its fingers grasp an object, as though it were your own hand.
US researchers on Thursday published a study in the journal Science about the world’s first brain-computer interface that allowed a volunteer with paralysis from the chest down to accomplish the feat.
The team say their work demonstrates that adding a sense of touch drastically improves the functionality of prosthetics for quadriplegics, as opposed to having them rely on visual cues alone.
Photo: AFP / UPMC / Pitt Health Sciences / Handout
“I am the first human in the world to have implants in the sensory cortex that they can use to stimulate my brain directly, and then I feel as if a sensation is coming from my actual hand,” 34-year-old Nathan Copeland said.
In 2004, Copeland was in a car accident that left him with a serious spinal cord injury and without the use of his hands or his legs.
He volunteered to participate in scientific research, and six years ago underwent a major operation to have tiny electrodes implanted into his brain.
Two sets of 88 electrodes the width of a strand of hair are arranged into “arrays” that resemble tiny hairbrushes and penetrate deep into the brain’s motor cortex, which directs movement.
Fewer than 30 people in the world have these kinds of implants, said Rob Gaunt, the study’s colead author and an assistant professor at the University of Pittsburgh’s Department of Physical Medicine and Rehabilitation.
What is unique about Copeland is an additional set of electrodes that are connected to his somatosensory cortex, which receives and processes sensations.
“When we’re grabbing objects, we use this sense of touch very naturally to improve our ability to control,” Gaunt said.
The team developed an interface that is “bidirectional” — meaning not only that it can “read” instructions from the brain and send them to the artificial limb, it can also “write” sensations from the device and transmit them back.
The idea of sending tactile feedback to the somatosensory cortex goes back decades, but doing so in a way that is controlled and is understandable by the circuitry of the brain was a challenge.
After operating on Copeland to install the electrodes, the team held their breath.
“No one knew what to expect because this had only been done in monkeys, and you can’t ask a monkey what something feels like,” Copeland said.
Then came the moment of truth, when they tried sending their first touch signal.
“It was really faint,” he said.
He asked them to try again, to be sure it was real.
“Oh yeah, that’s what that feels like, and it was just super cool,” he said.
Before the interface could be put to work with the robotic arm, the scientists had to do a series of tests with Copeland.
First, they needed to learn which electrodes caused what sensation when activated, and which fingers they were associated with, to set up the robotic hand correctly. They also made him watch videos of the robotic arm moving left or right and recorded the electrodes that lit up when he was asked to “think” it was him controlling it.
Finally it was time to try it out. Copeland sat next to the metallic black robotic arm and was asked to pick up a series of small objects such as rocks and spheres, and place them on a box — with either the tactile sensors switched on, or off.
He was able to complete each task on average twice as fast when the sensors were enabled, and was even able to achieve more complex tasks such as picking up a glass and pouring its contents into another.
“The sensation gave me that assurance and confidence to know that I definitely had a good grab on the object and I could lift it up,” Copeland said.
The team wants to refine the prosthetics because “we don’t want to just do science experiments in the lab, we want to actually build devices that are useful to people in their homes,” Gaunt said.
Copeland got his brain-computer interface set up at home when COVID-19 shut down the university, and has used his downtime to learn how to draw on a tablet and even play video games.
He does this by using his mind to send signals directly to the computer, rather than using the arm to push buttons.
“It is just second nature to me now,” he said.
Stephen Garrett, a 27-year-old graduate student, always thought he would study in China, but first the country’s restrictive COVID-19 policies made it nearly impossible and now he has other concerns. The cost is one deterrent, but Garrett is more worried about restrictions on academic freedom and the personal risk of being stranded in China. He is not alone. Only about 700 American students are studying at Chinese universities, down from a peak of nearly 25,000 a decade ago, while there are nearly 300,000 Chinese students at US schools. Some young Americans are discouraged from investing their time in China by what they see
MAJOR DROP: CEO Tim Cook, who is visiting Hanoi, pledged the firm was committed to Vietnam after its smartphone shipments declined 9.6% annually in the first quarter Apple Inc yesterday said it would increase spending on suppliers in Vietnam, a key production hub, as CEO Tim Cook arrived in the country for a two-day visit. The iPhone maker announced the news in a statement on its Web site, but gave no details of how much it would spend or where the money would go. Cook is expected to meet programmers, content creators and students during his visit, online newspaper VnExpress reported. The visit comes as US President Joe Biden’s administration seeks to ramp up Vietnam’s role in the global tech supply chain to reduce the US’ dependence on China. Images on
Taiwan Transport and Storage Corp (TTS, 台灣通運倉儲) yesterday unveiled its first electric tractor unit — manufactured by Volvo Trucks — in a ceremony in Taipei, and said the unit would soon be used to transport cement produced by Taiwan Cement Corp (TCC, 台灣水泥). Both TTS and TCC belong to TCC International Holdings Ltd (台泥國際集團). With the electric tractor unit, the Taipei-based cement firm would become the first in Taiwan to use electric vehicles to transport construction materials. TTS chairman Koo Kung-yi (辜公怡), Volvo Trucks vice president of sales and marketing Johan Selven, TCC president Roman Cheng (程耀輝) and Taikoo Motors Group
New apartments in Taiwan’s major cities are getting smaller, while old apartments are increasingly occupied by older people, many of whom live alone, government data showed. The phenomenon has to do with sharpening unaffordable property prices and an aging population, property brokers said. Apartments with one bedroom that are two years old or older have gained a noticeable presence in the nation’s six special municipalities as well as Hsinchu county and city in the past five years, Evertrust Rehouse Co (永慶房產集團) found, citing data from the government’s real-price transaction platform. In Taipei, apartments with one bedroom accounted for 19 percent of deals last