Like many autistic children, Julian Brown has trouble reading emotions in people’s faces, one of the biggest challenges for people with the neurological disorder.
The 10-year-old San Jose boy is getting help from “autism glass” — an experimental device that records and analyzes faces in real time and alerts him to the emotions they are expressing.
The facial recognition software was developed at Stanford University and runs on Google Glass, a computerized headset with a front-facing camera and a tiny display just above the right eye.
Julian is one of about 100 autistic children participating in a Stanford study to see if “autism glass” therapy can improve their ability to interpret facial expressions.
“There’s not a machine that can read your mind, but this helps with the emotions, you know, recognizing them,” Julian said.
Julian wears the device each day for three 20-minute sessions when he interacts with family members face-to-face — talking, playing games, eating meals. The program runs on a smartphone, which records the sessions.
When the device’s camera detects an emotion such as happiness or sadness, Julian sees the word “happy” or “sad” — or a corresponding “emoji” — flash on the glass display. The device also tests his ability to read facial expressions.
“The autism glass program is meant to teach children with autism how to understand what a face is telling them. And we believe that when that happens they will become more socially engaged,” said Dennis Wall, who directs the Stanford School of Medicine’s Wall Lab, which is running the study.
Stanford student Catalin Voss and researcher Nick Haber developed the technology to track faces and detect emotions in a wide range of people and settings.
“We had the idea of basically creating a behavioral aide that would recognize the expressions and faces for you and then give you social cues according to those,” said Voss, who was partly inspired by a cousin who has autism.
Google provided about 35 Google Glass devices to Stanford, but otherwise has not been involved in the project. The Silicon Valley tech giant stopped producing the headset last year after it failed to gain traction, but the device found new life among medical researchers.
Brain Power, a Cambridge, Massachusetts-based start-up, is also developing Google Glass-based applications to help children with autism improve their face-reading abilities and social skills.
Autism advocates are excited that researchers are developing technologies to help the estimated one in 68 US children diagnosed with autism spectrum disorder.
‘IN A DIFFERENT PLACE’: The envoy first visited Shanghai, where he attended a Chinese basketball playoff match, and is to meet top officials in Beijing tomorrow US Secretary of State Antony Blinken yesterday arrived in China on his second visit in a year as the US ramps up pressure on its rival over its support for Russia while also seeking to manage tensions with Beijing. The US diplomat tomorrow is to meet China’s top brass in Beijing, where he is also expected to plead for restraint as Taiwan inaugurates president-elect William Lai (賴清德), and to raise US concerns on Chinese trade practices. However, Blinken is also seeking to stabilize ties, with tensions between the world’s two largest economies easing since his previous visit in June last year. At the
Nearly half of China’s major cities are suffering “moderate to severe” levels of subsidence, putting millions of people at risk of flooding, especially as sea levels rise, according to a study of nationwide satellite data released yesterday. The authors of the paper, published by the journal Science, found that 45 percent of China’s urban land was sinking faster than 3mm per year, with 16 percent at more than 10mm per year, driven not only by declining water tables, but also the sheer weight of the built environment. With China’s urban population already in excess of 900 million people, “even a small portion
UNSETTLING IMAGES: The scene took place in front of TV crews covering the Trump trial, with a CNN anchor calling it an ‘emotional and unbelievably disturbing moment’ A man who doused himself in an accelerant and set himself on fire outside the courthouse where former US president Donald Trump is on trial has died, police said yesterday. The New York City Police Department (NYPD) said the man was declared dead by staff at an area hospital. The man was in Collect Pond Park at about 1:30pm on Friday when he took out pamphlets espousing conspiracy theories, tossed them around, then doused himself in an accelerant and set himself on fire, officials and witnesses said. A large number of police officers were nearby when it happened. Some officers and bystanders rushed
Beijing is continuing to commit genocide and crimes against humanity against Uyghurs and other Muslim minorities in its western Xinjiang province, U.S. Secretary of State Antony Blinken said in a report published on Monday, ahead of his planned visit to China this week. The State Department’s annual human rights report, which documents abuses recorded all over the world during the previous calendar year, repeated language from previous years on the treatment of Muslims in Xinjiang, but the publication raises the issue ahead of delicate talks, including on the war in Ukraine and global trade, between the top U.S. diplomat and Chinese