Absent what he calls “super luck,” Stephen Hicks could easily have found himself lugging plasma TV screens up the staircases of apartment buildings. As it turned out, the Australian scientist, who was in need of money in 2007, landed a job that was the first step in the creation of elaborate “smart glasses.”
The claim for the smart glasses is that they have the potential of giving those with impaired sight the chance to recognize everyday objects and people again.
The glasses use a combination of cameras to sense objects such as tables and walls, as well as people, and then process that information into bright light on a screen. The person with impaired sight can use what is left of their vision to understand what is in front of them and navigate their surroundings.
Illustration: Tania Chou
Hicks and his colleagues in Oxford recently won a £500,000 (US$816,000) grant to expand the project and they now plan to create 100 pairs of the glasses to test on people with sight loss, in their homes. They aim to bring smart glasses to market at the end of next year.
It is the culmination of a life-long interest in neuroscience for Hicks, who was led back to his passion for investigating how technology and the brain can work together when researching Huntington’s disease about seven years ago.
The latest prototype of his work uses two cameras and a laser to identify objects and then relay that information to a computer, which displays the objects on the glasses in very simplified form — detailed bright shapes. Users can see the objects using their residual vision, which typically is limited to perceptions of light and motion.
In effect, the wearer sees a reduced version of the world without color, where objects that are closer are much brighter. When people, bus stops and cars are farther away they get darker.
When he began the research, Hicks found that most people classified as blind still had some vision. “I didn’t realize that blindness was this continuum. In hindsight, of course it is, it is the same as deafness: You can get people who are profoundly deaf, but the majority of people who are using hearing aids really just need [sound] amplified.”
The technology is aimed at allowing those with partial sight to navigate around the environment with much greater ease.
In one of the early tests, a man was able to see his guide dog for the first time.
“A guy had seen his guide dog and said, ‘There you are, girl.’ Then we saw the power of what this could potentially mean to someone when it becomes more generally used,” Hicks said.
Some light perception is needed; the glasses can be calibrated to sensitivity.
“Nearby things are going to get brighter, so put your hand in front and wave it and you will see it. You will be able to build up hand-eye coordination. You will be able to walk around unfamiliar environments, especially at nighttime and get a good idea about obstacles — where gutters are, where overhanging branches are — giving you confidence to walk down unfamiliar streets and be able to avoid bollards and buggies,” Hicks said.
Lyn Oliver, 70, from Faringdon, Oxfordshire, has joined the trials. She says she can see bone structures from almost 2m away, as well as ceiling beams and doorways. She became unable to read print in 1970 and started using a guide dog three years later.
“It will be less stress,” she said. “Because I live in a market town, there is walking into hedges and low branches and things parked over the path. It will make a lot of difference to a lot of people and give them that little bit of normality, the confidence of walking out.”
Hicks quotes figures from the Royal National Institute of Blind People (RNIB) that reveal that less than half of people who were severely sight-impaired tended to leave their home on any one day because of the dangers of running into objects.
The RNIB has been working with Hicks and Oxford University to develop the glasses.
“We are excited about the potential these glasses have to improve the way blind and partially sighted people go about their everyday lives,” the RNIB’s Neil Heslop said.
The glasses have gotten smaller since initial tests that involved augmented ski goggles with banks of screens, but they are still chunky and pronounced. The makers aim to slim them down further until they are as unobtrusive as possible, with the potential of retrofitting normal glasses with the technology.
The funding for the project came from the Google Impact Challenge, a scheme to fund charities using technology to aid people. The glasses being developed are to be tested at home by 1,000 people. A spinoff company owned by the RNIB, Oxford University and the device creators is planned.
Hicks aims to have the first sets of glasses for sale by the end of next year, priced between £300 and £400, but said they would not immediately eradicate the need for such aids as canes.
“It is more important for me to have lots of these in people’s hands rather than a few for people who can afford it. If you can do mobile phones for that kind of price, I don’t see why we can’t replicate that with our own commercial approach,” he said.
There are more than 2 million people in the UK with impaired vision and 300,000 people are registered blind, the RNIB said.
A Chinese diplomat’s violent threat against Japanese Prime Minister Sanae Takaichi following her remarks on defending Taiwan marks a dangerous escalation in East Asian tensions, revealing Beijing’s growing intolerance for dissent and the fragility of regional diplomacy. Chinese Consul General in Osaka Xue Jian (薛劍) on Saturday posted a chilling message on X: “the dirty neck that sticks itself in must be cut off,” in reference to Takaichi’s remark to Japanese lawmakers that an attack on Taiwan could threaten Japan’s survival. The post, which was later deleted, was not an isolated outburst. Xue has also amplified other incendiary messages, including one suggesting
Chinese Consul General in Osaka Xue Jian (薛劍) on Saturday last week shared a news article on social media about Japanese Prime Minister Sanae Takaichi’s remarks on Taiwan, adding that “the dirty neck that sticks itself in must be cut off.” The previous day in the Japanese House of Representatives, Takaichi said that a Chinese attack on Taiwan could constitute “a situation threatening Japan’s survival,” a reference to a legal legal term introduced in 2015 that allows the prime minister to deploy the Japan Self-Defense Forces. The violent nature of Xue’s comments is notable in that it came from a diplomat,
Before 1945, the most widely spoken language in Taiwan was Tai-gi (also known as Taiwanese, Taiwanese Hokkien or Hoklo). However, due to almost a century of language repression policies, many Taiwanese believe that Tai-gi is at risk of disappearing. To understand this crisis, I interviewed academics and activists about Taiwan’s history of language repression, the major challenges of revitalizing Tai-gi and their policy recommendations. Although Taiwanese were pressured to speak Japanese when Taiwan became a Japanese colony in 1895, most managed to keep their heritage languages alive in their homes. However, starting in 1949, when the Chinese Nationalist Party (KMT) enacted martial law
“Si ambulat loquitur tetrissitatque sicut anas, anas est” is, in customary international law, the three-part test of anatine ambulation, articulation and tetrissitation. And it is essential to Taiwan’s existence. Apocryphally, it can be traced as far back as Suetonius (蘇埃托尼烏斯) in late first-century Rome. Alas, Suetonius was only talking about ducks (anas). But this self-evident principle was codified as a four-part test at the Montevideo Convention in 1934, to which the United States is a party. Article One: “The state as a person of international law should possess the following qualifications: a) a permanent population; b) a defined territory; c) government;