No more fiddling with remote-controller buttons or a mouse. Just look. San Francisco-based startup Fove has developed eye-tracking for virtual reality — that kernel of technology many feel is key for the illusion of becoming immersed in a setting.
Glance, and a video-game character talks back. Or use a death stare to shoot down virtual spaceships. Watch a movie of a forest or a room and be able to look around wherever you want.
“It allows you to go inside the world that’s behind the display,” Fove cofounder and chief executive Yuka Kojima said.
Photo: AP
Fove, which comes from “fovea,” the part of the eye with the sharpest vision, from “field of view,” and the word’s similarity with “love,” has devised a way to use tiny infrared sensors inside headset goggles to monitor the movements of a wearer’s pupils.
It is a small company, founded in 2014, with offices in Tokyo, San Francisco and Los Angeles, and employing just 17 people. However, Fove is getting attention from the fledgling VR industry, as “virtual reality” is known, and winning backing from innovative financiers. It has raised about US$500,000 through Kickstarter.
MYRIAD POTENTIAL
Virtual reality could revolutionize entertainment, like movies, games and live-streaming of sports. It has myriad potential business applications, such as giving apartment hunters a virtual look at real-estate options and car buyers tours of virtual showrooms.
It could also prove useful for training of pilots and surgeons, and has already been adopted by the military. The make-believe experience could aid in so-called “empathy training” for police and other service providers. Pornography is another potentially lucrative application.
A recent report by New York-based Superdata, which analyzes data on games, said smaller companies could become “first-movers,” as established players keep a cautious wait-and-see attitude.
Rahat Ahmed, cofounder and chief of strategy at New York-based Trinity VR, an investor in technology and emerging markets, says the big plus of VR is “intuitive interaction.”
Augmented reality enables users to see 3D objects in the real world, while VR delivers a 360-degree fictional universe.
“Every major company has to have a VR-AR strategy,” Ahmed said recently at the CLSA Japan Forum in Tokyo, referring by AR to “augmented reality,” which enables users to see 3D objects in the real world, while VR delivers a 360-degree fictional universe. “It allows connecting — going fishing with your father who is far away.”
New technology usually has its share of detractors and there are worries that VR could have harmful effects if users become too immersed in their fantasy environments and estranged from reality.
However, Fove developers say VR can play a positive role.
In one poignant demonstration, a bed-ridden grandmother wears a Fove headset to “attend” her grandson’s wedding, sending a human-shaped robot controlled by her eyes in her place. The woman gestures happily, reaching out from her bed as if the newlyweds are standing before her.
Eye-tracking can enable disabled people to use their eyes to control devices, said Kojima’s cofounder at Fove, Australian Lochlainn Wilson. He developed Fove’s breakthrough technology for eye-tracking.
With the help of Fove and a Japanese university, for example, a young man with spinal muscular atrophy was able to use eye movements to play a piano.
“We want to do things with VR that people haven’t thought about, or have thought to be impossible,” said Wilson, who met Kojima while she was studying English for four months in Australia. “And we have got other secret projects in the future.”
Fove has potential rivals, such as electronics and entertainment company Sony Corp and Facebook’s Oculus, which later this month will begin shipping the consumer version of its Rift virtual-reality headset for US$600, plus US$1,500 for an “Oculus-ready” PC.
Oculus says it is working on eye-tracking for its headsets, and other players like Eyefluence Inc, based in Milpitas, California, have also developed the technology.
Microsoft Corp will soon have a developer version of its augmented reality device, HoloLens, for US$3,000.
LICENSING TECHNOLOGY
Fove’s headset for game and other content developers will become available sometime later this year for about US$500 — though for the headset to work well, you need in addition a good PC costing US$1,000 or more.
The company plans to make 1,200 such headset kits, but Kojima says Fove could boost production to as many as a million headsets if she clinches a deal to supply them to Internet cafes. Fove is also offering to license the technology to other companies.
Fove’s eye-tracking technique is convincing: In one recent demonstration, a headset wearer watched a computer-graphic figure holding a machine gun slowly approach, evoking a sense of menace.
Looking at the space behind the figure, the background came into more vivid focus and the figure in front dimmed a bit, enhancing the illusion of perspective.
Kojima, who is also a filmmaker, became interested in story-telling from when she was studying at Tokyo’s Ochanomizu University. Later, while working as a game producer at Sony Computer Entertainment, she began to wonder why games allowed only “yes” or “no” choices, when stories usually called for more subtlety.
Fove can fix that by making the interaction more intuitive, she said.
“It should feel more like the way we are facing each other now, laughing, making eye contact, a nonverbal form of communication,” Kojima said. “Nuances should be part of storytelling. It should be natural.”
CHIP WAR: Tariffs on Taiwanese chips would prompt companies to move their factories, but not necessarily to the US, unleashing a ‘global cross-sector tariff war’ US President Donald Trump would “shoot himself in the foot” if he follows through on his recent pledge to impose higher tariffs on Taiwanese and other foreign semiconductors entering the US, analysts said. Trump’s plans to raise tariffs on chips manufactured in Taiwan to as high as 100 percent would backfire, macroeconomist Henry Wu (吳嘉隆) said. He would “shoot himself in the foot,” Wu said on Saturday, as such economic measures would lead Taiwanese chip suppliers to pass on additional costs to their US clients and consumers, and ultimately cause another wave of inflation. Trump has claimed that Taiwan took up to
SUPPORT: The government said it would help firms deal with supply disruptions, after Trump signed orders imposing tariffs of 25 percent on imports from Canada and Mexico The government pledged to help companies with operations in Mexico, such as iPhone assembler Hon Hai Precision Industry Co (鴻海精密), also known as Foxconn Technology Group (富士康科技集團), shift production lines and investment if needed to deal with higher US tariffs. The Ministry of Economic Affairs yesterday announced measures to help local firms cope with the US tariff increases on Canada, Mexico, China and other potential areas. The ministry said that it would establish an investment and trade service center in the US to help Taiwanese firms assess the investment environment in different US states, plan supply chain relocation strategies and
WASHINGTON POLICY: Tariffs of 10 percent or more and other new costs are tipped to hit shipments of small parcels, cutting export growth by 1.3 percentage points The decision by US President Donald Trump to ban Chinese companies from using a US tariff loophole would hit tens of billions of dollars of trade and reduce China’s economic growth this year, according to new estimates by economists at Nomura Holdings Inc. According to Nomura’s estimates, last year companies such as Shein (希音) and PDD Holdings Inc’s (拼多多控股) Temu shipped US$46 billion of small parcels to the US to take advantage of the rule that allows items with a declared value under US$800 to enter the US tariff-free. Tariffs of 10 percent or more and other new costs would slash such
Hon Hai Precision Industry Co (鴻海精密) is reportedly making another pass at Nissan Motor Co, as the Japanese automaker's tie-up with Honda Motor Co falls apart. Nissan shares rose as much as 6 percent after Taiwan’s Central News Agency reported that Hon Hai chairman Young Liu (劉揚偉) instructed former Nissan executive Jun Seki to connect with French carmaker Renault SA, which holds about 36 percent of Nissan’s stock. Hon Hai, the Taiwanese iPhone-maker also known as Foxconn Technology Group (富士康科技集團), was exploring an investment or buyout of Nissan last year, but backed off in December after the Japanese carmaker penned a deal