An unusual consensus has emerged between artificial intelligence (AI) researchers, rights advocates, lawmakers and many of the largest technology companies: Facial recognition software breeds bias, risks fueling mass surveillance and should be regulated. Deciding on effective controls and acting on them would be a lot harder.
The Algorithmic Justice League and the Center of Privacy and Technology at Georgetown University Law Center on Tuesday unveiled the Safe Face Pledge, which asks companies not to provide facial AI for autonomous weapons or sell to law enforcement unless explicit laws are debated and passed to allow it.
Microsoft Corp last week said the software carries significant risks and proposed rules to combat the threat.
Photo: Reuters
Research group AI Now, which includes AI researchers from Alphabet Inc’s Google and other companies, issued a similar call.
“Principles are great — they are starting points. Beyond the principles we need to be able to see actions,” said Joy Buolamwini, founder of the Algorithmic Justice League.
None of the biggest makers of the software — companies like Microsoft, Google, Amazon.com Inc, Facebook Inc and IBM Corp — has signed the Safe Face Pledge yet.
Large tech companies might be reluctant to commit to a pledge like this, even if they are concerned about negative consequences of the software.
That is because it could mean walking away from lucrative contracts for the emerging technology.
The market for video surveillance gear is worth US$18.5 billion a year and AI-powered equipment for new forms of video analysis is an important emerging category, researcher IHS Markit said.
Microsoft and Facebook said they are reviewing the pledge. Google declined to comment.
“There are going to be some large vendors who refuse to sign or are reluctant to sign, because they want these government contracts,” said Laura Moy, executive director of the Center on Privacy and Technology.
Microsoft is still selling facial recognition software to governments, a fact that the American Civil Liberties Union took the company to task for this week.
It asked Microsoft to halt the sales and join the organization’s call for a federal moratorium on government use of the technology.
The use of facial recognition for surveillance, policing and immigration is being questioned, because researchers, including Buolamwini, have shown that the technology is not accurate enough for critical decisions and performs worse on darker-skinned people.
Providers have responded differently to the scrutiny.
Microsoft is defending government contracts generally, while asking for laws to regulate the space. Amazon took issue with research by the union into the Rekognition program it sells to police departments, but it has also said that it is working to better educate police on how to use the software.
Companies including Microsoft, Facebook and Axon, a maker of police body cameras, have formed AI ethics boards and Google published a set of more general AI principles in June.
The Safe Face Pledge asks companies to “show value for human life, dignity and rights, address harmful bias, facilitate transparency” and make these commitments part of their business practices.
This includes not selling facial recognition software to identify targets where lethal force may be used.
The pledge also commits companies to halt sales of face AI products that are not “subject to public scrutiny, inspection and oversight.”
There are also commitments to internal bias reviews as well as checks by outside experts, along with a requirement to publish easy-to-understand information on how these technologies are used and by which customers.
Start-ups Simprints Technology, Robbie AI Inc and Yoti Ltd were the inaugural signers of the pledge.
“It’s kind of the wild west when it comes to use of automated facial analysis technology and it’s also an area that’s shrouded in secrecy,” Moy said.
The Safe Face pledge tries to address both areas, but Moy also believes new laws are needed.
That is where Microsoft is focusing its attention. The company last week detailed the laws it would like to see passed.
Microsoft president and chief legal officer Brad Smith put the chances of US federal legislation next year at 50-50, most likely as part of a broader privacy bill.
However, he said there is a far better shot at getting something passed in a US state or even a city next year.
If it is an important enough region, say California, that would probably be enough to make software sellers change their products and practices overall, he said.
In the meantime, Microsoft said it would turn down some AI contracts where it has concerns, and already has.
Smith would not specify which deals it has rejected and he has also said Microsoft would continue to be a key vendor to the US government.
“We’ve turned down business when we thought there was too much risk of discrimination, when we thought there was a risk to the human rights of individuals,” Smith said.
In contrast, Amazon thinks it is too soon to regulate.
“There are many positive and important uses of this technology that are being implemented today, to include preventing human trafficking, reuniting missing children with their parents and improving security,” the company said in a statement.
“It is too early to come out with blanket statements supporting broad regulation, given this technology is in the early stages of deployment and we have received no indications of misuse,” it said.
Still, the company said it would work with governments on standards and guidelines for the technology to maintain privacy and civil liberties.
Facebook said it is committed to using the technology responsibly and supports thoughtful proposals.
The social networking company, which uses face recognition to identify people in photographs users post, said it is eager to work with Microsoft and others on ideas.
While employees and customers can pressure companies to act ethically with regard to AI, more attention needs to be focused on laws and government oversight, said Ryan Calo, a law professor at the University of Washington, who is on the board of AI Now and gets funding from Microsoft.
Without broad regulation, if some companies refuse to sell the software, others would step in.
“We have been attempting to get companies to cease providing tools to the government, rather than trying to ensure the government doesn’t do things we don’t agree with,” Calo said. “They are government agencies — we ought to be able to police them. We can’t ask technology companies to make it all go away.”
With assistance from Emily Chang and Gerrit De Vynck.
Taiwan Transport and Storage Corp (TTS, 台灣通運倉儲) yesterday unveiled its first electric tractor unit — manufactured by Volvo Trucks — in a ceremony in Taipei, and said the unit would soon be used to transport cement produced by Taiwan Cement Corp (TCC, 台灣水泥). Both TTS and TCC belong to TCC International Holdings Ltd (台泥國際集團). With the electric tractor unit, the Taipei-based cement firm would become the first in Taiwan to use electric vehicles to transport construction materials. TTS chairman Koo Kung-yi (辜公怡), Volvo Trucks vice president of sales and marketing Johan Selven, TCC president Roman Cheng (程耀輝) and Taikoo Motors Group
Among the rows of vibrators, rubber torsos and leather harnesses at a Chinese sex toys exhibition in Shanghai this weekend, the beginnings of an artificial intelligence (AI)-driven shift in the industry quietly pulsed. China manufactures about 70 percent of the world’s sex toys, most of it the “hardware” on display at the fair — whether that be technicolor tentacled dildos or hyper-realistic personalized silicone dolls. Yet smart toys have been rising in popularity for some time. Many major European and US brands already offer tech-enhanced products that can enable long-distance love, monitor well-being and even bring people one step closer to
RECORD-BREAKING: TSMC’s net profit last quarter beat market expectations by expanding 8.9% and it was the best first-quarter profit in the chipmaker’s history Taiwan Semiconductor Manufacturing Co (TSMC, 台積電), which counts Nvidia Corp as a key customer, yesterday said that artificial intelligence (AI) server chip revenue is set to more than double this year from last year amid rising demand. The chipmaker expects the growth momentum to continue in the next five years with an annual compound growth rate of 50 percent, TSMC chief executive officer C.C. Wei (魏哲家) told investors yesterday. By 2028, AI chips’ contribution to revenue would climb to about 20 percent from a percentage in the low teens, Wei said. “Almost all the AI innovators are working with TSMC to address the
Malaysia’s leader yesterday announced plans to build a massive semiconductor design park, aiming to boost the Southeast Asian nation’s role in the global chip industry. A prominent player in the semiconductor industry for decades, Malaysia accounts for an estimated 13 percent of global back-end manufacturing, according to German tech giant Bosch. Now it wants to go beyond production and emerge as a chip design powerhouse too, Malaysian Prime Minister Anwar Ibrahim said. “I am pleased to announce the largest IC (integrated circuit) Design Park in Southeast Asia, that will house world-class anchor tenants and collaborate with global companies such as Arm [Holdings PLC],”