Alexa, are you really a human?
The revelation that a large team of Amazon.com Inc employees listens to conversations recorded by the company’s digital assistant has exposed the contrast between the hype of artificial intelligence (AI) and the reality of the armies of underpaid people that make the technology work in real life. It is these battalions that are leading Silicon Valley’s massive privacy invasion.
AI is supposed to be good at pattern recognition and natural language processing. However, it is all but impossible to train a neural network to recognize speech or faces with certainty. Algorithms that have to interact seamlessly with people need to be constantly retrained to allow for changes in slang, population movements that bring new accents, cultural phenomena and fashion trends.
That does not happen by magic; the algorithms cannot find out about the latest pop sensation or TV series all by themselves.
During last year’s soccer World Cup in Russia, the authorities used a sophisticated facial recognition system to exclude known hooligans from stadiums. It worked — until the final game, when members of punk band Pussy Riot rushed onto the field, dressed in police uniforms. They were not in the database.
For AI to work, it needs constant human input, but companies selling AI-based products do not want to tell customers about the role played by what Wired staff writer Lily Hay Newman has called their “covert human workforces” for two reasons.
One is that using thousands of people to annotate data collected from customers does not sound as magical as “deep learning,” “neural networks,” and “human-level image and speech recognition.”
The other is that people are prepared to entrust their secrets to a disembodied algorithm, in the same the way as King Midas’ barber whispered to the reeds about the king’s donkey ears.
However, if those secrets risked being heard by people, especially those with access to information that might identify the customer, it would be a different matter.
In the Midas myth, the barber’s whispers were picked up and amplified by the echo — coincidentally, the name of one Amazon device used to summon Alexa.
Employees who annotate its audio recordings and help train the virtual assistant to recognize that Taylor Swift does not mean a rush order for a suit do not see customers’ full names and addresses, but apparently do get access to account numbers and device serial numbers.
That is not a big distinction — especially when it comes to private conversations involving financial transactions or sensitive family matters. These, of course, are picked up by Alexa when the digital assistant is accidentally triggered.
There is not much difference between this level of access and that enjoyed by employees at the Kiev office of Ring, the security camera firm owned by Amazon.
The Intercept earlier this year reported that, unbeknownst to clients, employees tasked with annotating videos were watching camera feeds from inside and outside people’s homes.
Tellingly, the wording of Amazon’s response to the Intercept’s story was identical to the one it provided to Bloomberg.
The firm said that it has “zero tolerance for abuse of our systems.”
This kind of boilerplate response does little to inspire trust.
Amazon is not, of course, the only company that does this kind of thing.
In 2017, Expensify, which helps companies manage employees’ expense accounts, hired workers on Mechanical Turk, the Amazon-owned labor exchange, to analyze receipts.
Last year, the Guardian wrote of the rise of what it called pseudo-AI, and identified a number of cases where tech companies hired low-paid people to generate training data for AI.
The line between training and imitation is thin: To create the necessary dataset, people are sometimes needed to replicate the work expected of the algorithm, and this can go on for a long time.
Facebook Inc and Google are unlikely to ever get rid of the tens of thousands of contractors who scan posts for offensive, sensitive or criminal content, because their algorithms will never be good enough to prevent scandalous failures without human help.
In principle, there is nothing wrong with this human participation in AI-based endeavors. It is actually how things should work if a cataclysm in the labor market is to be avoided.
As Daron Acemoglu from the Massachusetts Institute of Technology and Pascual Restrepo from Boston University wrote in a recent paper: “The effects of automation are counterbalanced by the creation of new tasks in which labor has a comparative advantage.”
Those “covert human workforces” are doing tasks that would not have emerged without AI.
The problem lies elsewhere. Companies working on AI projects should be honest about human participation.
Facebook and Google are already: Their moderators and quality raters do similar work to that performed by Amazon’s Alexa-training team.
Of course, openness would demystify AI, and perhaps curb sales of intrusive products such as the Echo, but many people these days are happy to sacrifice privacy for convenience, so there would still be money to be made from these devices.
Regulators have a useful role to play here. They should make sure companies really anonymize their AI-training datasets and make it impossible to link sensitive data to actual people, rather than contingent on a company’s goodwill or enforcement practices.
It is also up to the authorities to examine the pay and conditions of workers in these new, data-oriented occupations. These people are often treated by the tech industry as nonessential, unqualified and easily replaceable, but are doing a job with an emotional and psychological toll that is not well understood.
The reason these workers talk to reporters, despite their nondisclosure agreements, is that they are underappreciated, operating in a gray backwater of the much-glorified tech industry. Their important role should not be a dirty secret.
Stephen Garrett, a 27-year-old graduate student, always thought he would study in China, but first the country’s restrictive COVID-19 policies made it nearly impossible and now he has other concerns. The cost is one deterrent, but Garrett is more worried about restrictions on academic freedom and the personal risk of being stranded in China. He is not alone. Only about 700 American students are studying at Chinese universities, down from a peak of nearly 25,000 a decade ago, while there are nearly 300,000 Chinese students at US schools. Some young Americans are discouraged from investing their time in China by what they see
MAJOR DROP: CEO Tim Cook, who is visiting Hanoi, pledged the firm was committed to Vietnam after its smartphone shipments declined 9.6% annually in the first quarter Apple Inc yesterday said it would increase spending on suppliers in Vietnam, a key production hub, as CEO Tim Cook arrived in the country for a two-day visit. The iPhone maker announced the news in a statement on its Web site, but gave no details of how much it would spend or where the money would go. Cook is expected to meet programmers, content creators and students during his visit, online newspaper VnExpress reported. The visit comes as US President Joe Biden’s administration seeks to ramp up Vietnam’s role in the global tech supply chain to reduce the US’ dependence on China. Images on
New apartments in Taiwan’s major cities are getting smaller, while old apartments are increasingly occupied by older people, many of whom live alone, government data showed. The phenomenon has to do with sharpening unaffordable property prices and an aging population, property brokers said. Apartments with one bedroom that are two years old or older have gained a noticeable presence in the nation’s six special municipalities as well as Hsinchu county and city in the past five years, Evertrust Rehouse Co (永慶房產集團) found, citing data from the government’s real-price transaction platform. In Taipei, apartments with one bedroom accounted for 19 percent of deals last
US CONSCULTANT: The US Department of Commerce’s Ursula Burns is a rarely seen US government consultant to be put forward to sit on the board, nominated as an independent director Taiwan Semiconductor Manufacturing Co (TSMC, 台積電), the world’s largest contract chipmaker, yesterday nominated 10 candidates for its new board of directors, including Ursula Burns from the US Department of Commerce. It is rare that TSMC has nominated a US government consultant to sit on its board. Burns was nominated as one of seven independent directors. She is vice chair of the department’s Advisory Council on Supply Chain Competitiveness. Burns is to stand for election at TSMC’s annual shareholders’ meeting on June 4 along with the rest of the candidates. TSMC chairman Mark Liu (劉德音) was not on the list after in December last