Sun, Apr 14, 2019 page15

• The role of Amazon’s human eavesdroppers needs demystifying

  Firms do not readily reveal the human input required to make AI software work, because people are more willing to entrust their secrets to a disembodied algorithm

  • By Leonid Bershidsky / Bloomberg Opinion
  • • 
    • 
    • 

  Alexa, are you really a human?

  The revelation that a large team of Amazon.com Inc employees listens to conversations recorded by the company’s digital assistant has exposed the contrast between the hype of artificial intelligence (AI) and the reality of the armies of underpaid people that make the technology work in real life. It is these battalions that are leading Silicon Valley’s massive privacy invasion.

  AI is supposed to be good at pattern recognition and natural language processing. However, it is all but impossible to train a neural network to recognize speech or faces with certainty. Algorithms that have to interact seamlessly with people need to be constantly retrained to allow for changes in slang, population movements that bring new accents, cultural phenomena and fashion trends.

  That does not happen by magic; the algorithms cannot find out about the latest pop sensation or TV series all by themselves.

  During last year’s soccer World Cup in Russia, the authorities used a sophisticated facial recognition system to exclude known hooligans from stadiums. It worked — until the final game, when members of punk band Pussy Riot rushed onto the field, dressed in police uniforms. They were not in the database.

  For AI to work, it needs constant human input, but companies selling AI-based products do not want to tell customers about the role played by what Wired staff writer Lily Hay Newman has called their “covert human workforces” for two reasons.

  One is that using thousands of people to annotate data collected from customers does not sound as magical as “deep learning,” “neural networks,” and “human-level image and speech recognition.”

  The other is that people are prepared to entrust their secrets to a disembodied algorithm, in the same the way as King Midas’ barber whispered to the reeds about the king’s donkey ears.

  However, if those secrets risked being heard by people, especially those with access to information that might identify the customer, it would be a different matter.

  In the Midas myth, the barber’s whispers were picked up and amplified by the echo — coincidentally, the name of one Amazon device used to summon Alexa.

  Employees who annotate its audio recordings and help train the virtual assistant to recognize that Taylor Swift does not mean a rush order for a suit do not see customers’ full names and addresses, but apparently do get access to account numbers and device serial numbers.

  That is not a big distinction — especially when it comes to private conversations involving financial transactions or sensitive family matters. These, of course, are picked up by Alexa when the digital assistant is accidentally triggered.

  There is not much difference between this level of access and that enjoyed by employees at the Kiev office of Ring, the security camera firm owned by Amazon.

  The Intercept earlier this year reported that, unbeknownst to clients, employees tasked with annotating videos were watching camera feeds from inside and outside people’s homes.

  Tellingly, the wording of Amazon’s response to the Intercept’s story was identical to the one it provided to Bloomberg.

  The firm said that it has “zero tolerance for abuse of our systems.”

  This kind of boilerplate response does little to inspire trust.

  Amazon is not, of course, the only company that does this kind of thing.

  In 2017, Expensify, which helps companies manage employees’ expense accounts, hired workers on Mechanical Turk, the Amazon-owned labor exchange, to analyze receipts.

  Last year, the Guardian wrote of the rise of what it called pseudo-AI, and identified a number of cases where tech companies hired low-paid people to generate training data for AI.

  The line between training and imitation is thin: To create the necessary dataset, people are sometimes needed to replicate the work expected of the algorithm, and this can go on for a long time.

  Facebook Inc and Google are unlikely to ever get rid of the tens of thousands of contractors who scan posts for offensive, sensitive or criminal content, because their algorithms will never be good enough to prevent scandalous failures without human help.

  In principle, there is nothing wrong with this human participation in AI-based endeavors. It is actually how things should work if a cataclysm in the labor market is to be avoided.

  As Daron Acemoglu from the Massachusetts Institute of Technology and Pascual Restrepo from Boston University wrote in a recent paper: “The effects of automation are counterbalanced by the creation of new tasks in which labor has a comparative advantage.”

  Those “covert human workforces” are doing tasks that would not have emerged without AI.

  The problem lies elsewhere. Companies working on AI projects should be honest about human participation.

  Facebook and Google are already: Their moderators and quality raters do similar work to that performed by Amazon’s Alexa-training team.

  Of course, openness would demystify AI, and perhaps curb sales of intrusive products such as the Echo, but many people these days are happy to sacrifice privacy for convenience, so there would still be money to be made from these devices.

  Regulators have a useful role to play here. They should make sure companies really anonymize their AI-training datasets and make it impossible to link sensitive data to actual people, rather than contingent on a company’s goodwill or enforcement practices.

  It is also up to the authorities to examine the pay and conditions of workers in these new, data-oriented occupations. These people are often treated by the tech industry as nonessential, unqualified and easily replaceable, but are doing a job with an emotional and psychological toll that is not well understood.

  The reason these workers talk to reporters, despite their nondisclosure agreements, is that they are underappreciated, operating in a gray backwater of the much-glorified tech industry. Their important role should not be a dirty secret.
• Most Popular

  • 1

    China reserves offshore airspace for 40 days without explanation: WSJ

  • 2

    Danish envoys’ privileges revoked over naming controversy

  • 3

    Eight million barrels of oil to set sail for Taiwan this month

  • 4

    Foreign exchange reserves fall below US$600 billion

  • 5

    Universities neglect to warn students of China danger: MOE