The revelation that a documentary filmmaker used voice-cloning software to make late chef Anthony Bourdain say words he never spoke has drawn criticism amid ethical concerns about use of the powerful technology.
The movie Roadrunner: A Film About Anthony Bourdain appeared in cinemas on Friday and mostly features real footage of the beloved celebrity chef and globe-trotting television host before he died in 2018.
However, its director, Morgan Neville, told The New Yorker that a snippet of dialogue was created using artificial intelligence (AI) technology.
Photo: AP
That has renewed a debate about the future of voice-cloning technology, not just in the entertainment world, but in politics and a fast-growing commercial sector dedicated to transforming text into realistic-sounding human speech.
“Unapproved voice cloning is a slippery slope,” Andrew Mason, the founder and chief executive of voice generator Descript Inc, wrote in a blog post on Friday. “As soon as you get into a world where you’re making subjective judgment calls about whether specific cases can be ethical, it won’t be long before anything goes.”
Before this week, most of the public controversy around such technologies focused on the creation of hard-to-detect deepfakes using simulated audio and/or video and their potential to fuel misinformation and political conflict.
Yet Mason, the founder and chief executive of Groupon, said in an interview that Descript has repeatedly rejected requests to bring back a voice, including from “people who have lost someone and are grieving.”
“It’s not even so much that we want to pass judgment,” he said. “We’re just saying you have to have some bright lines in what’s okay and what’s not.”
Angry and uncomfortable reactions to the voice cloning in the Bourdain case reflect expectations and issues of disclosure and consent, said Sam Gregory, program director at Witness, a nonprofit working on using video technology for human rights.
Obtaining consent and disclosing the technowizardry at work would have been appropriate, he said.
Instead, viewers were stunned — first by the fact of the audio fakery, then by the director’s seeming dismissal of any ethical questions — and expressed their displeasure online.
“It touches also on our fears of death and ideas about the way people could take control of our digital likeness and make us say or do things without any way to stop it,” Gregory said.
Neville has not identified what tool he used to recreate Bourdain’s voice, but said he used it for a few sentences that Bourdain wrote but never said aloud.
“With the blessing of his estate and literary agent we used AI technology,” Neville said in a written statement. “It was a modern storytelling technique that I used in a few places where I thought it was important to make Tony’s words come alive.”
Neville also told GQ magazine that he got the approval of Bourdain’s widow and literary executor.
“I certainly was NOT the one who said Tony would have been cool with that,” the chef’s wife, Ottavia Busia, wrote on Twitter.
Although tech giants, such as Microsoft Inc, Alphabet Inc’s Google and Amazon.com Inc, have dominated text-to-speech research, there are now also a number of start-ups such as Descript that offer voice-cloning software. The uses range from talking customer service chatbots to video games and podcasts.
Many of these voice cloning companies prominently feature an ethics policy on their Web site that explains the terms of use. Of nearly a dozen firms contacted by The Associated Press, many said they did not recreate Bourdain’s voice and would not have if asked.
Others did not respond.
“We have pretty strong polices around what can be done on our platform,” said Zohaib Ahmed, founder and chief executive of Resemble AI, a Toronto company that sells a custom AI voice generator service. “When you’re creating a voice clone, it requires consent from whoever’s voice it is.”
Ahmed said the rare occasions where he has allowed some posthumous voice cloning were for academic research, including a project working with the voice of former British Prime Minister Winston Churchill, who died in 1965.
Ahmed said a more common commercial use is to edit a TV ad recorded by real voice actors and then customize it to a region by adding a local reference. It is also used to dub anime movies and other videos, by taking a voice in one language and making it speak a different language, he said.
He compared it to past innovations in the entertainment industry, from stunt actors to greenscreen technology.
Just seconds or minutes of recorded human speech can help teach an AI system to generate its own synthetic speech, although getting it to capture the clarity and rhythm of Anthony Bourdain’s voice probably took a lot more training, said Rupal Patel, a professor at Northeastern University who is the founder and chief executive of another voice-generating company, VocaliD Inc, which focuses on customer service chatbots.
“If you wanted it to speak really like him, you’d need a lot, maybe 90 minutes of good, clean data,” she said. “You’re building an algorithm that learns to speak like Bourdain spoke.”
Neville is an acclaimed documentarian who also directed the Fred Rogers portrait Won’t You Be My Neighbor? and the Oscar-winning 20 Feet From Stardom.
He began making his latest movie in 2019, more than a year after Bourdain’s death by suicide.
The US dollar was trading at NT$29.7 at 10am today on the Taipei Foreign Exchange, as the New Taiwan dollar gained NT$1.364 from the previous close last week. The NT dollar continued to rise today, after surging 3.07 percent on Friday. After opening at NT$30.91, the NT dollar gained more than NT$1 in just 15 minutes, briefly passing the NT$30 mark. Before the US Department of the Treasury's semi-annual currency report came out, expectations that the NT dollar would keep rising were already building. The NT dollar on Friday closed at NT$31.064, up by NT$0.953 — a 3.07 percent single-day gain. Today,
‘SHORT TERM’: The local currency would likely remain strong in the near term, driven by anticipated US trade pressure, capital inflows and expectations of a US Fed rate cut The US dollar is expected to fall below NT$30 in the near term, as traders anticipate increased pressure from Washington for Taiwan to allow the New Taiwan dollar to appreciate, Cathay United Bank (國泰世華銀行) chief economist Lin Chi-chao (林啟超) said. Following a sharp drop in the greenback against the NT dollar on Friday, Lin told the Central News Agency that the local currency is likely to remain strong in the short term, driven in part by market psychology surrounding anticipated US policy pressure. On Friday, the US dollar fell NT$0.953, or 3.07 percent, closing at NT$31.064 — its lowest level since Jan.
The New Taiwan dollar and Taiwanese stocks surged on signs that trade tensions between the world’s top two economies might start easing and as US tech earnings boosted the outlook of the nation’s semiconductor exports. The NT dollar strengthened as much as 3.8 percent versus the US dollar to 30.815, the biggest intraday gain since January 2011, closing at NT$31.064. The benchmark TAIEX jumped 2.73 percent to outperform the region’s equity gauges. Outlook for global trade improved after China said it is assessing possible trade talks with the US, providing a boost for the nation’s currency and shares. As the NT dollar
PRESSURE EXPECTED: The appreciation of the NT dollar reflected expectations that Washington would press Taiwan to boost its currency against the US dollar, dealers said Taiwan’s export-oriented semiconductor and auto part manufacturers are expecting their margins to be affected by large foreign exchange losses as the New Taiwan dollar continued to appreciate sharply against the US dollar yesterday. Among major semiconductor manufacturers, ASE Technology Holding Co (日月光), the world’s largest integrated circuit (IC) packaging and testing services provider, said that whenever the NT dollar rises NT$1 against the greenback, its gross margin is cut by about 1.5 percent. The NT dollar traded as strong as NT$29.59 per US dollar before trimming gains to close NT$0.919, or 2.96 percent, higher at NT$30.145 yesterday in Taipei trading