Names translated as months of the year, incorrect time frames and mixed-up pronouns — the everyday failings of artificial intelligence-driven (AI) translation apps are causing havoc in the US asylum system, critics say.
“We have countless examples of this nature,” said Ariel Koren, founder of Respond Crisis Translation, a global collective that has translated more than 13,000 asylum applications, warning that errors can lead to unfounded denials.
In one case, she said, attorneys missed a crucial detail in a woman’s account of domestic abuse because the translation app they were using kept breaking down, and they ran out of time.
Illustration: Kevin Sheu
“The machines themselves are not operating with even a fraction of the quality they need to be able to do case work that’s acceptable for someone in a high-stakes situation,” said Koren, who used to work for Google Translate.
She told the Thomson Reuters Foundation that a translator with the group had estimated that 40 percent of Afghan asylum cases he had worked on had encountered problems due to machine translation. Cases involving Haitian Creole speakers have also faced significant issues, she added.
Government contractors and large aid organizations are increasingly using AI machine translation tools due to “an immense amount of incentive to cut costs,” Koren said.
The extent to which such tools are being used in US immigration processing is unclear amid a broad lack of transparency, said Aliya Bhatia, a policy analyst with the Center for Democracy & Technology think tank.
“We know governments and asylum lobbies around the world ... are moving toward using automated technology,” Bhatia said.
A 2019 report from investigative news outlet ProPublica found that immigration officials were being directed to use Google Translate to “vet” social media use for refugee applications.
The US Department of Justice, and the Immigration and Customs Enforcement agency did not respond to requests for comment, nor did the White House, which recently released a national “blueprint” on AI guidelines.
Asked about concerns over the use of machine translation in asylum cases, a spokesperson for Google said its Google Translate tool underwent strict quality controls and pointed out that it was offered free of charge.
“We rigorously train and test our systems to ensure each of the 133 languages we support meets a high standard for translation quality,” the spokesperson said.
A major shortcoming of translation tools’ use in asylum cases stems from the difficulty of building in checks, said Gabe Nicholas, a research fellow with the Center for Democracy & Technology and coauthor with Bhatia of a paper on the models being used for machine translation.
“Because the person speaks only one language, the potential for mistakes and errors to go uncaught is really, really high,” he said.
Machine translation has made significant progress in recent years, Nicholas and Bhatia said, adding that it is still nowhere near good enough to be relied upon in often complex, high-stakes situations such as the asylum process.
A core problem is how the apps are trained in the first place — on digitized text, for which there are masses available for English, but far less for other languages.
This not only results in less nuanced or simply incorrect translations, but it also means English or some other high-resource languages become “intermediaries though which these models view the world,” Bhatia said.
The result is Anglocentric translations that often fail to accurately capture crucial details around a particular word.
Like many other sectors, the translation industry has been upended in recent months by the release of “generative” AI tools such as ChatGPT.
“ChatGPT and AI are now on everybody’s minds,” said Jill Kushner Bishop, founder and CEO of Multilingual Connections, a company based in the Chicago area.
“There are cases for it, and those are more and more compelling all the time. But it’s still not ready in most cases to be used with the training wheels off and without a human involved,” Bishop said.
The company does regular testing of tools and different languages, production director Katie Baumann said, but continues to find problems with text translations involving, say, Turkish or Japanese, or AI-driven audio transcriptions with background noise.
“We’ve run tests of extracts of law enforcement interviews, processing and putting it through machine translation — a lot of it is nonsense. It wouldn’t save you any time, so we wouldn’t use it,” Baumann said.
So even as Multilingual Connections does increasingly use machine translation, a human is always involved.
“You don’t know what you don’t know. So for someone who is not a speaker of the language ... you don’t know where the mistakes will be,” Bishop said.
“Think about asylum cases ... and what might be misunderstood without a human verifying,” she said.
OpenAI, which developed ChatGPT, declined to comment, but a spokesperson pointed to policies that bar use for “high-risk government decisionmaking” including law enforcement, criminal justice, migration and asylum.
At Respond Crisis Translation, the shortcomings of AI-driven translation tools are also creating an extra layer of work for Koren and her colleagues.
“The people who need to clean up the mess are human translators,” she said.
One of the collective’s translators, Samara Zuza, has been working for three years with a Brazilian asylum seeker whose asylum papers were poorly translated by an AI app while he was in immigration detention in California, she said.
The application was “full of insane mistakes,” Zuza said. “The names of the city and state are wrong. The sentences are reversed — and that’s the form that was sent to the court.”
She thinks it was these inaccuracies that resulted in the rejection of initial attempts to secure the man’s release. The man, who asked to be identified only as Carlos, a pseudonym, was eventually released in May 2020 after the two started working together.
“The language was the worst aspect for me,” Carlos, 49, said of his six months in immigration detention after he fled gang activity in Brazil.
He spoke by phone from Massachusetts, where he is now living as he applies for US residency.
Carlos, who is illiterate and speaks Brazilian Portuguese, said he had been unable to communicate with immigration officials or even other detainees for months.
To fill out his asylum paperwork, he relied on a tablet computer’s voice recorder coupled with an app that used machine translation.
“So many of the words were being wrongly translated,” he said. “My asylum papers were a terrible mess.”
On Monday, the day before Chinese Nationalist Party (KMT) Chairwoman Cheng Li-wun (鄭麗文) departed on her visit to China, the party released a promotional video titled “Only with peace can we ‘lie flat’” to highlight its desire to have peace across the Taiwan Strait. However, its use of the expression “lie flat” (tang ping, 躺平) drew sarcastic comments, with critics saying it sounded as if the party was “bowing down” to the Chinese Communist Party (CCP). Amid the controversy over the opposition parties blocking proposed defense budgets, Cheng departed for China after receiving an invitation from the CCP, with a meeting with
Chinese Nationalist Party (KMT) Chairwoman Cheng Li-wun (鄭麗文) is leading a delegation to China through Sunday. She is expected to meet with Chinese President Xi Jinping (習近平) in Beijing tomorrow. That date coincides with the anniversary of the signing of the Taiwan Relations Act (TRA), which marked a cornerstone of Taiwan-US relations. Staging their meeting on this date makes it clear that the Chinese Communist Party (CCP) intends to challenge the US and demonstrate its “authority” over Taiwan. Since the US severed official diplomatic relations with Taiwan in 1979, it has relied on the TRA as a legal basis for all
A delegation of Chinese Nationalist Party (KMT) officials led by Chairwoman Cheng Li-wun (鄭麗文) is to travel to China tomorrow for a six-day visit to Jiangsu, Shanghai and Beijing, which might end with a meeting between Cheng and Chinese President Xi Jinping (習近平). The trip was announced by Xinhua news agency on Monday last week, which cited China’s Taiwan Affairs Office (TAO) Director Song Tao (宋濤) as saying that Cheng has repeatedly expressed willingness to visit China, and that the Chinese Communist Party (CCP) Central Committee and Xi have extended an invitation. Although some people have been speculating about a potential Xi-Cheng
The ongoing Iran conflict is putting Taiwan’s energy fragility on full display — the island of 23 million people, home to the world’s most advanced semiconductor manufacturing, is highly dependent on imported oil and gas, especially that from the Middle East. In 2025, 69.6 percent of Taiwan’s crude oil and 38.7 percent of liquified natural gas were sourced from the Middle East. In the same year, 62 percent of crude oil and 34 percent of LNG to Taiwan went through the Strait of Hormuz. Taiwan’s state-run oil company CPC Corp’s benchmark crude oil price (70 percent Dubai, 30 percent Brent)
RSS