Designers of machine translation tools still mostly rely on dictionaries to make a foreign language understandable. However, now there is a new way: numbers.
Facebook researchers said rendering words into figures and exploiting mathematical similarities between languages is a promising avenue — even if a universal communicator a la Star Trek remains a distant dream.
Powerful automatic translation is a big priority for Internet giants. Allowing as many people as possible worldwide to communicate is not just an altruistic goal, but also good business.
Facebook, Google and Microsoft as well as Russia’s Yandex, China’s Baidu (百度) and others are constantly seeking to improve their translation tools.
Facebook has artificial intelligence (AI) experts on the job at one of its research labs in Paris.
Up to 200 languages are used on Facebook, said Antoine Bordes, European codirector of fundamental AI research for the social network.
Automatic translation is based on having large databases of identical texts in both languages to work from.
However, for many language pairs there just are not enough such parallel texts.
That is why researchers have been looking for another method, like the system developed by Facebook, which creates a mathematical representation for words.
Each word becomes a “vector” in a space of several hundred dimensions. Words that have close associations in the spoken language also find themselves close to each other in this vector space.
“For example, if you take the words ‘cat’ and ‘dog,’ semantically, they are words that describe a similar thing, so they will be extremely close together physically” in the vector space, said Guillaume Lample, one of the system’s designers. “If you take words like Madrid, London, Paris, which are European capital cities, it’s the same idea.”
These language maps can then be linked to one another using algorithms — at first roughly, but eventually becoming more refined, until entire phrases can be matched without too many errors.
Lample said results are already promising.
For the language pair of English-Romanian, Facebook’s machine translation system is “equal or maybe a bit worse” than the word vector system, Lample said.
However, for the rarer language pair of English-Urdu, where Facebook’s traditional system does not have many bilingual texts to reference, the word vector system is already superior, he said.
However, could the method allow translation from, say, Basque into the language of an Amazonian tribe?
In theory, yes, Lample said, but in practice a large body of written texts is needed to map the language, something lacking in Amazonian tribal languages.
“If you have just tens of thousands of phrases, it won’t work. You need several hundreds of thousands,” he said.
Experts at France’s national scientific center, CNRS, said the approach Lample has taken for Facebook could produce useful results, even if it does not result in perfect translations.
Thierry Poibeau of CNRS’ Lattice laboratory, which also researches machine translation, called the word vector approach “a conceptual revolution.”
He said “translating without parallel data” — dictionaries or versions of the same documents in both languages — “is something of the Holy Grail” of machine translation.
“But the question is what level of performance can be expected” from the word vector method, Poibeau said.
The method “can give an idea of the original text,” but the capability for a good translation every time remains unproven.
Francois Yvon, a researcher at CNRS’ Computer Science Laboratory for Mechanics and Engineering Sciences, said “the linking of languages is much more difficult” when they are far removed from one another.
“The manner of denoting concepts in Chinese is completely different from French,” he added.
However, even imperfect translations can be useful and could prove sufficient to track hate speech, a major priority for Facebook, Yvon said.
‘NEO-NAZIS’: A minister described the rally as ‘spreading hate’ and ‘dividing our communities,’ adding that it had been organized and promoted by far-right groups Thousands of Australians joined anti-immigration rallies across the country yesterday that the center-left government condemned, saying they sought to spread hate and were linked to neo-Nazis. “March for Australia” rallies against immigration were held in Sydney, and other state capitals and regional centers, according to the group’s Web site. “Mass migration has torn at the bonds that held our communities together,” the Web site said. The group posted on X on Saturday that the rallies aimed to do “what the mainstream politicians never have the courage to do: demand an end to mass immigration.” The group also said it was concerned about culture,
CRACKDOWN: The Indonesian president vowed to clamp down on ‘treason and terrorism,’ while acceding to some protest demands to revoke lawmaker benefits Protests in Indonesia over rising living costs and inequality intensified overnight, prompting Indonesian President Prabowo Subianto to cancel a planned trip to China, while demonstrators reportedly targeted the homes of the finance minister and several lawmakers. Rioters entered Indonesian Minister of Finance Sri Mulyani Indrawati’s residence near Jakarta early yesterday, but were repelled by armed forces personnel, Kompas reported. Items were taken from the homes of lawmaker Ahmad Sahroni and two others, according to Detik.com. The reports of looting could not be independently verified, and the finance ministry has not responded to requests for comment. The protests were sparked by outrage over
VENEZUELAN ACTION: Marco Rubio said that previous US interdiction efforts have not stemmed the flow of illicit drugs into the US and that ‘blowing them up’ would US President Donald Trump on Wednesday justified a lethal military strike that his administration said was carried out a day earlier against a Venezuelan gang as a necessary effort by the US to send a message to Latin American cartels. Asked why the military did not instead interdict the vessel and capture those on board, Trump said that the operation would cause drug smugglers to think twice about trying to move drugs into the US. “There was massive amounts of drugs coming into our country to kill a lot of people and everybody fully understands that,” Trump said while hosting Polish President
A French couple kept Louise, a playful black panther, in an apartment in northern France, triggering panic when she was spotted roaming nearby rooftops. The pair were were handed suspended jail sentences on Thursday for illegally keeping a wild animal, despite protesting that they saw Louise as their baby. The ruling follows a September 2019 incident when the months-old feline was seen roaming a rooftop in Armentieres after slipping out of the couple’s window. Authorities captured the panther by sedating her with anesthetic darts after she entered a home. No injuries were reported during the animal’s time on the loose. The court in the
RSS