In an age of Photoshop, filters and social media, many people are used to seeing manipulated pictures — subjects become slimmer and smoother or, in the case of Snapchat, transformed into puppies.
However, there is a new breed of video and audio manipulation tools, made possible by advances in artificial intelligence and computer graphics, that would allow for the creation of realistic-looking footage of public figures appearing to say, well, anything.
US President Donald Trump declaring his proclivity for water sports. Former US secretary of state Hillary Rodham Clinton describing the stolen children she keeps locked in her wine cellar. Actor Tom Cruise finally admitting what we suspected all along — that he is a brony (a My Little Pony fan.)
This is the future of fake news. People have long been told not to believe everything they read, but soon they will have to question everything they see and hear as well.
For now, there are several research teams working on capturing and synthesizing different visual and audio elements of human behavior.
Software developed at Stanford University is able to manipulate video footage of public figures to allow a second person to put words in their mouth — in real time.
Face2Face captures the second person’s facial expressions as they talk into a webcam and then morphs those movements directly onto the face of the person in the original video.
The research team demonstrated their technology by puppeteering videos of former US president George W. Bush, Russian President Vladimir Putin and Trump.
On its own, Face2Face is a fun plaything for creating memes and entertaining late-night talk show hosts.
However, with the addition of a synthesized voice, it becomes more convincing — not only does the digital puppet look like the politician, but it can also sound like the politician.
A research team at the University of Alabama at Birmingham has been working on voice impersonation.
With three to five minutes of audio of a victim’s voice — taken live or from YouTube videos or radio shows — an attacker can create a synthesized voice that can fool both humans and voice biometric security systems used by some banks and smartphones.
The attacker can then talk into a microphone and the software will convert it so that the words sound like they are being spoken by the victim — whether that is over the telephone or on a radio show.
Canadian start-up Lyrebird has developed similar capabilities, which it says can be used to turn text into on-the-spot audiobooks “read” by famous voices or for characters in video games.
Although their intentions might be well-meaning, voice-morphing technology could be combined with face-morphing technology to create convincing fake statements by public figures.
You only have to look at the University of Washington’s Synthesizing Obama project, where they took the audio from one of former US president Barack Obama’s speeches and used it to animate his face in an entirely different video with incredible accuracy — thanks to training a recurrent neural network with hours of footage — to get a sense of how insidious these adulterations can be.
Beyond fake news, there are many other implications, said Nitesh Saxena, associate professor and research director of the University of Alabama at Birmingham’s department of computer science.
“You could leave fake voice messages posing as someone’s mom. Or defame someone and post the audio samples online,” Saxena said.
These morphing technologies are not yet perfect. The facial expressions in the videos can seem a little distorted or unnatural and the voices can sound a little robotic.
However, given time, they will be able to faithfully recreate the sound or appearance of a person — to the point where it might be very difficult for humans to detect the fraud.
Given the erosion of trust in the media and the rampant spread of hoaxes via social media, it will become even more important for news organizations to scrutinize content that looks and sounds like the real deal.
Telltale signs will be where the video or audio was created, who else was at the event and whether the weather conditions match the records of that day.
People should also be looking at the lighting and shadows in the video, whether all of the elements featured in the frame are the right size and whether the audio is synced perfectly, said Mandy Jenkins, from social news company Storyful, which specializes in verifying news content.
Doctored content might not pass the scrutiny of a rigorous newsroom, but if posted as a grainy video to social media, it could spread virally and trigger a public relations, political or diplomatic disaster. Imagine Trump declaring war on North Korea, for example.
“If someone looks like Trump and speaks like Trump, they will think it’s Trump,” Saxena said.
“We already see it doesn’t even take doctored audio or video to make people believe something that isn’t true,” Jenkins added. “This has the potential to make it worse.”
A gap appears to be emerging between Washington’s foreign policy elites and the broader American public on how the United States should respond to China’s rise. From my vantage working at a think tank in Washington, DC, and through regular travel around the United States, I increasingly experience two distinct discussions. This divergence — between America’s elite hawkishness and public caution — may become one of the least appreciated and most consequential external factors influencing Taiwan’s security environment in the years ahead. Within the American policy community, the dominant view of China has grown unmistakably tough. Many members of Congress, as
After declaring Iran’s military “gone,” US President Donald Trump appealed to the UK, France, Japan and South Korea — as well as China, Iran’s strategic partner — to send minesweepers and naval forces to reopen the Strait of Hormuz. When allies balked, the request turned into a warning: NATO would face “a very bad” future if it refused. The prevailing wisdom is that Trump faces a credibility problem: having spent years insulting allies, he finds they would not rally when he needs them. That is true, but superficial, as though a structural collapse could be caused by wounded feelings. Something
Former Taipei mayor and Taiwan People’s Party (TPP) founding chairman Ko Wen-je (柯文哲) was sentenced to 17 years in prison on Thursday, making headlines across major media. However, another case linked to the TPP — the indictment of Chinese immigrant Xu Chunying (徐春鶯) for alleged violations of the Anti-Infiltration Act (反滲透法) on Tuesday — has also stirred up heated discussions. Born in Shanghai, Xu became a resident of Taiwan through marriage in 1993. Currently the director of the Taiwan New Immigrant Development Association, she was elected to serve as legislator-at-large for the TPP in 2023, but was later charged with involvement
Out of 64 participating universities in this year’s Stars Program — through which schools directly recommend their top students to universities for admission — only 19 filled their admissions quotas. There were 922 vacancies, down more than 200 from last year; top universities had 37 unfilled places, 40 fewer than last year. The original purpose of the Stars Program was to expand admissions to a wider range of students. However, certain departments at elite universities that failed to meet their admissions quotas are not improving. Vacancies at top universities are linked to students’ program preferences on their applications, but inappropriate admission