Imagine receiving a telephone call from your aging mother seeking your help because she has forgotten her banking password.
Except it is not your mother. The voice on the other end of the phone call just sounds deceptively like her.
It is actually a synthesized voice, a tour de force of artificial intelligence (AI) technology that has been crafted to make it possible for someone to masquerade via the telephone.
Illustration: Mountain People
Such a situation is still science fiction — but just barely. It is also the future of crime.
The software components necessary to make such masking technology widely accessible are advancing rapidly.
Recently, for example, DeepMind, the Alphabet subsidiary known for a program that has bested some of the top human players in the 3,000-year-old Chinese board game go, announced that it had designed a program that “mimics any human voice and which sounds more natural than the best existing text-to-speech systems, reducing the gap with human performance by over 50 percent.”
EXPONENTIAL SCALE
The irony, of course, is that this year the computer security industry, with US$75 billion in annual revenue, has started to talk about how machine learning and pattern recognition techniques will improve the woeful state of computer security.
However, there is a downside.
“The thing people don’t get is that cybercrime is becoming automated and it is scaling exponentially,” said Marc Goodman, a law enforcement agency adviser and the author of Future Crimes.
“This is not about Matthew Broderick hacking from his basement,” he added, referring to the 1983 movie War Games.
The alarm about malevolent use of advanced AI technologies was sounded earlier this year by US Director of National Intelligence James Clapper. In his annual review of security, Clapper underscored the point that while AI systems would make some things easier, they would also expand the vulnerabilities of the online world.
The growing sophistication of computer criminals can be seen in the evolution of attack tools like the widely used malicious program known as Blackshades, Goodman said.
The author of the program, a Swedish national, was convicted last year in the US.
The system, which was sold widely in the computer underground, functioned as a “criminal franchise in a box,” Goodman said.
It allowed users without technical skills to deploy computer ransomware or perform video or audio eavesdropping with a mouse click.
The next generation of these tools will add machine learning capabilities that have been pioneered by AI researchers to improve the quality of machine vision, speech understanding, speech synthesis and natural language understanding.
Some computer security researchers believe that digital criminals have been experimenting with the use of AI technologies for more than half a decade.
That can be seen in efforts to subvert the Internet’s omnipresent CAPTCHA — Completely Automated Public Turing test to tell Computers and Humans Apart — the challenge and response puzzle invented in 2003 by Carnegie Mellon University researchers to block automated programs from stealing online accounts.
Both “white hat” AI researchers and “black hat” criminals have been deploying machine vision software to subvert CAPTCHAs for more than half a decade, said Stefan Savage, a computer security researcher at the University of California, San Diego.
“If you don’t change your CAPTCHA for two years, you will be owned by some machine vision algorithm,” he said.
Surprisingly, one thing that has slowed the development of malicious AI has been the ready availability of either low-cost or free human labor. For example, some cybercriminals have farmed out CAPTCHA-breaking schemes to electronic sweatshops where humans are used to decode the puzzles for a tiny fee.
Even more inventive computer crooks have used online pornography as a reward for human Web surfers who break the CAPTCHA, Goodman said.
Free labor is a commodity that AI software will not be able to compete with any time soon.
So what is next?
SOCIAL ENGINEERING
Criminals, for starters, can piggyback on new technology developments. Voice-recognition technology like Apple’s Siri and Microsoft’s Cortana are now used extensively to interact with computers. And Amazon’s Echo voice-controlled speaker and Facebook’s Messenger chatbot platform are rapidly becoming conduits for online commerce and customer support.
As is often the case, whenever a communication advancement like voice recognition starts to go mainstream, criminals looking to take advantage of it are not far behind.
“I would argue that companies that offer customer support via chatbots are unwittingly making themselves liable to social engineering,” said Brian Krebs, an investigative reporter who publishes at krebsonsecurity.com.
Social engineering, which refers to the practice of manipulating people into performing actions or divulging information, is widely seen as the weakest link in the computer security chain.
Cybercriminals already exploit the best qualities in humans — trust and willingness to help others — to steal and spy. The ability to create AI avatars that can fool people online will only make the problem worse.
This can already be seen in efforts by US state governments and political campaigns to use chatbot technology for political propaganda.
Researchers have coined the term “computational propaganda” to describe the explosion of deceptive social media campaigns on services like Facebook and Twitter.
In a recent research paper, Philip Howard, a sociologist at the Oxford Internet Institute, and Bence Kollanyi, a researcher at Corvinus University of Budapest, described how political chatbots had a “small but strategic role” in shaping the online conversation during the run-up to the “Brexit” referendum.
It is only a matter of time before such software is put to criminal use.
“There’s a lot of cleverness in designing social engineering attacks, but as far as I know, nobody has yet started using machine learning to find the highest quality suckers,” said Mark Seiden, an independent computer security specialist.
He paused and added, “I should have replied: ‘I’m sorry, Dave, I can’t answer that question right now.’”
The White House’s decision to take a 9.9 percent stake in Intel Corp is looking like very shrewd business indeed. Since the government bought in at US$20.47 a share last August, the US chipmaker’s surging stock price has delivered the US a US$43 billion return. One of the reasons the investment has so far proved so sound is that the White House has made sure of it. According to The Wall Street Journal, Howard personally pushed deals on Intel’s behalf with some of the most lucrative clients imaginable. They include Nvidia Corp, the company at the heart of the AI
The Ministry of the Interior, working with the navy and coast guard, is organizing Taiwan’s first joint exercise simulating escort tankers carrying liquefied natural gas (LNG) and oil through a Chinese blockade. The drills simulate fuel transport along three maritime corridors leading toward Japan, the Philippines and the US. Deputy Minister of the Interior Sawyer Mars (馬士元) said that a blockade of the Taiwan Strait would amount to “almost a 100 percent blockade of the regional energy supply.” Minister of National Defense Wellington Koo said planning to counter a blockade is standard practice in Taipei. While the exercise is limited in
A single photograph can cut through a lot of noise, but it can also be used to misrepresent the truth. At the very least, it can concentrate the mind on something that requires further investigation. On Monday last week, Ma Ying-jeou Foundation CEO Tai Hsia-ling (戴遐齡) and former National Security Council secretary-general King Pu-tsung (金溥聰) held a news conference in which they showed a photograph of former foundation CEO Hsiao Hsu-tsen (蕭旭岑), now Chinese Nationalist Party (KMT) deputy chairman. In the image Hsiao is seated next to Xiamen Taiwan Businessmen Association chairman Han Ying-huan (韓螢煥). The two men were holding
I first met Professor Ray Jiing (井迎瑞) as a film and documentary student at Shih Hsin University’s (SHU) Department of Radio Television and Film in 1988. The following year, he went on to become the director of the Chinese Taipei Film Archive — forerunner of the Taiwan Film and Audiovisual Institute (TFAI). Over his eight-year tenure, Jiing rescued and restored over 200 classic Taiwanese films. In 1997, he established the Graduate Institute of Studies in Documentary and Film Archiving at Tainan National University of the Arts (TNNUA), and I joined the program in his third cohort of students. Beyond a