Cybersecurity experts are warning that artificial intelligence agents, widely considered the next frontier in the generative AI revolution, could wind up getting hijacked and doing the dirty work for hackers.
AI agents are programs that use artificial intelligence chatbots to do the work humans do online, like buy a plane ticket or add events to a calendar.
But the ability to order around AI agents with plain language makes it possible for even the technically non-proficient to do mischief.
Photo: Reuters
“We’re entering an era where cybersecurity is no longer about protecting users from bad actors with a highly technical skillset,” AI startup Perplexity said in a blog post. “For the first time in decades, we’re seeing new and novel attack vectors that can come from anywhere.”
These so-called injection attacks are not new in the hacker world, but previously required cleverly written and concealed computer code to cause damage.
But as AI tools evolved from just generating text, images or video to being “agents” that can independently scour the internet, the potential for them to be commandeered by prompts slipped in by hackers has grown.
“People need to understand there are specific dangers using AI in the security sense,” said software engineer Marti Jorda Roca at NeuralTrust, which specializes in large language model security.
Meta calls this query injection threat a “vulnerability.” OpenAI chief information security officer Dane Stuckey has referred to it as “an unresolved security issue.”
Both companies are pouring billions of dollars into AI, the use of which is ramping up rapidly along with its capabilities.
AI ‘OFF TRACK’
Query injection can in some cases take place in real time when a user prompt -- “book me a hotel reservation” — is gerrymandered by a hostile actor into something else — “wire US$100 to this account.”
But these nefarious prompts can also be hiding out on the internet as AI agents built into browsers encounter online data of dubious quality or origin, and potentially booby-trapped with hidden commands from hackers.
Eli Smadja of Israeli cybersecurity firm Check Point sees query injection as the “number one security problem” for large language models that power AI agents and assistants that are fast emerging from the ChatGPT revolution.
Major rivals in the AI industry have installed defenses and published recommendations to thwart such cyberattacks.
Microsoft has integrated a tool to detect malicious commands based on factors including where instructions for AI agents originate.
OpenAI alerts users when agents doing their bidding visit sensitive websites and blocks proceeding until the software is supervised in real time by the human user.
Some security professionals suggest requiring AI agents to get user approval before performing any important task - like exporting data or accessing bank accounts.
“One huge mistake that I see happening a lot is to give the same AI agent all the power to do everything,” Smadja said.
In the eyes of cybersecurity researcher Johann Rehberger, known in the industry as “wunderwuzzi,” the biggest challenge is that attacks are rapidly improving.
“They only get better,” Rehberger said of hacker tactics.
Part of the challenge, according to the researcher, is striking a balance between security and ease of use since people want the convenience of AI doing things for them without constant checks and monitoring.
Rehberger argues that AI agents are not mature enough to be trusted yet with important missions or data.
“I don’t think we are in a position where you can have an agentic AI go off for a long time and safely do a certain task,” the researcher said.
“It just goes off track.”
Jan. 26 to Feb. 1 Nearly 90 years after it was last recorded, the Basay language was taught in a classroom for the first time in September last year. Over the following three months, students learned its sounds along with the customs and folktales of the Ketagalan people, who once spoke it across northern Taiwan. Although each Ketagalan settlement had its own language, Basay functioned as a common trade language. By the late 19th century, it had largely fallen out of daily use as speakers shifted to Hoklo (commonly known as Taiwanese), surviving only in fragments remembered by the elderly. In
William Liu (劉家君) moved to Kaohsiung from Nantou to live with his boyfriend Reg Hong (洪嘉佑). “In Nantou, people do not support gay rights at all and never even talk about it. Living here made me optimistic and made me realize how much I can express myself,” Liu tells the Taipei Times. Hong and his friend Cony Hsieh (謝昀希) are both active in several LGBT groups and organizations in Kaohsiung. They were among the people behind the city’s 16th Pride event in November last year, which gathered over 35,000 people. Along with others, they clearly see Kaohsiung as the nexus of LGBT rights.
Dissident artist Ai Weiwei’s (艾未未) famous return to the People’s Republic of China (PRC) has been overshadowed by the astonishing news of the latest arrests of senior military figures for “corruption,” but it is an interesting piece of news in its own right, though more for what Ai does not understand than for what he does. Ai simply lacks the reflective understanding that the loneliness and isolation he imagines are “European” are simply the joys of life as an expat. That goes both ways: “I love Taiwan!” say many still wet-behind-the-ears expats here, not realizing what they love is being an
In the American west, “it is said, water flows upwards towards money,” wrote Marc Reisner in one of the most compelling books on public policy ever written, Cadillac Desert. As Americans failed to overcome the West’s water scarcity with hard work and private capital, the Federal government came to the rescue. As Reisner describes: “the American West quietly became the first and most durable example of the modern welfare state.” In Taiwan, the money toward which water flows upwards is the high tech industry, particularly the chip powerhouse Taiwan Semiconductor Manufacturing Co (TSMC, 台積電). Typically articles on TSMC’s water demand
RSS