Holding an oversized carrot, a brawny, shirtless man promotes a supplement he claims can enlarge male genitalia — one of countless AI-generated videos on TikTok peddling unproven sexual treatments.
The rise of generative AI has made it easy — and financially lucrative — to mass-produce such videos with minimal human oversight, often featuring fake celebrity endorsements of bogus and potentially harmful products.
In some TikTok videos, carrots are used as a euphemism for male genitalia, apparently to evade content moderation policing sexually explicit language.
Photo: AFP
“You would notice that your carrot has grown up,” the muscled man says in a robotic voice in one video, directing users to an online purchase link.
“This product will change your life,” the man adds, claiming without evidence that the herbs used as ingredients boost testosterone and send energy levels “through the roof.”
The video appears to be AI-generated, according to a deepfake detection service recently launched by the Bay Area-headquartered firm Resemble AI.
“As seen in this example, misleading AI-generated content is being used to market supplements with exaggerated or unverified claims, potentially putting consumers’ health at risk,” said Zohaib Ahmed, Resemble AI’s chief executive and co-founder.
“We’re seeing AI-generated content weaponized to spread false information.”
‘CHEAP WAY’
The trend underscores how rapid advances in artificial intelligence have fueled what researchers call an AI dystopia, a deception-filled online universe designed to manipulate unsuspecting users into buying dubious products.
They include everything from unverified — and in some cases, potentially harmful — dietary supplements to weight loss products and sexual remedies.
“AI is a useful tool for grifters looking to create large volumes of content slop for a low cost,” said misinformation researcher Abbie Richards.
“It’s a cheap way to produce advertisements,” she added.
Alexios Mantzarlis, director of the Security, Trust and Safety Initiative at Cornell Tech, has observed a surge of “AI doctor” avatars and audio tracks on TikTok that promote questionable sexual remedies.
Some of these videos, many with millions of views, peddle testosterone-boosting concoctions made from ingredients such as lemon, ginger and garlic.
More troublingly, rapidly evolving AI tools have enabled the creation of deepfakes impersonating celebrities such as actress Amanda Seyfried and actor Robert De Niro.
“Your husband can’t get it up?” Anthony Fauci, former director of the National Institute of Allergy and Infectious Diseases, appears to ask in a TikTok video promoting a prostate supplement.
But the clip is a deepfake, using Fauci’s likeness.
‘PERNICIOUS’
Many manipulated videos are created from existing ones, modified with AI-generated voices and lip-synced to match what the altered voice says.
“The impersonation videos are particularly pernicious as they further degrade our ability to discern authentic accounts online,” Mantzarlis said.
Last year, Mantzarlis discovered hundreds of ads on YouTube featuring deepfakes of celebrities — including Arnold Schwarzenegger, Sylvester Stallone and Mike Tyson — promoting supplements branded as erectile dysfunction cures.
The rapid pace of generating short-form AI videos means that even when tech platforms remove questionable content, near-identical versions quickly reappear — turning moderation into a game of whack-a-mole.
Researchers say this creates unique challenges for policing AI-generated content, requiring novel solutions and more sophisticated detection tools.
Fact checkers have repeatedly debunked scam ads on Facebook promoting treatments — including erectile dysfunction cures — that use fake endorsements by Ben Carson, a neurosurgeon and former US cabinet member.
Yet many users still consider the endorsements legitimate, illustrating the appeal of deepfakes. “Scammy affiliate marketing schemes and questionable sex supplements have existed for as long as the Internet and before,” Mantzarlis said.
“As with every other bad thing online, generative AI has made this abuse vector cheaper and quicker to deploy at scale.”
Last week the government announced that by year’s end Taiwan will have the highest density of anti-ship missiles in the world. Its inventory could exceed 1,400, or enough for the opening two hours of an invasion from the People’s Republic of China (PRC). Snark aside, it sounds impressive. But an important piece is missing. Lost in all the “dialogues” and “debates” and “discussions” whose sole purpose is simply to dawdle and delay is what the Chinese Nationalist Party (KMT) alternative special defense budget proposal means for the defense of Taiwan. It is a betrayal of both Taiwan and the US. IT’S
Paul Thomas Anderson’s “One Battle After Another” was crowned best picture at the 98th Academy Awards, handing Hollywood’s top honor to a comic, multi-generational American saga of political resistance. The ceremony Sunday, which also saw Michael B. Jordan win best actor and “Sinners” cinematographer Autumn Durald Arkapaw make Oscar history as the first female director of photography to win the award, was a long-in-coming coronation for Anderson, a San Fernando Valley native who made his first short at age 18 and has been one of America’s most lionized filmmakers for decades. Before Sunday, Anderson had never won an Oscar. But “One Battle
In Kaohsiung’s Indigenous People’s Park (原住民主題公園), the dance group Push Hands is training. All its members are from Taiwan’s indigenous community, but their vibe is closer to that of a modern, urban hip-hop posse. MIXING CULTURES “The name Push Hands comes from the idea of pushing away tradition to expand our culture,” says Ljakuon (洪濬嚴), the 44-year-old founder and main teacher of the dance group. This is what makes Push Hands unique: while retaining their Aboriginal roots, and even reconnecting with them, they are adamant about doing something modern. Ljakuon started the group 20 years ago, initially with the sole intention of doing hip-hop dancing.
You would never believe Yancheng District (鹽埕) used to be a salt field. Today, it is a bustling, artsy, Kowloon-ish “old town” of Kaohsiung — full of neon lights, small shops, scooters and street food. Two hundred years ago, before Japanese occupiers developed a shipping powerhouse around it, Yancheng was a flat triangle where seawater was captured and dried to collect salt. This is what local art galleries are revealing during the first edition of the Yancheng Arts Festival. Shen Yu-rung (沈裕融), the main curator, says: “We chose the connection with salt as a theme. The ocean is still very near, just a
RSS