Her voice tinged with anger, an American mother worried about what the future holds for her teenage daughter, just one of dozens of girls targeted in yet another artificial intelligence (AI)-enabled pornography scandal that has rocked a US school.
The controversy that engulfed the Lancaster Country Day School in Pennsylvania last year highlights a new normal for pupils and educators struggling to keep up with a boom in cheap, easily available AI tools that have facilitated hyperrealistic deepfakes. One parent, who spoke to Agence France-Presse (AFP) on the condition of anonymity, said her 14-year-old daughter came to her “hysterically crying” last summer after finding AI-generated nude pictures of her circulating among her peers.
“What are the ramifications to her long term?” the mother said, voicing fears that the manipulated images could resurface when her daughter applies to college, starts dating or enters the job market.
Photo: AFP
“You can’t tell that they are fake,” she said.
Multiple charges — including sexual abuse of children and possession of child pornography — were filed last month against two teenage boys who authorities allege created the images.
Investigators uncovered 347 images and videos affecting a total of 60 victims, most of them female students at the private school, on the messaging app Discord.
All but one was younger than 18.
The scandal is the latest in a wave of similar incidents in schools across US states — from California to New Jersey — leading to a warning from the FBI last year that such child sexual abuse material, including realistic AI-generated images, was illegal.
“The rise of generative AI has collided with a long-standing problem in schools: the act of sharing non-consensual intimate imagery,” said Alexandra Reeve Givens, chief executive of the nonprofit Center for Democracy & Technology (CDT).
“In the digital age, kids desperately need support to navigate tech-enabled harassment,” she said.
A CDT survey of public schools in September last year found that 15 percent of students and 11 percent of teachers knew of at least one “deepfake that depicts an individual associated with their school in a sexually explicit or intimate manner.”
Such non-consensual imagery can lead to harassment, bullying or blackmail, sometimes causing devastating mental health consequences.
The mother who spoke to AFP said she knows of victims who had avoided school, had trouble eating, or required medical attention and counseling to cope with the ordeal.
She said she and other parents brought into a detective’s office to scrutinize the deepfakes were shocked to find printed out images stacked a “foot-and-a-half” (45.72cm) high.
“I had to see pictures of my daughter,” she said.
“If someone looked, they would think it’s real, so that’s even more damaging,” she added.
The alleged perpetrators, whose names have not been released, are accused of lifting pictures from social media, altering them using an AI application and sharing them on Discord.
The mother told AFP the fakes of her daughter were primarily altered from public photos on the school’s Instagram page, as well as a screenshot of a FaceTime call.
A simple online search throws up dozens of apps and Web sites that allow users to create “deepnudes,” digitally removing clothing, or superimpose selected faces onto pornographic images.
“Although results may not be as realistic or compelling as a professional rendition, these services mean that no technical skills are needed to produce deepfake content,” said Roberta Duffield, director of intelligence at Blackbird.AI.
Only a handful of US states have passed laws to deal with sexually explicit deepfakes, including Pennsylvania at the end of last year. The top leadership at the Pennsylvania school stepped aside after parents of the victims filed a lawsuit accusing the administration of failing to report the activity when they were first alerted to it in late 2023.
Researchers say schools are ill-equipped to tackle the threat of AI technology evolving at a rapid pace, in part because the law is still playing catchup.
“Underage girls are increasingly subject to deepfake exploitation from their friends, colleagues, school classmates,” Duffield said.
“Education authorities must urgently develop clear, comprehensive policies regarding the use of AI and digital technologies,” she said.
RIGHTS FEARS: A protester said Beijing would use the embassy to catch and send Hong Kongers to China, while a lawmaker said Chinese agents had threatened Britons Hundreds of demonstrators on Saturday protested at a site earmarked for Beijing’s controversial new embassy in London over human rights and security concerns. The new embassy — if approved by the British government — would be the “biggest Chinese embassy in Europe,” one lawmaker said earlier. Protester Iona Boswell, a 40-year-old social worker, said there was “no need for a mega embassy here” and that she believed it would be used to facilitate the “harassment of dissidents.” China has for several years been trying to relocate its embassy, currently in the British capital’s upmarket Marylebone district, to the sprawling historic site in the
A deluge of disinformation about a virus called hMPV is stoking anti-China sentiment across Asia and spurring unfounded concerns of renewed lockdowns, despite experts dismissing comparisons with the COVID-19 pandemic five years ago. Agence France-Presse’s fact-checkers have debunked a slew of social media posts about the usually non-fatal respiratory disease human metapneumovirus after cases rose in China. Many of these posts claimed that people were dying and that a national emergency had been declared. Garnering tens of thousands of views, some posts recycled old footage from China’s draconian lockdowns during the COVID-19 pandemic, which originated in the country in late
French police on Monday arrested a man in his 20s on suspicion of murder after an 11-year-old girl was found dead in a wood south of Paris over the weekend in a killing that sparked shock and a massive search for clues. The girl, named as Louise, was found stabbed to death in the Essonne region south of Paris in the night of Friday to Saturday, police said. She had been missing since leaving school on Friday afternoon and was found just a few hundred meters from her school. A police source, who asked not to be named, said that she had been
BACK TO BATTLE: North Korean soldiers have returned to the front lines in Russia’s Kursk region after earlier reports that Moscow had withdrawn them following heavy losses Ukrainian President Volodymyr Zelenskiy on Friday pored over a once-classified map of vast deposits of rare earths and other critical minerals as part of a push to appeal to US President Donald Trump’s penchant for a deal. The US president, whose administration is pressing for a rapid end to Ukraine’s war with Russia, on Monday said he wanted Ukraine to supply the US with rare earths and other minerals in return for financially supporting its war effort. “If we are talking about a deal, then let’s do a deal, we are only for it,” Zelenskiy said, emphasizing Ukraine’s need for security guarantees