From bombings and protests to the opening of a new health center, student journalist Baraa Razzouk has been documenting daily life in Idlib, Syria, for years, and posting the videos to his YouTube account.
Yet this month, the 21-year-old started getting automated e-mails from YouTube alerting him that his videos contravened its policy and would be deleted.
As of this month, more than a dozen of his videos had been removed, he said.
Illustration: Mountain People
“Documenting the [Syrian] protests in videos is really important — also, documenting attacks by regime forces,” he said in a telephone interview. “This is something I had documented for the world and now it’s deleted.”
YouTube, Facebook and Twitter in March said that videos and other content might be erroneously removed for policy contraventions, as the COVID-19 pandemic forced them to empty offices and rely on automated takedown software.
However, those artificial intelligence (AI)-enabled tools risk confusing human rights and historical documentation such as Razzouk’s videos with problematic material such as terrorist content — particularly in war-torn countries such as Syria and Yemen, digital rights activists have said.
“AI is notoriously context-blind,” said Jeff Deutch, a researcher for Syrian Archive, a nonprofit that archives video footage from conflict zones in the Middle East.
“It is often unable to gauge the historical, political or linguistic settings of posts ... human rights documentation and violent extremist proposals are too often indistinguishable,” he said in a telephone interview.
Erroneous takedowns threaten content such as videos that are used as formal evidence of rights violations by international bodies such as the International Criminal Court and the UN, said Dia Kayyali, program manager for tech and advocacy at digital rights group Witness.
“It’s a perfect storm,” Kayyali said.
After the Thomson Reuters Foundation flagged Razzouk’s account to YouTube, a spokesman said that the company had deleted the videos in error, although the removal was not appealed through their internal process.
YouTube has now restored 17 of Razzouk’s videos.
“With the massive volume of videos on our site, sometimes we make the wrong call,” the spokesman said in e-mailed comments. “When it’s brought to our attention that a video has been removed mistakenly, we act quickly to reinstate it.”
In the past few years, social media platforms have come under increased pressure from governments to quickly remove violent content and disinformation from their platforms, raising their reliance on AI systems.
With the help of automated software, YouTube removes millions of videos a year, and Facebook deleted more than 1 billion accounts last year for breaching rules such as not posting terrorist content.
Last year, social media companies pledged to block extremist content following a livestreamed terror attack on Facebook of a gunman killing 51 people at two mosques in Christchurch, New Zealand.
Governments have followed suit, with French President Emmanuel Macron vowing to make France a leader in containing the spread of illicit content and false information on social media platforms.
However, the country’s top court this week rejected most of a draft law that would have compelled social media giants to remove any hateful content within 24 hours.
Firms such as Facebook have also pledged to remove misinformation about the novel coronavirus outbreak that could contribute to imminent physical harm.
These pressures, combined with an increased reliance on AI during the pandemic, puts human rights content in particular jeopardy, Kayyali said.
Social media firms typically do not disclose how frequently their AI tools mistakenly take down content, so the Syrian Archive group has been using its own data to approximate change over time in the rate of deletions of human rights documentation on crimes committed in Syria, which has been battered by nearly a decade of war.
The group flags accounts posting human rights content on social media platforms, and archives the posts on its servers. To approximate the rate of deletions they run a script pinging the original post each month to see if it has been removed.
“Our research suggests that since the beginning of the year, the rate of content takedowns of Syrian human rights documentations on YouTube roughly doubled” from 13 percent to 20 percent, Deutch said, calling the increase “unprecendented.”
Last month, Syrian Archive detected that more than 350,000 videos on YouTube had disappeared — up from 200,000 in May last year, including videos of aerial attacks, protests and destruction of civilians homes in Syria.
Deutch said that he had seen content takedowns in other war-torn countries in the region, including Yemen and Sudan.
“Users in conflict zones are more vulnerable,” he said.
Other groups, including Amnesty International and Witness, have warned of the trend elsewhere, including in sub-Saharan Africa.
Syrian Archive was not able to test for takedowns at Facebook, because outside researchers are restricted from the platform’s application programming interface, but earlier this month Syrians began using the hashtag “Facebook is fighting the Syrian revolution” to flag similar content takedowns on the platform.
Last month, Yahya Daoud, a Syrian humanitarian worker with the White Helmets emergency response group, shared a post and a photograph showing a woman who died in a 2012 massacre by the forces of Syrian President Bashar al-Assad in the Houla region.
By the end of the month, Daoud said that his account — which he had used since 2011 to document his life in Syria — was automatically deleted without explanation.
“I was depending on Facebook to be an archive for me,” he said.
“So many memories have been lost: the death of my friends, the day I became displaced, the death of my mother,” he said, adding that he had unsuccessfully tried to appeal the decision through Facebook’s automated complaints system.
Facebook did not respond to requests for comment.
Researchers say that they are only able to detect a small slice of erroneous content takedowns.
“We don’t know how many people are trying to speak and we aren’t hearing them,” said Alexa Koenig, executive director of the University of California Berkeley’s Human Rights Center.
“These algorithms are grabbing the content before we even see it,” said Koenig, whose center uses images and videos posted from conflict zones such as Syria to document human rights abuses and build cases.
YouTube said that 80 percent of videos flagged by its AI were deleted before anyone had seen them in the second quarter of last year.
Koenig worries that the erasure of these videos could jeopardize ongoing investigations around the world.
In 2017, the International Criminal Court issued its first arrest warrant that rested primarily on social media evidence, after video footage emerged on Facebook of Libyan National Army commander Mahmoud al-Werfalli.
The video purportedly showed him shooting dead 10 blindfolded prisoners at the site of a car bombing in Benghazi. He is still at large.
Koenig worries that this kind of documentation is now under threat.
“The danger is much higher than it was just a few months ago,” she said. “It’s a sickening feeling to know we aren’t close to where we need to be in preserving this content.”
Jan. 1 marks a decade since China repealed its one-child policy. Just 10 days before, Peng Peiyun (彭珮雲), who long oversaw the often-brutal enforcement of China’s family-planning rules, died at the age of 96, having never been held accountable for her actions. Obituaries praised Peng for being “reform-minded,” even though, in practice, she only perpetuated an utterly inhumane policy, whose consequences have barely begun to materialize. It was Vice Premier Chen Muhua (陳慕華) who first proposed the one-child policy in 1979, with the endorsement of China’s then-top leaders, Chen Yun (陳雲) and Deng Xiaoping (鄧小平), as a means of avoiding the
The immediate response in Taiwan to the extraction of Venezuelan President Nicolas Maduro by the US over the weekend was to say that it was an example of violence by a major power against a smaller nation and that, as such, it gave Chinese President Xi Jinping (習近平) carte blanche to invade Taiwan. That assessment is vastly oversimplistic and, on more sober reflection, likely incorrect. Generally speaking, there are three basic interpretations from commentators in Taiwan. The first is that the US is no longer interested in what is happening beyond its own backyard, and no longer preoccupied with regions in other
A recent piece of international news has drawn surprisingly little attention, yet it deserves far closer scrutiny. German industrial heavyweight Siemens Mobility has reportedly outmaneuvered long-entrenched Chinese competitors in Southeast Asian infrastructure to secure a strategic partnership with Vietnam’s largest private conglomerate, Vingroup. The agreement positions Siemens to participate in the construction of a high-speed rail link between Hanoi and Ha Long Bay. German media were blunt in their assessment: This was not merely a commercial win, but has symbolic significance in “reshaping geopolitical influence.” At first glance, this might look like a routine outcome of corporate bidding. However, placed in
The last foreign delegation Nicolas Maduro met before he went to bed Friday night (January 2) was led by China’s top Latin America diplomat. “I had a pleasant meeting with Qiu Xiaoqi (邱小琪), Special Envoy of President Xi Jinping (習近平),” Venezuela’s soon-to-be ex-president tweeted on Telegram, “and we reaffirmed our commitment to the strategic relationship that is progressing and strengthening in various areas for building a multipolar world of development and peace.” Judging by how minutely the Central Intelligence Agency was monitoring Maduro’s every move on Friday, President Trump himself was certainly aware of Maduro’s felicitations to his Chinese guest. Just