Tue, May 14, 2019 - Page 9 News List

Facebook auto-generates videos celebrating extremist images

Analysts said that Facebook’s attempts to remove extremist content are obviously not working, as simple search terms quickly exposed users and groups that endorsed al-Qaeda or the Islamic State group

By Desmond Butler and Barbara Ortutay  /  AP, WASHINGTON

Illustration: Mountain People

The animated video begins with a photo of the black flags of jihad. Seconds later, it flashes highlights of a year of social media posts: plaques of anti-Semitic verses, talk of retribution and a photo of two men carrying more jihadi flags while they burn a US flag.

It was not produced by extremists; it was created by Facebook. In a clever bit of self-promotion, the social media giant takes a year of a user’s content and auto-generates a celebratory video. In this case, the user called himself “Abdel-Rahim Moussa, the Caliphate.”

“Thanks for being here, from Facebook,” the video concludes in a cartoon bubble before flashing the company’s famous “thumbs up.”

Facebook likes to give the impression that it is staying ahead of extremists by taking down their posts, often before users even see them. However, a confidential whistleblower’s complaint to the US Securities and Exchange Commission (SEC) alleges that the social media company has exaggerated its success. Even worse, it shows that the company is inadvertently making use of propaganda by militant groups to auto-generate videos and pages that could be used for networking by extremists.

According to the complaint, over a five-month period last year, researchers monitored pages by users who affiliated themselves with groups that the US Department of State has designated as terrorist organizations. In that period, 38 percent of the posts with prominent symbols of extremist groups were removed.

In its own review, the Associated Press found that as of this month, much of the banned content cited in the study — an execution video, images of severed heads, propaganda honoring martyred militants — slipped through the algorithmic web and remained easy to find on Facebook.

The complaint is landing as Facebook tries to stay ahead of a growing array of criticism over its privacy practices and its ability to keep hate speech, live-streamed murders and suicides off its service.

In the face of criticism, Facebook chief executive officer Mark Zuckerberg has spoken of his pride in the company’s ability to weed out violent posts automatically through artificial intelligence. During an earnings call last month, for instance, he repeated a carefully worded formulation that Facebook has been employing.

“In areas like terrorism, for al-Qaeda and ISIS [Islamic State]-related content, now 99 percent of the content that we take down in the category our systems flag proactively before anyone sees it,” he said.

Then he added: “That’s what really good looks like.”

Zuckerberg did not offer an estimate of how much of total prohibited material is being removed.

The research behind the SEC complaint is aimed at spotlighting glaring flaws in the company’s approach. Last year, researchers began monitoring users who explicitly identified themselves as members of extremist groups. It was not difficult to document. Some of these people even list the extremist groups as their employers. One profile heralded by the black flag of an al-Qaeda-affiliated group listed his employer, perhaps facetiously, as Facebook. The profile that included the auto-generated video with the flag burning also had a video of al-Qaeda leader Ayman al-Zawahiri urging jihadi groups not to fight among themselves.

While the study is far from comprehensive — in part because Facebook rarely makes much of its data publicly available — researchers involved in the project say that the ease of identifying these profiles using a basic keyword search and the fact that so few of them have been removed suggest that Facebook’s claims that its systems catch most extremist content are not accurate.

This story has been viewed 1890 times.

Comments will be moderated. Keep comments relevant to the article. Remarks containing abusive and obscene language, personal attacks of any kind or promotion will be removed and the user banned. Final decision will be at the discretion of the Taipei Times.

TOP top