When I was 14, I was looking for a video on the most popular file-sharing app of the time — Limewire — and started a download.
The video that arrived did not match the description. What I saw instead is as vivid in my mind today as it was in the seconds after I had shut it off, reacting too slowly to miss the horror of a young woman’s murder. That is the sort of thing that could happen in those days, when the Internet was a true Wild West. It was the risk you took when you used those kinds of services.
There should be no such danger for people who use Instagram.
Illustration: Yusha
Yet on Thursday last week, reports circulated — in 404 Media, the Wall Street Journal and elsewhere — of an “error” on the app that pushed videos of extreme violence and death into their feeds, nestled between their usual serving of friends and influencers.
Feeds started to take a dark turn on Wednesday, the Wall Street Journal reported. Those affected are thought to include minors.
Some of the videos were presented with a “sensitive content” warning that requires a user to tap before the clip is revealed. However, many of them did not — they just automatically started to play.
Reading through comments from unsuspecting users, I was reminded of my 14-year-old self and the lingering effects of a violent video you were not expecting or emotionally prepared for.
“I watched 10 people die today,” one user told the Wall Street Journal.
“I feel like I lost some humanity today,” another wrote on Reddit, saying it caused sleeplessness.
Meta Platforms Inc, Instagram’s parent, has apologized.
“We have fixed an error that caused some users to see content in their Instagram Reels feed that should not have been recommended,” a spokesman said. The company declined to share how many people were involved. Chatter online suggests it is far from an isolated incident.
Affected users need to hold Meta to account. Never before has there been such a clear-cut case of the company’s algorithm actively working to traumatize its users. What caused this error? What steps would be taken to make sure it does not happen again? Would anyone be held responsible? Meta would not voluntarily say.
One question for Meta might be why that content was on Instagram at all, shared on pages with names such as “BlackPeopleBeingHurt.”
Late last year, more than 140 Kenya-based content moderators working for Meta were diagnosed with post-traumatic stress disorder — the result of endless hours of sifting through traumatic material, doctors said. Mercifully, what Instagram users saw on Wednesday (and perhaps Thursday) was just a tiny reflection of the harrowing job those workers do for up to 10 hours a day. However, take it from me, it takes only one clip to sear into your brain for a lifetime.
The company insisted that the error was unrelated to its recently announced changes to its moderation policies. Last month, it said it would stop removing some content that would have previously been prohibited, although it has not provided a full updated breakdown of what is now considered acceptable.
It said it would use fewer automated processes to remove harmful material, instead relying on user reports.
Meta CEO Mark Zuckerberg conceded it would mean the company would “catch less bad stuff.”
Meta’s existing policy on violent material is that even the most disturbing scenes are permitted on the platform. Footage of human “dismemberment” and displaying “innards” are fine if given a warning label. So, too, are images and video of “burned or charred” people and “throat slitting.” However, Meta’s staff would remove such content at the request of a family member — which is mighty good of them.
It is unfortunate, and not Meta’s fault, that there exists an eager audience for such videos, known colloquially on the Internet as “gore.” Other social networks have contended with the issue, too. Reddit, for instance, took steps to remove forums such as “WatchPeopleDie.” However, in those cases, those who wanted such material had to go actively looking. This is different: a catastrophic failure for a company that billions trust to shield them from this harm.
What does it do to young minds to see extreme violence on their Instagram feeds? Meta’s apology does not cut it.
Dave Lee is Bloomberg Opinion’s US technology columnist. He was previously a correspondent for the Financial Times and BBC News.
The gutting of Voice of America (VOA) and Radio Free Asia (RFA) by US President Donald Trump’s administration poses a serious threat to the global voice of freedom, particularly for those living under authoritarian regimes such as China. The US — hailed as the model of liberal democracy — has the moral responsibility to uphold the values it champions. In undermining these institutions, the US risks diminishing its “soft power,” a pivotal pillar of its global influence. VOA Tibetan and RFA Tibetan played an enormous role in promoting the strong image of the US in and outside Tibet. On VOA Tibetan,
Sung Chien-liang (宋建樑), the leader of the Chinese Nationalist Party’s (KMT) efforts to recall Democratic Progressive Party (DPP) Legislator Lee Kun-cheng (李坤城), caused a national outrage and drew diplomatic condemnation on Tuesday after he arrived at the New Taipei City District Prosecutors’ Office dressed in a Nazi uniform. Sung performed a Nazi salute and carried a copy of Adolf Hitler’s Mein Kampf as he arrived to be questioned over allegations of signature forgery in the recall petition. The KMT’s response to the incident has shown a striking lack of contrition and decency. Rather than apologizing and distancing itself from Sung’s actions,
US President Trump weighed into the state of America’s semiconductor manufacturing when he declared, “They [Taiwan] stole it from us. They took it from us, and I don’t blame them. I give them credit.” At a prior White House event President Trump hosted TSMC chairman C.C. Wei (魏哲家), head of the world’s largest and most advanced chip manufacturer, to announce a commitment to invest US$100 billion in America. The president then shifted his previously critical rhetoric on Taiwan and put off tariffs on its chips. Now we learn that the Trump Administration is conducting a “trade investigation” on semiconductors which
By now, most of Taiwan has heard Taipei Mayor Chiang Wan-an’s (蔣萬安) threats to initiate a vote of no confidence against the Cabinet. His rationale is that the Democratic Progressive Party (DPP)-led government’s investigation into alleged signature forgery in the Chinese Nationalist Party’s (KMT) recall campaign constitutes “political persecution.” I sincerely hope he goes through with it. The opposition currently holds a majority in the Legislative Yuan, so the initiation of a no-confidence motion and its passage should be entirely within reach. If Chiang truly believes that the government is overreaching, abusing its power and targeting political opponents — then
RSS