For many people, Facebook is the Internet, and its number of users is still growing, according to Meta Platforms Inc’s latest financial results. But Meta Platforms Inc CEO Mark Zuckerberg is not just celebrating that continuing growth. He wants to take advantage of it by using data from Facebook and Instagram to create powerful, general-purpose artificial intelligence. Sounds great and Meta is well positioned to do it, but his billions of users might end up paying the price with their privacy and more.
Here is how Zuckerberg teased his next move in AI on Thursday last week:
“The next key part of our playbook is learning from unique data and feedback loops in our products… On Facebook and Instagram, there are hundreds of billions of publicly shared images and tens of billions of public videos, which we estimate is greater than the Common Crawl dataset and people share large numbers of public text posts in comments across our services as well.”
The point that Zuck makes here about “Common Crawl” startled observers in the tech press, because that archive is already huge: 250 billion Web pages spanning 17 years. It is one of the biggest and most popular repositories of the public Internet used for training AI systems today. When OpenAI launched its GPT-3 language model in 2020, close to 60 percent of the text used to train the system came from Common Crawl.
However, Meta’s data mountain is even bigger, which means it could theoretically build “smarter” AI. That is because research has shown that training AI models on more data tends to make them more capable and accurate. That formula has worked wonders for OpenAI, which over the years has increased the amount of data used to create models like ChatGPT.
If Zuckerberg wants to make a more powerful chatbot, the pile of data he is sitting on is especially valuable because so much of it comes from comment threads. Any text that represents human dialogue is critical for training so-called conversational agents, which is why OpenAI heavily mined the Internet forum Reddit Inc to build its own popular chatbot.
It is easy to scoff whenever Zuckerberg talks about a new ambition — whether it is bots or crypto or the metaverse. His latest quixotic vision is especially grand: to build “general intelligence,” or software systems that meet or surpass human intelligence. But with all that data, Zuckerberg’s quest looks doable. The problem is what the fallout could be for the rest of us.
It is odd that in the same message where Zuckerberg said that his AI team had been working on building general intelligence “for more than a decade,” he also said that Facebook would only now turn to its users’ data to build models as “the next key part of our playbook.” Why has Meta not done that already? Perhaps because using all that data is not so straightforward. For one thing, it would represent yet another infringement on the privacy of Facebook’s 3 billion users and Instagram’s 1.5 billion users.
In the same way OpenAI has come under fire for scraping up the copyrighted data of artists and writers to train its models, Facebook stands to face reputational blowback for exploiting people’s data all over again. Not only does that raise thorny ethical questions, doing so could require stringent data handling practices and compliance with global data protection laws, which could raise the hackles of European regulators.
The other issue is all the bias and toxicity in the data. OpenAI had to deal with this issue with Common Crawl, whose vast trove included Web pages like adultmovietop100.com and adelaide-femaleescorts.webcam, according to a 2021 study by the University of Montreal. The same study says that between 4 percent and 6 percent of all the Web sites in Common Crawl included racial slurs, hate speech or racially charged conspiracy theories.
While Facebook’s content-moderation software has become better at blocking hate speech and conspiracy theories, it is not perfect and tends to be worse in countries outside the US. Some of the content on Facebook that gets flagged as toxic does not get reviewed by a human anymore and is left on the site. Worse: When Zuckerberg said that Meta’s data were bigger than that of Common Crawl, he was likely lumping in the company’s historic archive that would include all the hyperbolic political content and fake news that were on the site before Zuckerberg took pains to clean it up.
All the work that must go into careful data handling and checking might explain why Zuckerberg has only now talked about capitalizing on the data mountain that he sits on. If he does not do it properly, he risks reliving the nightmare of public criticism about how Facebook has handled fake news and harmful content.
Still, if there is one thing we know about Zuckerberg, it is that he has a Caesar-like obsession with winning and domination. Last week, about 24 hours after he faced a crowd of parents in Washington, DC, who accused him of leading their children to self-harm or even suicide, he went on to announce one of Meta’s most successful financial quarters yet and tease how he would use people’s data to create powerful AI.
The proximity of those events should serve as a reminder: Facebook’s path to riches has hurt many. So too might its road to building powerful AI.
Parmy Olson is a Bloomberg Opinion columnist covering technology. A former reporter for the Wall Street Journal and Forbes, she is author of We Are Anonymous.
This column does not necessarily reflect the opinion of the editorial board or Bloomberg LP and its owners.
The Chinese Communist Party (CCP) continues to bully Taiwan by conducting military drills extremely close to Taiwan in late May 2024 and announcing a legal opinion in June on how they would treat “Taiwan Independence diehards” according to the PRC’s Criminal Code. This article will describe how China’s Anaconda Strategy of psychological and legal asphyxiation is employed. The CCP’s People’s Liberation Army (PLA) and Chinese Coast Guard (CCG) conducted a “punishment military exercise” against Taiwan called “Joint Sword 2024A” from 23-24 May 2024, just three days after President William Lai (賴清德) of the Democratic Progressive Party (DPP) was sworn in and
Former US president Donald Trump’s comments that Taiwan hollowed out the US semiconductor industry are incorrect. That misunderstanding could impact the future of one of the world’s most important relationships and end up aiding China at a time it is working hard to push its own tech sector to catch up. “Taiwan took our chip business from us,” the returnee US presidential contender told Bloomberg Businessweek in an interview published this week. The remarks came after the Republican nominee was asked whether he would defend Taiwan against China. It is not the first time he has said this about the nation’s
In a recent interview with the Malaysian Chinese-language newspaper Sin Chew Daily, former president Ma Ying-jeou (馬英九) called President William Lai (賴清德) “naive.” As always with Ma, one must first deconstruct what he is saying to fully understand the parallel universe he insists on defending. Who is being “naive,” Lai or Ma? The quickest way is to confront Ma with a series of pointed questions that force him to take clear stands on the complex issues involved and prevent him from his usual ramblings. Regarding China and Taiwan, the media should first begin with questions like these: “Did the Chinese Nationalist Party (KMT)
The Yomiuri Shimbun, the newspaper with the largest daily circulation in Japan, on Thursday last week published an article saying that an unidentified high-ranking Japanese official openly spoke of an analysis that the Chinese People’s Liberation Army (PLA) needs less than a week, not a month, to invade Taiwan with its amphibious forces. Reportedly, Japanese Prime Minister Fumio Kishida has already been advised of the analysis, which was based on the PLA’s military exercises last summer. A Yomiuri analysis of unclassified satellite photographs confirmed that the PLA has already begun necessary base repairs and maintenance, and is conducting amphibious operation exercises