Across the globe, data servers are humming, consuming megawatts and precious natural resources to bring life to our digital world.
The planet’s 8,000 or so data centers are the foundation of our online existence and will grow ever further with the advent of artificial intelligence (AI) — so much so that research estimates that by 2025, the IT industry could use 20 percent of all electricity produced and emit up to 5.5 percent of the world’s carbon.
This poses a real — and to some, increasingly urgent — question about the industry’s carbon footprint as start-ups and other companies fall behind Silicon Valley’s latest forward march.
“Pandora’s box is open,” said Arun Iyengar, chief executive officer of Untether AI, a highly specialized chipmaking company that strives to make AI more energy efficient.
“We can utilize AI in ways that enhance the climate requirements or we can ignore the climate requirements and find ourselves facing the consequences in a decade or so in terms of the impact,” Iyengar said.
The transformation of the world’s data servers to AI readiness is already well under way, in what one Google executive called a “once-in-a-generation inflection point in computing.”
However, the scope of the mission is huge.
The creation of generative AI tools such as GPT-4, which powers ChatGPT, or Google’s Palm2, behind the bot Bard, can be broken into two key stages, the actual “training” and then the execution, or “inference.”
In 2019, University of Massachusetts Amherst researchers trained several large-language models, and found that training a single AI model can emit the carbon equivalent of what five vehicles do over their lifetimes.
A more recent study by Google and the University of California, Berkeley reported that training GPT-3 resulted in 552 tonnes of carbon emissions, equivalent to driving a passenger vehicle 2 million kilometers.
OpenAI’s latest generation model, GPT-4, is trained on about 570 times more parameters — or inputs — than GPT-3, and the scale of these systems will only grow as AI becomes more powerful and ubiquitous.
Nvidia, AI’s chip giant, provides the processors that are indispensable for training, known as GPUs. And while they are more energy efficient than typical chips, they remain formidable consumers of power.
The other side of generative AI is deployment, or inference — when the trained model is applied to identify objects, respond to text prompts or whatever the use case might be.
Deployment does not necessarily need the computing heft of a Nvidia chip, but taken cumulatively, the endless interactions in the real world far outweigh training in terms of workload.
“Inference is going to be even more of a problem now with ChatGPT, which can be used by anyone and integrated into daily life through apps and Web searches,” said Lynn Kaack, assistant professor of computer science at the Hertie School in Berlin.
The biggest cloud companies insist that they are committed to being as energy efficient as possible.
Amazon Web Services pledges to be carbon-neutral by 2040, while Microsoft has pledged to be carbon-negative by 2030. The latest evidence that the companies are serious about energy efficiency is reassuring. Between 2010 and 2018, global data center energy use rose by only 6 percent, despite a 550 percent increase in workloads and computing instances, International Energy Agency data showed.
Silicon Valley’s AI tycoons believe discussions of AI’s current carbon footprint are beside the point and underplay its revolutionary potential.
The naysayers have it “backwards,” Nvidia CEO Jensen Huang (黃仁勳) told reporters on a recent visit to his company’s headquarters in California.
The mass deployment of AI and faster computing will in the end diminish the need to go to the world’s data clouds, he said.
AI’s superpowers will turn your laptop, vehicle or the device in your pocket into an energy-efficient supercomputer without the need to “retrieve” data from the cloud.
“In the future, there’ll be a little tiny model that sits on your phone and 90 percent of the pixels will be generated, 10 percent will be retrieved, instead of 100 percent retrieved — and so you’re going to save” energy, he said.
Meanwhile, OpenAI’s Sam Altman believes that AI will soon enough be able to build humanity a completely new future.
“I think once we have a really powerful super intelligence, addressing climate change will not be particularly difficult,” Altman said recently. “This illustrates how big we should dream... Think about a system where you can say: ‘Tell me how to make a lot of clean energy cheaply, tell me how to efficiently capture carbon and tell me how to build a factory to do this at planetary scale.’”
However, some experts worry that the mad dash for AI has elbowed out fears about the planet, at least for now.
“Large corporations are spending a lot of money right now deploying AI. I don’t think they are thinking about the environmental impact yet,” Iyengar said.
However, “I think that is coming,” he added.
A series of strong earthquakes in Hualien County not only caused severe damage in Taiwan, but also revealed that China’s power has permeated everywhere. A Taiwanese woman posted on the Internet that she found clips of the earthquake — which were recorded by the security camera in her home — on the Chinese social media platform Xiaohongshu. It is spine-chilling that the problem might be because the security camera was manufactured in China. China has widely collected information, infringed upon public privacy and raised information security threats through various social media platforms, as well as telecommunication and security equipment. Several former TikTok employees revealed
For the incoming Administration of President-elect William Lai (賴清德), successfully deterring a Chinese Communist Party (CCP) attack or invasion of democratic Taiwan over his four-year term would be a clear victory. But it could also be a curse, because during those four years the CCP’s People’s Liberation Army (PLA) will grow far stronger. As such, increased vigilance in Washington and Taipei will be needed to ensure that already multiplying CCP threat trends don’t overwhelm Taiwan, the United States, and their democratic allies. One CCP attempt to overwhelm was announced on April 19, 2024, namely that the PLA had erred in combining major missions
At the same time as more than 30 military aircraft were detected near Taiwan — one of the highest daily incursions this year — with some flying as close as 37 nautical miles (69kms) from the northern city of Keelung, China announced a limited and selected relaxation of restrictions on Taiwanese agricultural exports and tourism, upon receiving a Chinese Nationalist Party (KMT) delegation led by KMT legislative caucus whip Fu Kun-chi (傅崑萁). This demonstrates the two-faced gimmick of China’s “united front” strategy. Despite the strongest earthquake to hit the nation in 25 years striking Hualien on April 3, which caused
The Constitutional Court on Tuesday last week held a debate over the constitutionality of the death penalty. The issue of the retention or abolition of the death penalty often involves the conceptual aspects of social values and even religious philosophies. As it is written in The Federalist Papers by Alexander Hamilton, James Madison and John Jay, the government’s policy is often a choice between the lesser of two evils or the greater of two goods, and it is impossible to be perfect. Today’s controversy over the retention or abolition of the death penalty can be viewed in the same way. UNACCEPTABLE Viewing the