The global server market is expected to grow 12.8 percent annually this year, with artificial intelligence (AI) servers projected to account for 16.5 percent, driven by continued investment in AI infrastructure by major cloud service providers (CSPs), market researcher TrendForce Corp (集邦科技) said yesterday.
Global AI server shipments this year are expected to increase 28 percent year-on-year to more than 2.7 million units, driven by sustained demand from CSPs and government sovereign cloud projects, TrendForce analyst Frank Kung (龔明德) told the Taipei Times.
Demand for GPU-based AI servers, including Nvidia Corp’s GB and Vera Rubin rack systems, is expected to remain high, while CSPs would invest in in-house application-specific integrated circuit (ASIC) development, which is also expected to drive demand for AI training and inference, Kung said.
Photo: Bloomberg
Capital expenditures by the five largest CSPs — Google, Amazon Web Services, Meta Platforms Inc, Microsoft Corp and Oracle Corp — are expected to rise 40 percent year-on-year this year, TrendForce said in a separate report released on Tuesday last week.
Google and Microsoft are expected to lead the expansion of general-purpose server procurement to handle the surge in daily inference workloads generated by services such as Microsoft’s Copilot and Google’s Gemini, it said.
In addition to large-scale infrastructure expansion, part of the spending is expected to be earmarked for replacement of general-purpose servers purchased during the 2019 to 2021 cloud investment boom, the researcher said.
However, the share of ASIC-based AI servers is expected to rise to 27.8 percent as Google and Meta ramp up in-house chip development, with shipments of ASIC-based systems forecast to grow faster than those of GPU-based servers, TrendForce said.
Google, in particular, is investing more heavily in its own ASICs than most other CSPs and is emerging as a key market player, it said.
Its tensor processing units, which support Google Cloud Platform services, are also increasingly being sold to external customers such as AI start-up Anthropic PBC, it said.
The growth in the global server market this year would be driven by continued momentum in AI servers, with the rapid expansion of AI inference applications in particular fueling rising demand for storage and edge AI servers, Kung said.
Meanwhile, as demand for AI inference continues to grow rapidly across end devices and industrial applications, it is expected to reshape the computing power structure, which is still heavily skewed toward training workloads, he said.
Inference-based AI servers are expected to account for 44 percent of total AI server shipments this year, with the share projected to rise above 50 percent by 2029, he said.
As CSPs and enterprises expand AI applications across endpoints, the market is expected to develop along two main tracks, Kung said.
The first involves broader deployment of GPU-based systems, such as Nvidia’s platforms, as well as in-house ASIC rack solutions to support large language model training and generative AI inference, he said.
The other track is the growing adoption of more distributed, edge-oriented AI server architectures — such as MGX platforms — designed to support real-time inference workloads closer to data sources, he added.
HORMUZ ISSUE: The US president said he expected crude prices to drop at the end of the war, which he called a ‘minor excursion’ that could continue ‘for a little while’ The United Arab Emirates (UAE) and Kuwait started reducing oil production, as the near-closure of the crucial Strait of Hormuz ripples through energy markets and affects global supply. Abu Dhabi National Oil Co (ADNOC) is “managing offshore production levels to address storage requirements,” the company said in a statement, without giving details. Kuwait Petroleum Corp said it was lowering production at its oil fields and refineries after “Iranian threats against safe passage of ships through the Strait of Hormuz.” The war in the Middle East has all but closed Hormuz, the narrow waterway linking the Persian Gulf to the open seas,
Apple Inc increased iPhone production in India by about 53 percent last year and now makes a quarter of its marquee devices there, reflecting the US company’s efforts to avoid tariffs on China. The company assembled about 55 million iPhones in India last year, up from 36 million a year earlier, people familiar with the matter said, asking not to be named because the numbers aren’t public. Apple makes about 220 million to 230 million iPhones a year globally, with India’s share of the total increasing rapidly. Apple has accelerated its expansion in the world’s most populous country in recent years, bolstered
HEADWINDS: The company said it expects its computer business, as well as consumer electronics and communications segments to see revenue declines due to seasonality Pegatron Corp (和碩) yesterday said it aims to grow its artificial intelligence (AI) server revenue more than 10-fold this year from last year, driven by orders from neocloud solutions clients and large cloud service providers. The electronics manufacturing service provider said AI server revenue growth would be driven primarily by the Nvidia Corp GB300 server platform. Server shipments are expected to increase each quarter this year, with the second half likely to outperform the first half, it said. The AI server market is expected to broaden this year as more inference applications emerge, which would drive demand for system-on-chip, application-specific integrated circuits
PROJECTION: TSMC said it expects strong growth this year, with revenue in US dollars projected to grow by about 30 percent, outperforming the industry Taiwan Semiconductor Manufacturing Co (TSMC, 台積電) yesterday reported consolidated sales last month reached NT$317.66 billion (US$9.98 billion), the highest ever for the month of February, driven by robust demand for chips built using the company’s advanced 3-nanometer (3nm) process. Last month’s figure was up 22.2 percent from a year earlier, but fell 20.8 percent from January, the world’s largest contract chipmaker said in a statement. For the first two months of the year, TSMC posted cumulative sales of NT$718.91 billion, up 29.9 percent from a year earlier. Analysts attributed the growth to sustained global demand for artificial intelligence (AI) products
RSS