The global server market is expected to grow 12.8 percent annually this year, with artificial intelligence (AI) servers projected to account for 16.5 percent, driven by continued investment in AI infrastructure by major cloud service providers (CSPs), market researcher TrendForce Corp (集邦科技) said yesterday.
Global AI server shipments this year are expected to increase 28 percent year-on-year to more than 2.7 million units, driven by sustained demand from CSPs and government sovereign cloud projects, TrendForce analyst Frank Kung (龔明德) told the Taipei Times.
Demand for GPU-based AI servers, including Nvidia Corp’s GB and Vera Rubin rack systems, is expected to remain high, while CSPs would invest in in-house application-specific integrated circuit (ASIC) development, which is also expected to drive demand for AI training and inference, Kung said.
Photo: Bloomberg
Capital expenditures by the five largest CSPs — Google, Amazon Web Services, Meta Platforms Inc, Microsoft Corp and Oracle Corp — are expected to rise 40 percent year-on-year this year, TrendForce said in a separate report released on Tuesday last week.
Google and Microsoft are expected to lead the expansion of general-purpose server procurement to handle the surge in daily inference workloads generated by services such as Microsoft’s Copilot and Google’s Gemini, it said.
In addition to large-scale infrastructure expansion, part of the spending is expected to be earmarked for replacement of general-purpose servers purchased during the 2019 to 2021 cloud investment boom, the researcher said.
However, the share of ASIC-based AI servers is expected to rise to 27.8 percent as Google and Meta ramp up in-house chip development, with shipments of ASIC-based systems forecast to grow faster than those of GPU-based servers, TrendForce said.
Google, in particular, is investing more heavily in its own ASICs than most other CSPs and is emerging as a key market player, it said.
Its tensor processing units, which support Google Cloud Platform services, are also increasingly being sold to external customers such as AI start-up Anthropic PBC, it said.
The growth in the global server market this year would be driven by continued momentum in AI servers, with the rapid expansion of AI inference applications in particular fueling rising demand for storage and edge AI servers, Kung said.
Meanwhile, as demand for AI inference continues to grow rapidly across end devices and industrial applications, it is expected to reshape the computing power structure, which is still heavily skewed toward training workloads, he said.
Inference-based AI servers are expected to account for 44 percent of total AI server shipments this year, with the share projected to rise above 50 percent by 2029, he said.
As CSPs and enterprises expand AI applications across endpoints, the market is expected to develop along two main tracks, Kung said.
The first involves broader deployment of GPU-based systems, such as Nvidia’s platforms, as well as in-house ASIC rack solutions to support large language model training and generative AI inference, he said.
The other track is the growing adoption of more distributed, edge-oriented AI server architectures — such as MGX platforms — designed to support real-time inference workloads closer to data sources, he added.
Sweeping policy changes under US Secretary of Health and Human Services Robert F. Kennedy Jr are having a chilling effect on vaccine makers as anti-vaccine rhetoric has turned into concrete changes in inoculation schedules and recommendations, investors and executives said. The administration of US President Donald Trump has in the past year upended vaccine recommendations, with the country last month ending its longstanding guidance that all children receive inoculations against flu, hepatitis A and other diseases. The unprecedented changes have led to diminished vaccine usage, hurt the investment case for some biotechs, and created a drag that would likely dent revenues and
Macronix International Co (旺宏), the world’s biggest NOR flash memory supplier, yesterday said it would spend NT$22 billion (US$699.1 million) on capacity expansion this year to increase its production of mid-to-low-density memory chips as the world’s major memorychip suppliers are phasing out the market. The company said its planned capital expenditures are about 11 times higher than the NT$1.8 billion it spent on new facilities and equipment last year. A majority of this year’s outlay would be allocated to step up capacity of multi-level cell (MLC) NAND flash memory chips, which are used in embedded multimedia cards (eMMC), a managed
CULPRITS: Factors that affected the slip included falling global crude oil prices, wait-and-see consumer attitudes due to US tariffs and a different Lunar New Year holiday schedule Taiwan’s retail sales ended a nine-year growth streak last year, slipping 0.2 percent from a year earlier as uncertainty over US tariff policies affected demand for durable goods, data released on Friday by the Ministry of Economic Affairs showed. Last year’s retail sales totaled NT$4.84 trillion (US$153.27 billion), down about NT$9.5 billion, or 0.2 percent, from 2024. Despite the decline, the figure was still the second-highest annual sales total on record. Ministry statistics department deputy head Chen Yu-fang (陳玉芳) said sales of cars, motorcycles and related products, which accounted for 17.4 percent of total retail rales last year, fell NT$68.1 billion, or
In the wake of strong global demand for AI applications, Taiwan’s export-oriented economy accelerated with the composite index of economic indicators flashing the first “red” light in December for one year, indicating the economy is in booming mode, the National Development Council (NDC) said yesterday. Moreover, the index of leading indicators, which gauges the potential state of the economy over the next six months, also moved higher in December amid growing optimism over the outlook, the NDC said. In December, the index of economic indicators rose one point from a month earlier to 38, at the lower end of the “red” light.
RSS