Nvidia Corp’s GB300 platform is expected to account for 70 to 80 percent of global artificial intelligence (AI) server rack shipments this year, while adoption of its next-generation Vera Rubin 200 platform is to gradually gain momentum after the third quarter of the year, TrendForce Corp (集邦科技) said.
Servers based on Nvidia’s GB300 chips entered mass production last quarter and they are expected to become the mainstay models for Taiwanese server manufacturers this year, Trendforce analyst Frank Kung (龔明德) said in an interview.
This year is expected to be a breakout year for AI servers based on a variety of chips, as shipments of graphics processing unit (GPU)-based rack systems — including Nvidia’s GB300 and Vera Rubin 200 platforms, as well as Advanced Micro Devices Inc’s MI400 — are set to accelerate, while cloud service providers (CSPs), such as Google Inc, Amazon Web Services and Meta Platforms Inc, are expected to step up use of application-specific integrated circuit (ASIC)-based AI infrastructure, he said.
Photo: AP
As development of GPU and ASIC-based servers accelerates this year, the threshold for system integration among local server manufacturers is rising, Kung said.
Hon Hai Precision Industry Co (鴻海精密), Quanta Computer Inc (廣達) and Wistron Corp (緯創) are some of the Taiwanese server system integration suppliers for overseas tech giants.
The challenge is becoming more pronounced as major CSPs continue to develop ASICs with increasingly advanced and customized specifications, a trend that further raises technical barriers to entry for manufacturers, he said.
GB300 is one of Nvidia’s Blackwell GPU series, with modest upgrades compared with the GB200 across connectors, substrates and thermal components, while the Vera Rubin 200 platform features a significant increase in GPU power consumption, analysts said.
High power consumption in AI servers based on Nvidia chips, coupled with the CSPs’ continued upscaling of AI data centers, results in a growing need for liquid cooling solutions this year, TrendForce analyst Fiona Chiu (邱珮雯) said.
As the market’s heat dissipation solutions remain concentrated on liquid-to-air designs — which serve as a transitional phase between traditional air cooling and full liquid cooling — liquid-to-air systems are still expected to dominate AI infrastructure deployments this year, she said.
Fully liquid-to-liquid cooling solutions are expected to become more prominent next year as data center power density continues to rise, she added.
The developments would benefit Taiwanese liquid-cooling solution providers, with heat dissipation specialists such as Auras Technology Co (雙鴻科技) and Asia Vital Components Co (奇鋐科技) poised to strengthen their positions in the market, Chiu said.
Power supply solution providers such as Delta Electronics Inc (台達電) and Lite-On Technology Corp (光寶科技) are also expected to gain market share with their power supply and infrastructure-related products, she added.
CHIP HANG-UP: Surging memorychip prices would deal a blow to smartphone sales this year, potentially hindering one of MediaTek’s biggest sources of revenue MediaTek Inc (聯發科), the world’s biggest smartphone chip designer, yesterday said its new artificial intelligence (AI) chips used in data centers are to account for 20 percent of its total revenue next year, as cloud service providers race to deploy AI infrastructure to meet voracious demand. MediaTek is believed to be developing tensor processing units for Google, which are used in AI applications. While it did not confirm such reports, MediaTek said its new application-specific IC (ASIC) business would be a new growth engine for the company. It again hiked its forecast for the addressable ASIC market to US$70 billion by 2028, compared
MediaTek Inc (聯發科), the world’s biggest smartphone chip supplier, yesterday said it plans to double investment in data center-related technologies, including advanced packaging and high-speed interconnect technologies, to broaden the new business’ customer and service portfolios. The chip designer is redirecting its resources to data centers, mainly designing application-specific integrated circuits (ASIC) with artificial intelligence (AI) capabilities for cloud service providers. The data center business is forecast to lead growth in the next three years and become the company’s second-biggest revenue source, replacing chips used in smart devices, MediaTek president Joe Chen (陳冠州) told a media event in Taipei. “Three or four years
Until US President Donald Trump’s return a year ago, when the EU talked about cutting economic dependency on foreign powers — it was understood to mean China, but now Brussels has US tech in its sights. As Trump ramps up his threats — from strong-arming Europe on trade to pushing to seize Greenland — concern has grown that the unpredictable leader could, should he so wish, plunge the bloc into digital darkness. Since Trump’s Greenland climbdown, top officials have stepped up warnings that the EU is dangerously exposed to geopolitical shocks and must work toward strategic independence — in defense, energy and
Motorists ride past a mural along a street in Varanasi, India, yesterday.
RSS