Nvidia Corp’s GB300 platform is expected to account for 70 to 80 percent of global artificial intelligence (AI) server rack shipments this year, while adoption of its next-generation Vera Rubin 200 platform is to gradually gain momentum after the third quarter of the year, TrendForce Corp (集邦科技) said.
Servers based on Nvidia’s GB300 chips entered mass production last quarter and they are expected to become the mainstay models for Taiwanese server manufacturers this year, Trendforce analyst Frank Kung (龔明德) said in an interview.
This year is expected to be a breakout year for AI servers based on a variety of chips, as shipments of graphics processing unit (GPU)-based rack systems — including Nvidia’s GB300 and Vera Rubin 200 platforms, as well as Advanced Micro Devices Inc’s MI400 — are set to accelerate, while cloud service providers (CSPs), such as Google Inc, Amazon Web Services and Meta Platforms Inc, are expected to step up use of application-specific integrated circuit (ASIC)-based AI infrastructure, he said.
Photo: AP
As development of GPU and ASIC-based servers accelerates this year, the threshold for system integration among local server manufacturers is rising, Kung said.
Hon Hai Precision Industry Co (鴻海精密), Quanta Computer Inc (廣達) and Wistron Corp (緯創) are some of the Taiwanese server system integration suppliers for overseas tech giants.
The challenge is becoming more pronounced as major CSPs continue to develop ASICs with increasingly advanced and customized specifications, a trend that further raises technical barriers to entry for manufacturers, he said.
GB300 is one of Nvidia’s Blackwell GPU series, with modest upgrades compared with the GB200 across connectors, substrates and thermal components, while the Vera Rubin 200 platform features a significant increase in GPU power consumption, analysts said.
High power consumption in AI servers based on Nvidia chips, coupled with the CSPs’ continued upscaling of AI data centers, results in a growing need for liquid cooling solutions this year, TrendForce analyst Fiona Chiu (邱珮雯) said.
As the market’s heat dissipation solutions remain concentrated on liquid-to-air designs — which serve as a transitional phase between traditional air cooling and full liquid cooling — liquid-to-air systems are still expected to dominate AI infrastructure deployments this year, she said.
Fully liquid-to-liquid cooling solutions are expected to become more prominent next year as data center power density continues to rise, she added.
The developments would benefit Taiwanese liquid-cooling solution providers, with heat dissipation specialists such as Auras Technology Co (雙鴻科技) and Asia Vital Components Co (奇鋐科技) poised to strengthen their positions in the market, Chiu said.
Power supply solution providers such as Delta Electronics Inc (台達電) and Lite-On Technology Corp (光寶科技) are also expected to gain market share with their power supply and infrastructure-related products, she added.
South Korea’s equity benchmark yesterday crossed a new milestone just a month after surpassing the once-unthinkable 5,000 mark as surging global memory demand powers the country’s biggest chipmakers. The KOSPI advanced as much as 2.6 percent to a record 6,123, with Samsung Electronics Co and SK Hynix Inc each gaining more than 2 percent. With the benchmark now up 45 percent this year, South Korea’s stock market capitalization has also moved past France’s, following last month’s overtaking of Germany’s. Long overlooked by foreign funds, despite being undervalued, South Korean stocks have now emerged as clear winners in the global market. The so-called “artificial intelligence
NEW IDENTITY: Known for its software, India has expanded into hardware, with its semiconductor industry growing from US$38bn in 2023 to US$45bn to US$50bn India on Saturday inaugurated its first semiconductor assembly and test facility, a milestone in the government’s push to reduce dependence on foreign chipmakers and stake a claim in a sector dominated by China. Indian Prime Minister Narendra Modi opened US firm Micron Technology Inc’s semiconductor assembly, test and packaging unit in his home state of Gujarat, hailing the “dawn of a new era” for India’s technology ambitions. “When young Indians look back in the future, they will see this decade as the turning point in our tech future,” Modi told the event, which was broadcast on his YouTube channel. The plant would convert
‘SEISMIC SHIFT’: The researcher forecast there would be about 1.1 billion mobile shipments this year, down from 1.26 billion the prior year and erasing years of gains The global smartphone market is expected to contract 12.9 percent this year due to the unprecedented memorychip shortage, marking “a crisis like no other,” researcher International Data Corp (IDC) said. The new forecast, a dramatic revision down from earlier estimates, gives the latest accounting of the ongoing memory crunch that is affecting every corner of the electronics industry. The demand for advanced memory to power artificial intelligence (AI) tasks has drained global supply until well into next year and jeopardizes the business model of many smartphone makers. IDC forecast about 1.1 billion mobile shipments this year, down from 1.26 billion the prior
People stand in a Pokemon store in Tokyo on Thursday. One of the world highest-grossing franchises is celebrated its 30th anniversary yesterday.
RSS