Nvidia Corp is building a new business unit focused on designing bespoke chips for cloud computing firms and others, including advanced artificial intelligence (AI) processors, nine sources familiar with its plans told Reuters.
The dominant global designer and supplier of AI chips aims to capture a portion of an exploding market for custom AI chips and shield itself from the growing number of companies pursuing alternatives to its products.
The Santa Clara, California-based company controls about 80 percent of the high-end AI chip market, a position that has sent its stock market value up 40 percent so far this year to US$1.73 trillion after it more than tripled last year.
Photo: Reuters
Nvidia’s customers, which include ChatGPT creator OpenAI, Microsoft Corp, Alphabet Inc and Meta Platforms Inc, have raced to snap up the dwindling supply of its chips to compete in the fast-emerging generative AI sector.
The firm’s H100 and A100 chips serve as a generalized, all-purpose AI processor for many of those major customers, but the tech companies have started to develop their own internal chips for specific needs. Doing so helps reduce energy consumption, and can potentially shrink the cost and time to design.
Nvidia is now attempting to play a role in helping these companies develop custom AI chips that have flowed to rival firms such as Broadcom Inc and Marvell Technology Group Inc, the sources said.
“If you’re really trying to optimize on things like power, or optimize on cost for your application, you can’t afford to go drop an H100 or A100 in there,” Eclipse Ventures LLC general partner Greg Reichow said in an interview. “You want to have the exact right mixture of compute and just the kind of compute that you need.”
Nvidia does not disclose H100 prices, which are higher than for the prior-generation A100, but each chip can sell for US$16,000 to US$100,000 depending on volume and other factors. Meta plans to bring its total stock to 350,000 H100s this year.
Nvidia officials have met with representatives from Amazon.com, Meta, Microsoft, Google and OpenAI to discuss making custom chips for them, two sources familiar with the meetings said. Beyond data center chips, Nvidia has pursued telecom, automotive and video game customers.
Dina McKinney, a former Advanced Micro Devices Inc and Marvell executive, heads Nvidia’s custom unit and her team’s goal is to make its technology available for customers in cloud, 5G wireless, video games and automotives, a LinkedIn profile said. Those mentions were scrubbed and her title changed after Reuters sought comment from Nvidia.
According to estimates from research firm 650 Group’s Alan Weckel, the data center custom chip market will grow to as much as US$10 billion this year, and double that next year.
The broader custom chip market was worth roughly US$30 billion last year, which amounts to roughly 5 percent of annual global chip sales, according to Needham & Co analyst Charles Shi.
Currently, custom silicon design for data centers is dominated by Broadcom and Marvell.
In a typical arrangement, a design partner such as Nvidia would offer intellectual property and technology, but leave the chip fabrication, packaging and additional steps to Taiwan Semiconductor Manufacturing Co (台積電) or another contract chip manufacturer.
Nvidia moving into this territory has the potential to eat into Broadcom and Marvell sales.
“With Broadcom’s custom silicon business touching US$10 billion, and Marvell’s around US$2 billion, this is a real threat,” SemiAnalysis founder Dylan Patel said. “It’s a real big negative — there’s more competition entering the fray.”
Nvidia is in talks with telecom infrastructure builder Ericsson AB for a wireless chip that includes the chip designer's graphics processing unit technology, two sources familiar with the discussions said.
Weckle expects the telecom custom chip market to remain flat at roughly US$4 billion to US$5 billion a year.
Nvidia also plans to target the automotive and video game markets, according to sources and public social media postings.
Weckel expects the custom auto market to grow consistently from its current US$6 billion to US$8 billion range at 20 percent a year, and the US$7 billion to US$8 billion video game custom chip market could increase with the next-generation consoles from Microsoft and Sony Group Corp.
Nintendo Co's current Switch handheld console already includes Nvidia's Tegra X1 chip. A new version of the Switch console expected this year is likely to include a Nvidia custom design, one source said.
ARTIFICIAL INTELLIGENCE: The chipmaker last month raised its capital spending by 28 percent for this year to NT$32 billion from a previous estimate of NT$25 billion Contract chipmaker Powerchip Semiconductor Manufacturing Corp (力積電子) yesterday launched a new 12-inch fab, tapping into advanced chip-on-wafer-on-substrate (CoWoS) packaging technology to support rising demand for artificial intelligence (AI) devices. Powerchip is to offer interposers, one of three parts in CoWoS packaging technology, with shipments scheduled for the second half of this year, Powerchip chairman Frank Huang (黃崇仁) told reporters on the sidelines of a fab inauguration ceremony in the Tongluo Science Park (銅鑼科學園區) in Miaoli County yesterday. “We are working with customers to supply CoWoS-related business, utilizing part of this new fab’s capacity,” Huang said, adding that Powerchip intended to bridge
BUSINESS UPDATE: The iPhone assembler said operations outlook is expected to show quarter-on-quarter and year-on-year growth for the second quarter Hon Hai Precision Industry Co (鴻海精密) yesterday reported strong growth in sales last month, potentially raising expectations for iPhone sales while artificial intelligence (AI)-related business booms. The company, which assembles the majority of Apple Inc’s smartphones, reported a 19.03 percent rise in monthly sales to NT$510.9 billion (US$15.78 billion), from NT$429.22 billion in the same period last year. On a monthly basis, sales rose 14.16 percent, it said. The company in a statement said that last month’s revenue was a record-breaking April performance. Hon Hai, known also as Foxconn Technology Group (富士康科技集團), assembles most iPhones, but the company is diversifying its business to
Microsoft Corp yesterday said that it would create Thailand’s first data center region to boost cloud and artificial intelligence (AI) infrastructure, promising AI training to more than 100,000 people to develop tech. Bangkok is a key economic player in Southeast Asia, but it has lagged behind Indonesia and Singapore when it comes to the tech industry. Thailand has an “incredible opportunity to build a digital-first, AI-powered future,” Microsoft chairman and chief executive officer Satya Nadella said at an event in Bangkok. Data center regions are physical locations that store computing infrastructure, allowing secure and reliable access to cloud platforms. The global embrace of AI
RIDING AI WAVE: : Most of its NT$15bn capital budget would be spent on packaging technologies used in AI and HPC chips and advanced testing technology, it said Chip testing and packaging service provider Powertech Technology Inc (PTI, 力成科技) plans to increase this year’s capital expenditure by 50 percent to expand capacity to meet growing demand for advanced memorychips used in artificial intelligence (AI) products. The company proposed to spend NT$15 billion (US$460.94 million) to expand advanced capacity and equipment, compared with a budget of NT$10 billion it planned three months ago. “We are seeing a recovery in market demand as well as new business opportunities. We will spend heavily on advanced packaging” equipment, Powertech chief executive officer Boris Hsieh (謝永達) told investors on Tuesday. “We will focus on ramping