OpenAI, the company behind ChatGPT, is exploring making its own artificial intelligence (AI)chips and has gone as far as evaluating a potential acquisition target, according to people familiar with the company’s plans.
The company has not yet decided to move ahead, according to recent internal discussions described to Reuters.
However, since at least lay year, it has discussed options to solve the shortage of expensive AI chips that OpenAI relies on, people said.
Photo: Reuters
These options have included building its own AI chip, working more closely with other chipmakers, including Nvidia, and also diversifying its suppliers beyond Nvidia.
OpenAI declined to comment. Its CEO, Sam Altman, has made the acquisition of more AI chips a top priority for the company. He has publicly complained about the scarcity of graphics processing units (GPU), a market dominated by Nvidia, which controls more than 80 percent of the global market for the chips best suited to run AI applications. The effort to obtain more chips is tied to two major concerns Altman has identified: a shortage of the advanced processors that power OpenAI’s software and the “eye-watering” costs associated with running the hardware necessary to power its efforts and products.
Since 2020, OpenAI has developed its generative AI technologies on a massive supercomputer constructed by Microsoft, one of OpenAI’s largest backers, that uses 10,000 Nvidia GPUs.
Running ChatGPT is very expensive for the company. Each query costs roughly US$0.04, according to an analysis from Bernstein analyst Stacy Rasgon.
If ChatGPT queries grow to one-10th the scale of Google’s search engine, it would require roughly US$48.1 billion in GPUs initially and about US$16 billion in chips per year to stay operational.
CUSTOM CHIPS ERA
An effort to develop its own AI chips would put OpenAI among a small group of large tech players such as Alphabet’s Google and Amazon.com that have sought to take control over designing the chips that are fundamental to their businesses.
It is unclear whether OpenAI would move ahead with a plan to build a custom chip. Doing so would be a major strategic initiative and a heavy investment that could amount to hundreds of millions of dollars a year in costs, according to industry veterans. Even if OpenAI committed resources to the task, it would not guarantee success. An acquisition of a chip company could speed up the process of building OpenAI’s own chip — as it did for Amazon.com and its acquisition of Annapurna Labs in 2015.
OpenAI had considered the path to the point where it performed its due diligence on a potential acquisition target, according to one of the people familiar with its plans.
The identity of the company OpenAI looked at purchasing could not be learned.
Even if OpenAI goes ahead with plans for a custom chip — including an acquisition — the effort is likely to take several years, leaving the company dependent on commercial providers like Nvidia and Advanced Micro Devices in the meantime. Some big tech companies have been building their own processors for years with limited results. Meta’s custom chip effort has been besotted with issues, leading the company to scrap some of its AI chips, according to a Reuters report. The Facebook owner is now working on a newer chip that would span all types of AI work.
OpenAI’s main backer, Microsoft, is also developing a custom AI chip that OpenAI is testing, The Information has reported. The plans could signal further distancing between the two companies.
BUSINESS UPDATE: The iPhone assembler said operations outlook is expected to show quarter-on-quarter and year-on-year growth for the second quarter Hon Hai Precision Industry Co (鴻海精密) yesterday reported strong growth in sales last month, potentially raising expectations for iPhone sales while artificial intelligence (AI)-related business booms. The company, which assembles the majority of Apple Inc’s smartphones, reported a 19.03 percent rise in monthly sales to NT$510.9 billion (US$15.78 billion), from NT$429.22 billion in the same period last year. On a monthly basis, sales rose 14.16 percent, it said. The company in a statement said that last month’s revenue was a record-breaking April performance. Hon Hai, known also as Foxconn Technology Group (富士康科技集團), assembles most iPhones, but the company is diversifying its business to
ARTIFICIAL INTELLIGENCE: The chipmaker last month raised its capital spending by 28 percent for this year to NT$32 billion from a previous estimate of NT$25 billion Contract chipmaker Powerchip Semiconductor Manufacturing Corp (力積電子) yesterday launched a new 12-inch fab, tapping into advanced chip-on-wafer-on-substrate (CoWoS) packaging technology to support rising demand for artificial intelligence (AI) devices. Powerchip is to offer interposers, one of three parts in CoWoS packaging technology, with shipments scheduled for the second half of this year, Powerchip chairman Frank Huang (黃崇仁) told reporters on the sidelines of a fab inauguration ceremony in the Tongluo Science Park (銅鑼科學園區) in Miaoli County yesterday. “We are working with customers to supply CoWoS-related business, utilizing part of this new fab’s capacity,” Huang said, adding that Powerchip intended to bridge
Microsoft Corp yesterday said that it would create Thailand’s first data center region to boost cloud and artificial intelligence (AI) infrastructure, promising AI training to more than 100,000 people to develop tech. Bangkok is a key economic player in Southeast Asia, but it has lagged behind Indonesia and Singapore when it comes to the tech industry. Thailand has an “incredible opportunity to build a digital-first, AI-powered future,” Microsoft chairman and chief executive officer Satya Nadella said at an event in Bangkok. Data center regions are physical locations that store computing infrastructure, allowing secure and reliable access to cloud platforms. The global embrace of AI
Qualcomm Inc, the world’s biggest seller of smartphone processors, gave an upbeat forecast for sales and profit in the current period, suggesting demand for handsets is increasing after a two-year slump. Revenue in the three months ended in June will be US$8.8 billion to US$9.6 billion, the company said in a statement Wednesday. Excluding certain items, earnings will be US$2.15 to US$2.35 a share. Analysts had projected sales of US$9.08 billion and earnings of US$2.16 a share. The outlook signals that the smartphone market has begun to bounce back, tracking with Qualcomm’s forecast that demand would gradually recover this year. The San