OpenAI, the company behind ChatGPT, is exploring making its own artificial intelligence (AI)chips and has gone as far as evaluating a potential acquisition target, according to people familiar with the company’s plans.
The company has not yet decided to move ahead, according to recent internal discussions described to Reuters.
However, since at least lay year, it has discussed options to solve the shortage of expensive AI chips that OpenAI relies on, people said.
Photo: Reuters
These options have included building its own AI chip, working more closely with other chipmakers, including Nvidia, and also diversifying its suppliers beyond Nvidia.
OpenAI declined to comment. Its CEO, Sam Altman, has made the acquisition of more AI chips a top priority for the company. He has publicly complained about the scarcity of graphics processing units (GPU), a market dominated by Nvidia, which controls more than 80 percent of the global market for the chips best suited to run AI applications. The effort to obtain more chips is tied to two major concerns Altman has identified: a shortage of the advanced processors that power OpenAI’s software and the “eye-watering” costs associated with running the hardware necessary to power its efforts and products.
Since 2020, OpenAI has developed its generative AI technologies on a massive supercomputer constructed by Microsoft, one of OpenAI’s largest backers, that uses 10,000 Nvidia GPUs.
Running ChatGPT is very expensive for the company. Each query costs roughly US$0.04, according to an analysis from Bernstein analyst Stacy Rasgon.
If ChatGPT queries grow to one-10th the scale of Google’s search engine, it would require roughly US$48.1 billion in GPUs initially and about US$16 billion in chips per year to stay operational.
CUSTOM CHIPS ERA
An effort to develop its own AI chips would put OpenAI among a small group of large tech players such as Alphabet’s Google and Amazon.com that have sought to take control over designing the chips that are fundamental to their businesses.
It is unclear whether OpenAI would move ahead with a plan to build a custom chip. Doing so would be a major strategic initiative and a heavy investment that could amount to hundreds of millions of dollars a year in costs, according to industry veterans. Even if OpenAI committed resources to the task, it would not guarantee success. An acquisition of a chip company could speed up the process of building OpenAI’s own chip — as it did for Amazon.com and its acquisition of Annapurna Labs in 2015.
OpenAI had considered the path to the point where it performed its due diligence on a potential acquisition target, according to one of the people familiar with its plans.
The identity of the company OpenAI looked at purchasing could not be learned.
Even if OpenAI goes ahead with plans for a custom chip — including an acquisition — the effort is likely to take several years, leaving the company dependent on commercial providers like Nvidia and Advanced Micro Devices in the meantime. Some big tech companies have been building their own processors for years with limited results. Meta’s custom chip effort has been besotted with issues, leading the company to scrap some of its AI chips, according to a Reuters report. The Facebook owner is now working on a newer chip that would span all types of AI work.
OpenAI’s main backer, Microsoft, is also developing a custom AI chip that OpenAI is testing, The Information has reported. The plans could signal further distancing between the two companies.
The US dollar was trading at NT$29.7 at 10am today on the Taipei Foreign Exchange, as the New Taiwan dollar gained NT$1.364 from the previous close last week. The NT dollar continued to rise today, after surging 3.07 percent on Friday. After opening at NT$30.91, the NT dollar gained more than NT$1 in just 15 minutes, briefly passing the NT$30 mark. Before the US Department of the Treasury's semi-annual currency report came out, expectations that the NT dollar would keep rising were already building. The NT dollar on Friday closed at NT$31.064, up by NT$0.953 — a 3.07 percent single-day gain. Today,
‘SHORT TERM’: The local currency would likely remain strong in the near term, driven by anticipated US trade pressure, capital inflows and expectations of a US Fed rate cut The US dollar is expected to fall below NT$30 in the near term, as traders anticipate increased pressure from Washington for Taiwan to allow the New Taiwan dollar to appreciate, Cathay United Bank (國泰世華銀行) chief economist Lin Chi-chao (林啟超) said. Following a sharp drop in the greenback against the NT dollar on Friday, Lin told the Central News Agency that the local currency is likely to remain strong in the short term, driven in part by market psychology surrounding anticipated US policy pressure. On Friday, the US dollar fell NT$0.953, or 3.07 percent, closing at NT$31.064 — its lowest level since Jan.
The New Taiwan dollar and Taiwanese stocks surged on signs that trade tensions between the world’s top two economies might start easing and as US tech earnings boosted the outlook of the nation’s semiconductor exports. The NT dollar strengthened as much as 3.8 percent versus the US dollar to 30.815, the biggest intraday gain since January 2011, closing at NT$31.064. The benchmark TAIEX jumped 2.73 percent to outperform the region’s equity gauges. Outlook for global trade improved after China said it is assessing possible trade talks with the US, providing a boost for the nation’s currency and shares. As the NT dollar
The Financial Supervisory Commission (FSC) yesterday met with some of the nation’s largest insurance companies as a skyrocketing New Taiwan dollar piles pressure on their hundreds of billions of dollars in US bond investments. The commission has asked some life insurance firms, among the biggest Asian holders of US debt, to discuss how the rapidly strengthening NT dollar has impacted their operations, people familiar with the matter said. The meeting took place as the NT dollar jumped as much as 5 percent yesterday, its biggest intraday gain in more than three decades. The local currency surged as exporters rushed to
RSS