Amazon Web Services (AWS) on Tuesday launched its in-house-built Trainium3 artificial intelligence (AI) chip, marking a significant push to compete with Nvidia Corp in the lucrative market for AI computing power.
The move intensifies competition in the AI chip market, where Nvidia dominates with an estimated 80 to 90 percent market share for products used in training large language models that power the likes of ChatGPT.
Google last week caused tremors in the industry when it was reported that Facebook-parent Meta Platforms Inc would employ Google AI chips in data centers, signaling new competition for Nvidia.
Photo: Amazon Web Services/Handout via Reuters
This followed the release last month of Google’s latest AI model, which was trained using the company’s in-house chips, not Nvidia’s.
Responding to Google’s successes, Nvidia wrote on social media that it was “delighted” by the competition, but added that Nvidia “is a generation ahead of the industry.”
AWS, which would make the technology available to its cloud computing clients, said its new chip is lower cost than rivals and delivers over four times the computing performance of its predecessor while using 40 percent less energy.
“Trainium3 offers the industry’s best price performance for large-scale AI training and inference,” AWS CEO Matt Garman said at a launch event in Las Vegas. Inference is the execution phase of AI, where the model stops scouring the Internet for training and starts performing tasks in real-world scenarios.
Energy consumption is one of the major concerns about the AI revolution, with major tech companies scaling back or pausing their net zero emissions commitments as they race to keep up on the technology.
AWS said its chip could reduce the cost of training and operating AI models by up to 50 percent compared with systems that use equivalent graphics processing units, mainly from Nvidia.
“Training cutting-edge models now requires infrastructure investments that only a handful of organizations can afford,” AWS said, positioning Trainium3 as a way to democratize access to high-powered AI computing.
AWS said several companies are already using the technology, including Anthropic PBC, maker of the Claude AI assistant and a competitor to ChatGPT-maker OpenAI.
AWS also announced that it is already developing Trainium4, which is expected to deliver at least three times the performance of Trainium3 for standard AI workloads.
The next-generation chip would support Nvidia’s technology, allowing it to work alongside that company’s servers and hardware.
Amazon’s in-house chip development reflects a broader trend among cloud service providers seeking to reduce dependence on external suppliers while offering customers more cost-effective alternatives for AI workloads.
Elon Musk’s lieutenants have reached out to chip industry suppliers, including Applied Materials Inc, Tokyo Electron Ltd and Lam Research Corp, for his envisioned Terafab, early steps in an audacious and likely arduous attempt to break into the production of cutting-edge chips. Staff working for the joint venture between Tesla Inc and Space Exploration Technologies Corp (SpaceX) have sought price quotes and delivery times for an array of chipmaking gear, people familiar with the matter said. In past weeks, they’ve contacted makers of photomasks, substrates, etchers, depositors, cleaning devices, testers and other tools, according to the people, who asked not to
Taiwan is attracting a growing number of foreign jobseekers as companies increasingly recruit overseas talent to ease labor shortages and expand global reach, recruitment platform 104 Job Bank (104人力銀行) said yesterday. More than 40,000 foreign nationals searched for jobs in Taiwan through the platform last year, a 28 percent increase from a year earlier, the company said. Malaysians accounted for the largest share of overseas jobseekers at 12.2 percent, followed by Indonesians at 11.9 percent and Vietnamese at 10.8 percent. Indonesian applicants surged more than 50 percent year-on-year, while Vietnamese jobseekers rose by more than 30 percent. Applicants from the
JET JUICE: The war on Iran’s secondary effects have seen fuel prices skyrocket, knocking flight schedules down to earth in return as airlines struggle with costs Airline passengers should brace for more irritation in the next few months as carriers worldwide cancel flights and ground planes to cope with stratospheric increases in jet-fuel prices. Dutch flag carrier KLM is the latest company to cut its schedule, saying on Thursday that it would scrap 80 return flights at Amsterdam’s Schiphol Airport in the coming month. That puts it in the same league as United Airlines Holdings Inc, Deutsche Lufthansa AG and Cathay Pacific Airways Ltd, which have all pruned itineraries to mitigate costs. Global capacity for next month has been reduced by about 3 percentage points, with all
NO SHORTCUTS: Asked about Elon Musk’s Terafab initiative, TSMC CEO C.C. Wei said it takes two to three years to build a fab and another one to two to ramp it up Taiwan Semiconductor Manufacturing Co (TSMC, 台積電) yesterday raised its revenue growth forecast for this year to above 30 percent, up from the 25 percent it estimated three months earlier, citing extremely robust artificial intelligence (AI)-related chip demand. “Our customers and customers’ customers, who are mainly cloud service providers, continue to send us very positive signals and outlook,” TSMC chairman and CEO C.C. Wei (魏哲家) said at an earnings conference. The company also hiked its capital expenditure for this year toward the higher end of its forecast, or US$56 billion, as it aims to step up advanced chip capacity expansions, such as
RSS