Amazon Web Services (AWS) on Tuesday launched its in-house-built Trainium3 artificial intelligence (AI) chip, marking a significant push to compete with Nvidia Corp in the lucrative market for AI computing power.
The move intensifies competition in the AI chip market, where Nvidia dominates with an estimated 80 to 90 percent market share for products used in training large language models that power the likes of ChatGPT.
Google last week caused tremors in the industry when it was reported that Facebook-parent Meta Platforms Inc would employ Google AI chips in data centers, signaling new competition for Nvidia.
Photo: Amazon Web Services/Handout via Reuters
This followed the release last month of Google’s latest AI model, which was trained using the company’s in-house chips, not Nvidia’s.
Responding to Google’s successes, Nvidia wrote on social media that it was “delighted” by the competition, but added that Nvidia “is a generation ahead of the industry.”
AWS, which would make the technology available to its cloud computing clients, said its new chip is lower cost than rivals and delivers over four times the computing performance of its predecessor while using 40 percent less energy.
“Trainium3 offers the industry’s best price performance for large-scale AI training and inference,” AWS CEO Matt Garman said at a launch event in Las Vegas. Inference is the execution phase of AI, where the model stops scouring the Internet for training and starts performing tasks in real-world scenarios.
Energy consumption is one of the major concerns about the AI revolution, with major tech companies scaling back or pausing their net zero emissions commitments as they race to keep up on the technology.
AWS said its chip could reduce the cost of training and operating AI models by up to 50 percent compared with systems that use equivalent graphics processing units, mainly from Nvidia.
“Training cutting-edge models now requires infrastructure investments that only a handful of organizations can afford,” AWS said, positioning Trainium3 as a way to democratize access to high-powered AI computing.
AWS said several companies are already using the technology, including Anthropic PBC, maker of the Claude AI assistant and a competitor to ChatGPT-maker OpenAI.
AWS also announced that it is already developing Trainium4, which is expected to deliver at least three times the performance of Trainium3 for standard AI workloads.
The next-generation chip would support Nvidia’s technology, allowing it to work alongside that company’s servers and hardware.
Amazon’s in-house chip development reflects a broader trend among cloud service providers seeking to reduce dependence on external suppliers while offering customers more cost-effective alternatives for AI workloads.
Shares of contract chipmaker Taiwan Semiconductor Manufacturing Co (TSMC, 台積電) came under pressure yesterday after a report that Apple Inc is looking to shift some orders from the Taiwanese company to Intel Corp. TSMC shares fell NT$55, or 2.4 percent, to close at NT$2,235 on the local main board, Taiwan Stock Exchange data showed. Despite the losses, TSMC is expected to continue to benefit from sound fundamentals, as it maintains a lead over its peers in high-end process development, analysts said. “The selling was a knee-jerk reaction to an Intel-Apple report over the weekend,” Mega International Investment Services Corp (兆豐國際投顧) analyst Alex Huang
Taiwan Semiconductor Manufacturing Co (TSMC, 台積電) is expected to remain Apple Inc’s primary chip manufacturing partner despite reports that Apple could shift some orders to Intel Corp, industry experts said yesterday. The comments came after The Wall Street Journal reported on Friday that Apple and Intel had reached a preliminary agreement following more than a year of negotiations for Intel to manufacture some chips for Apple devices. Taiwan Institute of Economic Research (台灣經濟研究院) economist Arisa Liu (劉佩真) said TSMC’s advanced packaging technologies, including integrated fan-out and chip-on-wafer-on-substrate, remain critical to the performance of Apple’s A-series and M-series chips. She said Intel and Samsung
TRANSITION: With the closure, the company would reorganize its Taiwanese unit to a sales and service-focused model, Bridgestone said Bridgestone Corp yesterday announced it would cease manufacturing operations at its tire plant in Hsinchu County’s Hukou Township (湖口), affecting more than 500 workers. Bridgestone Taiwan Co (台灣普利司通) said in a statement that the decision was based on the Tokyo-based tire maker’s adjustments to its global operational strategy and long-term market development considerations. The Taiwanese unit would be reorganized as part of the closure, effective yesterday, and all related production activities would be concluded, the statement said. Under the plan, Bridgestone would continue to deepen its presence in the Taiwanese market, while transitioning to a sales and service-focused business model, it added. The Hsinchu
Taiwan Semiconductor Manufacturing Co (TSMC, 台積電) has approved a capital budget of US$31.28 billion for production expansion to meet long-term development needs during the artificial intelligence (AI) boom. The company’s board meeting yesterday approved the capital appropriation plan for purposes such as the installation of advanced technology capacity and fab construction, the world’s largest contract chipmaker said in a statement. At an earnings conference last month, TSMC forecast that its capital expenditure for this year would be at the higher end of the US$52 billion to US$56 billion range it forecast in January in response to robust demand for 5G, AI and
RSS