Amazon.com Inc’s cloud-computing unit on Tuesday announced updated versions of its in-house computer chips while also forging closer ties with Nvidia Corp — dual efforts designed to ensure it can get enough supplies of crucial data-center processors.
New homegrown Graviton4 chips will have as much as 30 percent better performance than their predecessors, Amazon Web Services (AWS) said at its annual re:Invent conference in Las Vegas. Computers using the processors are to start coming online in the coming months.
The company also unveiled Trainium2, an updated version of a processor designed for artificial intelligence (AI) systems. It will begin powering new services starting next year, Amazon said. That chip provides an alternative to so-called AI accelerators sold by Nvidia — processors that have been vital to the build-out of AI services.
Photo: Bloomberg
However, Amazon also touted “an expansion of its partnership” with Nvidia, whose CEO, Jensen Huang (黃仁勳), joined AWS CEO Adam Selipsky on stage.
AWS is to be the first big user of an updated version of that company’s Grace Hopper Superchip, and it will be one of the data-center companies hosting Nvidia’s DGX Cloud service.
The new in-house chips are part of AWS’s push to maintain its lead over Microsoft Corp’s Azure and Alphabet Inc’s Google Cloud Platform. Earlier this month, Microsoft announced its own processors and AI accelerators. Like Amazon, it has pointed to the efficiency that they bring compared with buying off-the-shelf parts from traditional sellers such as Intel Corp.
AWS said that it has built more than 2 million Graviton processors since beginning the project about five years ago. All of the top 100 of its users of EC2 — AWS’ family of processing power for rent — have chosen to use Graviton-based computing, the company said.
“By focusing our chip designs on real workloads that matter to customers, we’re able to deliver the most advanced cloud infrastructure to them,” AWS vice president Dave Brown said. “Graviton4 marks the fourth generation we’ve delivered in just five years. And with the surge of interest in generative AI, Trainium2 will help customers train their machine learning models faster, at a lower cost and with better energy efficiency.”
Amazon faces a delicate balancing act. Although it is keen to tout the technological prowess of its new chips, the company also needs to maintain its relationship with Nvidia. Getting sufficient supply of Nvidia products has become a status symbol in the technology industry, with figures such as Larry Ellison and Elon Musk boasting about their ability to get the chips.
For now, Nvidia’s products are considered the industry’s best. Until Trainium or other alternatives can match their capabilities, companies like Amazon cannot afford to alienate Nvidia — and catching up will not be easy. Nvidia’s prized H100 chip is getting a more advanced update called H200 in the first half of next year, followed by a whole new design later in the year.
AWS will also operate a supercomputer based on Nvidia hardware. When not in use for internal research and development, the “supercluster” will be made available to other users as a service.
Elon Musk’s lieutenants have reached out to chip industry suppliers, including Applied Materials Inc, Tokyo Electron Ltd and Lam Research Corp, for his envisioned Terafab, early steps in an audacious and likely arduous attempt to break into the production of cutting-edge chips. Staff working for the joint venture between Tesla Inc and Space Exploration Technologies Corp (SpaceX) have sought price quotes and delivery times for an array of chipmaking gear, people familiar with the matter said. In past weeks, they’ve contacted makers of photomasks, substrates, etchers, depositors, cleaning devices, testers and other tools, according to the people, who asked not to
Taichung reported the steepest fall in completed home prices among the six special municipalities in the first quarter of this year, data compiled by Taiwan Realty Co (台灣房屋) showed yesterday. From January through last month, the average transaction price for completed homes in Taichung fell 8 percent from a year earlier to NT$299,000 (US$9,483) per ping (3.3m²), said Taiwan Realty, which compiled the data based on the government’s price registration platform. The decline could be attributed to many home buyers choosing relatively affordable used homes to live in themselves, instead of newly built homes in the city’s prime property market, Taiwan Realty
The government yesterday approved applications by Alphabet Inc’s Google to invest NT$27.08 billion (US$859.98 million) in Taiwan, the Ministry of Economic Affairs said in a statement. The Department of Investment Review approved two investments proposed by Google, with much of the funds to be used for data processing and electronic information supply services, as well as inventory procurement businesses in the semiconductor field, the ministry said. It marks the second consecutive year that Google has applied to increase its investment in Taiwan. Google plans to infuse NT$25.34 billion into Charter Investments Ltd (特許投資顧問) through its Singapore-based subsidiary Fructan Holdings Singapore Pte Ltd, and
JET JUICE: The war on Iran’s secondary effects have seen fuel prices skyrocket, knocking flight schedules down to earth in return as airlines struggle with costs Airline passengers should brace for more irritation in the next few months as carriers worldwide cancel flights and ground planes to cope with stratospheric increases in jet-fuel prices. Dutch flag carrier KLM is the latest company to cut its schedule, saying on Thursday that it would scrap 80 return flights at Amsterdam’s Schiphol Airport in the coming month. That puts it in the same league as United Airlines Holdings Inc, Deutsche Lufthansa AG and Cathay Pacific Airways Ltd, which have all pruned itineraries to mitigate costs. Global capacity for next month has been reduced by about 3 percentage points, with all