SK Hynix Inc is ramping up its spending on advanced chip packaging, in hopes of capturing more of the burgeoning demand for a crucial component in artificial intelligence (AI) development: high-bandwidth memory (HBM).
The Icheon-based firm is investing more than US$1 billion in South Korea this year to expand and improve the final steps of its chip manufacture, said Lee Kang-wook, a former Samsung Electronics Co engineer who now heads up packaging development at SK Hynix.
Lee specializes in advanced ways of combining and connecting semiconductors, which has grown in importance with the advent of modern AI and its digestion of vast troves of data via parallel processing chains. While SK Hynix has not disclosed its capital expenditure budget for this year, the average analyst estimate puts the figure at 14 trillion won (US$10.5 billion). That suggests advanced packaging, which could take up a 10th of that, is a major priority.
Photo: Bloomberg
“The first 50 years of the semiconductor industry has been about the front-end,” or the design and fabrication of the chips themselves, Lee said in an interview. “But the next 50 years is going to be all about the back-end,” or packaging.
Being first to achieve the next milestone in this race could now catapult companies into industry-leading positions. SK Hynix was chosen by Nvidia Corp to provide the HBM for its standard-setting AI accelerators, pushing the South Korean firm’s value up to 119 trillion won. Its stock gained about 1 percent in Seoul on Thursday, adding to a nearly 120 percent increase since the start of last year. It is now South Korea’s second most valuable company, outperforming Samsung and US rival Micron Technology Inc.
Lee, now 55 years old, helped pioneer a novel method to packaging the third generation of the technology, HBM2E, which was quickly followed by the other two major makers. That innovation was central to SK Hynix winning Nvidia as a customer in late 2019.
HBM is a type of high-performance memory that stacks chips on top of one another and connects them with through-silicon via (TSV) technology for faster and more energy-efficient data processing.
ChatGPT’s release in November 2022 was the moment Lee had been waiting for. By that time, his team had developed a new packaging method called mass reflow-molded underfill (MR-MUF), aided by his contacts in Japan. The process, which involves injecting and then hardening liquid material between layers of silicon, improved heat dissipation and production yields. SK Hynix teamed up with Namics Corp in Japan for the material and a related patent, a person familiar with the matter said.
SK Hynix is pouring the bulk of its new investment into advancing MR-MUF and TSV technologies, Lee said.
Samsung, which has for years been distracted by a succession saga at its very top, is now fighting back. Nvidia last year gave the nod to Samsung’s HBM chips, and the Suwon-based company said on Feb. 26 that it has developed the fifth generation of the technology, HBM3E, with 12 layers of DRAM chips and the industry’s largest capacity of 36 gigabytes.
On the same day, Boise, Idaho-based Micron surprised industry watchers by saying it had begun volume production of 24GB, eight-layer HBM3E, which would be part of Nvidia’s H200 Tensor Core units shipping in the second quarter.
With its big commitment to expanding and enhancing technology at home and a multibillion-dollar advanced packaging facility planned for the US, Lee remains bullish about SK Hynix’s prospects in the face of intensifying competition. He sees the present investment as laying the groundwork to meet more demand to come with future generations of HBM.
EXPANSION: The investment came as ASE in July told investors it would accelerate capacity growth to mitigate supply issues, and would boost spending by 16 percent ASE Technology Holding Co (ASE, 日月光投控), the world’s biggest chip assembly and testing service provider, yesterday said it is investing NT$17.6 billion (US$578.6 million) to build a new advanced chip packaging facility in Kaohsiung to cope with fast-growing demand from artificial intelligence (AI), high-performance-computing (HPC) and automotive applications. The new fab, called K18B, is to commence operation in the first quarter of 2028, offering chip-on-wafer-on-substrate (CoWoS) chip packaging and final testing services, ASE said in a statement. The fab is to create 2,000 new jobs upon its completion, ASE said. A wide spectrum of system-level chip packaging technologies would be available at
Taiwan’s foreign exchange reserves hit a record high at the end of last month, surpassing the US$600 billion mark for the first time, the central bank said yesterday. Last month, the country’s foreign exchange reserves rose US$5.51 billion from a month earlier to reach US$602.94 billion due to an increase in returns from the central bank’s portfolio management, the movement of other foreign currencies in the portfolio against the US dollar and the bank’s efforts to smooth the volatility of the New Taiwan dollar. Department of Foreign Exchange Director-General Eugene Tsai (蔡炯民)said a rate cut cycle launched by the US Federal Reserve
HEAVYWEIGHT: The TAIEX ended up 382.67 points, with about 280 of those points contributed by TSMC shares alone, which rose 2.56 percent to close at NT$1,400 Shares in Taiwan broke records at the end of yesterday’s session after contract chipmaker Taiwan Semiconductor Manufacturing Co (TSMC, 台積電) hit a fresh closing-high amid enthusiasm toward artificial intelligence (AI) development, dealers said. The TAIEX ended up 382.67 points, or 1.45 percent, at the day’s high of 26,761.06. Turnover totaled NT$463.09 billion (US$15.22 billion). “The local main board has repeatedly hit new closing highs in the past few sessions as investors continued to embrace high hopes about AI applications, taking cues from a strong showing in shares of US-based AI chip designer Nvidia Corp,” Hua Nan Securities Co (華南永昌證券) analyst Kevin Su
Nvidia Corp’s major server production partner Hon Hai Precision Industry Co (鴻海精密) reported 10.99 percent year-on-year growth in quarterly sales, signaling healthy demand for artificial intelligence (AI) infrastructure. Revenue totaled NT$2.06 trillion (US$67.72 billion) in the last quarter, in line with analysts’ projections, a company statement said. On a quarterly basis, revenue was up 14.47 percent. Hon Hai’s businesses cover four primary product segments: cloud and networking, smart consumer electronics, computing, and components and other products. Last quarter, “cloud and networking products delivered strong growth, components and other products demonstrated significant growth, while smart consumer electronics and computing products slightly declined,” compared with the