Artificial intelligence (AI) chips from Qualcomm Inc beat Nvidia Corp in two out of three measures of power efficiency in a new set of test data published on Wednesday, while a Taiwanese start-up bested both in one category.
Nvidia dominates the market for training AI models, but after AI models are trained, they are put to wider use in “inference” by doing tasks such as generating text responses and analyzing images.
Analysts say that the market for data center inference chips would grow quickly as businesses put AI technologies into their products, but companies such as Alphabet Inc’s Google are already exploring how to keep the lid on the extra costs that doing so would add.
Photo: Reuters
Qualcomm has created a chip called the Cloud AI 100 that aims for parsimonious power consumption.
In testing data published on Wednesday by MLCommons, an engineering consortium that maintains testing benchmarks widely used in the AI chip industry, Qualcomm’s AI 100 beat Nvidia’s flagship H100 chip at classifying images, based on how many data center server queries each chip can carry out per watt.
Qualcomm’s chips hit 197.6 server queries per watt versus 108.4 queries per watt for Nvidia.
Neuchips Corp (創鑫智慧), a start-up founded by veteran Taiwanese chip academic Lin Youn-long (林永隆), took the top spot with 227 queries per watt.
Qualcomm also beat Nvidia at object detection with a score of 3.2 queries per watt versus Nvidia’s 2.4 queries per watt.
Object detection can be used in applications such as analyzing footage from retail stores to see where shoppers go most often.
However, Nvidia took the top spot in absolute performance terms and power efficiency terms in a test of natural-language processing, the AI technology most widely used in chatbots.
Nvidia hit 10.8 samples per watt, while Neuchips ranked second at 8.9 samples per watt and Qualcomm was third at 7.5 samples per watt.
TECH TITAN: Pandemic-era demand for semiconductors turbocharged the nation’s GDP per capita to surpass South Korea’s, but it still remains half that of Singapore Taiwan is set to surpass South Korea this year in terms of wealth for the first time in more than two decades, marking a shift in Asia’s economic ranks made possible by the ascent of Taiwan Semiconductor Manufacturing Co (TSMC, 台積電). According to the latest forecasts released on Thursday by the central bank, Taiwan’s GDP is expected to expand 4.55 percent this year, a further upward revision from the 4.45 percent estimate made by the statistics bureau last month. The growth trajectory puts Taiwan on track to exceed South Korea’s GDP per capita — a key measure of living standards — a
Samsung Electronics Co shares jumped 4.47 percent yesterday after reports it has won approval from Nvidia Corp for the use of advanced high-bandwidth memory (HBM) chips, which marks a breakthrough for the South Korean technology leader. The stock closed at 83,500 won in Seoul, the highest since July 31 last year. Yesterday’s gain comes after local media, including the Korea Economic Daily, reported that Samsung’s 12-layer HBM3E product recently passed Nvidia’s qualification tests. That clears the components for use in the artificial intelligence (AI) accelerators essential to the training of AI models from ChatGPT to DeepSeek (深度求索), and finally allows Samsung
READY TO HELP: Should TSMC require assistance, the government would fully cooperate in helping to speed up the establishment of the Chiayi plant, an official said Taiwan Semiconductor Manufacturing Co (TSMC, 台積電) yesterday said its investment plans in Taiwan are “unchanged” amid speculation that the chipmaker might have suspended construction work on its second chip packaging plant in Chiayi County and plans to move equipment arranged for the plant to the US. The Chinese-language Economic Daily News reported earlier yesterday that TSMC had halted the construction of the chip packaging plant, which was scheduled to be completed next year and begin mass production in 2028. TSMC did not directly address whether construction of the plant had halted, but said its investment plans in Taiwan remain “unchanged.” The chipmaker started
MORTGAGE WORRIES: About 34% of respondents to a survey said they would approach multiple lenders to pay for a home, while 29.2% said they would ask family for help New housing projects in Taiwan’s six special municipalities, as well as Hsinchu city and county, are projected to total NT$710.65 billion (US$23.61 billion) in the upcoming fall sales season, a record 30 percent decrease from a year earlier, as tighter mortgage rules prompt developers to pull back, property listing platform 591.com (591新建案) said yesterday. The number of projects has also fallen to 312, a more than 20 percent decrease year-on-year, underscoring weakening sentiment and momentum amid lingering policy and financing headwinds. New Taipei City and Taoyuan bucked the downturn in project value, while Taipei, Hsinchu city and county, Taichung, Tainan and Kaohsiung
RSS