Alibaba Group Holding Ltd (阿里巴巴) cofounder Jack Ma (馬雲)-backed Ant Group Co (螞蟻集團) used Chinese-made semiconductors to develop techniques for training artificial intelligence (AI) models that would cut costs by 20 percent, people familiar with the matter said.
Ant used domestic chips, including from Alibaba and Huawei Technologies Co (華為), to train models using the so-called “mixture of experts” machine learning approach, the people said.
It got results similar to those from Nvidia Corp chips, such as the H800, they said.
Photo: AFP
Hangzhou-based Ant is still using Nvidia for AI development, but is now relying mostly on alternatives, including from Advanced Micro Devices Inc and Chinese chips for its latest models, one of the people said.
The models mark Ant’s entry into a race between Chinese and US companies that has accelerated since DeepSeek (深度求索) demonstrated how capable models can be trained for far less than the billions invested by OpenAI and Alphabet Inc’s Google.
It underscores how Chinese companies are trying to use local alternatives to the most advanced Nvidia semiconductors. While not the most advanced, the H800 is a relatively powerful processor and is barred by the US from China.
The company published a research paper this month that said its models at times outperformed Meta Platforms Inc in certain benchmarks, which has not been independently verified.
However, if they work as advertised, Ant’s platforms could mark another step forward for Chinese AI development by slashing the cost of inferencing or supporting AI services.
Ant said it cost about 6.35 million yuan (US$875,952) to train 1 trillion tokens using high-performance hardware, but its optimized approach would cut that down to 5.1 million yuan using lower-specification hardware.
Tokens are the fundamental units of text — such as words, characters or parts of words — that a language model breaks down and analyzes to understand context, meaning and structure.
In essence, they are the building blocks that enable the model to interpret human language and produce intelligent output.
The company plans to leverage the recent breakthrough in the large language models it has developed, Ling-Plus and Ling-Lite, for industrial AI solutions including healthcare and finance, the people said.
On English-language understanding, Ant in its paper said that the Ling-Lite model did better in a key benchmark compared with one of Meta’s Llama models.
Ling-Lite and Ling-Plus models outperformed DeepSeek’s equivalents on Chinese-language benchmarks.
Ant has made the Ling models open-source. Ling-Lite contains 16.8 billion parameters, which are adjustable settings that work like knobs and dials to direct the model’s performance.
Ling-Plus has 290 billion parameters, which is considered relatively large in the realm of language models. For comparison, experts estimate that ChatGPT’s GPT-4.5 has 1.8 trillion parameters, MIT Technology Review said. DeepSeek-R1 has 671 billion.
The company faced challenges in some areas of the training, including stability.
Even small changes in the hardware or the model’s structure led to problems, including jumps in the models’ error rate, it said in the paper.
Additonal reporting by staff writer
Intel Corp chief executive officer Lip-Bu Tan (陳立武) is expected to meet with Taiwanese suppliers next month in conjunction with the opening of the Computex Taipei trade show, supply chain sources said on Monday. The visit, the first for Tan to Taiwan since assuming his new post last month, would be aimed at enhancing Intel’s ties with suppliers in Taiwan as he attempts to help turn around the struggling US chipmaker, the sources said. Tan is to hold a banquet to celebrate Intel’s 40-year presence in Taiwan before Computex opens on May 20 and invite dozens of Taiwanese suppliers to exchange views
Application-specific integrated circuit designer Faraday Technology Corp (智原) yesterday said that although revenue this quarter would decline 30 percent from last quarter, it retained its full-year forecast of revenue growth of 100 percent. The company attributed the quarterly drop to a slowdown in customers’ production of chips using Faraday’s advanced packaging technology. The company is still confident about its revenue growth this year, given its strong “design-win” — or the projects it won to help customers design their chips, Faraday president Steve Wang (王國雍) told an online earnings conference. “The design-win this year is better than we expected. We believe we will win
Chizuko Kimura has become the first female sushi chef in the world to win a Michelin star, fulfilling a promise she made to her dying husband to continue his legacy. The 54-year-old Japanese chef regained the Michelin star her late husband, Shunei Kimura, won three years ago for their Sushi Shunei restaurant in Paris. For Shunei Kimura, the star was a dream come true. However, the joy was short-lived. He died from cancer just three months later in June 2022. He was 65. The following year, the restaurant in the heart of Montmartre lost its star rating. Chizuko Kimura insisted that the new star is still down
While China’s leaders use their economic and political might to fight US President Donald Trump’s trade war “to the end,” its army of social media soldiers are embarking on a more humorous campaign online. Trump’s tariff blitz has seen Washington and Beijing impose eye-watering duties on imports from the other, fanning a standoff between the economic superpowers that has sparked global recession fears and sent markets into a tailspin. Trump says his policy is a response to years of being “ripped off” by other countries and aims to bring manufacturing to the US, forcing companies to employ US workers. However, China’s online warriors
RSS