An open-source traditional Mandarin large language model (LLM) localized for Taiwan was released yesterday, achieving higher scores in the Taiwanese bar exam than GPT-4o.
The project, called Taiwan Mixture of Experts (TAME), was initiated by Chang Chun Group, Pegatron, Unimicron, Chang Gung Memorial Hospital, TechOrange and National Taiwan University.
Using Nvidia’s Taipei-1 supercomputer in Kaohsiung, it was trained on nearly 500 billion tokens of data provided by the partners in their specialized fields.
Photo: Reuters
On its first attempt taking last year’s bar exam, Project TAME did better than 89 percent of test takers, LegalSign.ai chief executive officer Steven Chen (陳啟桐) said.
After only a few months, it has already received outstanding marks when taking exams for university students, legal professionals, traditional Chinese medicine practitioners, tour guides and drivers, Project TAME said.
Out of 39 evaluations and nearly 3,000 questions, Project TAME outperformed all other available models, with an accuracy rate 6.8 percent higher than the second-place Claude-Opus and 9.3 percent higher than GPT-4o.
The model is available to use for free online at https://twllm.com and would be open source, organizers said.
An interactive chatbot version for the public was created by AMPIC.
It is also available for download by enterprises and developers on Github.
The new LLM is the result of 350,000 GPU hours and 1,285 working hours by 31 engineers, Project TAME leader and Pegatron associate vice president of AI development Andrew Hsiao (蕭安助) said.
Its two specialties are localization for Taiwan and application for industry, he said.
It was only released today, but enterprises would be able to verify and fine-tune the model as time goes on to verify whether it is suitable for use in different fields, he added.
Taiwanese scientists have engineered plants that can capture about 50 percent more carbon dioxide and produce more than twice as many seeds as unmodified plants, a breakthrough they hope could one day help mitigate global warming and grow more food staples such as rice. If applied to major food crops, the new system could cut carbon emissions and raise yields “without additional equipment or labor costs,” Academia Sinica researcher and lead author the study Lu Kuan-jen (呂冠箴) said. Academia Sinica president James Liao (廖俊智) said that as humans emit 9.6 billion tonnes of carbon dioxide compared with the 220 billion tonnes absorbed
The Taipei Mass Rapid Transit (MRT) Wanda-Zhonghe Line is 81.7 percent complete, with public opening targeted for the end of 2027, New Taipei City Mayor Hou You-yi (侯友宜) said today. Surrounding roads are to be open to the public by the end of next year, Hou said during an inspection of construction progress. The 9.5km line, featuring nine underground stations and one depot, is expected to connect Chiang Kai-shek Memorial Hall Station to Chukuang Station in New Taipei City’s Jhonghe District (中和). All 18 tunnels for the line are complete, while the main structures of the stations and depot are mostly finished, he
Taipei is to implement widespread road closures around Taipei 101 on Friday to make way for large crowds during the Double Ten National Day celebration, the Taipei Department of Transportation said. A four-minute fireworks display is to be launched from the skyscraper, along with a performance by 500 drones flying in formation above the nearby Nanshan A21 site, starting at 10pm. Vehicle restrictions would occur in phases, they said. From 5pm to 9pm, inner lanes of Songshou Road between Taipei City Hall and Taipei 101 are to be closed, with only the outer lanes remaining open. Between 9pm and 9:40pm, the section is
China’s plan to deploy a new hypersonic ballistic missile at a Chinese People’s Liberation Army Rocket Force (PLARF) base near Taiwan likely targets US airbases and ships in the western Pacific, but it would also present new threats to Taiwan, defense experts said. The New York Times — citing a US Department of Defense report from last year on China’s military power — on Monday reported in an article titled “The missiles threatening Taiwan” that China has stockpiled 3,500 missiles, 1.5 times more than four years earlier. Although it is unclear how many of those missiles were targeting Taiwan, the newspaper reported
RSS