An open-source traditional Mandarin large language model (LLM) localized for Taiwan was released yesterday, achieving higher scores in the Taiwanese bar exam than GPT-4o.
The project, called Taiwan Mixture of Experts (TAME), was initiated by Chang Chun Group, Pegatron, Unimicron, Chang Gung Memorial Hospital, TechOrange and National Taiwan University.
Using Nvidia’s Taipei-1 supercomputer in Kaohsiung, it was trained on nearly 500 billion tokens of data provided by the partners in their specialized fields.
Photo: Reuters
On its first attempt taking last year’s bar exam, Project TAME did better than 89 percent of test takers, LegalSign.ai chief executive officer Steven Chen (陳啟桐) said.
After only a few months, it has already received outstanding marks when taking exams for university students, legal professionals, traditional Chinese medicine practitioners, tour guides and drivers, Project TAME said.
Out of 39 evaluations and nearly 3,000 questions, Project TAME outperformed all other available models, with an accuracy rate 6.8 percent higher than the second-place Claude-Opus and 9.3 percent higher than GPT-4o.
The model is available to use for free online at https://twllm.com and would be open source, organizers said.
An interactive chatbot version for the public was created by AMPIC.
It is also available for download by enterprises and developers on Github.
The new LLM is the result of 350,000 GPU hours and 1,285 working hours by 31 engineers, Project TAME leader and Pegatron associate vice president of AI development Andrew Hsiao (蕭安助) said.
Its two specialties are localization for Taiwan and application for industry, he said.
It was only released today, but enterprises would be able to verify and fine-tune the model as time goes on to verify whether it is suitable for use in different fields, he added.
SECURITY: Starlink owner Elon Musk has taken pro-Beijing positions, and allowing pro-China companies to control Taiwan’s critical infrastructure is risky, a legislator said Starlink was reluctant to offer services in Taiwan because of the nation’s extremely high penetration rates in 4G and 5G services, the Ministry of Digital Affairs said yesterday. The ministry made the comments at a meeting of the legislature’s Transportation Committee, which reviewed amendments to Article 36 of the Telecommunications Management Act (電信管理法). Article 36 bans foreigners from holding more than 49 percent of shares in public telecommunications networks, while shares foreigners directly and indirectly hold are also capped at 60 percent of the total, unless specified otherwise by law. The amendments, sponsored by Chinese Nationalist Party (KMT) Legislator Ko
The military has spotted two Chinese warships operating in waters near Penghu County in the Taiwan Strait and sent its own naval and air forces to monitor the vessels, the Ministry of National Defense (MND) said. Beijing sends warships and warplanes into the waters and skies around Taiwan on an almost daily basis, drawing condemnation from Taipei. While the ministry offers daily updates on the locations of Chinese military aircraft, it only rarely gives details of where Chinese warships are operating, generally only when it detects aircraft carriers, as happened last week. A Chinese destroyer and a frigate entered waters to the southwest
The eastern extension of the Taipei MRT Red Line could begin operations as early as late June, the Taipei Department of Rapid Transit Systems said yesterday. Taipei Rapid Transit Corp said it is considering offering one month of free rides on the new section to mark its opening. Construction progress on the 1.4km extension, which is to run from the current terminal Xiangshan Station to a new eastern terminal, Guangci/Fengtian Temple Station, was 90.6 percent complete by the end of last month, the department said in a report to the Taipei City Council's Transportation Committee. While construction began in October 2016 with an
NON-RED SUPPLY: Boosting the nation’s drone industry is becoming increasingly urgent as China’s UAV dominance could become an issue in a crisis, an analyst said Taiwan’s drone exports to Europe grew 41.7-fold from 2024 to last year, with demand from Ukraine’s fight against Russian aggression the most likely driver of growth, a study showed. The Institute for Democracy, Society and Emerging Technology (DSET) in a statement on Wednesday said it found that many of Taiwan’s uncrewed aerial vehicle (UAV) sales were from Poland and the Czech Republic. These countries likely transferred the drones to Ukraine to aid it in its fight against the Russian invasion that started in 2022, it said. Despite the gains, Taiwan is not the dominant drone exporter to these markets, ranking second and fourth
RSS