An open-source traditional Mandarin large language model (LLM) localized for Taiwan was released yesterday, achieving higher scores in the Taiwanese bar exam than GPT-4o.
The project, called Taiwan Mixture of Experts (TAME), was initiated by Chang Chun Group, Pegatron, Unimicron, Chang Gung Memorial Hospital, TechOrange and National Taiwan University.
Using Nvidia’s Taipei-1 supercomputer in Kaohsiung, it was trained on nearly 500 billion tokens of data provided by the partners in their specialized fields.
Photo: Reuters
On its first attempt taking last year’s bar exam, Project TAME did better than 89 percent of test takers, LegalSign.ai chief executive officer Steven Chen (陳啟桐) said.
After only a few months, it has already received outstanding marks when taking exams for university students, legal professionals, traditional Chinese medicine practitioners, tour guides and drivers, Project TAME said.
Out of 39 evaluations and nearly 3,000 questions, Project TAME outperformed all other available models, with an accuracy rate 6.8 percent higher than the second-place Claude-Opus and 9.3 percent higher than GPT-4o.
The model is available to use for free online at https://twllm.com and would be open source, organizers said.
An interactive chatbot version for the public was created by AMPIC.
It is also available for download by enterprises and developers on Github.
The new LLM is the result of 350,000 GPU hours and 1,285 working hours by 31 engineers, Project TAME leader and Pegatron associate vice president of AI development Andrew Hsiao (蕭安助) said.
Its two specialties are localization for Taiwan and application for industry, he said.
It was only released today, but enterprises would be able to verify and fine-tune the model as time goes on to verify whether it is suitable for use in different fields, he added.
NATURE TAKES ITS COURSE: The agency’s head said he felt a sense of loss watching red-banded snakes eat the babies, as they had decided on non-intervention The Forestry and Nature Conservation Agency yesterday released a documentary on a hundred-pace viper that had incubated 16 eggs, all of which hatched, but only a baby viper escaped after they were attacked by red-banded snakes. The agency’s Taichung branch last year launched the viper reproduction monitoring project soon after forest rangers Lin Chun-yu (林俊佑) and Chou Chia-cheng (周家成) spotted a pregnant hundred-pace viper in a grass-covered burrow near a parking lot in Tbulan Village (松鶴部落). The Atayal village, in Taichung’s Heping District (和平), is headed by Ecyang Yapu, who was positive about the project and assisted in access control and power
The Coast Guard Administration (CGA) yesterday said that it had deployed vessels to “monitor” Chinese ships operating in waters off the east coast. The CGA said it dispatched vessels in response to a China Coast Guard announcement that it had carried out another “routine law-enforcement patrol” in waters off the east coast. “The CGA firmly rejects China’s cognitive warfare campaign of ‘law enforcement in name, jurisdictional expansion in practice,’” it said on X. As of 11am yesterday, two China Coast Guard ships were “loitering and drifting” about 105 nautical miles (195km) and 74 nautical miles east of Green Island (綠島) respectively, it said. It
A sharp rise in compensation to be paid by air force officers who leave before completing their required service could indicate an increase in pilots leaving the military early, an analyst said on Friday, warning that the trend could worsen a shortage of experienced personnel. Chieh Chung (揭仲), a researcher at the Association for Strategic Foresight, issued the warning even though the number of volunteer military personnel is expected to increase next year. The planned headcount for volunteer military personnel, covering officers, noncommissioned officers (NCO) and enlisted soldiers, is 158,223 for next year, up 4,258 from 153,965 this year, Chieh said. The increase
Potential improvements to munitions used by China’s long-range rocket-artillery units could extend their range to cover the entire Miyako Strait, which might give the Chinese People’s Liberation Army (PLA) the ability to secure the strategic waterway, the Mainland Affairs Council (MAC) said in a report. The PLA’s long-range rocket-artillery units deployed along the Taiwan Strait are concentrated along the coast of Fujian Province, including Changle, Pingtan and Shishi, the quarterly report on China said. The artillery brigades of the PLA’s 71st, 72nd and 73rd group armies have been deployed, with preparations for potential battlefield operations under way since August 2022, the report
RSS