The preponderance of content written in simplified Chinese characters on the Internet poses a hurdle to Taiwan’s development of machine-learning technology, artificial intelligence (AI) experts said.
The Trustworthy Artificial Intelligence Dialog Engine being developed by the National Science and Technology Council (NSTC) was billed by the government as a key program for bringing innovation to Taiwan’s tech sector.
However, experts are sounding the alarm that the initiative is outgunned by the competition in China, which enjoys superior funding, computing power, staffing and the sheer amount of content available for training the AI.
Photo: Reuters
The data put into generative AI has a deep impact on its behavior and capabilities, as the algorithm needs to be trained by reading texts, Lee Yuh-jye (李育杰), a distinguished research fellow at Academia Sinica’s Research Center for Information Technology Innovation, said on Saturday.
Academia Sinica’s own experimental chatbot, which embarrassed its researchers by claiming to be Chinese and calling Chinese President Xi Jingping (習近平) the leader of Taiwan, was an example of training gone awry, he said.
Web content from China that the bot was exposed to during its training, via the Llama 2 language model, was determined to be the source of the problem, Lee said, adding that the bot’s Chinese views stemmed from data it consumed.
This incident has shown that a domestic language model is needed for the nation to make progress in AI research, he said.
Although Taiwanese social media create a large amount of content, much of it consists of gibberish, short-lived buzzwords and flame war threads on Professional Technology Temple and Dcard, he said.
The dubious quality of the content means that the data have to be massaged to train AI models, Lee said.
Taiwanese researchers prevent Chinese influence on the AI by converting simplified Chinese characters to traditional ones or by excluding material originating in China altogether, Taiwan Artificial Intelligence Association chairman Eric Huang (黃逸華) said.
The latter approach runs the risk of giving too little data to the algorithm, which could worsen the AI’s “hallucinations” and limit its versatility, he said.
The problem is decades in the making and is unlikely to be resolved soon, while making use of social media platforms would lead to significant cost increases due to the need to curate the data, he said.
Meanwhile, Tunghai University assistant law professor Chang Kai-hsin (張凱鑫), said legislation is needed to deal with the implications of generative AI on copyrights and for Taiwan to make headway in machine learning.
Backlash from content creators over their creations being used in AI training has highlighted the legal problems that could arise from the large-scale data mining machine learning requires, he said.
The copyright walls erected around content has exacerbated the scarcity of text in traditional Chinese characters that could be used for Taiwan’s AI research, Chang said, adding that the problem especially hampers government-funded projects.
The safest legal way to utilize content — individually obtaining use permissions from the content’s rightful owner — cannot apply to AI training which harvests tremendous amounts of data, he said.
Crawling the Internet for data is especially fraught with respect to copyrights, trade patents and privacy, Chang said.
The legal strategy of US enterprises engaged in machine learning that incorporates OpenAI is to leverage the fair use principle when litigated, with their success at court being determined on a case-by-case basis, he said.
Taiwan does not have laws governing copyright issues originating from AI use, as the nation’s research on large language models has not yet produced a working specimen, Chang said.
The nation does have an advantage due to the high degree of specificity in Subsection 3 of the Copyright Act (著作權法), which does not need extensive reworking for regulating AI, he said.
The ownership of copyrights on AI-generated content would be calculated by the percentage of human contributions to the creation if the principles espoused in the law are upheld, Chang said.
The NSTC should consider the needs of each link in the AI industry’s supply chain through writing a promised AI basic law, he said, adding that efforts to grow the sector require a suitable regulatory framework.
ALIGNED THINKING: Taiwan and Japan have a mutual interest in trade, culture and engineering, and can work together for stability, Cho Jung-tai said Taiwan and Japan are two like-minded countries willing to work together to form a “safety barrier” in the Indo-Pacific region, Premier Cho Jung-tai (卓榮泰) yesterday said at the opening ceremony of the 35th Taiwan-Japan Modern Engineering and Technology Symposium in Taipei. Taiwan and Japan are close geographically and closer emotionally, he added. Citing the overflowing of a barrier lake in the Mataian River (馬太鞍溪) in September, Cho said the submersible water level sensors given by Japan during the disaster helped Taiwan monitor the lake’s water levels more accurately. Japan also provided a lot of vaccines early in the outbreak of the COVID-19 pandemic,
Kaohsiung Mayor Chen Chi-mai (陳其邁) on Monday announced light shows and themed traffic lights to welcome fans of South Korean pop group Twice to the port city. The group is to play Kaohsiung on Saturday as part of its “This Is For” world tour. It would be the group’s first performance in Taiwan since its debut 10 years ago. The all-female group consists of five South Koreans, three Japanese and Tainan’s Chou Tzu-yu (周子瑜), the first Taiwan-born and raised member of a South Korean girl group. To promote the group’s arrival, the city has been holding a series of events, including a pop-up
TEMPORAL/SPIRITUAL: Beijing’s claim that the next Buddhist leader must come from China is a heavy-handed political maneuver that will fall flat-faced, experts said China’s requirement that the Dalai Lama’s reincarnation to be born in China and approved by Beijing has drawn criticism, with experts at a forum in Taipei yesterday saying that if Beijing were to put forth its own Dalai Lama, the person would not be recognized by the Tibetan Buddhist community. The experts made a remarks at the two-day forum hosted by the Tibet Religious Foundation of His Holiness the Dalai Lama titled: “The Snow Land Forum: Finding Common Ground on Tibet.” China says it has the right to determine the Dalai Lama’s reincarnation, as it claims sovereignty over Tibet since ancient times,
Temperatures in some parts of Taiwan are expected to fall sharply to lows of 15°C later this week as seasonal northeasterly winds strengthen, the Central Weather Administration (CWA) said today. It is to be the strongest cold wave to affect northern Taiwan this autumn, while Chiayi County in the southwest and some parts of central Taiwan are likely to also see lower temperatures due to radiational cooling, which occurs under conditions of clear skies, light winds and dry weather, the CWA said. Across Taiwan, temperatures are to fall gradually this week, dropping to 15°C to 16°C in the early hours of Wednesday
RSS