Artificial intelligence systems capable of feelings or self-awareness are at risk of being harmed if the technology is developed irresponsibly, according to an open letter signed by AI practitioners and thinkers including Sir Stephen Fry.
More than 100 experts have put forward five principles for conducting responsible research into AI consciousness, as rapid advances raise concerns that such systems could be considered sentient.
The principles include prioritizing research on understanding and assessing consciousness in AIs, in order to prevent “mistreatment and suffering.”
Photo: Photo: Bloomberg
The other principles are: setting constraints on developing conscious AI systems; taking a phased approach to developing such systems; sharing findings with the public; and refraining from making misleading or overconfident statements about creating conscious AI.
The letter’s signatories include academics such as Sir Anthony Finkelstein at the University of London and AI professionals at companies including Amazon and the advertising group WPP.
It has been published alongside a research paper that outlines the principles. The paper argues that conscious AI systems could be built in the near future — or at least ones that give the impression of being conscious.
Photo: EPA
“It may be the case that large numbers of conscious systems could be created and caused to suffer,” the researchers say, adding that if powerful AI systems were able to reproduce themselves it could lead to the creation of “large numbers of new beings deserving moral consideration.”
The paper, written by Oxford University’s Patrick Butlin and Theodoros Lappas of the Athens University of Economics and Business, adds that even companies not intending to create conscious systems will need guidelines in case of “inadvertently creating conscious entities.”
It acknowledges that there is widespread uncertainty and disagreement over defining consciousness in AI systems and whether it is even possible, but says it is an issue that “we must not ignore”.
Photo: AFP
Other questions raised by the paper focus on what to do with an AI system if it is defined as a “moral patient” — an entity that matters morally “in its own right, for its own sake.” In that scenario, it questions if destroying the AI would be comparable to killing an animal.
The paper, published in the Journal of Artificial Intelligence Research, also warned that a mistaken belief that AI systems are already conscious could lead to a waste of political energy as misguided efforts are made to promote their welfare.
The paper and letter were organized by Conscium, a research organization part-funded by WPP and co-founded by WPP’s chief AI officer, Daniel Hulme.
Last year a group of senior academics argued there was a “realistic possibility” that some AI systems will be conscious and “morally significant” by 2035.
In 2023, Sir Demis Hassabis, the head of Google’s AI program and a Nobel prize winner, said AI systems were “definitely” not sentient currently but could be in the future.
“Philosophers haven’t really settled on a definition of consciousness yet but if we mean sort of self-awareness, these kinds of things, I think there’s a possibility AI one day could be,” he said in an interview with US broadcaster CBS.
The small platform at Duoliang Train Station in Taitung County’s Taimali Township (太麻里) served villagers from 1992 to 2006, but was eventually shut down due to lack of use. Just 10 years later, the abandoned train station had become widely known as the most beautiful station in Taiwan, and visitors were so frequent that the village had to start restricting traffic. Nowadays, Duoliang Village (多良) is known as a bit of a tourist trap, with a mandatory, albeit modest, admission fee of NT$10 giving access to a crowded lane of vendors with a mediocre view of the ocean and the trains
For many people, Bilingual Nation 2030 begins and ends in the classroom. Since the policy was launched in 2018, the debate has centered on students, teachers and the pressure placed on schools. Yet the policy was never solely about English education. The government’s official plan also calls for bilingualization in Taiwan’s government services, laws and regulations, and living environment. The goal is to make Taiwan more inclusive and accessible to international enterprises and talent and better prepared for global economic and trade conditions. After eight years, that grand vision is due for a pulse check. RULES THAT CAN BE READ For Harper Chen (陳虹宇), an adviser
Traditionally, indigenous people in Taiwan’s mountains practice swidden cultivation, or “slash and burn” agriculture, a practice common in human history. According to a 2016 research article in the International Journal of Environmental Sustainability, among the Atayal people, this began with a search for suitable forested slopeland. The trees are burnt for fertilizer and the land cleared of stones. The stones and wood are then piled up to make fences, while both dead and standing trees are retained on the plot. The fences are used to grow climbing crops like squash and beans. The plot itself supports farming for three years.
President William Lai (賴清德) on Nov. 25 last year announced in a Washington Post op-ed that “my government will introduce a historic US$40 billion supplementary defense budget, an investment that underscores our commitment to defending Taiwan’s democracy.” Lai promised “significant new arms acquisitions from the United States” and to “invest in cutting-edge technologies and expand Taiwan’s defense industrial base,” to “bolster deterrence by inserting greater costs and uncertainties into Beijing’s decision-making on the use of force.” Announcing it in the Washington Post was a strategic gamble, both geopolitically and domestically, with Taiwan’s international credibility at stake. But Lai’s message was exactly