In October last year, 31 Chinese teenagers reported to the Beijing Institute of Technology, one of the country’s premier military research establishments. Selected from more than 5,000 applicants, Chinese authorities hope they will design a new generation of artificial intelligent weapons systems that could range from microscopic robots to computer worms, submarines, drones and tanks.
The program is a potent reminder of what could be the defining arms race of the century, as greater computing power and self-learning programs create new avenues for war and statecraft. It is an area in which technology might now be outstripping strategic, ethical and policy thinking — but also where the battle for raw human talent may be just as important as getting the computer hardware, software and programming right.
Consultancy PwC estimates that by 2030 artificial intelligence products and systems will contribute up to US$15.7 trillion to the global economy, with China and the US likely the two leading nations.
Illustration: Mountain People
However, it is the potential military consequences that have governments most worried, fearful of falling behind — but also nervous that untested technology could bring new dangers.
In the US, Pentagon leaders have asked the Defense Innovation Board — a collection of senior Silicon Valley figures who provide the US military with tech advice — to come up with a set of ethical principles for the use of artificial intelligence (AI) in war. Last month, France and Canada announced they were setting up an international panel to discuss broadly similar questions.
So far, Western states have stuck to the belief that decisions of life and death in conflict should always be made by humans, with computers and algorithms simply supporting those decisions. Other nations — particularly Russia and China — are flirting with a different path.
Russia — which last year announced it was doubling AI investment — said this month it would publish a new AI national strategy “roadmap” by the middle of the year. Russian officials say they see AI as a key to dominating cyberspace and information operations, with suspected Russian online “troll farms” thought to already be using automated social media feeds to push disinformation.
Beijing is seen as even further ahead in developing AI, to the extent some experts believe it may already be beating the US.
Experts say achieving mastery in AI comes down to having sufficient computer power, enough data to learn from, and the human talent to make those systems work. As the world’s most powerful autocratic states, Russia and China have that capability and intent, both to use AI to maintain government dominance at home and beat enemies beyond.
Already, Beijing is using mass automatic surveillance — including facial recognition software — to crack down on dissent, particularly in its ethnic Uighur Muslim northwest. Along with Russia, China has many fewer scruples and controls than Western states when it comes to monitoring its citizens’ communications. Such systems will likely become more powerful as technology improves.
Traditionally, Western democracies — particularly the US — have proved more adept than dictatorships at tapping new technology and innovation. However, on AI, Washington’s efforts to build links between Silicon Valley and the military have been far from trouble-free. In June, employees at Google forced the firm to avoid renewing its contract with the Pentagon. Many tech researchers are reluctant to work on defense projects, nervous they will end up building out-of-control robots that kill.
The US and its allies are still researching and building their own autonomous weapons. In October last year, Microsoft quietly announced it intended to sell the Pentagon whatever advanced AI systems it needed to “build a strong defense.” US Air Force leaders say its highly classified future long-range strike aircraft, designed to replace the B-2 stealth bomber, will be able to operate both with and without crew.
Western militaries are also plowing growing resources into unmanned trucks and other supply vehicles, hoping to perform many more “dirty, dull and dangerous” battlefield tasks without risking human personnel.
These dynamics will become much more complex with the growing use of drone swarms, in which multiple unmanned vehicles control themselves. When it comes to drones fighting drones, Western policymakers are generally happy to let unmanned systems make their own decisions, but when it comes to killing, US Department of Defense policy requires that a human must remain “in the loop.”
However, that might become ever harder to manage, particularly if an enemy’s automated systems are making such judgments at much faster than human speed.
By the early 2020s, Chinese scientists expect to be operating large unmanned and potentially armed submarines in the world’s oceans, aimed at enemy forces in disputed areas such as the South China Sea. Such vessels could potentially travel vast distances and remain concealed for long periods of time — China says a prototype drone “underwater glider” completed a record 141-day, 3,619km voyage last month.
For now, Chinese researchers say any decision for such vessels to conduct attacks would still be made by human commanders — but that might not always remain the case.
In January last year, the Pentagon reported Russia was building and looking to operate its own large nuclear-powered unmanned submarines, likely capable of carrying nuclear weapons.
Both Moscow and Beijing are also prioritizing unmanned robot tanks, with Russia testing its latest version on the ground in Syria. Such systems could dramatically complicate battlefield targeting decisions for Western commanders in any conflict, making it unclear whether individual vehicles or vessels contained human beings. Mistakes could start or dramatically escalate wars.
In recruiting their 31 teenagers for the Beijing Institute of Technology, those managing selection reportedly looked for “willingness to fight.” With technology this untested — and so potentially destructive — that may prove a very dangerous trait to prioritize.
Peter Apps is Reuters global affairs columnist. Since 2016, he has been a member of the British Army Reserve and the UK Labour Party. The opinions expressed here are his own.
Could Asia be on the verge of a new wave of nuclear proliferation? A look back at the early history of the North Atlantic Treaty Organization (NATO), which recently celebrated its 75th anniversary, illuminates some reasons for concern in the Indo-Pacific today. US Secretary of Defense Lloyd Austin recently described NATO as “the most powerful and successful alliance in history,” but the organization’s early years were not without challenges. At its inception, the signing of the North Atlantic Treaty marked a sea change in American strategic thinking. The United States had been intent on withdrawing from Europe in the years following
My wife and I spent the week in the interior of Taiwan where Shuyuan spent her childhood. In that town there is a street that functions as an open farmer’s market. Walk along that street, as Shuyuan did yesterday, and it is next to impossible to come home empty-handed. Some mangoes that looked vaguely like others we had seen around here ended up on our table. Shuyuan told how she had bought them from a little old farmer woman from the countryside who said the mangoes were from a very old tree she had on her property. The big surprise
The issue of China’s overcapacity has drawn greater global attention recently, with US Secretary of the Treasury Janet Yellen urging Beijing to address its excess production in key industries during her visit to China last week. Meanwhile in Brussels, European Commission President Ursula von der Leyen last week said that Europe must have a tough talk with China on its perceived overcapacity and unfair trade practices. The remarks by Yellen and Von der Leyen come as China’s economy is undergoing a painful transition. Beijing is trying to steer the world’s second-largest economy out of a COVID-19 slump, the property crisis and
As former president Ma Ying-jeou (馬英九) wrapped up his visit to the People’s Republic of China, he received his share of attention. Certainly, the trip must be seen within the full context of Ma’s life, that is, his eight-year presidency, the Sunflower movement and his failed Economic Cooperation Framework Agreement, as well as his eight years as Taipei mayor with its posturing, accusations of money laundering, and ups and downs. Through all that, basic questions stand out: “What drives Ma? What is his end game?” Having observed and commented on Ma for decades, it is all ironically reminiscent of former US president Harry