What jumps to mind when you think about the impending AI apocalypse? If you’re partial to sci-fi movie cliches, you may envisage killer robots (with or without thick Austrian accents) rising up to terminate their hubristic creators. Or perhaps, a la The Matrix, you’ll go for scary machines sucking energy out of our bodies as they distract us with a simulated reality.
For Yuval Noah Harari, who has spent a lot of time worrying about AI over the past decade, the threat is less fantastical and more insidious.
“In order to manipulate humans, there is no need to physically hook brains to computers,” he writes in his engrossing new book Nexus. “For thousands of years prophets, poets and politicians have used language to manipulate and reshape society. Now computers are learning how to do it. And they won’t need to send killer robots to shoot us. They could manipulate human beings to pull the trigger.”
Language — and the human ability to spin it into vast, globe-encircling yarns — is fundamental to how the Israeli historian, now on his fourth popular science book, understands our species and its vulnerabilities. In his 2014 mega-hit Sapiens (originally published in Hebrew in 2011), he argued that humans became dominant because they learned to cooperate in large numbers, thanks to a newfound aptitude for telling stories. That aptitude, which enabled our ancestors to believe in completely imaginary things, lies at the root of our religions, economies and nations, all of which would dissolve if our narrative-spinning faculties were somehow switched off.
Sapiens has sold 25 million copies to date — a testament to Harari’s own storytelling prowess — though it’s had its share of detractors. Academics questioned its accuracy and the idea of cramming 70,000 years of human history into 450 pages. Sitcoms poked fun at Harari superfans who wave the book around like a modern-day bible. The appeal of Sapiens lies in its dizzying scope but, as a 2020 New Yorker profile pointed out, Harari’s zoomed-out approach can have the effect of minimizing the importance of current affairs.
Nexus could be seen as a rebuke to that criticism. Though it executes its own breakneck dash through the millennia, hopping back and forth in time and between continents, it is very much concerned about what’s happening today.
If stories were fundamental to the schema of Sapiens, here it’s all about information networks, which Harari views as the basic structures undergirding our societies.
“Power always stems from cooperation between large numbers of humans,” he writes, and the “glue” that holds these networks of cooperation together is information, which “many philosophers and biologists” see as “the most basic building block of reality.”
But information doesn’t reliably tell the truth about the world. More often, Harari emphasizes, it gives rise to fictions, fantasies and mass delusions, which lead to such catastrophic developments as nazism and Stalinism. Why is Homo sapiens, for all its evolutionary successes, so perennially self-destructive? “The fault,” according to Harari, “isn’t with our nature but with our information networks.”
Casting his eye over how information has led us astray in the past, Harari has no shortage of examples to draw on. One of the more gorily memorable is Malleus Maleficarum, written by the Dominican friar Heinrich Kramer in 1480s Austria. A guide to exposing and murdering witches in deliriously horrible ways, the book wouldn’t have traveled far had the printing press not been invented a few decades earlier, allowing Kramer’s deranged ideas to spread across Europe, stoking a witch-hunting frenzy.
Harari’s basic point is that information revolutions can give rise to periods of human flourishing but always come at a cost. When we invent shiny new technologies that carry words and ideas farther and faster than ever before, much of the information that spews out is dross or actively dangerous. It’s not helped by the fact that, when it comes to maintaining social order, fictions tend to be more reliable binding agents than truths.
What’s scary about the AI revolution isn’t just that we’ll be overwhelmed with misinformation from chatbots, or that the powers that be will use it to crunch data on our private lives. Unlike previous technologies such as books and radios, writes Harari: “AI is the first tool that is capable of making decisions and generating ideas by itself.” We saw an early warning of this in Myanmar in 2016-17, when Facebook algorithms, tasked with maximizing user engagement, responded by promoting hateful anti-Rohingya propaganda that fueled mass murder and ethnic cleansing.
Harari makes a strong case for why we should regard such algorithms as autonomous agents and how, if we’re not careful, humans could become tools for AI to manipulate with ever more terrible force. Unless we take immediate action, this burgeoning “alien intelligence,” as he prefers to call it, could trigger catastrophes we can’t even imagine, up to and including the destruction of human civilization.
This pessimistic take on AI is nothing new: “doomers” such as Eliezer Yudkowsky have been warning of its apocalyptic potential for years and even the AI industry has started voicing concerns. What Harari seeks to add to the debate is the long view. By applying his lens to previous information revolutions and showing how different forms of government have reacted to them, he believes we can prepare ourselves for the earthquakes to come.
Nexus has some curious blind spots; it’s odd, in a critique of a technology driven largely by profit-seeking corporations, that capitalism is hardly mentioned at all. But whether or not you agree with Harari’s historical framing of AI, it’s hard not to be impressed by the meticulous way he builds it up, speckling what could be a rather dry analysis with vivid examples, such as the story of Cher Ami, a first world war messenger pigeon, used here to tease out information’s fundamental slipperiness. As in previous books, he relies heavily on lists (“the two main challenges,” “the five basic principles”) and binaries (truth versus order, democracy versus dictatorship), but this serves to organize his thinking rather than dull the writing.
The solutions he proposes to restrict AI’s power range from the sensible (ban bots from impersonating humans) to the laughable (encourage artists and bureaucrats to “cooperate” to help the rest of us understand the computer network), but Nexus operates primarily as a diagnosis and a call to action, and on those terms it’s broadly successful. If it sells anywhere near as well as Sapiens did, we’ll be that bit better equipped as a species to deal with the rise of the machines.
Behind a car repair business on a nondescript Thai street are the cherished pets of a rising TikTok animal influencer: two lions and a 200-kilogram lion-tiger hybrid called “Big George.” Lion ownership is legal in Thailand, and Tharnuwarht Plengkemratch is an enthusiastic advocate, posting updates on his feline companions to nearly three million followers. “They’re playful and affectionate, just like dogs or cats,” he said from inside their cage complex at his home in the northern city of Chiang Mai. Thailand’s captive lion population has exploded in recent years, with nearly 500 registered in zoos, breeding farms, petting cafes and homes. Experts warn the
The unexpected collapse of the recall campaigns is being viewed through many lenses, most of them skewed and self-absorbed. The international media unsurprisingly focuses on what they perceive as the message that Taiwanese voters were sending in the failure of the mass recall, especially to China, the US and to friendly Western nations. This made some sense prior to early last month. One of the main arguments used by recall campaigners for recalling Chinese Nationalist Party (KMT) lawmakers was that they were too pro-China, and by extension not to be trusted with defending the nation. Also by extension, that argument could be
Aug. 4 to Aug. 10 When Coca-Cola finally pushed its way into Taiwan’s market in 1968, it allegedly vowed to wipe out its major domestic rival Hey Song within five years. But Hey Song, which began as a manual operation in a family cow shed in 1925, had proven its resilience, surviving numerous setbacks — including the loss of autonomy and nearly all its assets due to the Japanese colonial government’s wartime economic policy. By the 1960s, Hey Song had risen to the top of Taiwan’s beverage industry. This success was driven not only by president Chang Wen-chi’s
Last week, on the heels of the recall election that turned out so badly for Taiwan, came the news that US President Donald Trump had blocked the transit of President William Lai (賴清德) through the US on his way to Latin America. A few days later the international media reported that in June a scheduled visit by Minister of National Defense Wellington Koo (顧立雄) for high level meetings was canceled by the US after China’s President Xi Jinping (習近平) asked Trump to curb US engagement with Taiwan during a June phone call. The cancellation of Lai’s transit was a gaudy
RSS