What jumps to mind when you think about the impending AI apocalypse? If you’re partial to sci-fi movie cliches, you may envisage killer robots (with or without thick Austrian accents) rising up to terminate their hubristic creators. Or perhaps, a la The Matrix, you’ll go for scary machines sucking energy out of our bodies as they distract us with a simulated reality.
For Yuval Noah Harari, who has spent a lot of time worrying about AI over the past decade, the threat is less fantastical and more insidious.
“In order to manipulate humans, there is no need to physically hook brains to computers,” he writes in his engrossing new book Nexus. “For thousands of years prophets, poets and politicians have used language to manipulate and reshape society. Now computers are learning how to do it. And they won’t need to send killer robots to shoot us. They could manipulate human beings to pull the trigger.”
Language — and the human ability to spin it into vast, globe-encircling yarns — is fundamental to how the Israeli historian, now on his fourth popular science book, understands our species and its vulnerabilities. In his 2014 mega-hit Sapiens (originally published in Hebrew in 2011), he argued that humans became dominant because they learned to cooperate in large numbers, thanks to a newfound aptitude for telling stories. That aptitude, which enabled our ancestors to believe in completely imaginary things, lies at the root of our religions, economies and nations, all of which would dissolve if our narrative-spinning faculties were somehow switched off.
Sapiens has sold 25 million copies to date — a testament to Harari’s own storytelling prowess — though it’s had its share of detractors. Academics questioned its accuracy and the idea of cramming 70,000 years of human history into 450 pages. Sitcoms poked fun at Harari superfans who wave the book around like a modern-day bible. The appeal of Sapiens lies in its dizzying scope but, as a 2020 New Yorker profile pointed out, Harari’s zoomed-out approach can have the effect of minimizing the importance of current affairs.
Nexus could be seen as a rebuke to that criticism. Though it executes its own breakneck dash through the millennia, hopping back and forth in time and between continents, it is very much concerned about what’s happening today.
If stories were fundamental to the schema of Sapiens, here it’s all about information networks, which Harari views as the basic structures undergirding our societies.
“Power always stems from cooperation between large numbers of humans,” he writes, and the “glue” that holds these networks of cooperation together is information, which “many philosophers and biologists” see as “the most basic building block of reality.”
But information doesn’t reliably tell the truth about the world. More often, Harari emphasizes, it gives rise to fictions, fantasies and mass delusions, which lead to such catastrophic developments as nazism and Stalinism. Why is Homo sapiens, for all its evolutionary successes, so perennially self-destructive? “The fault,” according to Harari, “isn’t with our nature but with our information networks.”
Casting his eye over how information has led us astray in the past, Harari has no shortage of examples to draw on. One of the more gorily memorable is Malleus Maleficarum, written by the Dominican friar Heinrich Kramer in 1480s Austria. A guide to exposing and murdering witches in deliriously horrible ways, the book wouldn’t have traveled far had the printing press not been invented a few decades earlier, allowing Kramer’s deranged ideas to spread across Europe, stoking a witch-hunting frenzy.
Harari’s basic point is that information revolutions can give rise to periods of human flourishing but always come at a cost. When we invent shiny new technologies that carry words and ideas farther and faster than ever before, much of the information that spews out is dross or actively dangerous. It’s not helped by the fact that, when it comes to maintaining social order, fictions tend to be more reliable binding agents than truths.
What’s scary about the AI revolution isn’t just that we’ll be overwhelmed with misinformation from chatbots, or that the powers that be will use it to crunch data on our private lives. Unlike previous technologies such as books and radios, writes Harari: “AI is the first tool that is capable of making decisions and generating ideas by itself.” We saw an early warning of this in Myanmar in 2016-17, when Facebook algorithms, tasked with maximizing user engagement, responded by promoting hateful anti-Rohingya propaganda that fueled mass murder and ethnic cleansing.
Harari makes a strong case for why we should regard such algorithms as autonomous agents and how, if we’re not careful, humans could become tools for AI to manipulate with ever more terrible force. Unless we take immediate action, this burgeoning “alien intelligence,” as he prefers to call it, could trigger catastrophes we can’t even imagine, up to and including the destruction of human civilization.
This pessimistic take on AI is nothing new: “doomers” such as Eliezer Yudkowsky have been warning of its apocalyptic potential for years and even the AI industry has started voicing concerns. What Harari seeks to add to the debate is the long view. By applying his lens to previous information revolutions and showing how different forms of government have reacted to them, he believes we can prepare ourselves for the earthquakes to come.
Nexus has some curious blind spots; it’s odd, in a critique of a technology driven largely by profit-seeking corporations, that capitalism is hardly mentioned at all. But whether or not you agree with Harari’s historical framing of AI, it’s hard not to be impressed by the meticulous way he builds it up, speckling what could be a rather dry analysis with vivid examples, such as the story of Cher Ami, a first world war messenger pigeon, used here to tease out information’s fundamental slipperiness. As in previous books, he relies heavily on lists (“the two main challenges,” “the five basic principles”) and binaries (truth versus order, democracy versus dictatorship), but this serves to organize his thinking rather than dull the writing.
The solutions he proposes to restrict AI’s power range from the sensible (ban bots from impersonating humans) to the laughable (encourage artists and bureaucrats to “cooperate” to help the rest of us understand the computer network), but Nexus operates primarily as a diagnosis and a call to action, and on those terms it’s broadly successful. If it sells anywhere near as well as Sapiens did, we’ll be that bit better equipped as a species to deal with the rise of the machines.
Oct. 14 to Oct. 20 After working above ground for two years, Chang Kui (張桂) entered the Yamamoto coal mine for the first time, age 16. It was 1943, and because many men had joined the war effort, an increasing number of women went underground to take over the physically grueling and dangerous work. “As soon as the carts arrived, I climbed on for the sake of earning money; I didn’t even feel scared,” Chang tells her granddaughter Tai Po-fen (戴伯芬) in The last female miner: The story of Chang Kui (末代女礦工: 張桂故事), which can be found on the Frontline
There is perhaps no better way to soak up the last of Taipei’s balmy evenings than dining al fresco at La Piada with a sundowner Aperol Spritz and a luxuriant plate of charcuterie. La Piada (義式薄餅) is the brainchild of Milano native William Di Nardo. Tucked into an unassuming apartment complex, fairy lights and wining diners lead the way to this charming slice of laid-back Mediterranean deli culture. Taipei is entirely saturated with Italian cuisine, but La Piada offers something otherwise unseen on the island. Piadina Romagnola: a northern Italian street food classic. These handheld flatbreads are stuffed with cold
President William Lai’s (賴清德) National Day speech was exactly what most of us expected. It was pleasant, full of keywords like “resilience” and “net zero” and lacked any trolling of the People’s Republic of China (PRC). Of course the word “Taiwan” popped up often, and Lai reiterated the longtime claim of his Democratic Progressive Party (DPP), a claim that now dates back 30 years on the pro-Taiwan side. But it was gentle. Indeed, it was possible to see the speech as conciliatory, leaving room for the PRC to make a gesture. That may have been one of its purposes: if
In the tourism desert that is most of Changhua County, at least one place stands out as a remarkable exception: one of Taiwan’s earliest Han Chinese settlements, Lukang. Packed with temples and restored buildings showcasing different eras in Taiwan’s settlement history, the downtown area is best explored on foot. As you make your way through winding narrow alleys where even Taiwanese scooters seldom pass, you are sure to come across surprise after surprise. The old Taisugar railway station is a good jumping-off point for a walking tour of downtown Lukang. Though the interior is not open to the public, the exterior
RSS