Studies of the role of intelligence operations inevitably have a Rashomon-like quality, with the same events yielding various, sometimes contradictory, interpretations. The world of intelligence, after all, is one of secrets, special-access compartments, covert action, clandestine relationships and occasionally off-the-books escapades. This makes it very difficult to assess successes and failures, and to chronicle the role of intelligence in political leaders’ decisions.
Harvard historian Calder Walton confronts this challenge head on in a new book, Spies: The Epic Intelligence War Between East and West, which recounts the rise and role of modern intelligence capabilities through the history of the West’s competition with the Russian security services. It is an ambitious and entertaining story, but one that is also firmly grounded in academic research.
Walton’s account sheds new light on seemingly well-studied events, from the Bolshevik Revolution and World War II to the deployment of moles in the ranks of US, British, and Russian intelligence services at the end of the century.
Illustration: Tania Chou
Walton draws on newly opened archives, formerly classified in-house histories, memoirs, and interviews with policymakers and spies. He illuminates how intelligence contributed to episodes like the 1962 Cuban Missile Crisis and the 1983 Able Archer incident, when a NATO drill triggered Soviet fears of a Western first strike, bringing the world to the brink of nuclear war.
However, Walton does more than add previously secret details to old accounts. In an example of “applied history,” he uses his examination of the past to weigh in on current events, such as the Ukraine war, and raise important questions about the future, including whether Western intelligence can prevail against China in the new cold war.
Spies details the rise and role of Russia’s intelligence services, from Vladimir Lenin’s Cheka to Joseph Stalin’s KGB to their post-Soviet incarnations. It offers new insights into their domestic and international missions, from the murderous role of the People’s Commissariat for Internal Affairs (NKVD), the KGB’s predecessor, in Stalin’s Great Purge to the penetration of the Manhattan Project by Soviet spies gathering secrets vital to Moscow’s nuclear breakthrough. It describes how the SVR and the FSB, the KGB’s successors, still use a Soviet-era playbook to guide their espionage, disinformation, and covert action abroad and repression at home.
Thanks to Russian President Vladimir Putin — a former KGB man himself — KGB alumni dominate the Russian elite, including its corrupt economic oligarchy, and lead the powerful coercive institutions that are transforming Russia into an authoritarian security state. Whatever their labels, Russia’s security services have formed the backbone of its ruling regimes in the 20th and 21st centuries.
However, as Walton demonstrates, Russia’s intelligence services have always had significant deficiencies, rooted not least in a totalitarian culture that has made it impossible to speak truth to power. From the deadly purges that reached deep into the NKVD in the 1930s to the top-down decisionmaking in Putin’s Kremlin, the message to the rank and file has remained simple: Say what your leader wants to hear, because unvarnished reporting and analysis can have deadly — not just career-ending — consequences.
The crippling conformity that characterized Soviet intelligence assessments meant that they played at most a marginal role in the Kremlin’s Cold War decisionmaking, Walton says.
The disconnect between approved narratives and reality has also led to signature strategic failures, such as Stalin’s rejection of intelligence warning of Hitler’s impending invasion in 1941 and Putin’s disastrous decision to invade Ukraine last year.
Walton’s historical perspective also provides a valuable framework for assessing the performance of Russia’s Western counterparts. From the outset, he argues, Western leaders only belatedly recognized the vulnerabilities of their open societies and the magnitude of the threat posed by Soviet intelligence.
In fact, US intelligence got off to a rocky start. When the CIA was created in 1947, then-chairman of the US Joint Chiefs of Staff Omar Bradley was angry that he was not put in charge. So, he teamed up with then-FBI Director J. Edgar Hoover, himself no fan of the intelligence start-up, to keep the CIA’s director at the time, Roscoe Hillenkoetter, in the dark. Hillenkoetter was thus not informed of the top-secret Venona project or the revelations of far-reaching Soviet spying, before, during, and after World War II, that the program’s cryptologists produced. This US intelligence “mess,” as Walton aptly calls it, lasted until 1952.
Of course, bureaucratic rivalries and political infighting continued, even as the US intelligence community matured. However, popular ambivalence has also affected the trajectory of US intelligence services, owing to disagreements about their role in a democracy, together with decades of controversy, from failed covert-action programs and proxy wars abroad to abuses of power at home.
As a changing world transforms the security landscape, national leaders would need public cooperation. However, deep polarization and growing popular distrust in government, exemplified by (but not confined to) those who believe former US president Donald Trump’s claims about the mythical “deep state,” pose significant hurdles and threaten US democracy and the country’s international role.
While Walton acknowledges this danger, he is far more concerned about the threat China poses in an increasingly technology-driven world. Here, Walton does not mince words. US leaders, he contends, have ignored China’s massive, multi-front intelligence offensive, underfunding collection and counterintelligence, and underplaying the economic, technological, and strategic challenge the country poses.
“If I were to situate where we ... are [regarding China] today,” he writes, “I would place us at approximately the year 1947.”
That said, Walton’s case for action on China lacks the depth of analysis that buttresses his judgements about Russia. His recommendations for future intelligence efforts — based on “lessons” from the past 100 years — are thought-provoking, though less than persuasive.
“The age of the secret service is over,” he writes in his conclusion. “In a world that will be increasingly dominated by open-source information, the future of intelligence lies in the private sector, not with governments.”
Maybe so, but Walton’s faith in technology as the intelligence world’s silver bullet, and in the power of persuasion to enlist corporations that demonstrate daily their reluctance to leave the Chinese market, merit skepticism.
As Walton notes, history might not repeat itself, but it does, as Mark Twain quipped, sometimes rhyme. Whether high-tech tools and open-source collection or classic espionage will deliver what countries need remains to be seen.
However, one thing is certain: In any democratic society, popular and political support for intelligence is vital. The success of any intelligence service begins at home.
Kent Harrington, a former senior CIA analyst, served as US intelligence officer for East Asia, chief of station in Asia and the CIA’s director of public affairs.
Copyright: Project Syndicate
With escalating US-China competition and mutual distrust, the trend of supply chain “friend shoring” in the wake of the COVID-19 pandemic and the fragmentation of the world into rival geopolitical blocs, many analysts and policymakers worry the world is retreating into a new cold war — a world of trade bifurcation, protectionism and deglobalization. The world is in a new cold war, said Robin Niblett, former director of the London-based think tank Chatham House. Niblett said he sees the US and China slowly reaching a modus vivendi, but it might take time. The two great powers appear to be “reversing carefully
As China steps up a campaign to diplomatically isolate and squeeze Taiwan, it has become more imperative than ever that Taipei play a greater role internationally with the support of the democratic world. To help safeguard its autonomous status, Taiwan needs to go beyond bolstering its defenses with weapons like anti-ship and anti-aircraft missiles. With the help of its international backers, it must also expand its diplomatic footprint globally. But are Taiwan’s foreign friends willing to translate their rhetoric into action by helping Taipei carve out more international space for itself? Beating back China’s effort to turn Taiwan into an international pariah
Typhoon Krathon made landfall in southwestern Taiwan last week, bringing strong winds, heavy rain and flooding, cutting power to more than 170,000 homes and water supply to more than 400,000 homes, and leading to more than 600 injuries and four deaths. Due to the typhoon, schools and offices across the nation were ordered to close for two to four days, stirring up familiar controversies over whether local governments’ decisions to call typhoon days were appropriate. The typhoon’s center made landfall in Kaohsiung’s Siaogang District (小港) at noon on Thursday, but it weakened into a tropical depression early on Friday, and its structure
Since the end of the Cold War, the US-China espionage battle has arguably become the largest on Earth. Spying on China is vital for the US, as China’s growing military and technological capabilities pose direct challenges to its interests, especially in defending Taiwan and maintaining security in the Indo-Pacific. Intelligence gathering helps the US counter Chinese aggression, stay ahead of threats and safeguard not only its own security, but also the stability of global trade routes. Unchecked Chinese expansion could destabilize the region and have far-reaching global consequences. In recent years, spying on China has become increasingly difficult for the US