Neuroscientists have long been banging their heads on their desks over exaggerated reports of brain scanning studies. Media stories illustrated with colored scans, supposedly showing how the brain works, are now a standard part of the science pages and some people find them so convincing that they are touted as ways of designing education for our children, evaluating the effectiveness of marketing campaigns and testing potential recruits. Recently, to the chagrin of French scientists, politicians called for neuro-imaging to be used in the courts to decide on the guilt of criminals, after the technology made its dubious debut in the legal systems of India, Italy and the US.
This misplaced enthusiasm often stems from a misunderstanding about what brain scans tell us. The interpretation seems straightforward according to the popular press — the colored blobs represent a “pleasure center,” an “art center” or perhaps a “love center” — but none of this is true.
All of our experiences and abilities rely on a distributed brain network and nothing relies on a single “center.” More than anything, the conclusions depend on the tasks volunteers undertake in the scanner and what each study tells us is limited. This small print has been repeated many times over by scientists. They bemoan how people misunderstand the subtleties and draw unwarranted conclusions. But now neuroscientists have had to come to terms with the fact that many of the methods on which brain scan studies are based have been flawed.
Photo: Bloomberg
To understand where these flaws come from it’s important to know something about how data from the most common technique, functional Magnetic Resonance Imaging or fMRI, is analyzed. The scanner creates a 3D map of the brain split up into tens of thousands of tiny blocks called voxels (like pixels but for volume) and each has a value that describes blood flow — used as a proxy for brain activity as more active areas need more oxygen. What you want to know is which bits of the brain are more active in certain tasks. Of course, the brain is changing all the time so scientists use statistics to check that changes in blood flow are due to the experimental tasks and not because of unrelated brain changes. The statistical problem is huge, however, as each scan has about 50,000 data points and thousands of scans are made in a single study.
When we’re talking about millions of comparisons, a big problem is false positives. Imagine you are playing two roulette wheels. Clearly, the result of one doesn’t affect the outcome of the other but sometimes they’ll both come up with the same number just because of chance. Now imagine you have a roulette wheel for every point or voxel in the brain. A comparison of any two scans could look like some areas show linked activity when really there is no relationship. Ideally, the analysis should separate roulette wheels from genuine activity, but you may be surprised that hundreds if not thousands of studies have been conducted without such corrections. To illustrate the problem, Craig Bennett and his colleagues at the University of California did a spoof experiment on a dead salmon. The standard techniques showed “brain activity” in the deceased fish.
Further illustrating the issue, Edward Vul and Hal Pashler from the University of California showed that some researchers were producing conclusions by first picking out the best results and then seeing if there was a relationship between them. To return to our roulette analogy, it would be like discarding any results that weren’t in the range of numbers one to five and then using only these selected results to see if any of the same numbers came up, something that is suddenly much more likely. A recent study by Anders Eklund and colleagues from Linkoping University in Sweden found that they could find spurious “brain activity” related to non-existent tasks with standard settings on the most popular fMRI analysis software.
Recent advances have tried to control these problems but researchers have become much more cautious. “Our default attitude to any new and interesting fMRI finding should be skepticism,” says Tal Yarkoni, a neuroscientist at the University of Colorado. “What’s particularly problematic,” he says, “is the amount of flexibility researchers have when performing their analyses ... you have no idea how many things the researchers tried before they got something to work.” Psychologist Russ Poldrack, from the University of Texas, who has been at the forefront of correcting these issues, also highlights cultural issues. This flexible approach “also includes methods that are known by experts to be invalid, but unfortunately these still get into top journals, which only helps perpetuate them.” Yarkoni explains that “researchers have a big incentive to come up with exciting new findings,” meaning scientists are motivated to “torture” the data and journals are attracted by the media-friendly results.
In this light of this, stories about the discovery of “brain centers” fall flat and efforts to base public policy on brain scans become nothing short of ridiculous. But perhaps the most important problem is not that brain scans can be misleading, but that they are beautiful. Like all other neuroscientists, I find them beguiling. They have us enchanted and we are far from breaking their spell.
Vaughan Bell is visiting senior research fellow at the Institute of Psychiatry, King’s College London
In the mainstream view, the Philippines should be worried that a conflict over Taiwan between the superpowers will drag in Manila. President Ferdinand Marcos Jr observed in an interview in The Wall Street Journal last year, “I learned an African saying: When elephants fight, the only one that loses is the grass. We are the grass in this situation. We don’t want to get trampled.” Such sentiments are widespread. Few seem to have imagined the opposite: that a gray zone incursion of People’s Republic of China (PRC) ships into the Philippines’ waters could trigger a conflict that drags in Taiwan. Fewer
March 18 to March 24 Yasushi Noro knew that it was not the right time to scale Hehuan Mountain (合歡). It was March 1913 and the weather was still bitingly cold at high altitudes. But he knew he couldn’t afford to wait, either. Launched in 1910, the Japanese colonial government’s “five year plan to govern the savages” was going well. After numerous bloody battles, they had subdued almost all of the indigenous peoples in northeastern Taiwan, save for the Truku who held strong to their territory around the Liwu River (立霧溪) and Mugua River (木瓜溪) basins in today’s Hualien County (花蓮). The Japanese
Pei-Ru Ko (柯沛如) says her Taipei upbringing was a little different from her peers. “We lived near the National Palace Museum [north of Taipei] and our neighbors had rice paddies. They were growing food right next to us. There was a mountain and a river so people would say, ‘you live in the mountains,’ and my friends wouldn’t want to come and visit.” While her school friends remained a bus ride away, Ko’s semi-rural upbringing schooled her in other things, including where food comes from. “Most people living in Taipei wouldn’t have a neighbor that was growing food,” she says. “So
Whether you’re interested in the history of ceramics, the production process itself, creating your own pottery, shopping for ceramic vessels, or simply admiring beautiful handmade items, the Zhunan Snake Kiln (竹南蛇窯) in Jhunan Township (竹南), Miaoli County, is definitely worth a visit. For centuries, kiln products were an integral part of daily life in Taiwan: bricks for walls, tiles for roofs, pottery for the kitchen, jugs for fermenting alcoholic drinks, as well as decorative elements on temples, all came from kilns, and Miaoli was a major hub for the production of these items. The Zhunan Snake Kiln has a large area dedicated