Getting stuff right is normally regarded as science’s central aim, but a new analysis has raised the existential specter that universities, laboratory chiefs and academic journals are contributing to the “natural selection of bad science.”
To thrive in the cutthroat world of academia, scientists are incentivized to publish surprising findings frequently, the study suggests — despite the risk that such findings are “most likely to be wrong.”
“As long as the incentives are in place that reward publishing novel, surprising results, often and in high-visibility journals above other, more nuanced aspects of science, shoddy practices that maximize one’s ability to do so will run rampant,” said Paul Smaldino, a cognitive scientist who led the work at the University of California, Merced.
The paper comes as psychologists and biomedical scientists are grappling with an apparent replication crisis, in which many high-profile results have been shown to be unreliable.
Observations that striking a power pose will make you feel bolder, smiling makes you feel happy or that placing a pair of “big brother” eyes on the wall will protect against theft have all failed to stand up to replication.
Sociology, economics, climate science and ecology are other areas likely to be vulnerable to the propagation of bad practice, Smaldino said.
“My impression is that, to some extent, the combination of studying very complex systems with a dearth of formal mathematical theory creates good conditions for low reproducibility,” he said. “This doesn’t require anyone to actively game the system or violate any ethical standards. Competition for limited resources — in this case jobs and funding — will do all the work.”
Drawing parallels with Charles Darwin’s classic theory of evolution, Smaldino claims that various forms of bad scientific practice flourish in the academic world, much like hardy germs that thwart extermination in real life.
One scientific “germ” identified in the paper is the problem of “low statistical power.”
Typically this refers to findings in human behavior, health or psychology based on data from too small a sample of people to be able to draw any statistically sound conclusions.
Despite red flags being consistently raised on the issue in the scientific community, the latest analysis, published in the journal Royal Society Open Science, shows that sample sizes in studies have not increased during the past 50 years.
Another problem is the publication of “false positive” results, where random noise in the data appears to be a real phenomenon of interest. Since the failure to reproduce a result rarely makes a real dent in a laboratory’s prestige, the reliability of results is only “weakly selected for,” the study suggests.
Smaldino cites an experiment by US psychologist Daryl Bem, who purported to show that undergraduates could predict the future and published the result in a prestigious journal.
“What he found was the equivalent of flipping a bunch of pennies, nickels and quarters, asking students to guess heads or tails each time, and then reporting that psychic abilities exist for pennies, but not nickels and quarters, because the students were right 53 percent of the time for the pennies, rather than the expected 50 percent. It’s insane,” Smaldino said. “Bem used exactly the same standards of evidence that all social psychologists were using to evaluate their findings and if those standards allowed this ridiculous a hypothesis to make the cut, imagine what else was getting through.”
Akin to the survival of the fittest model in nature, Smaldino argues that laboratory chiefs who publish most frequently in high-profile journals will attract more funding and produce more “progeny” (graduate students), who will eventually run labs of their own, potentially taking bad scientific habits with them.
Vince Walsh, a professor of neuroscience at University College London, said he was not convinced of the existence of a replication crisis, but that the paper raised valid concerns about the culture of science.
“I agree that the pressure to publish is corrosive and anti-intellectual. Scientists are just humans and if organizations are dumb enough to rate them on sales figures, they will do discounts to reach the targets, just like any other salesperson,” Walsh said.
“The more people who are aware of the problems in science, and who are committed to improving its institutions, the sooner and more easily institutional change will come,” Smaldino said.
In the event of a war with China, Taiwan has some surprisingly tough defenses that could make it as difficult to tackle as a porcupine: A shoreline dotted with swamps, rocks and concrete barriers; conscription for all adult men; highways and airports that are built to double as hardened combat facilities. This porcupine has a soft underbelly, though, and the war in Iran is exposing it: energy. About 39,000 ships dock at Taiwan’s ports each year, more than the 30,000 that transit the Strait of Hormuz. About one-fifth of their inbound tonnage is coal, oil, refined fuels and liquefied natural gas (LNG),
On Monday, the day before Chinese Nationalist Party (KMT) Chairwoman Cheng Li-wun (鄭麗文) departed on her visit to China, the party released a promotional video titled “Only with peace can we ‘lie flat’” to highlight its desire to have peace across the Taiwan Strait. However, its use of the expression “lie flat” (tang ping, 躺平) drew sarcastic comments, with critics saying it sounded as if the party was “bowing down” to the Chinese Communist Party (CCP). Amid the controversy over the opposition parties blocking proposed defense budgets, Cheng departed for China after receiving an invitation from the CCP, with a meeting with
Chinese Nationalist Party (KMT) Chairwoman Cheng Li-wun (鄭麗文) is leading a delegation to China through Sunday. She is expected to meet with Chinese President Xi Jinping (習近平) in Beijing tomorrow. That date coincides with the anniversary of the signing of the Taiwan Relations Act (TRA), which marked a cornerstone of Taiwan-US relations. Staging their meeting on this date makes it clear that the Chinese Communist Party (CCP) intends to challenge the US and demonstrate its “authority” over Taiwan. Since the US severed official diplomatic relations with Taiwan in 1979, it has relied on the TRA as a legal basis for all
To counter the CCP’s escalating threats, Taiwan must build a national consensus and demonstrate the capability and the will to fight. The Chinese Communist Party (CCP) often leans on a seductive mantra to soften its threats, such as “Chinese do not kill Chinese.” The slogan is designed to frame territorial conquest (annexation) as a domestic family matter. A look at the historical ledger reveals a different truth. For the CCP, being labeled “family” has never been a guarantee of safety; it has been the primary prerequisite for state-sanctioned slaughter. From the forced starvation of 150,000 civilians at the Siege of Changchun
RSS