News:

Departing the Vacuousness

Main Menu

On the 'Replication Crisis' in Science Publishing

Started by Recusant, May 25, 2021, 07:48:57 AM

Previous topic - Next topic

Recusant

The primate fascination with novelty. Worse than cats and curiosity.  ;)

I don't doubt that some of the articles I've posted here describe studies whose results have not been replicated.

"The 'Replication Crisis' Could Be Worse Than We Thought, New Analysis Reveals" | Science Alert

QuoteThe science replication crisis might be worse than we thought: new research reveals that studies with replicated results tend to be cited less often than studies which have failed to replicate.

That's not to say that these more widely cited studies with unreplicated experiments are necessarily wrong or misleading - but it does mean that, for one reason or another, follow-up research has failed to deliver the same result as the original study, yet it still gets loads of citations.

Thus, based on the new analysis, research that is more interesting and different appears to garner more citations than research with a lot of corroborating evidence.

Behavioral economists Marta Serra-Garcia and Uri Gneezy from the University of California analyzed papers in some of the top psychology, economy, and science journals; they found that studies that failed to replicate since their publication were on average 153 times more likely to be cited than studies that had – and that the influence of these papers is growing over time.

[Continues . . .]

The paper is open access:

"Nonreplicable publications are cited more than replicable ones" | Science Advances

QuoteAbstract:

We use publicly available data to show that published papers in top psychology, economics, and general interest journals that fail to replicate are cited more than those that replicate. This difference in citation does not change after the publication of the failure to replicate. Only 12% of postreplication citations of nonreplicable findings acknowledge the replication failure.

Existing evidence also shows that experts predict well which papers will be replicated. Given this prediction, why are nonreplicable papers accepted for publication in the first place? A possible answer is that the review team faces a trade-off. When the results are more "interesting," they apply lower standards regarding their reproducibility.
"Religion is fundamentally opposed to everything I hold in veneration — courage, clear thinking, honesty, fairness, and above all, love of the truth."
— H. L. Mencken


Tank

If religions were TV channels atheism is turning the TV off.
"Religion is a culture of faith; science is a culture of doubt." ― Richard P. Feynman
'It is said that your life flashes before your eyes just before you die. That is true, it's called Life.' - Terry Pratchett
Remember, your inability to grasp science is not a valid argument against it.

xSilverPhinx

That's bad.

The lab I'm in is part of a national effort to replicate some of the country's biomedical/neuroscience studies. So far we haven't been able to start because of the pandemic but should do so soon. It should be interesting to see the results.

Replicability and reproducibility are major problems.   
I am what survives if it's slain - Zack Hemsey


Dark Lightning

I read that over at Phys.org the other day. Crazy business that the unreplicatable sometimes propagates more.

Icarus

The credentials of the numerous inputs should be evaluated.  If for example, Richard Fynemann (sp) had claimed something that was in opposition to the several others, then I would need to consider the other sources with care. All the while it is possible, though rarely so, that Richard was mistaken.