The primate fascination with novelty. Worse than cats and curiosity. ;)
I don't doubt that some of the articles I've posted here describe studies whose results have not been replicated.
"The 'Replication Crisis' Could Be Worse Than We Thought, New Analysis Reveals" |
Science Alert (https://www.sciencealert.com/non-replicable-studies-make-the-most-impact-scientists-find)
QuoteThe science replication crisis (https://en.wikipedia.org/wiki/Replication_crisis) might be worse than we thought: new research reveals that studies with replicated results tend to be cited less often than studies which have failed to replicate.
That's not to say that these more widely cited studies with unreplicated experiments are necessarily wrong or misleading - but it does mean that, for one reason or another, follow-up research has failed to deliver the same result as the original study, yet it still gets loads of citations.
Thus, based on the new analysis, research that is more interesting and different appears to garner more citations than research with a lot of corroborating evidence.
Behavioral economists Marta Serra-Garcia and Uri Gneezy from the University of California analyzed papers in some of the top psychology, economy, and science journals; they found that studies that failed to replicate since their publication were on average 153 times more likely to be cited than studies that had – and that the influence of these papers is growing over time.
[Continues . . . (https://www.sciencealert.com/non-replicable-studies-make-the-most-impact-scientists-find)]
The paper is open access:
"Nonreplicable publications are cited more than replicable ones" |
Science Advances (https://advances.sciencemag.org/content/7/21/eabd1705)
QuoteAbstract:
We use publicly available data to show that published papers in top psychology, economics, and general interest journals that fail to replicate are cited more than those that replicate. This difference in citation does not change after the publication of the failure to replicate. Only 12% of postreplication citations of nonreplicable findings acknowledge the replication failure.
Existing evidence also shows that experts predict well which papers will be replicated. Given this prediction, why are nonreplicable papers accepted for publication in the first place? A possible answer is that the review team faces a trade-off. When the results are more "interesting," they apply lower standards regarding their reproducibility.
Interesting.
That's bad.
The lab I'm in is part of a national effort to replicate some of the country's biomedical/neuroscience studies. So far we haven't been able to start because of the pandemic but should do so soon. It should be interesting to see the results.
Replicability and reproducibility are major problems.
I read that over at Phys.org the other day. Crazy business that the unreplicatable sometimes propagates more.
The credentials of the numerous inputs should be evaluated. If for example, Richard Fynemann (sp) had claimed something that was in opposition to the several others, then I would need to consider the other sources with care. All the while it is possible, though rarely so, that Richard was mistaken.