Doubt Raised on Credibility of Medical Research, Billions Wasted on Flawed Research

Scientific studies are considered valid only if they can be reproduced by outside teams of researchers who come to the same conclusions using independent methods. Two studies have observed major flaws with a large number of research papers in the biomedical sciences, a problem that authors say wastes billions and slows the pace of life-saving research. One of the studies in the PLOS Biology analyzed a random sample of 441 biomedical journal articles published in the last 15 years, and found that only one included a full protocol of the information necessary for evaluating and replicating the research. Furthermore, most of the studies did not say where their funding came from, and did not establish whether there were any conflicts of interest.

"We hope our survey will further sensitize scientists, funders, journals and other science-related stakeholders about the need to improve these indicators," wrote the study authors, who included prominent scientist John Ioannidis from the Meta-Research Innovation Center at Stanford University and Shareen Iqbal from Emory University.

A separate study by researchers in Germany examined hundreds of published experiments on stroke and cancer research and found that most did not contain sufficient information about how many animals were used.

In many papers, the number of animals used over the course of the study 'vanished', making any conclusions far less reliable.

"The study began with an attempt to look at the robustness of findings in a handful of preclinical papers. But the sheer number of missing animals stopped us in our tracks," said first author Constance Holman, a researcher at Charite Universitatsmedizin.

When human subjects are part of a clinical trial, information about how many took part is considered crucial to the findings, and would not be left out of the published study, the authors said.

An accompanying editorial in PLOS Biology noted that a 'credibility crisis' is ravaging scientific research.

For instance, a recent attempt to replicate 100 psychology studies found that only 39% could in fact be reproduced.

"With our new section on data-driven meta-research, we aim to highlight that research about research is an important area of science. By creating a prominent forum in this field, PLOS Biology will contribute to ongoing efforts to improve research standards in the biological sciences and beyond," wrote editor Stavroula Kousta.

Source-AFP