4
SciPoll 640: Impact of publication bias
How do you think publication bias impacts the credibility of the published literature in your field?
Results
(203 Answers)
Answer Explanations
- Somewhat reduces credibilityuser-74194Depends on the readers' level of sophistication.
- Somewhat reduces credibilityuser-683654It makes people to want to publish incomplete results. Similarly, articles that should just be one are splitted into two or three so that a person can show that he has many articles.
- Somewhat reduces credibilityuser-625143We often do not have enough information about common treatments that don't work.
- Somewhat reduces credibilityuser-649046All positive findings are not useful findings to impact positive science and societal development and therefore, indiscriminate publication bias definitely affect the credibility of published research results.
- Somewhat reduces credibilityuser-606148Consumers of research reports learn to critically assess claims of efficacy, for all the reasons given above. Large scale studies with strong designs, and a history of replication, are usually impossible due to limited funding of education research of all kinds.
- Greatly reduces credibilityuser-773118So, normally I only trust what I have found.
- Greatly reduces credibilityuser-388091I have not seen such a simple study, but I would predict that a poll of the percentage of articles withdrawn for fraud, scientific misconduct, or other "ladder climber" - motivated reasons, would be highest amongst the sensationalized magazines - e.g. Science and Nature. It wastes everyone's time.
- Somewhat reduces credibilityuser-861631Publication bias somewhat reduces the credibility of the published literature in the field, as it creates a partial and potentially distorted representation of research results. When only studies with positive results are more frequently published, this can lead to an inflated perception of the efficacy of certain interventions or theories. Researchers and professionals who rely on this literature may make decisions based on an incomplete set of evidence, which can affect the quality and accuracy of their work. However, since many studies still adhere to rigorous methodological standards, the overall credibility of the literature is not entirely compromised but is weakened by the absence of a more balanced view of research results.
- Has little impact on credibilityuser-447943While negative results may contradict previously obtained and published results, I believe they should be published to achieve a better understanding of the studied phenomenon
- Greatly reduces credibilityuser-975015Some great journals got reject due to lack of expertise
- Greatly reduces credibilityuser-2453970
- Somewhat reduces credibilityuser-650602Scientist still want their work to get out, no matter what
- Somewhat reduces credibilityuser-584178While not often discussed, I think people implicitly distrust any pharmaceutical company sponsored research as a result.
- Has little impact on credibilityuser-673264No comments
- Greatly reduces credibilityuser-293647publication bias does not allow for the true risk of products in commerce. How does anyone feel this useful. Having a more complete picture of product risk should be welcomed.
- Somewhat reduces credibilityuser-765807Publication bias somewhat reduces credibility in the published literature. When studies with positive results are disproportionately published, it skews the evidence base. Researchers, journals, and the scientific community must actively address this issue to maintain trust in research findings.
- Has little impact on credibilityuser-902950In terms of credibility, if the science is rigororous, the impact should be minimal. It just hinders viewing the bigger picture.
- Greatly reduces credibilityuser-887682Greatly impacted, we can't reproduce the results from top journals! Around 90% of published results simply non-reproducible trash.
- Has no impact on credibilityuser-887652You left out "enhances credibility" with the public. That is an actual problem, and it is connected to press coverage and popularization.
- Greatly reduces credibilityuser-525512This is what publication bias does: overrepresentation of positive or statistically significant results and suppression of null or negative results in the literature. This creates a disproportional view about the total amount of existing evidence and thereby overestimation of effectiveness or significance of some interventions, techniques, or approaches. Therefore, the validity of the literature in print is actually terribly compromised as every time it never represents any view regarding research outcomes in its totality and devoid of any bias. Thus, publication bias becomes an issue that is worthy of serious concern for the preservation and augmentation of the validity of the published record in the field of computer science and engineering.
- Greatly reduces credibilityuser-575039It greatly reduces evidence credibility. Because, the scientific community already know that how journals prefer positive results to publish than either negative or null results.
- Somewhat reduces credibilityuser-725842Publication bias somewhat reduces the credibility of the published literature in the biotech and pharmaceutical industry. When studies with positive results are overrepresented, it can create a skewed understanding of the efficacy and safety of treatments. This bias may lead to inflated estimates of treatment effects, misinformed clinical decisions, and ineffective or harmful therapies being promoted. While the core of scientific research remains robust, the underreporting of null or negative results undermines the completeness and reliability of the evidence base, necessitating reforms to ensure a more accurate and comprehensive representation of all research findings. After the COVID-19 pandemic, there have been incidences where, in many journals, several authors had to retract their publications due to challenges with reproducibility pf their work.