1
|
Abstract
Scientists in some fields are concerned that many published results are false. Recent models predict selection for false positives as the inevitable result of pressure to publish, even when scientists are penalized for publications that fail to replicate. We model the cultural evolution of research practices when laboratories are allowed to expend effort on theory, enabling them, at a cost, to identify hypotheses that are more likely to be true, before empirical testing. Theory can restore high effort in research practice and suppress false positives to a technical minimum, even without replication. The mere ability to choose between two sets of hypotheses, one with greater prior chance of being correct, promotes better science than can be achieved with effortless access to the set of stronger hypotheses. Combining theory and replication can have synergistic effects. On the basis of our analysis, we propose four simple recommendations to promote good science.
Collapse
|
2
|
Dinis-Oliveira RJ. COVID-19 research: pandemic versus "paperdemic", integrity, values and risks of the "speed science". Forensic Sci Res 2020; 5:174-187. [PMID: 32939434 PMCID: PMC7476615 DOI: 10.1080/20961790.2020.1767754] [Citation(s) in RCA: 54] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2020] [Revised: 05/03/2020] [Accepted: 05/06/2020] [Indexed: 12/23/2022] Open
Abstract
Scientific integrity is a learned skill. When researchers and students learn integrity in laboratories or in the classroom, they are empowered to use similar principles in other aspects of their lives. This commentary reviews the concepts related to scientific integrity at a time when science faces important challenges related to the increase number of articles produced regarding research on coronavirus disease 2019 (COVID-19). Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has ignited another parallel viral pandemic, with science ranging from robust studies to dishonest studies being conducted, posted, and shared at an unprecedented rate. A balance is needed between the benefits of the rapid access to new scientific data and the threat of causing panic or erroneous clinical decisions based on mistakes or misconduct. The truth is that the "scientific research has changed the world" but now, and more than ever, "it needs to change itself". A pandemic with a "paperdemic" will be even more complicated to manage if it progresses in an uncontrolled manner and is not properly scrutinized.
Collapse
Affiliation(s)
- Ricardo Jorge Dinis-Oliveira
- Department of Public Health and Forensic Sciences, and Medical Education, Faculty of Medicine, University of Porto, Porto, Portugal
- Department of Sciences, IINFACTS-Institute of Research and Advanced Training in Health Sciences and Technologies, University Institute of Health Sciences (IUCS), CESPU, CRL, Gandra, Portugal
- UCIBIO-REQUIMTE, Laboratory of Toxicology, Department of Biological Sciences, Faculty of Pharmacy, University of Porto, Porto, Portugal
| |
Collapse
|
3
|
Mendiola Pastrana IR, Hernández AV, Pérez Manjarrez FE, López EO, Romero-Henríquez LF, López-Ortiz G. Peer-Review and Rejection Causes in Submitting Original Medical Manuscripts. THE JOURNAL OF CONTINUING EDUCATION IN THE HEALTH PROFESSIONS 2020; 40:182-186. [PMID: 32427687 DOI: 10.1097/ceh.0000000000000295] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
The purpose of specialized medical journals is to accurately disseminate the results of new research. The peer-review process is crucial for journals to be able to fulfill this purpose. Although the peer-review determines whether scientific papers are accepted or rejected for publication, for many authors is a not well known process in its entirety. Many journals have focused on educating their audience about how and what is assessed during peer-review, nevertheless, the rate of manuscripts rejected because of easily-avoidable causes related to this, remains high. In this paper, we describe the process that specialized journals use to assess original medical manuscripts and list the main causes of paper rejection. Practicing physicians and medical students who wish to report their research results stand to benefit if they can identify and early avoid on the issues that most often arise during the peer-review process.
Collapse
Affiliation(s)
- Indira Rocío Mendiola Pastrana
- Dr. Mendiola Pastrana: Master Degree in Health Sciences at the National Institute of Public Health of México, Specialist in Family Medicine, Ciudad de México, México. Currently Working as Family Physician and Collaborate as Researcher at Centro de Investigación en Políticas, Población y Salud (CIPPS) at Universidad Nacional Autónoma de México, Mexico city, Mexico. Dr. Hernández: General Physician, Subdivisión de Medicina Familiar, Facultad de Medicina, Universidad Nacional Autónoma de México, Mexico city, Mexico. Dr. Pérez Manjarrez: General Physician, Subdivisión de Medicina Familiar, Facultad de Medicina, Universidad Nacional Autónoma de México, Mexico city, Mexico. Dr. López: Epidemiologist, Summer Internship Program in Nuffield Department of Medicine, Oxford University, Oxford, United Kingdom. His Research Topic Is Related with Epidemiology of Infectious Diseases and Prevention of Metabolic Syndrome. M Ed. Romero Henríquez: Master Degree in Education, Member of Academy of Social Sciences, Centro de Actualización del Magisterio of México City, Academic Board CAMDF-CA-1 Educational Inequality and Professional Practices, Mexico city, Mexico. Currently Studying Inclusive Education, Human Rights of Children, and Education for Medical Residents. Dr. López-Ortiz: Associate Professor and Head of Research at Subdivisión de Medicina Familiar, Facultad de Medicina Universidad Nacional Autónoma de México, Mexico city, Mexico. Editor in Chief of a Medical Journal Specialized in Family Practice. His Academic Interest Is Focused in Education Research and Metabolic Diseases
| | | | | | | | | | | |
Collapse
|
4
|
Brown T, Ho YS, Gutman SA. High Impact and Highly Cited Peer-Reviewed Journal Article Publications by Canadian Occupational Therapy Authors: A Bibliometric Analysis. Occup Ther Health Care 2019; 33:329-354. [PMID: 31244404 DOI: 10.1080/07380577.2019.1633587] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Abstract
A bibliometric analysis of high impact and highly cited peer-reviewed literature published between 1992 and 2016 by Canadian occupational therapy authors that were included in the Science Citation Index-Expanded (SCI-E) or Social Sciences Citation Index (SSCI) was completed. To complete the analysis, journal article titles, abstracts, author details, and keywords were searched. A second-filter identified articles where the first or corresponding author had a Canadian affiliation and occupational therapy qualification. The total number of times an article was cited since its initial publication and during 2016 in Web of Science Core Collection was recorded. A total of 919 retrieved articles met the inclusion criteria with 18 articles having 5 or more citations during 2016 alone and another 34 articles having 50 or more citations since their initial publication date. The top three journals where high impact and highly-cited articles were published were Archives of Physical Medicine and Rehabilitation, Disability and Rehabilitation, and American Journal of Occupational Therapy. The three institutions that generated the largest number of high impact and highly cited articles were McGill University, University of Toronto, and University of British Columbia. Therefore, as of 2016, Canadian occupational therapy authors published 18 high impact and 34 highly cited articles.
Collapse
Affiliation(s)
- Ted Brown
- Department of Occupational Therapy, Faculty of Medicine, Nursing and Health Sciences, Monash University - Peninsula Campus, Frankston, Australia
| | - Yuh-Shan Ho
- Trend Research Centre, Asia University, Taichung, Taiwan
| | - Sharon A Gutman
- Programs in Occupational Therapy, Columbia University Irving Medical Center, New York, NY, USA
| |
Collapse
|
5
|
Haven TL, Bouter LM, Smulders YM, Tijdink JK. Perceived publication pressure in Amsterdam: Survey of all disciplinary fields and academic ranks. PLoS One 2019; 14:e0217931. [PMID: 31216293 PMCID: PMC6583945 DOI: 10.1371/journal.pone.0217931] [Citation(s) in RCA: 31] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2019] [Accepted: 05/21/2019] [Indexed: 11/19/2022] Open
Abstract
Publications determine to a large extent the possibility to stay in academia ("publish or perish"). While some pressure to publish may incentivise high quality research, too much publication pressure is likely to have detrimental effects on both the scientific enterprise and on individual researchers. Our research question was: What is the level of perceived publication pressure in the four academic institutions in Amsterdam and does the pressure to publish differ between academic ranks and disciplinary fields? Investigating researchers in Amsterdam with the revised Publication Pressure Questionnaire, we find that a negative attitude towards the current publication climate is present across academic ranks and disciplinary fields. Postdocs and assistant professors (M = 3.42) perceive the greatest publication stress and PhD-students (M = 2.44) perceive a significant lack of resources to relieve publication stress. Results indicate the need for a healthier publication climate where the quality and integrity of research is rewarded.
Collapse
Affiliation(s)
- Tamarinde L. Haven
- Department of Philosophy, Vrije Universiteit, Amsterdam, North Holland, The Netherlands
| | - Lex M. Bouter
- Department of Philosophy, Vrije Universiteit, Amsterdam, North Holland, The Netherlands
- Department of Epidemiology and Biostatistics, Amsterdam UMC, location VUmc, Amsterdam, North Holland, The Netherlands
| | - Yvo M. Smulders
- Department of Internal Medicine, Amsterdam UMC, location VUmc, Amsterdam, North Holland, The Netherlands
| | - Joeri K. Tijdink
- Department of Philosophy, Vrije Universiteit, Amsterdam, North Holland, The Netherlands
- Department of Medical Humanities, Amsterdam UMC, location VUmc, Amsterdam, North Holland, The Netherlands
| |
Collapse
|
6
|
He Y, Yuan C, Chen L, Liu Y, Zhou H, Xu N, Liao DJ. While it is not deliberate, much of today's biomedical research contains logical and technical flaws, showing a need for corrective action. Int J Med Sci 2018; 15:309-322. [PMID: 29511367 PMCID: PMC5835702 DOI: 10.7150/ijms.23215] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/08/2017] [Accepted: 12/21/2017] [Indexed: 12/20/2022] Open
Abstract
Biomedical research has advanced swiftly in recent decades, largely due to progress in biotechnology. However, this rapid spread of new, and not always-fully understood, technology has also created a lot of false or irreproducible data and artifacts, which sometimes have led to erroneous conclusions. When describing various scientific issues, scientists have developed a habit of saying "on one hand… but on the other hand…", because discrepant data and conclusions have become omnipresent. One reason for this problematic situation is that we are not always thoughtful enough in study design, and sometimes lack enough philosophical contemplation. Another major reason is that we are too rushed in introducing new technology into our research without assimilating technical details. In this essay, we provide examples in different research realms to justify our points. To help readers test their own weaknesses, we raise questions on technical details of RNA reverse transcription, polymerase chain reactions, western blotting and immunohistochemical staining, as these methods are basic and are the base for other modern biotechnologies. Hopefully, after contemplation and reflection on these questions, readers will agree that we indeed know too little about these basic techniques, especially about the artifacts they may create, and thus many conclusions drawn from the studies using those ever-more-sophisticated techniques may be even more problematic.
Collapse
Affiliation(s)
- Yan He
- Key Lab of Endemic and Ethnic Diseases of the Ministry of Education of China in Guizhou Medical University, Guiyang, Guizhou 550004, P. R. China.,Molecular Biology Center, Guizhou Medical University, Guiyang, Guizhou 550004, P.R. China
| | - Chengfu Yuan
- Department of Biochemistry, China Three Gorges University, Yichang City, Hubei 443002, P.R. China
| | - Lichan Chen
- Hormel Institute, University of Minnesota, Austin, MN 55912, USA
| | - Yanjie Liu
- Department of Pathology, Guizhou Medical University, Guiyang, Guizhou 550004, P.R. China
| | - Haiyan Zhou
- Clinical Research Center, Guizhou Medical University Hospital, Guiyang, Guizhou 550004, P.R. China
| | - Ningzhi Xu
- Laboratory of Cell and Molecular Biology & State Key Laboratory of Molecular Oncology, National Cancer Center/Cancer Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing 100021, PR China
| | - Dezhong Joshua Liao
- Key Lab of Endemic and Ethnic Diseases of the Ministry of Education of China in Guizhou Medical University, Guiyang, Guizhou 550004, P. R. China.,Molecular Biology Center, Guizhou Medical University, Guiyang, Guizhou 550004, P.R. China.,Department of Pathology, Guizhou Medical University, Guiyang, Guizhou 550004, P.R. China
| |
Collapse
|
7
|
Bustin S, Nolan T. Talking the talk, but not walking the walk: RT-qPCR as a paradigm for the lack of reproducibility in molecular research. Eur J Clin Invest 2017; 47:756-774. [PMID: 28796277 DOI: 10.1111/eci.12801] [Citation(s) in RCA: 69] [Impact Index Per Article: 8.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/14/2017] [Accepted: 08/07/2017] [Indexed: 12/11/2022]
Abstract
Poorly executed and inadequately reported molecular measurement methods are amongst the causes underlying the lack of reproducibility of much biomedical research. Although several high impact factor journals have acknowledged their past failure to scrutinise adequately the technical soundness of manuscripts, there is a perplexing reluctance to implement basic corrective measures. The reverse transcription real-time quantitative PCR (RT-qPCR) is probably the most straightforward measurement technique available for RNA quantification and is widely used in research, diagnostic, forensic and biotechnology applications. Despite the impact of the minimum information for the publication of quantitative PCR experiments (MIQE) guidelines, which aim to improve the robustness and the transparency of reporting of RT-qPCR data, we demonstrate that elementary protocol errors, inappropriate data analysis and inadequate reporting continue to be rife and conclude that the majority of published RT-qPCR data are likely to represent technical noise.
Collapse
Affiliation(s)
- Stephen Bustin
- Postgraduate Medical Institute, Faculty of Medical Science, Anglia Ruskin University, Chelmsford, Essex, UK
| | - Tania Nolan
- Institute of Population Health, Faculty of Medical and Human Sciences, University of Manchester, Manchester, UK
| |
Collapse
|
8
|
McArthur RA. Aligning physiology with psychology: Translational neuroscience in neuropsychiatric drug discovery. Neurosci Biobehav Rev 2017; 76:4-21. [DOI: 10.1016/j.neubiorev.2017.02.004] [Citation(s) in RCA: 35] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2016] [Accepted: 02/03/2017] [Indexed: 12/12/2022]
|
9
|
Bal AM, Mahawar KK. Dental publishing: Peer review reviewed. Br Dent J 2016; 221:686. [PMID: 27932847 DOI: 10.1038/sj.bdj.2016.890] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
10
|
Dinis-Oliveira RJ, Magalhães T. Teaching and learning based on peer review: a realistic approach in forensic sciences. F1000Res 2016; 5:1048. [PMID: 27547377 PMCID: PMC4975368 DOI: 10.12688/f1000research.8726.1] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 05/24/2016] [Indexed: 12/03/2022] Open
Abstract
Teaching and learning methods need a continuous upgrade in higher education. However it is also true that some of the modern methodologies do not reduce or prevent school failure. Perhaps the real limitation is the inability to identify the true reasons that may explain it or ignore/undervalue the problem. In our opinion, one of the current constraints of the teaching/learning process is the excess of and inadequate bibliography recommended by the teacher, which results in continuous student difficulties and waste of time in searching and selecting useful information. The need to change the paradigm of the teaching/learning process comes also from employers. They claim forensic experts armed with useful knowledge to face professional life. It is therefore mandatory to identify the new needs and opportunities regarding pedagogical methodologies. This article reflects on the recent importance of peer review in teaching/learning forensic sciences based on the last 10 years of pedagogical experience inseparably from the scientific activity.
Collapse
Affiliation(s)
- Ricardo Jorge Dinis-Oliveira
- Department of Legal Medicine and Forensic Sciences, Faculty of Medicine, University of Porto, Porto, 4200-319, Portugal; Department of Sciences, IINFACTS - Institute of Research and Advanced Training in Health Sciences and Technologies, University Institute of Health Sciences (IUCS), CESPU, CRL, Gandra, 4585-116, Portugal; Department of Biological Sciences, UCIBIO-REQUIMTE, Laboratory of Toxicology, Faculty of Pharmacy, University of Porto, Porto, 4050-313, Portugal
| | - Teresa Magalhães
- Department of Legal Medicine and Forensic Sciences, Faculty of Medicine, University of Porto, Porto, 4200-319, Portugal; Department of Sciences, IINFACTS - Institute of Research and Advanced Training in Health Sciences and Technologies, University Institute of Health Sciences (IUCS), CESPU, CRL, Gandra, 4585-116, Portugal
| |
Collapse
|