1
|
Tang G, Cai H, Jia J. Status bias in Chinese scholarly publishing: an exploratory study based on mixed methods. Account Res 2024; 31:241-257. [PMID: 36001891 DOI: 10.1080/08989621.2022.2117621] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/15/2022]
Abstract
The academic community requires not only responsible research but also responsible academic journals. An exploratory study of Chinese-language academic journals that used mixed methods found Chinese-language academic journals on the humanities and social sciences exhibiting a widespread status bias. Most of them summarily rejected submissions from junior researchers and students without paying due attention to the quality of the research itself. The main reasons for this problem are editorial department resources, the scientific research evaluation system, the editorial department culture, and the wider academic environment. This study recommends that Chinese-language academic journals join the Committee on Publication Ethics, other publishing ethics organizations, and the "Responsible Journals" program as soon as possible.
Collapse
Affiliation(s)
- Gengyan Tang
- Institute of Journalism and Communication, Sichuan Academy of Social Sciences, Chengdu, China
| | - Hao Cai
- The First Affiliated Hospital, Chongqing Medical University, Chongqing, China
| | - Jingwen Jia
- Institute of Journalism and Communication, Sichuan Academy of Social Sciences, Chengdu, China
| |
Collapse
|
2
|
Verharen JPH. ChatGPT identifies gender disparities in scientific peer review. eLife 2023; 12:RP90230. [PMID: 37922198 PMCID: PMC10624422 DOI: 10.7554/elife.90230] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2023] Open
Abstract
The peer review process is a critical step in ensuring the quality of scientific research. However, its subjectivity has raised concerns. To investigate this issue, I examined over 500 publicly available peer review reports from 200 published neuroscience papers in 2022-2023. OpenAI's generative artificial intelligence ChatGPT was used to analyze language use in these reports, which demonstrated superior performance compared to traditional lexicon- and rule-based language models. As expected, most reviews for these published papers were seen as favorable by ChatGPT (89.8% of reviews), and language use was mostly polite (99.8% of reviews). However, this analysis also demonstrated high levels of variability in how each reviewer scored the same paper, indicating the presence of subjectivity in the peer review process. The results further revealed that female first authors received less polite reviews than their male peers, indicating a gender bias in reviewing. In addition, published papers with a female senior author received more favorable reviews than papers with a male senior author, for which I discuss potential causes. Together, this study highlights the potential of generative artificial intelligence in performing natural language processing of specialized scientific texts. As a proof of concept, I show that ChatGPT can identify areas of concern in scientific peer review, underscoring the importance of transparent peer review in studying equitability in scientific publishing.
Collapse
Affiliation(s)
- Jeroen PH Verharen
- Department of Molecular and Cell Biology and Helen Wills Neuroscience Institute, University of California, BerkeleyBerkeleyUnited States
| |
Collapse
|
3
|
Moretti A, Costa M, Beretta G. Would Moving Forward Mean Going Back? Comment on Maselli et al. Direct Access to Physical Therapy: Should Italy Move Forward? Int. J. Environ. Res. Public Health 2022, 19, 555. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:ijerph19084579. [PMID: 35457446 PMCID: PMC9026379 DOI: 10.3390/ijerph19084579] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 01/14/2022] [Revised: 04/30/2022] [Accepted: 04/06/2022] [Indexed: 02/05/2023]
Abstract
In a recent communication, Maselli and colleagues [...].
Collapse
Affiliation(s)
- Antimo Moretti
- Department of Medical and Surgical Specialties and Dentistry, University of Campania “Luigi Vanvitelli”, 80138 Naples, Italy
- Correspondence: ; Tel.: +39-0815665537
| | - Massimo Costa
- Physical and Rehabilitation Unit, AORN Vincenzo Cardarelli, 80131 Napoli, Italy;
| | - Giovanna Beretta
- Unit of Rehabilitation Medicine and Neurorehabilitation, Department of Neuroscience, ASST Niguarda Hospital, 20162 Milan, Italy;
| |
Collapse
|
4
|
Mitigating Biases in a Cohort Study: A Critical Examination of the Silicone Arthroplasty in Rheumatoid Arthritis Study. Plast Reconstr Surg 2020; 145:746-754. [PMID: 32097319 DOI: 10.1097/prs.0000000000006602] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
Research bias, or the systematic errors of a study, can arise before, during, or after a trial ends. These biases hinder the internal validity of the study, which is the accuracy of a study's conclusions regarding the effects of an intervention on a given group of subjects. With the growing use of evidence-based medicine, there is a demand for high-quality evidence from the research community. Systematic reviews and meta-analyses of randomized controlled trials are considered the highest level of evidence, followed by individual randomized controlled trials. However, most surgical trials cannot be conducted as randomized controlled trials because of factors such as patient preferences and lack of equipoise among surgeons. Therefore, surgical trials may lack features that are held as important standards for high-quality evidence, such as randomization and blinding. To demonstrate the biases that surgical trials may encounter, the authors examined a prospective cohort study, the Silicone Arthroplasty in Rheumatoid Arthritis study. The authors focus on the challenges that arise during a surgical trial, including the design, implementation, and methods used to report the clinical evidence. By recognizing and addressing obstacles that exist in research, investigators will provide health care providers with high-quality evidence needed to make well-informed, evidence-based clinical decisions.
Collapse
|
5
|
Smith CJ, Perfetti TA. Improving the ACGIH threshold limit value (TLV) process. TOXICOLOGY RESEARCH AND APPLICATION 2018. [DOI: 10.1177/2397847318801758] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
The intent of this manuscript is to elucidate needed improvements in American Conference of Governmental Industrial Hygienists (ACGIH) threshold limit value (TLV) deliberations. More broadly, irreproducibility and bias adversely impact the collection, interpretation, statistical analysis, presentation, and reporting of results in many fields. In 2012, Begley and Ellis reported that scientists at Amgen had attempted to confirm published findings related to research topics of possible interest to Amgen. Fifty-three papers were deemed “landmark” studies. The authors were “shocked” when scientific findings were confirmed in only 6 (11%) cases. Many studies have confirmed that the peer-reviewed literature in biomedicine is in the midst of an irreproducibility crisis. Compounding the irreproducibility crisis is the existence of a significant bias against the publication of negative results. In the toxicology setting, negative toxicity test results are infrequently published as compared with reports that a chemical possesses a particular toxicity in a given test. Despite these deficiencies, the ACGIH states that “…the TLV®-CS Committee preferably relies on published, peer reviewed literature available in the public domain.” The primarily academic studies published in the peer-reviewed literature upon which ACGIH relies to determine TLVs rarely report raw data not already statistically transformed that are thus incalculable. In contrast, consideration of unpublished studies funded by industry, the vast majority of which are good laboratory practice-conducted contract lab studies, is only acceptable to ACGIH if the data owner provides the raw data to third parties upon request. This asymmetry in both the source of data emphasized, and inability to independently statistically analyze findings reported in the published academic literature, introduces a strong skew toward reliance on unverifiable although published measurements in the TLV process. Since Occupational Safety and Health Administration (OSHA) recommends that workplaces rely on ACGIH TLVs and National Institute for Occupational Safety and Health recommended exposure limits rather than older OSHA permissible exposure limit values to optimize worker safety, ACGIH should adopt a more transparent and science-based process.
Collapse
Affiliation(s)
- Carr J Smith
- Albemarle Corporation, Alabama, USA
- Department of Nurse Anesthesia, Florida State University, Tallahassee, FL, USA
| | | |
Collapse
|
6
|
[Perception of scientific fraud in the Spanish biomedical journals]. Med Clin (Barc) 2014; 143:554-9. [PMID: 25073824 DOI: 10.1016/j.medcli.2014.03.036] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2013] [Revised: 03/04/2014] [Accepted: 03/27/2014] [Indexed: 11/21/2022]
|
7
|
Abstract
Many biases affect scientific research, causing a waste of resources, posing a threat to human health, and hampering scientific progress. These problems are hypothesized to be worsened by lack of consensus on theories and methods, by selective publication processes, and by career systems too heavily oriented toward productivity, such as those adopted in the United States (US). Here, we extracted 1,174 primary outcomes appearing in 82 meta-analyses published in health-related biological and behavioral research sampled from the Web of Science categories Genetics & Heredity and Psychiatry and measured how individual results deviated from the overall summary effect size within their respective meta-analysis. We found that primary studies whose outcome included behavioral parameters were generally more likely to report extreme effects, and those with a corresponding author based in the US were more likely to deviate in the direction predicted by their experimental hypotheses, particularly when their outcome did not include additional biological parameters. Nonbehavioral studies showed no such "US effect" and were subject mainly to sampling variance and small-study effects, which were stronger for non-US countries. Although this latter finding could be interpreted as a publication bias against non-US authors, the US effect observed in behavioral research is unlikely to be generated by editorial biases. Behavioral studies have lower methodological consensus and higher noise, making US researchers potentially more likely to express an underlying propensity to report strong and significant findings.
Collapse
|
8
|
Matías-Guiu J, García-Ramos R, Castellanos M, Martínez-Vila E, Matías-Guiu J. What happens to medical articles submitted in Spanish that are not accepted for publication? NEUROLOGÍA (ENGLISH EDITION) 2013. [DOI: 10.1016/j.nrleng.2012.05.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022] Open
|
9
|
Matías-Guiu J, García-Ramos R, Castellanos M, Martínez-Vila E, Matías-Guiu J. ¿Qué ocurre con los artículos médicos remitidos en español que no son aceptados para publicación? Neurologia 2013; 28:205-11. [DOI: 10.1016/j.nrl.2012.05.002] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2012] [Accepted: 05/28/2012] [Indexed: 11/26/2022] Open
|
10
|
Jennings RG, Van Horn JD. Publication bias in neuroimaging research: implications for meta-analyses. Neuroinformatics 2012; 10:67-80. [PMID: 21643733 DOI: 10.1007/s12021-011-9125-y] [Citation(s) in RCA: 53] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
Neuroimaging and the neurosciences have made notable advances in sharing activation results through detailed databases, making meta-analysis of the published research faster and easier. However, the effect of publication bias in these fields has not been previously addressed or accounted for in the developed meta-analytic methods. In this article, we examine publication bias in functional magnetic resonance imaging (fMRI) for tasks involving working memory in the frontal lobes (Brodmann Areas 4, 6, 8, 9, 10, 37, 45, 46, and 47). Seventy-four studies were selected from the literature and the effect of publication bias was examined using a number of regression-based techniques. Pearson's r correlation coefficient and Cohen's d effect size estimates were computed for the activation in each study and compared to the study sample size using Egger's regression, Macaskill's regression, and the 'Trim and Fill' method. Evidence for publication bias was identified in this body of literature (p < 0.01 for each test), generally, though was neither task- nor sub-region-dependent. While we focused our analysis on this subgroup of brain mapping studies, we believe our findings generalize to the brain imaging literature as a whole and databases seeking to curate their collective results. While neuroimaging databases of summary effects are of enormous value to the community, the potential publication bias should be considered when performing meta-analyses based on database contents.
Collapse
Affiliation(s)
- Robin G Jennings
- Department of Biostatistics, University of California Los Angeles, 635 Charles Young Drive South, Suite 225, Los Angeles, CA, 90095, USA.
| | | |
Collapse
|
11
|
Barolo S. Shadow enhancers: frequently asked questions about distributed cis-regulatory information and enhancer redundancy. Bioessays 2012; 34:135-41. [PMID: 22083793 PMCID: PMC3517143 DOI: 10.1002/bies.201100121] [Citation(s) in RCA: 115] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
This paper, in the form of a frequently asked questions page (FAQ), addresses outstanding questions about "shadow enhancers", quasi-redundant cis-regulatory elements, and their proposed roles in transcriptional control. Questions include: What exactly are shadow enhancers? How many genes have shadow/redundant/distributed enhancers? How redundant are these elements? What is the function of distributed enhancers? How modular are enhancers? Is it useful to study a single enhancer in isolation? In addition, a revised definition of "shadow enhancers" is proposed, and possible mechanisms of shadow enhancer function and evolution are discussed.
Collapse
Affiliation(s)
- Scott Barolo
- Department of Cell and Developmental Biology, University of Michigan Medical School, Ann Arbor, MI, USA.
| |
Collapse
|
12
|
Matías-Guiu J, García-Ramos R. Ghost-authors, improvement article communication, and medical publications. Neurologia 2011; 26:257-61. [PMID: 21356568 DOI: 10.1016/j.nrl.2010.12.001] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2010] [Accepted: 12/15/2010] [Indexed: 10/18/2022] Open
Abstract
INTRODUCTION Relationship between ghost-authors and medical writers has been debated, even arriving to citizens. Accusation that through ghost-authors, market messages are introduced in medical journals has been suggested. DEVELOPMENT This paper carried out an analysis of ghost-authors and their application to medical writers and discusses the intellectual authorship of the scientific articles, as well as the relationship with research groups and pharmaceutical industry, as well as the position of journal. CONCLUSIONS The role of medical workers is advisable because improves communication of articles. Using authorship criteria, medical writers cannot be considered as ghost-authors. Misconducts for medical writers should be pursued but also those from editors and authors. Responsibility of articles belongs to authors who are responsible of false conclusions obtained from data research and to the editor in the case of the paper was published.
Collapse
Affiliation(s)
- J Matías-Guiu
- Servicio de Neurología, Instituto de Neurociencias, Hospital Clínico San Carlos, Universidad Complutense de Madrid, Madrid, España.
| | | |
Collapse
|