1
|
Schneider JW, Allum N, Andersen JP, Petersen MB, Madsen EB, Mejlgaard N, Zachariae R. Is something rotten in the state of Denmark? Cross-national evidence for widespread involvement but not systematic use of questionable research practices across all fields of research. PLoS One 2024; 19:e0304342. [PMID: 39133711 PMCID: PMC11318862 DOI: 10.1371/journal.pone.0304342] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Accepted: 05/10/2024] [Indexed: 08/15/2024] Open
Abstract
Questionable research practices (QRP) are believed to be widespread, but empirical assessments are generally restricted to a few types of practices. Furthermore, conceptual confusion is rife with use and prevalence of QRPs often being confused as the same quantity. We present the hitherto most comprehensive study examining QRPs across scholarly fields and knowledge production modes. We survey perception, use, prevalence and predictors of QRPs among 3,402 researchers in Denmark and 1,307 in the UK, USA, Croatia and Austria. Results reveal remarkably similar response patterns among Danish and international respondents (τ = 0.85). Self-reported use indicates whether respondents have used a QRP in recent publications. 9 out of 10 respondents admitted using at least one QRP. Median use is three out of nine QRP items. Self-reported prevalence reflects the frequency of use. On average, prevalence rates were roughly three times lower compared to self-reported use. Findings indicated that the perceived social acceptability of QRPs influenced self-report patterns. Results suggest that most researchers use different types of QRPs within a restricted time period. The prevalence estimates, however, do not suggest outright systematic use of specific QRPs. Perceived pressure was the strongest systemic predictor for prevalence. Conversely, more local attention to research cultures and academic age was negatively related to prevalence. Finally, the personality traits conscientiousness and, to a lesser degree, agreeableness were also inversely associated with self-reported prevalence. Findings suggest that explanations for engagement with QRPs are not only attributable to systemic factors, as hitherto suggested, but a complicated mixture of experience, systemic and individual factors, and motivated reasoning.
Collapse
Affiliation(s)
- Jesper W. Schneider
- Danish Centre for Studies in Research and Research Policy, Aarhus University, Aarhus, Denmark
| | - Nick Allum
- Department of Sociology, University of Essex, Essex, United Kingdom
| | - Jens Peter Andersen
- Danish Centre for Studies in Research and Research Policy, Aarhus University, Aarhus, Denmark
| | | | - Emil B. Madsen
- Danish Centre for Studies in Research and Research Policy, Aarhus University, Aarhus, Denmark
| | - Niels Mejlgaard
- Danish Centre for Studies in Research and Research Policy, Aarhus University, Aarhus, Denmark
| | - Robert Zachariae
- Unit for Psychooncology and Health Psychology (EPoS), Department of Oncology, Aarhus University Hospital, Aarhus, Denmark
- Department Psychology and Behavioral Science, Aarhus University, Aarhus, Denmark
| |
Collapse
|
2
|
Martins RS, Mustafa MA, Fatimi AS, Nasir N, Pervez A, Nadeem S. The CalculAuthor: determining authorship using a simple-to-use, fair, objective, and transparent process. BMC Res Notes 2023; 16:329. [PMID: 37951910 PMCID: PMC10640724 DOI: 10.1186/s13104-023-06597-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2023] [Accepted: 10/26/2023] [Indexed: 11/14/2023] Open
Abstract
Authorship determination on a research article remains a largely subjective process. Existing guidelines on authorship taxonomy lack objectivity and are more useful in determining who deserves authorship rather than determining the order of authors. To promote best practices in authorship taxonomy, we developed an authorship rubric that provides a fair, objective, and transparent means of crediting authorship. We christened this tool the "CalculAuthor". The following steps are to be undertaken to create a scoring system based on the requirements of the projects: determining creditable criteria, assigning credit weightages, deciding levels of contribution, determining each author's contribution, calculating authorship scores and ranking. These must be performed by or in close collaboration with the primary investigator (PI), with conflicts being resolved at the PI's discretion. All team members should be informed about the authorship determination process early in the project and their agreement regarding its use must be obtained. While the CalculAuthor was developed to be used in medical research, its customizability enables it to be employed in any field of academia. We recommend that the CalculAuthor be piloted within institutions before its mainstream adoption, and any institution-specific factors should be considered to make the process more efficient and suitable.
Collapse
Affiliation(s)
- Russell Seth Martins
- Division of Thoracic Surgery, Department of Surgery, JFK University Medical Center, Hackensack Meridian School of Medicine, Hackensack Meridian Health (HMH) Network, Edison, NJ, 08820, USA.
| | - Mohsin Ali Mustafa
- CITRIC Center for Clinical Best Practices, Aga Khan University, Karachi, 74800, Pakistan
| | | | - Nosheen Nasir
- Department of Medicine, Aga Khan University, Karachi, 74800, Pakistan
| | - Alina Pervez
- CITRIC Center for Clinical Best Practices, Aga Khan University, Karachi, 74800, Pakistan
| | - Sarah Nadeem
- CITRIC Center for Clinical Best Practices, Aga Khan University, Karachi, 74800, Pakistan
- Department of Medicine, Aga Khan University, Karachi, 74800, Pakistan
| |
Collapse
|
3
|
Duchardt-Ferner E, Ferner J, Fürtig B, Hengesbach M, Richter C, Schlundt A, Sreeramulu S, Wacker A, Weigand JE, Wirmer-Bartoschek J, Schwalbe H. The COVID19-NMR Consortium: A Public Report on the Impact of this New Global Collaboration. Angew Chem Int Ed Engl 2023; 62:e202217171. [PMID: 36748955 DOI: 10.1002/anie.202217171] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Indexed: 02/08/2023]
Abstract
The outbreak of COVID-19 in December 2019 required the formation of international consortia for a coordinated scientific effort to understand and combat the virus. In this Viewpoint Article, we discuss how the NMR community has gathered to investigate the genome and proteome of SARS-CoV-2 and tested them for binding to low-molecular-weight binders. External factors including extended lockdowns due to the global pandemic character of the viral infection triggered the transition from locally focused collaborative research conducted within individual research groups to digital exchange formats for immediate discussion of unpublished results and data analysis, sample sharing, and coordinated research between more than 50 groups from 18 countries simultaneously. We discuss key lessons that might pertain after the end of the pandemic and challenges that we need to address.
Collapse
Affiliation(s)
- Elke Duchardt-Ferner
- Institute for Biomolecular Sciences, Center for Biomolecular Magnetic Resonance (BMRZ), Goethe-University Frankfurt, Max-von-Laue-Str. 9, 60438, Frankfurt/M., Germany
| | - Jan Ferner
- Institute for Organic Chemistry and Chemical Biology, Center for Biomolecular Magnetic Resonance (BMRZ), Goethe-University Frankfurt, Max-von-Laue-Str. 7, 60438, Frankfurt/M., Germany
| | - Boris Fürtig
- Institute for Organic Chemistry and Chemical Biology, Center for Biomolecular Magnetic Resonance (BMRZ), Goethe-University Frankfurt, Max-von-Laue-Str. 7, 60438, Frankfurt/M., Germany
| | - Martin Hengesbach
- Institute for Organic Chemistry and Chemical Biology, Center for Biomolecular Magnetic Resonance (BMRZ), Goethe-University Frankfurt, Max-von-Laue-Str. 7, 60438, Frankfurt/M., Germany
| | - Christian Richter
- Institute for Organic Chemistry and Chemical Biology, Center for Biomolecular Magnetic Resonance (BMRZ), Goethe-University Frankfurt, Max-von-Laue-Str. 7, 60438, Frankfurt/M., Germany
| | - Andreas Schlundt
- Institute for Biomolecular Sciences, Center for Biomolecular Magnetic Resonance (BMRZ), Goethe-University Frankfurt, Max-von-Laue-Str. 9, 60438, Frankfurt/M., Germany
| | - Sridhar Sreeramulu
- Institute for Organic Chemistry and Chemical Biology, Center for Biomolecular Magnetic Resonance (BMRZ), Goethe-University Frankfurt, Max-von-Laue-Str. 7, 60438, Frankfurt/M., Germany
| | - Anna Wacker
- Institute for Organic Chemistry and Chemical Biology, Center for Biomolecular Magnetic Resonance (BMRZ), Goethe-University Frankfurt, Max-von-Laue-Str. 7, 60438, Frankfurt/M., Germany
| | - Julia E Weigand
- Philipps-University Marburg, Department of Pharmacy, Institute of Pharmaceutical Chemistry, Marbacher Weg 6, 35037, Marburg, Germany
| | - Julia Wirmer-Bartoschek
- Institute for Organic Chemistry and Chemical Biology, Center for Biomolecular Magnetic Resonance (BMRZ), Goethe-University Frankfurt, Max-von-Laue-Str. 7, 60438, Frankfurt/M., Germany
| | - Harald Schwalbe
- Institute for Organic Chemistry and Chemical Biology, Center for Biomolecular Magnetic Resonance (BMRZ), Goethe-University Frankfurt, Max-von-Laue-Str. 7, 60438, Frankfurt/M., Germany
- Instruct-ERIC, Oxford House, Parkway Court, John Smith Drive, Oxford, OX4 2JY, UK
| |
Collapse
|
4
|
Duchardt‐Ferner E, Ferner J, Fürtig B, Hengesbach M, Richter C, Schlundt A, Sreeramulu S, Wacker A, Weigand JE, Wirmer‐Bartoschek J, Schwalbe H. Das COVID19‐NMR‐Konsortium: Ein öffentlicher Bericht über den Einfluss dieser neuen globalen Kollaboration. Angew Chem Int Ed Engl 2023. [DOI: 10.1002/ange.202217171] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/10/2023]
Affiliation(s)
- Elke Duchardt‐Ferner
- Institute for Biomolecular Sciences Center for Biomolecular Magnetic Resonance (BMRZ) Goethe-University Frankfurt Max-von-Laue-Str. 9 60438 Frankfurt/M. Deutschland
| | - Jan Ferner
- Institute for Organic Chemistry and Chemical Biology Center for Biomolecular Magnetic Resonance (BMRZ) Goethe-University Frankfurt Max-von-Laue-Str. 7 60438 Frankfurt/M. Deutschland
| | - Boris Fürtig
- Institute for Organic Chemistry and Chemical Biology Center for Biomolecular Magnetic Resonance (BMRZ) Goethe-University Frankfurt Max-von-Laue-Str. 7 60438 Frankfurt/M. Deutschland
| | - Martin Hengesbach
- Institute for Organic Chemistry and Chemical Biology Center for Biomolecular Magnetic Resonance (BMRZ) Goethe-University Frankfurt Max-von-Laue-Str. 7 60438 Frankfurt/M. Deutschland
| | - Christian Richter
- Institute for Organic Chemistry and Chemical Biology Center for Biomolecular Magnetic Resonance (BMRZ) Goethe-University Frankfurt Max-von-Laue-Str. 7 60438 Frankfurt/M. Deutschland
| | - Andreas Schlundt
- Institute for Biomolecular Sciences Center for Biomolecular Magnetic Resonance (BMRZ) Goethe-University Frankfurt Max-von-Laue-Str. 9 60438 Frankfurt/M. Deutschland
| | - Sridhar Sreeramulu
- Institute for Organic Chemistry and Chemical Biology Center for Biomolecular Magnetic Resonance (BMRZ) Goethe-University Frankfurt Max-von-Laue-Str. 7 60438 Frankfurt/M. Deutschland
| | - Anna Wacker
- Institute for Organic Chemistry and Chemical Biology Center for Biomolecular Magnetic Resonance (BMRZ) Goethe-University Frankfurt Max-von-Laue-Str. 7 60438 Frankfurt/M. Deutschland
| | - Julia E. Weigand
- Philipps-University Marburg Department of Pharmacy Institute of Pharmaceutical Chemistry Marbacher Weg 6 35037 Marburg Deutschland
| | - Julia Wirmer‐Bartoschek
- Institute for Organic Chemistry and Chemical Biology Center for Biomolecular Magnetic Resonance (BMRZ) Goethe-University Frankfurt Max-von-Laue-Str. 7 60438 Frankfurt/M. Deutschland
| | - Harald Schwalbe
- Institute for Organic Chemistry and Chemical Biology Center for Biomolecular Magnetic Resonance (BMRZ) Goethe-University Frankfurt Max-von-Laue-Str. 7 60438 Frankfurt/M. Deutschland
- Instruct-ERIC Oxford House, Parkway Court John Smith Drive Oxford OX4 2JY Großbritannien
| |
Collapse
|
5
|
Csomós G. A critical review of the proposed academic performance indicators for the assessment of individual researchers in Hungary. COLLNET JOURNAL OF SCIENTOMETRICS AND INFORMATION MANAGEMENT 2022. [DOI: 10.1080/09737766.2022.2106166] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Affiliation(s)
- György Csomós
- Department of Civil Engineering, University of Debrecen, 2-4 Otemeto u., Debrecen, 4028, Hungary
| |
Collapse
|
6
|
Ing EB. A Survey-Weighted Analytic Hierarchy Process to Quantify Authorship. ADVANCES IN MEDICAL EDUCATION AND PRACTICE 2021; 12:1021-1031. [PMID: 34552366 PMCID: PMC8450677 DOI: 10.2147/amep.s328648] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/09/2021] [Accepted: 09/07/2021] [Indexed: 06/13/2023]
Abstract
BACKGROUND Authorship is a pinnacle activity in academic medicine that often involves collaboration and a mentor-mentee relationship. The International Committee of Medical Journal Editors criteria for authorship (ICMJEc) are intended to prevent abuses of authorship and are used by more than 5500 medical journals. However, the binary ICMJEc have not yet been quantified. AIM To develop a numeric scoring rubric for the ICMJEc to corroborate the authenticity of authorship claims. METHODS The four ICMJEc were separated into the nine authorship components of conception, design, data acquisition, data analysis, interpretation of data, draft, revision, final approval and accountability. In spring 2021, members of an international association of medical editors rated the importance of each authorship component using an 11-point Likert scale ranging from 0 (no importance) to 10 (most important). The median component scores were used to calibrate the pairwise comparisons in an analytic hierarchy process (AHP). The AHP priority weights were multiplied against a four-level perceived effort/capability grade to calculate an authorship score. RESULTS Sixty-six decision-making medical editors completed the survey. The components had the median scores/AHP weights: conception 7.5/5.3%; design 8/8.9%; data acquisition 7/3.6%; data analysis 7/3.6%; interpretation of data 8/8.9%; draft 8/8.9%; revision 8/8.9%; final approval 9/20.1%; and accountability 10/31.8%, with Kruskal-Wallis Chi2 = 65.11, p < 0.001. CONCLUSION The editors rated accountability as the most important component of authorship, followed by the final approval of the manuscript; data acquisition had the lowest median importance score for authorship. The scoring rubric (https://tinyurl.com/eyu86y96) transforms the binary tetrad ICMJEc into 9 quantifiable components of authorship, providing a transparent method to objectively assess authorship contributions, determine authorship order and potentially decrease the abuse of authorship. If desired, individual journals can survey their editorial boards and use the AHP method to derive customized weightings for an ICMJEc-based authorship index.
Collapse
|
7
|
Xing Y, Wang F, Zeng A, Ying F. Solving the cold-start problem in scientific credit allocation. J Informetr 2021. [DOI: 10.1016/j.joi.2021.101157] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
8
|
|
9
|
|
10
|
Reply to Herschlag: Enhancing integrative science by acknowledging our biases. Proc Natl Acad Sci U S A 2020; 117:16117. [DOI: 10.1073/pnas.2009232117] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
|
11
|
|