1
|
Dal-Ré R, Bekker LG, Jha V, Le Louarn A, Naudet F. Navigating US participant data sharing requirements: implications for international clinical trials. BMJ 2024; 386:e079701. [PMID: 39242115 DOI: 10.1136/bmj-2024-079701] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 09/09/2024]
Affiliation(s)
- Rafael Dal-Ré
- Epidemiology Unit, Health Research Institute-Fundación Jiménez Díaz University Hospital, Universidad Autónoma de Madrid, Madrid, Spain
| | - Linda-Gail Bekker
- Desmond Tutu HIV Centre, Institute of Infectious Disease and Molecular Medicine, University of Cape Town, South Africa
| | - Vivekanand Jha
- George Institute for Global Health, UNSW, New Delhi, India
- Prasanna School of Public Health, Manipal Academy of Higher Education, Manipal, India
- School of Public Health, Imperial College, London, UK
| | - Anne Le Louarn
- GCS Comité National de Coordination de la Recherche (CNCR), Paris, France
| | - Florian Naudet
- University of Rennes, CHU Rennes, Inserm, EHESP, Irset (Institut de recherche en santé, environnement et travail) -UMR-S 1085, Centre d'investigation clinique de Rennes (CIC1414), Rennes, France
- University Institute of France, Paris, France
| |
Collapse
|
2
|
Shrier I, Impellizzeri FM, Stovitz SD. Identifying and Minimizing Incentives for Competing Interests in Sports Medicine Publications. Sports Med 2024; 54:1991-2000. [PMID: 38714641 DOI: 10.1007/s40279-024-02037-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/17/2024] [Indexed: 05/10/2024]
Abstract
Academics in sports medicine as well as other medical fields are generally expected to publish research and opinions in peer-reviewed journals. The peer-review process is intended to protect against the publication of flawed research and unsubstantiated claims. However, both financial and non-financial competing interests may result in sub-optimal results by affecting investigators, editors, peer reviewers, academic institutions, and publishers. In this article, we focus on the non-financial competing interests created in our current academic system. Because these competing interests are embedded in our current scholastic framework, the potential biases are difficult to quantify. To minimize the effect of these competing interests, we review and highlight some underlying incentives for each stakeholder and some potential solutions to mitigate their effects.
Collapse
Affiliation(s)
- Ian Shrier
- Centre for Clinical Epidemiology, Lady Davis Institute, Jewish General Hospital, McGill University, 3755 Cote Sainte Catherine Road, Montreal, QC, H3T 1E2, Canada.
| | - Franco M Impellizzeri
- School of Sport, Exercise and Rehabilitation, Faculty of Health, University of Technology Sydney, Sydney, NSW, Australia
| | - Steven D Stovitz
- Department of Family Medicine and Community Health, University of Minnesota, Minnesota, USA
| |
Collapse
|
3
|
Cunha-Oliveira T, Ioannidis JPA, Oliveira PJ. Best practices for data management and sharing in experimental biomedical research. Physiol Rev 2024; 104:1387-1408. [PMID: 38451234 DOI: 10.1152/physrev.00043.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2023] [Revised: 02/07/2024] [Accepted: 02/29/2024] [Indexed: 03/08/2024] Open
Abstract
Effective data management is crucial for scientific integrity and reproducibility, a cornerstone of scientific progress. Well-organized and well-documented data enable validation and building on results. Data management encompasses activities including organization, documentation, storage, sharing, and preservation. Robust data management establishes credibility, fostering trust within the scientific community and benefiting researchers' careers. In experimental biomedicine, comprehensive data management is vital due to the typically intricate protocols, extensive metadata, and large datasets. Low-throughput experiments, in particular, require careful management to address variations and errors in protocols and raw data quality. Transparent and accountable research practices rely on accurate documentation of procedures, data collection, and analysis methods. Proper data management ensures long-term preservation and accessibility of valuable datasets. Well-managed data can be revisited, contributing to cumulative knowledge and potential new discoveries. Publicly funded research has an added responsibility for transparency, resource allocation, and avoiding redundancy. Meeting funding agency expectations increasingly requires rigorous methodologies, adherence to standards, comprehensive documentation, and widespread sharing of data, code, and other auxiliary resources. This review provides critical insights into raw and processed data, metadata, high-throughput versus low-throughput datasets, a common language for documentation, experimental and reporting guidelines, efficient data management systems, sharing practices, and relevant repositories. We systematically present available resources and optimal practices for wide use by experimental biomedical researchers.
Collapse
Affiliation(s)
- Teresa Cunha-Oliveira
- Center for Neuroscience and Cell Biology, University of Coimbra, Coimbra, Portugal
- Center for Innovative Biomedicine and Biotechnology, University of Coimbra, Coimbra, Portugal
| | - John P A Ioannidis
- Meta-Research Innovation Center at Stanford (METRICS), Stanford, California, United States
- Department of Statistics, Stanford University, Stanford, California, United States
| | - Paulo J Oliveira
- Center for Neuroscience and Cell Biology, University of Coimbra, Coimbra, Portugal
- Center for Innovative Biomedicine and Biotechnology, University of Coimbra, Coimbra, Portugal
| |
Collapse
|
4
|
Fusaroli M, Salvo F, Begaud B, AlShammari TM, Bate A, Battini V, Brueckner A, Candore G, Carnovale C, Crisafulli S, Cutroneo PM, Dolladille C, Drici MD, Faillie JL, Goldman A, Hauben M, Herdeiro MT, Mahaux O, Manlik K, Montastruc F, Noguchi Y, Norén GN, Noseda R, Onakpoya IJ, Pariente A, Poluzzi E, Salem M, Sartori D, Trinh NTH, Tuccori M, van Hunsel F, van Puijenbroek E, Raschi E, Khouri C. The REporting of A Disproportionality Analysis for DrUg Safety Signal Detection Using Individual Case Safety Reports in PharmacoVigilance (READUS-PV): Explanation and Elaboration. Drug Saf 2024; 47:585-599. [PMID: 38713347 PMCID: PMC11116264 DOI: 10.1007/s40264-024-01423-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/07/2024] [Indexed: 05/08/2024]
Abstract
In pharmacovigilance, disproportionality analyses based on individual case safety reports are widely used to detect safety signals. Unfortunately, publishing disproportionality analyses lacks specific guidelines, often leading to incomplete and ambiguous reporting, and carries the risk of incorrect conclusions when data are not placed in the correct context. The REporting of A Disproportionality analysis for drUg Safety signal detection using individual case safety reports in PharmacoVigilance (READUS-PV) statement was developed to address this issue by promoting transparent and comprehensive reporting of disproportionality studies. While the statement paper explains in greater detail the procedure followed to develop these guidelines, with this explanation paper we present the 14 items retained for READUS-PV guidelines, together with an in-depth explanation of their rationale and bullet points to illustrate their practical implementation. Our primary objective is to foster the adoption of the READUS-PV guidelines among authors, editors, peer reviewers, and readers of disproportionality analyses. Enhancing transparency, completeness, and accuracy of reporting, as well as proper interpretation of their results, READUS-PV guidelines will ultimately facilitate evidence-based decision making in pharmacovigilance.
Collapse
Affiliation(s)
- Michele Fusaroli
- Department of Medical and Surgical Sciences, Alma Mater Studiorum, University of Bologna, Bologna, Italy.
| | - Francesco Salvo
- Université de Bordeaux, INSERM, BPH, Team AHeaD, U1219, 33000, Bordeaux, France.
- Service de Pharmacologie Médicale, CHU de Bordeaux, INSERM, U1219, 33000, Bordeaux, France.
| | - Bernard Begaud
- Université de Bordeaux, INSERM, BPH, Team AHeaD, U1219, 33000, Bordeaux, France
| | | | - Andrew Bate
- Global Safety, GSK, Brentford, UK
- Department of Non-Communicable Epidemiology, London School of Hygiene and Tropical Medicine, London, UK
| | - Vera Battini
- Pharmacovigilance and Clinical Research, International Centre for Pesticides and Health Risk Prevention, Department of Biomedical and Clinical Sciences (DIBIC), ASST Fatebenefratelli-Sacco University Hospital, Università degli Studi di Milano, Milan, Italy
| | | | | | - Carla Carnovale
- Pharmacovigilance and Clinical Research, International Centre for Pesticides and Health Risk Prevention, Department of Biomedical and Clinical Sciences (DIBIC), ASST Fatebenefratelli-Sacco University Hospital, Università degli Studi di Milano, Milan, Italy
| | | | - Paola Maria Cutroneo
- Unit of Clinical Pharmacology, Sicily Pharmacovigilance Regional Centre, University Hospital of Messina, Messina, Italy
| | - Charles Dolladille
- UNICAEN, EA4650 SEILIRM, CHU de Caen Normandie, Normandie University, Caen, France
- Department of Pharmacology, CHU de Caen Normandie, Caen, France
| | - Milou-Daniel Drici
- Department of Clinical Pharmacology, Université Côte d'Azur Medical Center, Nice, France
| | - Jean-Luc Faillie
- Desbrest Institute of Epidemiology and Public Health, Department of Medical Pharmacology and Toxicology, INSERM, Univ Montpellier, Regional Pharmacovigilance Centre, CHU Montpellier, Montpellier, France
| | - Adam Goldman
- Department of Internal Medicine, Sheba Medical Center, Ramat-Gan, Israel
- Department of Epidemiology and Preventive Medicine, School of Public Health, Sackler School of Medicine, Tel Aviv University, Tel Aviv, Israel
| | - Manfred Hauben
- Pfizer Inc, New York, NY, USA
- Department of Family and Community Medicine, New York Medical College, Valhalla, New York, USA
| | - Maria Teresa Herdeiro
- Department of Medical Sciences, IBIMED-Institute of Biomedicine, University of Aveiro, 3810-193, Aveiro, Portugal
| | | | - Katrin Manlik
- Medical Affairs and Pharmacovigilance, Bayer AG, Berlin, Germany
| | - François Montastruc
- Department of Medical and Clinical Pharmacology, Centre of PharmacoVigilance and Pharmacoepidemiology, Faculty of Medicine, Toulouse University Hospital (CHU), Toulouse, France
- CIC 1436, Team PEPSS (Pharmacologie En Population cohorteS et biobanqueS), Toulouse University Hospital, Toulouse, France
| | - Yoshihiro Noguchi
- Laboratory of Clinical Pharmacy, Gifu Pharmaceutical University, Gifu, Japan
| | | | - Roberta Noseda
- Institute of Pharmacological Sciences of Southern Switzerland, Division of Clinical Pharmacology and Toxicology, Ente Ospedaliero Cantonale, Lugano, Switzerland
| | - Igho J Onakpoya
- Department for Continuing Education, University of Oxford, Oxford, UK
| | - Antoine Pariente
- Université de Bordeaux, INSERM, BPH, Team AHeaD, U1219, 33000, Bordeaux, France
- Service de Pharmacologie Médicale, CHU de Bordeaux, INSERM, U1219, 33000, Bordeaux, France
| | - Elisabetta Poluzzi
- Department of Medical and Surgical Sciences, Alma Mater Studiorum, University of Bologna, Bologna, Italy
| | | | - Daniele Sartori
- Uppsala Monitoring Centre, Uppsala, Sweden
- Centre for Evidence-Based Medicine, Nuffield, Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Nhung T H Trinh
- PharmacoEpidemiology and Drug Safety Research Group, Department of Pharmacy, University of Oslo, Oslo, Norway
| | - Marco Tuccori
- Tuscany Regional Centre, Unit of Adverse Drug Reaction Monitoring, University Hospital of Pisa, Pisa, Italy
| | - Florence van Hunsel
- Netherlands Pharmacovigilance Centre Lareb, 's-Hertogenbosch, The Netherlands
- PharmacoTherapy, Epidemiology and Economics, University of Groningen, Groningen Research Institute of Pharmacy, Groningen, The Netherlands
| | - Eugène van Puijenbroek
- Netherlands Pharmacovigilance Centre Lareb, 's-Hertogenbosch, The Netherlands
- PharmacoTherapy, Epidemiology and Economics, University of Groningen, Groningen Research Institute of Pharmacy, Groningen, The Netherlands
| | - Emanuel Raschi
- Department of Medical and Surgical Sciences, Alma Mater Studiorum, University of Bologna, Bologna, Italy
| | - Charles Khouri
- Pharmacovigilance Department, Université Grenoble Alpes, Grenoble Alpes University Hospital, Grenoble, France
- UMR 1300-HP2 Laboratory, Université Grenoble Alpes, INSERM, Grenoble Alpes University, Grenoble, France
| |
Collapse
|
5
|
Dulitzki C, Crane SM, Hardwicke TE, Ioannidis JPA. Expanding the data Ark: an attempt to make the data from highly cited social science papers publicly available. ROYAL SOCIETY OPEN SCIENCE 2024; 11:240016. [PMID: 39076822 PMCID: PMC11285638 DOI: 10.1098/rsos.240016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/04/2024] [Accepted: 04/19/2024] [Indexed: 07/31/2024]
Abstract
Access to scientific data can enable independent reuse and verification; however, most data are not available and become increasingly irrecoverable over time. This study aimed to retrieve and preserve important datasets from 160 of the most highly-cited social science articles published between 2008-2013 and 2015-2018. We asked authors if they would share data in a public repository-the Data Ark-or provide reasons if data could not be shared. Of the 160 articles, data for 117 (73%, 95% CI [67%-80%]) were not available and data for 7 (4%, 95% CI [0%-12%]) were available with restrictions. Data for 36 (22%, 95% CI [16%-30%]) articles were available in unrestricted form: 29 of these datasets were already available and 7 datasets were made available in the Data Ark. Most authors did not respond to our data requests and a minority shared reasons for not sharing, such as legal or ethical constraints. These findings highlight an unresolved need to preserve important scientific datasets and increase their accessibility to the scientific community.
Collapse
Affiliation(s)
- Coby Dulitzki
- Department of Biology, Stanford University, Stanford, CA, USA
| | - Steven Michael Crane
- Stanford Prevention Research Center, Stanford School of Medicine, Stanford, CA, USA
| | - Tom E. Hardwicke
- School of Psychological Sciences, University of Melbourne, Melbourne, Australia
| | - John P. A. Ioannidis
- Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA, USA
- Departments of Medicine, of Epidemiology and Population Health, of Biomedical Data Science, and of Statistics, Stanford University, Stanford, CA, USA
- Stanford Prevention Research Center, Stanford School of Medicine, Stanford, CA, USA
| |
Collapse
|
6
|
Pilgram L, Meurers T, Malin B, Schaeffner E, Eckardt KU, Prasser F. The Costs of Anonymization: Case Study Using Clinical Data. J Med Internet Res 2024; 26:e49445. [PMID: 38657232 PMCID: PMC11079766 DOI: 10.2196/49445] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2023] [Revised: 01/14/2024] [Accepted: 02/13/2024] [Indexed: 04/26/2024] Open
Abstract
BACKGROUND Sharing data from clinical studies can accelerate scientific progress, improve transparency, and increase the potential for innovation and collaboration. However, privacy concerns remain a barrier to data sharing. Certain concerns, such as reidentification risk, can be addressed through the application of anonymization algorithms, whereby data are altered so that it is no longer reasonably related to a person. Yet, such alterations have the potential to influence the data set's statistical properties, such that the privacy-utility trade-off must be considered. This has been studied in theory, but evidence based on real-world individual-level clinical data is rare, and anonymization has not broadly been adopted in clinical practice. OBJECTIVE The goal of this study is to contribute to a better understanding of anonymization in the real world by comprehensively evaluating the privacy-utility trade-off of differently anonymized data using data and scientific results from the German Chronic Kidney Disease (GCKD) study. METHODS The GCKD data set extracted for this study consists of 5217 records and 70 variables. A 2-step procedure was followed to determine which variables constituted reidentification risks. To capture a large portion of the risk-utility space, we decided on risk thresholds ranging from 0.02 to 1. The data were then transformed via generalization and suppression, and the anonymization process was varied using a generic and a use case-specific configuration. To assess the utility of the anonymized GCKD data, general-purpose metrics (ie, data granularity and entropy), as well as use case-specific metrics (ie, reproducibility), were applied. Reproducibility was assessed by measuring the overlap of the 95% CI lengths between anonymized and original results. RESULTS Reproducibility measured by 95% CI overlap was higher than utility obtained from general-purpose metrics. For example, granularity varied between 68.2% and 87.6%, and entropy varied between 25.5% and 46.2%, whereas the average 95% CI overlap was above 90% for all risk thresholds applied. A nonoverlapping 95% CI was detected in 6 estimates across all analyses, but the overwhelming majority of estimates exhibited an overlap over 50%. The use case-specific configuration outperformed the generic one in terms of actual utility (ie, reproducibility) at the same level of privacy. CONCLUSIONS Our results illustrate the challenges that anonymization faces when aiming to support multiple likely and possibly competing uses, while use case-specific anonymization can provide greater utility. This aspect should be taken into account when evaluating the associated costs of anonymized data and attempting to maintain sufficiently high levels of privacy for anonymized data. TRIAL REGISTRATION German Clinical Trials Register DRKS00003971; https://drks.de/search/en/trial/DRKS00003971. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) RR2-10.1093/ndt/gfr456.
Collapse
Affiliation(s)
- Lisa Pilgram
- Junior Digital Clinician Scientist Program, Biomedical Innovation Academy, Berlin Institute of Health at Charité-Universitätsmedizin Berlin, Berlin, Germany
- Department of Nephrology and Medical Intensive Care, Charité-Universitätsmedizin Berlin, Berlin, Germany
| | - Thierry Meurers
- Medical Informatics Group, Berlin Institute of Health at Charité-Universitätsmedizin Berlin, Berlin, Germany
| | - Bradley Malin
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN, United States
| | - Elke Schaeffner
- Institute of Public Health, Charité-Universitätsmedizin Berlin, Berlin, Germany
| | - Kai-Uwe Eckardt
- Department of Nephrology and Medical Intensive Care, Charité-Universitätsmedizin Berlin, Berlin, Germany
- Department of Nephrology and Hypertension, Universitätsklinikum Erlangen, Friedrich-Alexander University Erlangen-Nürnberg, Erlangen, Germany
| | - Fabian Prasser
- Medical Informatics Group, Berlin Institute of Health at Charité-Universitätsmedizin Berlin, Berlin, Germany
| |
Collapse
|
7
|
Bullock GS, Ward P, Kluzek S, Hughes T, Shanley E, Arundale AJH, Ranson C, Nimphius S, Riley RD, Collins GS, Impellizzeri FM. Paving the way for greater open science in sports and exercise medicine: navigating the barriers to adopting open and accessible data practices. Br J Sports Med 2024; 58:293-295. [PMID: 38135463 DOI: 10.1136/bjsports-2023-107225] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/12/2023] [Indexed: 12/24/2023]
Affiliation(s)
- Garrett S Bullock
- Orthopaedic Surgery & Rehabilitation, Wake Forest University School of Medicine, Winston-Salem, North Carolina, USA
- Biostatistics and Data Science, Wake Forest University School of Medicine, Winston-Salem, North Carolina, USA
| | | | - Stefan Kluzek
- Nuffield Department of Orthopaedics, Rheumatology, and Musculoskeletal Sciences, University of Oxford, Oxford, UK
| | - Tom Hughes
- Department of Health Professions, Manchester Metropolitan University, Manchester, UK
| | - Ellen Shanley
- Clinical Excellence, ATI Physical Therapy, Greer, South Carolina, USA
- Arnold School of Public Health, University of South Carolina System, Columbia, South Carolina, USA
| | | | | | - Sophia Nimphius
- School of Medical and Health Sciences, Edith Cowan University, Perth, Western Australia, Australia
| | - Richard D Riley
- Institute of Applied Health Research, University of Birmingham, Birmingham, UK
| | - Gary S Collins
- Centre for Statistics in Medicine, Oxford University, Oxford, UK
| | - Franco M Impellizzeri
- School of Sport, Exercise, and Rehabilitation, University of Technology Sydney, Broadway, New South Wales, Australia
| |
Collapse
|
8
|
Siontis GCM, Coles B, Häner JD, McGovern L, Bartkowiak J, Coughlan JJ, Spirito A, Galea R, Haeberlin A, Praz F, Tomii D, Melvin T, Frenk A, Byrne RA, Fraser AG, Windecker S. Quality and transparency of evidence for implantable cardiovascular medical devices assessed by the CORE-MD consortium. Eur Heart J 2024; 45:161-177. [PMID: 37638967 DOI: 10.1093/eurheartj/ehad567] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/16/2023] [Revised: 08/15/2023] [Accepted: 08/21/2023] [Indexed: 08/29/2023] Open
Abstract
BACKGROUND AND AIMS The European Union Medical Device Regulation 2017/745 challenges key stakeholders to follow transparent and rigorous approaches to the clinical evaluation of medical devices. The purpose of this study is a systematic evaluation of published clinical evidence underlying selected high-risk cardiovascular medical devices before and after market access in the European Union (CE-marking) between 2000 and 2021. METHODS Pre-specified strategies were applied to identify published studies of prospective design evaluating 71 high-risk cardiovascular devices in seven different classes (bioresorbable coronary scaffolds, left atrial appendage occlusion devices, transcatheter aortic valve implantation systems, transcatheter mitral valve repair/replacement systems, surgical aortic and mitral heart valves, leadless pacemakers, subcutaneous implantable cardioverter-defibrillator). The search time span covered 20 years (2000-21). Details of study design, patient population, intervention(s), and primary outcome(s) were summarized and assessed with respect to timing of the corresponding CE-mark approval. RESULTS At least one prospective clinical trial was identified for 70% (50/71) of the pre-specified devices. Overall, 473 reports of 308 prospectively designed studies (enrolling 97 886 individuals) were deemed eligible, including 81% (251/308) prospective non-randomized clinical trials (66 186 individuals) and 19% (57/308) randomized clinical trials (31 700 individuals). Pre-registration of the study protocol was available in 49% (150/308) studies, and 16% (48/308) had a peer-reviewed publicly available protocol. Device-related adverse events were evaluated in 82% (253/308) of studies. An outcome adjudication process was reported in 39% (120/308) of the studies. Sample size was larger for randomized in comparison to non-randomized trials (median of 304 vs. 100 individuals, P < .001). No randomized clinical trial published before CE-mark approval for any of the devices was identified. Non-randomized clinical trials were predominantly published after the corresponding CE-mark approval of the device under evaluation (89%, 224/251). Sample sizes were smaller for studies published before (median of 31 individuals) than after (median of 135 individuals) CE-mark approval (P < .001). Clinical trials with larger sample sizes (>50 individuals) and those with longer recruitment periods were more likely to be published after CE-mark approval, and were more frequent during the period 2016-21. CONCLUSIONS The quantity and quality of publicly available data from prospective clinical investigations across selected categories of cardiovascular devices, before and after CE approval during the period 2000-21, were deemed insufficient. The majority of studies was non-randomized, with increased risk of bias, and performed in small populations without provision of power calculations, and none of the reviewed devices had randomized trial results published prior to CE-mark certification.
Collapse
Affiliation(s)
- George C M Siontis
- Department of Cardiology, Bern University Hospital, Inselspital, University of Bern, Freiburgstrasse 18, CH-3010 Bern, Switzerland
| | - Bernadette Coles
- Velindre University NHS Trust Library and Knowledge Service, Cardiff, UK
| | - Jonas D Häner
- Department of Cardiology, Bern University Hospital, Inselspital, University of Bern, Freiburgstrasse 18, CH-3010 Bern, Switzerland
| | - Laurna McGovern
- Department of Cardiology and Cardiovascular Research Institute (CVRI) Dublin, Mater Private Network, Dublin, Ireland
| | - Joanna Bartkowiak
- Department of Cardiology, Bern University Hospital, Inselspital, University of Bern, Freiburgstrasse 18, CH-3010 Bern, Switzerland
| | - J J Coughlan
- Department of Cardiology and Cardiovascular Research Institute (CVRI) Dublin, Mater Private Network, Dublin, Ireland
- School of Pharmacy and Biomolecular Sciences, RCSI University of Medicine and Health Sciences, Dublin, Ireland
| | - Alessandro Spirito
- Zena and Michael A. Wiener Cardiovascular Institute, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Roberto Galea
- Department of Cardiology, Bern University Hospital, Inselspital, University of Bern, Freiburgstrasse 18, CH-3010 Bern, Switzerland
| | - Andreas Haeberlin
- Department of Cardiology, Bern University Hospital, Inselspital, University of Bern, Freiburgstrasse 18, CH-3010 Bern, Switzerland
| | - Fabien Praz
- Department of Cardiology, Bern University Hospital, Inselspital, University of Bern, Freiburgstrasse 18, CH-3010 Bern, Switzerland
| | - Daijiro Tomii
- Department of Cardiology, Bern University Hospital, Inselspital, University of Bern, Freiburgstrasse 18, CH-3010 Bern, Switzerland
| | - Tom Melvin
- School of Medicine, Trinity College Dublin, Ireland
| | - André Frenk
- Department of Cardiology, Bern University Hospital, Inselspital, University of Bern, Freiburgstrasse 18, CH-3010 Bern, Switzerland
| | - Robert A Byrne
- Department of Cardiology and Cardiovascular Research Institute (CVRI) Dublin, Mater Private Network, Dublin, Ireland
| | - Alan G Fraser
- Department of Cardiology, University Hospital of Wales, Cardiff, UK
| | - Stephan Windecker
- Department of Cardiology, Bern University Hospital, Inselspital, University of Bern, Freiburgstrasse 18, CH-3010 Bern, Switzerland
| |
Collapse
|
9
|
Bullock GS, Ward P, Impellizzeri FM, Kluzek S, Hughes T, Hillman C, Waterman BR, Danelson K, Henry K, Barr E, Healy K, Räisänen AM, Gomez C, Fernandez G, Wolf J, Nicholson KF, Sell T, Zerega R, Dhiman P, Riley RD, Collins GS. Up Front and Open? Shrouded in Secrecy? Or Somewhere in Between? A Meta-Research Systematic Review of Open Science Practices in Sport Medicine Research. J Orthop Sports Phys Ther 2023; 53:735-747. [PMID: 37860866 DOI: 10.2519/jospt.2023.12016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/21/2023]
Abstract
OBJECTIVE: To investigate open science practices in research published in the top 5 sports medicine journals from May 1, 2022, and October 1, 2022. DESIGN: A meta-research systematic review. LITERATURE SEARCH: Open science practices were searched in MEDLINE. STUDY SELECTION CRITERIA: We included original scientific research published in one of the identified top 5 sports medicine journals in 2022 as ranked by Clarivate: (1) British Journal of Sports Medicine, (2) Journal of Sport and Health Science, (3) American Journal of Sports Medicine, (4) Medicine and Science in Sports and Exercise, and (5) Sports Medicine-Open. Studies were excluded if they were systematic reviews, qualitative research, gray literature, or animal or cadaver models. DATA SYNTHESIS: Open science practices were extracted in accordance with the Transparency and Openness Promotion guidelines and patient and public involvement. RESULTS: Two hundred forty-three studies were included. The median number of open science practices in each study was 2, out of a maximum of 12 (range: 0-8; interquartile range: 2). Two hundred thirty-four studies (96%, 95% confidence interval [CI]: 94%-99%) provided an author conflict-of-interest statement and 163 (67%, 95% CI: 62%-73%) reported funding. Twenty-one studies (9%, 95% CI: 5%-12%) provided open-access data. Fifty-four studies (22%, 95% CI: 17%-27%) included a data availability statement and 3 (1%, 95% CI: 0%-3%) made code available. Seventy-six studies (32%, 95% CI: 25%-37%) had transparent materials and 30 (12%, 95% CI: 8%-16%) used a reporting guideline. Twenty-eight studies (12%, 95% CI: 8%-16%) were preregistered. Six studies (3%, 95% CI: 1%-4%) published a protocol. Four studies (2%, 95% CI: 0%-3%) reported an analysis plan a priori. Seven studies (3%, 95% CI: 1%-5%) reported patient and public involvement. CONCLUSION: Open science practices in the sports medicine field are extremely limited. The least followed practices were sharing code, data, and analysis plans. J Orthop Sports Phys Ther 2023;53(12):1-13. Epub 20 October 2023. doi:10.2519/jospt.2023.12016.
Collapse
Affiliation(s)
- Garrett S Bullock
- Department of Orthopaedic Surgery & Rehabilitation, Wake Forest School of Medicine, Winston-Salem, NC
- Department of Biostatistics and Data Science, Wake Forest School of Medicine, Winston-Salem, NC
- Centre for Sport, Exercise and Osteoarthritis Research Versus Arthritis, University of Oxford, Oxford, United Kingdom
- Sport Injury Prevention Research Center, University of Calgary, Calgary, AB, Canada
| | | | - Franco M Impellizzeri
- School of Sport, Exercise, and Rehabilitation, University of Technology Sydney, Sydney, Australia
| | - Stefan Kluzek
- Centre for Sport, Exercise and Osteoarthritis Research Versus Arthritis, University of Oxford, Oxford, United Kingdom
- Sports Medicine Research Department, University of Nottingham, Nottingham, UK
- English Institute of Sport, Marlow, United Kingdom
| | - Tom Hughes
- Department of Health Professions, Manchester Metropolitan University, Manchester, United Kingdom
| | - Charles Hillman
- Sports Medicine Research Department, University of Nottingham, Nottingham, UK
| | - Brian R Waterman
- Department of Orthopaedic Surgery & Rehabilitation, Wake Forest School of Medicine, Winston-Salem, NC
| | - Kerry Danelson
- Department of Orthopaedic Surgery & Rehabilitation, Wake Forest School of Medicine, Winston-Salem, NC
| | - Kaitlin Henry
- Department of Orthopaedic Surgery & Rehabilitation, Wake Forest School of Medicine, Winston-Salem, NC
| | - Emily Barr
- Department of Orthopaedic Surgery & Rehabilitation, Wake Forest School of Medicine, Winston-Salem, NC
| | - Kelsey Healy
- Department of Orthopaedic Surgery & Rehabilitation, Wake Forest School of Medicine, Winston-Salem, NC
| | - Anu M Räisänen
- Department of Physical Therapy Education - Oregon, College of Health Sciences-Northwest, Western University of Health Sciences, Lebanon, OR
- Sport Injury Prevention Research Centre, Faculty of Kinesiology, University of Calgary, Calgary, AB, Canada
| | - Christina Gomez
- Department of Physical Therapy Education - Oregon, College of Health Sciences-Northwest, Western University of Health Sciences, Lebanon, OR
| | - Garrett Fernandez
- Department of Orthopaedic Surgery & Rehabilitation, Wake Forest School of Medicine, Winston-Salem, NC
| | - Jakob Wolf
- Department of Orthopaedic Surgery & Rehabilitation, Wake Forest School of Medicine, Winston-Salem, NC
| | - Kristen F Nicholson
- Department of Orthopaedic Surgery & Rehabilitation, Wake Forest School of Medicine, Winston-Salem, NC
| | | | | | - Paula Dhiman
- Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology, and Musculoskeletal Sciences, University of Oxford, Oxford, United Kingdom
| | - Richard D Riley
- Institute of Applied Health Research, College of Medical and Dental Sciences, University of Birmingham, Birmingham, United Kingdom
| | - Gary S Collins
- Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology, and Musculoskeletal Sciences, University of Oxford, Oxford, United Kingdom
| |
Collapse
|
10
|
Hopkins AM, Modi ND, Abuhelwa AY, Kichenadasse G, Kuderer NM, Lyman GH, Wiese MD, McKinnon RA, Rockhold FW, Mann A, Rowland A, Sorich MJ. Heterogeneity and Utility of Pharmaceutical Company Sharing of Individual-Participant Data Packages. JAMA Oncol 2023; 9:1621-1626. [PMID: 37796495 PMCID: PMC10557028 DOI: 10.1001/jamaoncol.2023.3996] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2023] [Accepted: 07/10/2023] [Indexed: 10/06/2023]
Abstract
Importance The pharmaceutical industry has made substantial investments in developing processes for sharing individual-participant data (IPD) from clinical trials. However, the utility and completeness of shared IPD and supporting documents must be evaluated to ensure the potential for scientific advancements from the data sharing ecosystem can be realized. Objective To assess the utility and completeness of IPD and supporting documents provided from industry-sponsored clinical trials. Design, Setting, and Participants From February 9, 2022, to February 9, 2023, 91 of 203 clinical trials supporting US Food and Drug Administration registrations of anticancer medicines for the treatment of solid tumors from the past decade were confirmed as eligible for IPD request. This quality improvement study performed a retrospective audit of the utility and completeness of the IPD and supporting documents provided from the 91 clinical trials for a planned meta-analysis. Exposures Request for IPD from 91 clinical oncology trials indicated as eligible for the request. Main Outcomes and Measures The utility and completeness of the IPD and supporting documents provided. Results The IPD packages were obtained from 70 of 91 requested clinical trials (77%). The median time to data provision was 123 (range, 117-352) days. Redactions were observed in 18 of the acquired IPD packages (26%) for outcome data, 11 (16%) for assessment variables, and 19 (27%) for adjustment data. Additionally, 20 IPD packages (29%) lacked a clinical study report, 4 (6%) had incomplete or missing data dictionaries, and 20 (29%) were missing anonymization or redaction description files. Access to IPD from 21 eligible trials (23%) was not granted. Conclusions and Relevance In this quality improvement study, there was substantial variability within the provided IPD packages regarding the completeness of key data variables and supporting documents. To improve the data sharing ecosystem, key areas for enhancement include (1) ensuring that clinical trials are eligible for IPD sharing, (2) making eligible IPD transparently accessible, and (3) ensuring that IPD packages meet a standard of utility and completeness.
Collapse
Affiliation(s)
- Ashley M. Hopkins
- College of Medicine and Public Health, Flinders University, Adelaide, South Australia, Australia
| | - Natansh D. Modi
- College of Medicine and Public Health, Flinders University, Adelaide, South Australia, Australia
| | - Ahmad Y. Abuhelwa
- College of Pharmacy, University of Sharjah, Sharjah, United Arab Emirates
| | - Ganessan Kichenadasse
- College of Medicine and Public Health, Flinders University, Adelaide, South Australia, Australia
- Flinders Centre for Innovation in Cancer, Department of Medical Oncology, Flinders Medical Centre, Adelaide, South Australia, Australia
| | | | - Gary H. Lyman
- Public Health Sciences Division, Fred Hutchinson Cancer Research Center, Seattle, Washington
| | - Michael D. Wiese
- Clinical & Health Sciences, University of South Australia, Adelaide, South Australia, Australia
| | - Ross A. McKinnon
- College of Medicine and Public Health, Flinders University, Adelaide, South Australia, Australia
| | - Frank W. Rockhold
- Department of Biostatistics and Bioinformatics, Duke University, Durham, North Carolina
| | - Aaron Mann
- Clinical Research Data Sharing Alliance, Piscataway, New Jersey
| | - Andrew Rowland
- College of Medicine and Public Health, Flinders University, Adelaide, South Australia, Australia
| | - Michael J. Sorich
- College of Medicine and Public Health, Flinders University, Adelaide, South Australia, Australia
| |
Collapse
|
11
|
Locher C, Le Goff G, Le Louarn A, Mansmann U, Naudet F. Making data sharing the norm in medical research. BMJ 2023; 382:p1434. [PMID: 37433610 DOI: 10.1136/bmj.p1434] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 07/13/2023]
Affiliation(s)
- Clara Locher
- University of Rennes, CHU Rennes, Inserm, Irset (Institut de recherche en santé, environnement et travail)-UMR_S 1085, CIC 1414 (Centre of Clinical Investigation of Rennes, Rennes, France
| | - Gérard Le Goff
- Patient representative, France Rein Bretagne, Laillé, France
| | - Anne Le Louarn
- GCS CNCR (Comité National de Coordination de la Recherche), Paris, France
| | - Ulrich Mansmann
- Ludwig-Maximilians University Munich, Medical Faculty, Institute for Medical Information Processing, Biometry, and Epidemiology, Munich, Germany
| | - Florian Naudet
- University of Rennes, CHU Rennes, Inserm, Irset (Institut de recherche en santé, environnement et travail)-UMR_S 1085, CIC 1414 (Centre of Clinical Investigation of Rennes, Rennes, France
- University Institute of France (IUF), Paris, France
| |
Collapse
|
12
|
Garralda E, Laurie SA, Seymour L, de Vries EGE. Towards evidence-based response criteria for cancer immunotherapy. Nat Commun 2023; 14:3001. [PMID: 37225715 DOI: 10.1038/s41467-023-38837-3] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Accepted: 05/17/2023] [Indexed: 05/26/2023] Open
Affiliation(s)
- Elena Garralda
- Research Unit, Vall d'Hebron Institute of Oncology, Barcelona, Spain
| | - Scott A Laurie
- Division of Medical Oncology, The Ottawa Hospital Cancer Centre, Ottawa, Canada
| | - Lesley Seymour
- Canadian Cancer Trials Group, Queens University, Cancer Centre of South Eastern Ontario, Kingston, ON, Canada
| | - Elisabeth G E de Vries
- Department of Medical Oncology, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands.
| |
Collapse
|
13
|
Haven TL, Abunijela S, Hildebrand N. Biomedical supervisors' role modeling of open science practices. eLife 2023; 12:83484. [PMID: 37211820 DOI: 10.7554/elife.83484] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2022] [Accepted: 05/04/2023] [Indexed: 05/23/2023] Open
Abstract
Supervision is one important way to socialize Ph.D. candidates into open and responsible research. We hypothesized that one should be more likely to identify open science practices (here publishing open access and sharing data) in empirical publications that were part of a Ph.D. thesis when the Ph.D. candidates' supervisors engaged in these practices compared to those whose supervisors did not or less often did. Departing from thesis repositories at four Dutch University Medical centers, we included 211 pairs of supervisors and Ph.D. candidates, resulting in a sample of 2062 publications. We determined open access status using UnpaywallR and Open Data using Oddpub, where we also manually screened publications with potential open data statements. Eighty-three percent of our sample was published openly, and 9% had open data statements. Having a supervisor who published open access more often than the national average was associated with an odds of 1.99 to publish open access. However, this effect became nonsignificant when correcting for institutions. Having a supervisor who shared data was associated with 2.22 (CI:1.19-4.12) times the odds to share data compared to having a supervisor that did not. This odds ratio increased to 4.6 (CI:1.86-11.35) after removing false positives. The prevalence of open data in our sample was comparable to international studies; open access rates were higher. Whilst Ph.D. candidates spearhead initiatives to promote open science, this study adds value by investigating the role of supervisors in promoting open science.
Collapse
Affiliation(s)
- Tamarinde L Haven
- Danish Centre for Studies in Research and Research Policy, Department of Political Science, Aarhus University, Aarhus, Denmark
| | - Susan Abunijela
- QUEST Center for Responsible Research, Berlin Institute of Health at Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Nicole Hildebrand
- QUEST Center for Responsible Research, Berlin Institute of Health at Charité - Universitätsmedizin Berlin, Berlin, Germany
| |
Collapse
|