1
|
Machado T, Mainoli B, Caldeira D, Ferreira JJ, Fernandes RM. Data monitoring committees in pediatric randomized controlled trials registered in ClinicalTrials.gov. Clin Trials 2023; 20:624-631. [PMID: 37366168 PMCID: PMC10638853 DOI: 10.1177/17407745231182417] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/28/2023]
Abstract
BACKGROUND Data monitoring committees advise on clinical trial conduct through appraisal of emerging data to ensure participant safety and scientific integrity. While consideration of their use is recommended for trials performed with vulnerable populations, previous research has shown that data monitoring committees are reported infrequently in publications of pediatric randomized controlled trials. We aimed to assess the frequency of reported data monitoring committee adoption in ClinicalTrials.gov registry records and to examine the influence of key trial characteristics. METHODS We conducted a cross-sectional data analysis of all randomized controlled trials performed exclusively in a pediatric population and registered in ClinicalTrials.gov between 2008 and 2021. We used the Access to Aggregate Content of ClinicalTrials.gov database to retrieve publicly available information on trial characteristics and data on safety results. Abstracted data included reported trial design and conduct parameters, population and intervention characteristics, reasons for prematurely halting, serious adverse events, and mortality outcomes. We performed descriptive analyses on the collected data and explored the influence of clinical, methodological, and operational trial characteristics on the reported adoption of data monitoring committees. RESULTS We identified 13,928 pediatric randomized controlled trial records, of which 39.7% reported adopting a data monitoring committee, 49.0% reported not adopting a data monitoring committee, and 11.3% did not answer on this item. While the number of registered pediatric trials has been increasing since 2008, we found no clear time trend in the reported adoption of data monitoring committees. Data monitoring committees were more common in multicenter trials (50.6% vs 36.9% for single-center), multinational trials (60.2% vs 38.7% for single-country), National Institutes of Health-funded (60.3% vs 40.1% for industry-funded or 37.5% for other funders), and placebo-controlled (47.6% vs 37.5% for other types of control groups). Data monitoring committees were also more common among trials enrolling younger participants, trials employing blinding techniques, and larger trials. Data monitoring committees were more common in trials with at least one serious adverse event (52.6% vs 38.4% for those without) as well as for trials with reported deaths (70.3% vs 38.9% for trials without reported deaths). In all, 4.9% were listed as halted prematurely, most often due to low accrual rates. Trials with a data monitoring committee were more often halted for reasons related to scientific data than trials without a data monitoring committee (15.7% vs 7.3%). CONCLUSION According to registry records, the use of data monitoring committees in pediatric randomized controlled trials was more frequent than previously reported in reviews of published trial reports. The use of data monitoring committees varied across key clinical and trial characteristics based on which their use is recommended. Data monitoring committees may still be underutilized in pediatric trials, and reporting of this item could be improved.
Collapse
Affiliation(s)
- Tiago Machado
- Laboratory of Clinical Pharmacology and Therapeutics, Faculdade de Medicina, Universidade de Lisboa, Lisbon, Portugal
- Instituto de Medicina Molecular João Lobo Antunes, Lisbon, Portugal
| | - Beatrice Mainoli
- Laboratory of Clinical Pharmacology and Therapeutics, Faculdade de Medicina, Universidade de Lisboa, Lisbon, Portugal
- Instituto de Medicina Molecular João Lobo Antunes, Lisbon, Portugal
- Clinical Research Unit, Research Center of IPO Porto (CI-IPOP), Porto, Portugal
| | - Daniel Caldeira
- Laboratory of Clinical Pharmacology and Therapeutics, Faculdade de Medicina, Universidade de Lisboa, Lisbon, Portugal
- Instituto de Medicina Molecular João Lobo Antunes, Lisbon, Portugal
| | - Joaquim J Ferreira
- Laboratory of Clinical Pharmacology and Therapeutics, Faculdade de Medicina, Universidade de Lisboa, Lisbon, Portugal
- Instituto de Medicina Molecular João Lobo Antunes, Lisbon, Portugal
- Campus Neurológico Sénior (CNS), Torres Vedras, Portugal
| | - Ricardo M Fernandes
- Laboratory of Clinical Pharmacology and Therapeutics, Faculdade de Medicina, Universidade de Lisboa, Lisbon, Portugal
- Instituto de Medicina Molecular João Lobo Antunes, Lisbon, Portugal
- Department of Pediatrics, Santa Maria Hospital, Centro Hospitalar Universitário Lisboa Norte, Lisbon, Portugal
| |
Collapse
|
2
|
Ruamviboonsuk V, Thinkhamrop B, Kulvichit K, Tulvatana W. Data sharing implementation in top 10 ophthalmology journals in 2021. BMJ Open Ophthalmol 2023; 8:e001276. [PMID: 37493649 PMCID: PMC10335465 DOI: 10.1136/bmjophth-2023-001276] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2023] [Accepted: 06/27/2023] [Indexed: 07/27/2023] Open
Abstract
BACKGROUND/AIMS Deidentified individual participant data (IPD) sharing has been implemented in the International Committee of Medical Journal Editors journals since 2017. However, there were some published clinical trials that did not follow the new implemented policy. This study examines the number of clinical trials that endorsed IPD sharing policy among top ophthalmology journals. METHOD All published original articles in 2021 in 10 highest-ranking ophthalmology journals according to the 2020 journal impact factor were included. Clinical trials were determined by the WHO definition of clinical trials. Each article was then thoroughly searched for the IPD sharing statement either in the manuscript or in the clinical trial registry. We collected the number of published clinical trials that implemented IPD sharing policy as our primary outcome. RESULTS 1852 published articles in top 10 ophthalmology journals were identified, and 9.45% were clinical trials. Of these clinical trials, 44% had clinical trial registrations and 49.14% declared IPD sharing statements. Only 42 (48.83%) clinical trials were willing to share IPD, and 5 (10.21%) of these share IPD via an online repository platform. In terms of sharing period, 37 clinical trials were willing to share right after the publication and only 2 showed the ending of sharing period. CONCLUSION This report shows that the number of clinical trials in top ophthalmology journals that endorsed the IPD sharing policy and the number of registrations is lower than half even though the policy has been implemented for several years. Future updates are necessary as policy evolves.
Collapse
Affiliation(s)
- Varis Ruamviboonsuk
- Department of Biochemistry, Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand
| | - Bandit Thinkhamrop
- Thai Clinical Trials Registry, The Medical Research Foundation, Bangkok, Thailand
- Department of Epidemiology and Biostatistics, Faculty of Public Health, Khon Kaen University, Khon Kaen, Thailand
| | - Kittisak Kulvichit
- Thai Clinical Trials Registry, The Medical Research Foundation, Bangkok, Thailand
- Center of Excellence in Retina, Department of Ophthalmology, Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand
| | - Wasee Tulvatana
- Thai Clinical Trials Registry, The Medical Research Foundation, Bangkok, Thailand
- Department of Ophthalmology, Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand
| |
Collapse
|
3
|
Weibel S, Popp M, Reis S, Skoetz N, Garner P, Sydenham E. Identifying and managing problematic trials: A research integrity assessment tool for randomized controlled trials in evidence synthesis. Res Synth Methods 2023; 14:357-369. [PMID: 36054583 PMCID: PMC10551123 DOI: 10.1002/jrsm.1599] [Citation(s) in RCA: 27] [Impact Index Per Article: 27.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2022] [Revised: 07/28/2022] [Accepted: 08/11/2022] [Indexed: 12/29/2022]
Abstract
Evidence synthesis findings depend on the assumption that the included studies follow good clinical practice and results are not fabricated or false. Studies which are problematic due to scientific misconduct, poor research practice, or honest error may distort evidence synthesis findings. Authors of evidence synthesis need transparent mechanisms to identify and manage problematic studies to avoid misleading findings. As evidence synthesis authors of the Cochrane COVID-19 review on ivermectin, we identified many problematic studies in terms of research integrity and regulatory compliance. Through iterative discussion, we developed a research integrity assessment (RIA) tool for randomized controlled trials for the update of this Cochrane review. In this paper, we explain the rationale and application of the RIA tool in this case study. RIA assesses six study criteria: study retraction, prospective trial registration, adequate ethics approval, author group, plausibility of methods (e.g., randomization), and plausibility of study results. RIA was used in the Cochrane review as part of the eligibility check during screening of potentially eligible studies. Problematic studies were excluded and studies with open questions were held in awaiting classification until clarified. RIA decisions were made independently by two authors and reported transparently. Using the RIA tool resulted in the exclusion of >40% of studies in the first update of the review. RIA is a complementary tool prior to assessing "Risk of Bias" aiming to establish the integrity and authenticity of studies. RIA provides a platform for urgent development of a standard approach to identifying and managing problematic studies.
Collapse
Affiliation(s)
- Stephanie Weibel
- Department of Anaesthesiology, Intensive Care, Emergency and Pain Medicine, University Hospital Wuerzburg, 97080 Wuerzburg, Germany
| | - Maria Popp
- Department of Anaesthesiology, Intensive Care, Emergency and Pain Medicine, University Hospital Wuerzburg, 97080 Wuerzburg, Germany
| | - Stefanie Reis
- Department of Anaesthesiology, Intensive Care, Emergency and Pain Medicine, University Hospital Wuerzburg, 97080 Wuerzburg, Germany
| | - Nicole Skoetz
- Evidence-based Oncology, Department I of Internal Medicine, Center for Integrated Oncology Aachen Bonn Cologne Duesseldorf, Faculty of Medicine and University Hospital Cologne, University of Cologne, 50937 Cologne, Germany
| | - Paul Garner
- Centre for Evidence Synthesis in Global Health, Liverpool School of Tropical Medicine, Liverpool, L3 5QA, UK
| | - Emma Sydenham
- Cochrane Injuries Group, London School of Hygiene & Tropical Medicine, London, WC1E 7HT, UK
| |
Collapse
|
4
|
Lindsley K, Fusco N, Li T, Scholten R, Hooft L. Clinical trial registration was associated with lower risk of bias compared with non-registered trials among trials included in systematic reviews. J Clin Epidemiol 2022; 145:164-173. [PMID: 35081449 PMCID: PMC9875740 DOI: 10.1016/j.jclinepi.2022.01.012] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2021] [Revised: 01/08/2022] [Accepted: 01/18/2022] [Indexed: 01/27/2023]
Abstract
OBJECTIVE To examine the association between clinical trial registration and risk of bias in clinical trials that have been included in systematic reviews. As a secondary objective, we evaluated the risk of bias among trials registered prospectively vs. retrospectively. METHOD Clinical trials published in 2005 or after included in a sample of 100 Cochrane systematic reviews published from 2014-2019. RESULTS Of 1,177 clinical trials identified, we verified 368 (31%) had been registered, of which 135 (36.7%) were registered prospectively (i.e., before or up to 1 month after enrollment of the first participant). Across the bias domains (one bias assessment for each domain per trial), the percentage of trials at low risk ranged from 29% to 58%; unclear risk ranged from to 26% to 61% and high risk ranged from 2% to 38%. Trials that had been registered had less high or unclear risk of bias in five domains: random sequence generation (univariate risk ratio [RR] 0.69, 95% confidence interval [95% CI] 0.58-0.81), allocation concealment (RR 0.64, 95% CI 0.57-0.72), performance bias (RR 0.65, 95% CI 0.58-0.72), detection bias (RR 0.70, 95% CI 0.62-0.78), and reporting bias (RR 0.62, 95% CI 0.53-0.73). An association between clinical trial registration and high or unclear risk of attrition bias could not be demonstrated nor refuted (RR 1.02, 95% CI 0.89-1.17). It also was observed in terms of overall risk of bias, that registered trials had less high or unclear overall risk of bias than trials that had not been registered (univariate RR 0.29, 95% CI 0.19-0.46). Prospective clinical trial registration was associated with low risks of selection bias due to inadequate allocation concealment, performance bias, and detection bias compared with retrospective clinical trial registration. CONCLUSION In a large sample of clinical trials included in recently published systematic reviews of interventions, clinical trial registration was associated with low risk of bias for five of the six domains examined.
Collapse
Affiliation(s)
- Kristina Lindsley
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands; Cochrane Netherlands, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands.
| | | | - Tianjing Li
- Department of Ophthalmology, School of Medicine, University of Colorado Anschutz Medical Campus, Aurora, CO
| | - Rob Scholten
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands; Cochrane Netherlands, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Lotty Hooft
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands; Cochrane Netherlands, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| |
Collapse
|
5
|
Huh KY, Yu KS, Lim HS, Kim H. Trends of clinical trials from 2017 to 2019 in Korea: an integrated analysis based on the Ministry of Food and Drug Safety (MFDS) and the Clinical Research Information Service (CRIS) registries. Transl Clin Pharmacol 2022; 29:186-196. [PMID: 35024359 PMCID: PMC8718355 DOI: 10.12793/tcp.2021.29.e24] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2021] [Revised: 11/28/2021] [Accepted: 12/16/2021] [Indexed: 12/03/2022] Open
Abstract
Public disclosure of approved clinical trials in a reliable registry can provide the transparency of the study. Although the registration of clinical trials has increased remarkably, the integrity of the data is not always satisfactory. In this study, we analyzed public clinical trial databases updated by the Ministry of Food and Drug Safety (MFDS) and Clinical Research Information Service (CRIS) registry to provide an overview of the trends of clinical trials approved between 2017 and 2019 in Korea. Information on clinical trials approved between January 1, 2017 and December 31, 2019 was collected from two databases. Trial information was categorized and summarized by study phase, therapeutic area, and location of the participating centers. A total of 655 to 715 clinical trials were newly approved annually by MFDS during the period from 2017 to 2019. Phase 1 clinical trials accounted for the largest proportion (31.0%), followed by phase 3 (29.5%), investigator-initiated trials (24.1%), phase 2 (14.6%), and phase 4 (0.5%). The number of clinical trials classified as an Antineoplastic and immunomodulating agent was the greatest (40.1%) regardless of the study phase. The similar result was obtained from CRIS registry where therapeutic area Neoplasms (15.9%) accounted for the largest number. The number of clinical trials performed in Seoul and Gyeonggi-do was approximately 70% of the total trials. In conclusion, our study provided a comprehensive overview of clinical trials in Korea from 2017 to 2019. The discrepancy between clinical trial registries could be resolved by introducing standardized database and guidelines.
Collapse
Affiliation(s)
- Ki Young Huh
- Department of Clinical Pharmacology and Therapeutics, Seoul National University College of Medicine and Hospital, Seoul 03080, Korea
| | - Kyung-Sang Yu
- Department of Clinical Pharmacology and Therapeutics, Seoul National University College of Medicine and Hospital, Seoul 03080, Korea
| | - Hyeong-Seok Lim
- Department of Clinical Pharmacology and Therapeutics, Asan Medical Center, University of Ulsan College of Medicine, Seoul 05505, Korea
| | - Hyungsub Kim
- Department of Emergency Medical Services, College of Health Sciences, Eulji University, Seongnam 13135, Korea
| |
Collapse
|
6
|
Tovey D, Tugwell P. Provisional title: old world, new world. J Clin Epidemiol 2021; 132:A5-A6. [PMID: 33775388 DOI: 10.1016/j.jclinepi.2021.02.018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|