1
|
Hinga A, Ibrahim A, Vintimilla D, Jones M, Eckstein L, Rid A, Shah SK, Kamuya D. Ethical preparedness of data monitoring committees (DMCs) to oversee international clinical trials: a qualitative descriptive study. BMJ Glob Health 2024; 9:e015233. [PMID: 39182924 PMCID: PMC11404254 DOI: 10.1136/bmjgh-2024-015233] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2024] [Accepted: 07/31/2024] [Indexed: 08/27/2024] Open
Abstract
INTRODUCTION A data monitoring committee (DMC) is an independent group of experts who assess the ongoing scientific and ethical integrity of a study through periodic analyses of study data. The objective of this study was to explore the extent to which the structure, membership and deliberations of DMCs enable them to address ethical issues. METHODS We conducted qualitative individual interviews (n=22) with DMC members from countries across Africa, the Americas, South Asia and the UK. We selected interview respondents through purposive sampling, managed data using NVivo (Release V.1.7) and analysed data thematically. RESULTS All respondents were highly experienced professionals; many (18/22) had received training in medicine and/or statistics. One respondent had academic qualifications in ethics, and four indicated that they served on DMCs as ethicists. While respondents generally felt DMCs should be required for studies that were high-risk or enrolled vulnerable populations, some were concerned about the overuse of DMCs. There were divergent views on the necessity of geographical and disciplinary representation in DMC membership, including about whether ethicists were helpful. Many respondents described a DMC member recruitment process that they felt was somewhat exclusive. While one respondent received DMC-specific training, most described learning on the job. Respondents generally agreed that study protocols and DMC charters were key guiding documents for addressing ethical issues and described DMC deliberations that often, but not always, involved consensus-building. CONCLUSION This study is one of the first to consider the ethical implications of DMC structure, membership and deliberations. The potential overuse of DMCs, DMC member recruitment processes that seem somewhat insular, limited training for DMC members, and divergent approaches to deliberation may limit the capacity of DMCs for addressing ethical issues. Further research on DMC structure and processes could help enhance the ethical preparedness of DMCs.
Collapse
Affiliation(s)
- Alex Hinga
- Health Systems and Research Ethics Department, KEMRI-Wellcome Trust Research Programme, Kilifi, Kenya
| | - Akram Ibrahim
- Mary Ann & J. Milburn Smith Child Health Outcomes, Research, and Evaluation Center, Stanley Manne Children's Research Institute, Ann & Robert H Lurie Children's Hospital, Chicago, Illinois, USA
| | | | - Mickayla Jones
- Mary Ann & J. Milburn Smith Child Health Outcomes, Research, and Evaluation Center, Stanley Manne Children's Research Institute, Ann & Robert H Lurie Children's Hospital, Chicago, Illinois, USA
| | - Lisa Eckstein
- School of Law, University of Tasmania, Hobart, Tasmania, Australia
| | - Annette Rid
- Department of Bioethics, The Clinical Center & Division of International Science Policy, Planning and Evaluation, Fogarty International Center, National Institutes of Health, Bethesda, Maryland, USA
| | - Seema K Shah
- Mary Ann & J. Milburn Smith Child Health Outcomes, Research, and Evaluation Center, Stanley Manne Children's Research Institute, Ann & Robert H Lurie Children's Hospital, Chicago, Illinois, USA
- Department of Pediatrics, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA
| | - Dorcas Kamuya
- Health Systems and Research Ethics Department, KEMRI-Wellcome Trust Research Programme, Kilifi, Kenya
- Nuffield Department of Clinical Medicine, Centre for Tropical Medicine and Global Health, University of Oxford, Oxford, UK
| |
Collapse
|
2
|
Baba A, Aregbesola A, Caldwell PHY, Elliott SA, Elsman EBM, Fernandes RM, Hartling L, Heath A, Kelly LE, Preston J, Sammy A, Webbe J, Williams K, Woolfall K, Klassen TP, Offringa M. Developments in the Design, Conduct, and Reporting of Child Health Trials. Pediatrics 2024; 154:e2024065799. [PMID: 38832441 DOI: 10.1542/peds.2024-065799] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/17/2024] [Revised: 03/25/2024] [Accepted: 03/28/2024] [Indexed: 06/05/2024] Open
Abstract
To identify priority areas to improve the design, conduct, and reporting of pediatric clinical trials, the international expert network, Standards for Research (StaR) in Child Health, was assembled and published the first 6 Standards in Pediatrics in 2012. After a recent review summarizing the 247 publications by StaR Child Health authors that highlight research practices that add value and reduce research "waste," the current review assesses the progress in key child health trial methods areas: consent and recruitment, containing risk of bias, roles of data monitoring committees, appropriate sample size calculations, outcome selection and measurement, and age groups for pediatric trials. Although meaningful change has occurred within the child health research ecosystem, measurable progress is still disappointingly slow. In this context, we identify and review emerging trends that will advance the agenda of increased clinical usefulness of pediatric trials, including patient and public engagement, Bayesian statistical approaches, adaptive designs, and platform trials. We explore how implementation science approaches could be applied to effect measurable improvements in the design, conducted, and reporting of child health research.
Collapse
Affiliation(s)
- Ami Baba
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Alex Aregbesola
- Children's Hospital Research Institute of Manitoba, Winnipeg, Manitoba, Canada
- Department of Pediatrics and Child Health, Max Rady College of Medicine, Rady Faculty of Health Sciences, University of Manitoba, Winnipeg, Canada
| | - Patrina H Y Caldwell
- Discipline of Child and Adolescent Health, University of Sydney, Sydney, Australia
| | - Sarah A Elliott
- Cochrane Child Health
- Alberta Research Centre for Health Evidence, Department of Pediatrics, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, Alberta, Canada
| | - Ellen B M Elsman
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Ricardo M Fernandes
- Clinical Pharmacology and Therapeutics, Faculty of Medicine, University of Lisbon, Lisbon, Portugal
| | - Lisa Hartling
- Cochrane Child Health
- Alberta Research Centre for Health Evidence, Department of Pediatrics, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, Alberta, Canada
| | - Anna Heath
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
- Division of Biostatistics, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada
- Department of Statistical Science, University College London, London, United Kingdom
| | - Lauren E Kelly
- Children's Hospital Research Institute of Manitoba, Winnipeg, Manitoba, Canada
- Department of Pharmacology and Therapeutics, Rady Faculty of Medicine, University of Manitoba, Winnipeg, Canada
| | - Jennifer Preston
- National Institute for Health and Care Research (NIHR) Alder Hey Clinical Research Facility, Liverpool, United Kingdom
| | - Adrian Sammy
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - James Webbe
- Section of Neonatal Medicine, Imperial College London, London, United Kingdom
| | - Katrina Williams
- Department of Paediatrics, Monash University and Developmental Paediatrics, Monash Children's Hospital, Melbourne, Australia
| | - Kerry Woolfall
- Department of Public Health, Policy and Systems, University of Liverpool, Liverpool, United Kingdom
| | - Terry P Klassen
- Children's Hospital Research Institute of Manitoba, Winnipeg, Manitoba, Canada
| | - Martin Offringa
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| |
Collapse
|
3
|
Sammy A, Baba A, Klassen TP, Moher D, Offringa M. A Decade of Efforts to Add Value to Child Health Research Practices. J Pediatr 2024; 265:113840. [PMID: 38000771 DOI: 10.1016/j.jpeds.2023.113840] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/09/2023] [Revised: 10/25/2023] [Accepted: 11/15/2023] [Indexed: 11/26/2023]
Abstract
OBJECTIVE To identify practices that add value to improve the design, conduct, and reporting of child health research and reduce research waste. STUDY DESIGN In order to categorize the contributions of members of Standards for Research (StaR) in Child Health network, we developed a novel Child Health Improving Research Practices (CHIRP) framework comprised of 5 domains meant to counteract avoidable child health research waste and improve quality: 1) address research questions relevant to children, their families, clinicians, and researchers; 2) apply appropriate research design, conduct and analysis; 3) ensure efficient research oversight and regulation; 4) Provide accessible research protocols and reports; and 5) develop unbiased and usable research reports, including 17 responsible research practice recommendations. All child health research relevant publications by the 48 original StaR standards' authors over the last decade were identified, and main topic areas were categorized using this framework. RESULTS A total of 247 publications were included in the final sample: 100 publications (41%) in domain 1 (3 recommendations), 77 publications (31%) in domain 2 (3), 35 publications (14%) in domain 3 (4), 20 publications (8%) in domain 4 (4), and 15 publications (6%) in domain 5 (3). We identified readily implementable "responsible" research practices to counter child health research waste and improve quality, especially in the areas of patients and families' engagement throughout the research process, developing Core Outcome Sets, and addressing ethics and regulatory oversight issues. CONCLUSION While most of the practices are readily implementable, increased awareness of methodological issues and wider guideline uptake is needed to improve child health research. The CHIRP Framework can be used to guide responsible research practices that add value to child health research.
Collapse
Affiliation(s)
- Adrian Sammy
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Ami Baba
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Terry P Klassen
- Department of Pediatrics and Child Health, Children's Hospital Research Institute of Manitoba, Rady Faculty of Health Sciences, University of Manitoba, Winnipeg, Manitoba, Canada
| | - David Moher
- Centre for Journalology, Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada; School of Epidemiology and Public Health, Faculty of Medicine, University of Ottawa, Ottawa, Ontario, Canada
| | - Martin Offringa
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada; Division of Neonatology, The Hospital for Sick Children, Toronto, Ontario, Canada; Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada.
| |
Collapse
|
4
|
O'Neill L, Murphy F, Reidy D, Poisson C, Hussey J, Guinan E. Development and Initial Implementation of a Clinical Monitoring Strategy in a Non-regulated Trial: a research note from the ReStOre II Trial. HRB Open Res 2023; 6:46. [PMID: 39280895 PMCID: PMC11401978 DOI: 10.12688/hrbopenres.13763.2] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/04/2023] [Indexed: 09/18/2024] Open
Abstract
Background Data and Safety Monitoring is integral to quality assurance of clinical trials. Although monitoring is a core legal component of regulated clinical trials, non-regulated trials are not mandated to incorporate monitoring. Consequently, the monitoring process has been underutilised and underreported in this setting. This research report outlines the development and plans for implementing a bespoke Clinical Monitoring Strategy within the ' Rehabilitation Strategies Following Oesophagogastric and Hepatopancreaticobiliary Cancer (ReStOre II) Trial', a non-regulated trial comparing a 12-week multidisciplinary programme of rehabilitation to standard care in a cohort of 120 cancer survivors. Methods This research note provides a detailed overview of the ReStOre II Clinical Monitoring Strategy and describes the development of the strategy pre and post awarding of the grant. The strategy consists of the establishment and implementation of a comprehensive trial governance structure, inclusive of a Trial Management Group, Trial Steering Committee Meeting, and Independent Data Monitoring Committee. In addition, external trial monitoring by the Clinical Research Facility at St James's Hospital. Three monitoring visits will be conducted during the trial; i) site initiation visit, ii) interim monitoring visit, and iii) close our visit. Results The Clinical Monitoring Strategy has been finalised and is currently being implemented within the ReStOre II Trial. Two site initiation visits and one interim monitoring visit have been completed to date. Conclusion This research note provides a template for implementation of a Clinical Monitoring Strategy in a non-regulated clinical trial. Registration ReStOre II Trial: https://clinicaltrials.gov/ct2/show/NCT03958019.
Collapse
Affiliation(s)
- Linda O'Neill
- School of Medicine, Discipline of Physiotherapy, Trinity College, Dublin, Ireland
- Trinity St James's Cancer Institute, Trinity College, St James's Hospital, Dublin, Ireland
| | - Fiona Murphy
- School of Medicine, Discipline of Physiotherapy, Trinity College, Dublin, Ireland
- Trinity St James's Cancer Institute, Trinity College, St James's Hospital, Dublin, Ireland
- School of Pharmacy and Pharmaceutical Sciences, Trinity College, Dublin, Ireland
| | - Derval Reidy
- Wellcome-Health Research Board Clinical Research Facility, Trinity College, St James's Hospital, Dublin, Ireland
| | - Camille Poisson
- Wellcome-Health Research Board Clinical Research Facility, Trinity College, St James's Hospital, Dublin, Ireland
- Research Innovation, Trinity College, Trinity College Dublin, the University of Dublin, Dublin, Ireland
| | - Juliette Hussey
- School of Medicine, Discipline of Physiotherapy, Trinity College, Dublin, Ireland
- Trinity St James's Cancer Institute, Trinity College, St James's Hospital, Dublin, Ireland
| | - Emer Guinan
- Trinity St James's Cancer Institute, Trinity College, St James's Hospital, Dublin, Ireland
- Trinity Innovation & Enterprise, Trinity College, Hartford, Connecticut, USA
| |
Collapse
|
5
|
Machado T, Mainoli B, Caldeira D, Ferreira JJ, Fernandes RM. Data monitoring committees in pediatric randomized controlled trials registered in ClinicalTrials.gov. Clin Trials 2023; 20:624-631. [PMID: 37366168 PMCID: PMC10638853 DOI: 10.1177/17407745231182417] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/28/2023]
Abstract
BACKGROUND Data monitoring committees advise on clinical trial conduct through appraisal of emerging data to ensure participant safety and scientific integrity. While consideration of their use is recommended for trials performed with vulnerable populations, previous research has shown that data monitoring committees are reported infrequently in publications of pediatric randomized controlled trials. We aimed to assess the frequency of reported data monitoring committee adoption in ClinicalTrials.gov registry records and to examine the influence of key trial characteristics. METHODS We conducted a cross-sectional data analysis of all randomized controlled trials performed exclusively in a pediatric population and registered in ClinicalTrials.gov between 2008 and 2021. We used the Access to Aggregate Content of ClinicalTrials.gov database to retrieve publicly available information on trial characteristics and data on safety results. Abstracted data included reported trial design and conduct parameters, population and intervention characteristics, reasons for prematurely halting, serious adverse events, and mortality outcomes. We performed descriptive analyses on the collected data and explored the influence of clinical, methodological, and operational trial characteristics on the reported adoption of data monitoring committees. RESULTS We identified 13,928 pediatric randomized controlled trial records, of which 39.7% reported adopting a data monitoring committee, 49.0% reported not adopting a data monitoring committee, and 11.3% did not answer on this item. While the number of registered pediatric trials has been increasing since 2008, we found no clear time trend in the reported adoption of data monitoring committees. Data monitoring committees were more common in multicenter trials (50.6% vs 36.9% for single-center), multinational trials (60.2% vs 38.7% for single-country), National Institutes of Health-funded (60.3% vs 40.1% for industry-funded or 37.5% for other funders), and placebo-controlled (47.6% vs 37.5% for other types of control groups). Data monitoring committees were also more common among trials enrolling younger participants, trials employing blinding techniques, and larger trials. Data monitoring committees were more common in trials with at least one serious adverse event (52.6% vs 38.4% for those without) as well as for trials with reported deaths (70.3% vs 38.9% for trials without reported deaths). In all, 4.9% were listed as halted prematurely, most often due to low accrual rates. Trials with a data monitoring committee were more often halted for reasons related to scientific data than trials without a data monitoring committee (15.7% vs 7.3%). CONCLUSION According to registry records, the use of data monitoring committees in pediatric randomized controlled trials was more frequent than previously reported in reviews of published trial reports. The use of data monitoring committees varied across key clinical and trial characteristics based on which their use is recommended. Data monitoring committees may still be underutilized in pediatric trials, and reporting of this item could be improved.
Collapse
Affiliation(s)
- Tiago Machado
- Laboratory of Clinical Pharmacology and Therapeutics, Faculdade de Medicina, Universidade de Lisboa, Lisbon, Portugal
- Instituto de Medicina Molecular João Lobo Antunes, Lisbon, Portugal
| | - Beatrice Mainoli
- Laboratory of Clinical Pharmacology and Therapeutics, Faculdade de Medicina, Universidade de Lisboa, Lisbon, Portugal
- Instituto de Medicina Molecular João Lobo Antunes, Lisbon, Portugal
- Clinical Research Unit, Research Center of IPO Porto (CI-IPOP), Porto, Portugal
| | - Daniel Caldeira
- Laboratory of Clinical Pharmacology and Therapeutics, Faculdade de Medicina, Universidade de Lisboa, Lisbon, Portugal
- Instituto de Medicina Molecular João Lobo Antunes, Lisbon, Portugal
| | - Joaquim J Ferreira
- Laboratory of Clinical Pharmacology and Therapeutics, Faculdade de Medicina, Universidade de Lisboa, Lisbon, Portugal
- Instituto de Medicina Molecular João Lobo Antunes, Lisbon, Portugal
- Campus Neurológico Sénior (CNS), Torres Vedras, Portugal
| | - Ricardo M Fernandes
- Laboratory of Clinical Pharmacology and Therapeutics, Faculdade de Medicina, Universidade de Lisboa, Lisbon, Portugal
- Instituto de Medicina Molecular João Lobo Antunes, Lisbon, Portugal
- Department of Pediatrics, Santa Maria Hospital, Centro Hospitalar Universitário Lisboa Norte, Lisbon, Portugal
| |
Collapse
|
6
|
McGee RG, Dawson AC. Fake news and fake research: Why meta-research matters more than ever. J Paediatr Child Health 2020; 56:1868-1871. [PMID: 33085816 PMCID: PMC7821256 DOI: 10.1111/jpc.15237] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/06/2020] [Accepted: 09/24/2020] [Indexed: 11/29/2022]
Abstract
Research is in a crisis of credibility, and this is to the peril of all paediatricians. Billions of dollars are being wasted each year because research is not planned, badly conducted or poorly reported, and this is on a background of rapidly reducing research budgets. How can paediatricians, families and patients make informed treatment choices if the evidence base is absent or not trustworthy? This article discusses why meta-research now matters more than ever, how it can help solve this crisis of credibility and how this should lead to more efficient and effective clinical care. The field of meta-research or research-on-research is the ultimate big picture approach to identifying and solving issues of bias, error, misconduct and waste in research. Meta-researchers value authenticity over aesthetics and quality over quantity. The utility of meta-research does not rely on accusations or critical assessments of individual research, but through highlighting where and how the scientific method and research standards across all fields can be improved. Meta-researchers study, analyse and critique the research pathway, focusing on elements such as methods (how to conduct), evaluation (how to test), reporting (how to communicate), reproducibility (how to verify) and incentives (how to reward). In the current climate it is now more critical than ever that we make use of meta-research and prioritise high-quality high-impact research, ultimately leading to improved patient outcomes.
Collapse
Affiliation(s)
- Richard G McGee
- The Central Coast Clinical School, School of Medicine and Public HealthThe University of NewcastleNewcastleNew South WalesAustralia,Department of PaediatricsGosford HospitalNewcastleNew South WalesAustralia
| | - Amanda C Dawson
- The Central Coast Clinical School, School of Medicine and Public HealthThe University of NewcastleNewcastleNew South WalesAustralia,Department of SurgeryGosford HospitalGosfordNew South WalesAustralia
| |
Collapse
|