1
|
Sousa Filho LF, Farlie MK, Haines T, Borrelli B, Carroll C, Mathews C, Ribeiro DC, Fritz JM, Underwood M, Foster NE, Lamb SE, Sanchez ZM, Malliaras P. Developing an international consensus Reporting guideline for intervention Fidelity in Non-Drug, non-surgical trials: The ReFiND protocol. Contemp Clin Trials 2024; 142:107575. [PMID: 38750951 DOI: 10.1016/j.cct.2024.107575] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2024] [Revised: 04/23/2024] [Accepted: 05/11/2024] [Indexed: 05/21/2024]
Abstract
BACKGROUND Inadequate reporting of fidelity to interventions in trials limits the transparency and interpretation of trial findings. Despite this, most trials of non-drug, non-surgical interventions lack comprehensive reporting of fidelity. If fidelity is poorly reported, it is unclear which intervention components were tested or implemented within the trial, which also hinders research reproducibility. This protocol describes the development process of a reporting guideline for fidelity of non-drug, non-surgical interventions (ReFiND) in the context of trials. METHODS The ReFiND guideline will be developed in six stages. Stage one: a guideline development group has been formed to oversee the guideline methodology. Stage two: a scoping review will be conducted to identify and summarize existing guidance documents on the fidelity of non-drug, non-surgical interventions. Stage three: a Delphi study will be conducted to reach consensus on reporting items. Stage four: a consensus meeting will be held to consolidate the reporting items and discuss the wording and structure of the guideline. Stage five: a guidance statement, an elaboration and explanation document, and a reporting checklist will be developed. Stage six: different strategies will be used to disseminate and implement the ReFiND guideline. DISCUSSION The ReFiND guideline will provide a set of items developed through international consensus to improve the reporting of intervention fidelity in trials of non-drug, non-surgical interventions. This reporting guideline will enhance transparency and reproducibility in future non-drug, non-surgical intervention research.
Collapse
Affiliation(s)
| | - Melanie K Farlie
- School of Primary and Allied Health Care, Monash University, Melbourne, Australia.
| | - Terry Haines
- School of Primary and Allied Health Care, Monash University, Melbourne, Australia.
| | - Belinda Borrelli
- Center for Behavioral Science Research, Department of Health Policy and Health Services Research, Boston University, Henry M. Goldman School of Dental Medicine, Boston, MA, USA.
| | | | - Catherine Mathews
- Health Systems Research Unit, South African Medical Research Council, Cape Town, South Africa; School of Public Health and Family Medicine, Faculty of Health Sciences, University of Cape Town, Cape Town, South Africa.
| | - Daniel C Ribeiro
- Centre for Health, Activity and Rehabilitation Research, School of Physiotherapy, University of Otago, Dunedin, New Zealand.
| | - Julie M Fritz
- Department of Physical Therapy & Athletic Training, University of Utah, Salt Lake City, UT, USA.
| | - Martin Underwood
- Warwick Clinical Trials Unit, University of Warwick, Warwick, UK.; University Hospitals of Coventry and Warwickshire, Coventry, UK.
| | - Nadine E Foster
- STARS Education and Research Alliance, Surgical Treatment and Rehabilitation Service (STARS), The University of Queensland and Metro North Health, Brisbane, Australia; School of Medicine, Keele University, Keele, UK.
| | - Sarah E Lamb
- University of Exeter, St Luke's Campus, Exeter, UK.
| | - Zila M Sanchez
- Department of Preventive Medicine, Universidade Federal de São Paulo (UNIFESP), São Paulo, SP, Brazil.
| | - Peter Malliaras
- School of Primary and Allied Health Care, Monash University, Melbourne, Australia.
| |
Collapse
|
2
|
Yin Z, Mander AP, de Bono JS, Zheng H, Yap C. Handling Incomplete or Late-Onset Toxicities in Early-Phase Dose-Finding Clinical Trials: Current Practice and Future Prospects. JCO Precis Oncol 2024; 8:e2300441. [PMID: 38181316 DOI: 10.1200/po.23.00441] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2023] [Revised: 09/28/2023] [Accepted: 10/12/2023] [Indexed: 01/07/2024] Open
Abstract
PURPOSE The way late-onset toxicities are managed can affect trial outcomes and participant safety. Specifically, participants often might not have completed their entire follow-up period to observe any toxicities before new participants would be recruited. We conducted a methodological review of published early-phase dose-finding clinical trials that used designs accounting for partial and complete toxicity information, aiming to understand (1) how such designs were implemented and reported and (2) if sufficient information was provided to enable the replicability of trial results. METHODS Until March 26, 2023, we identified 141 trials using the rolling 6 design, the time-to-event continuous reassessment method (TITE-CRM), the TITE-CRM with cycle information, the TITE Bayesian optimal interval design, the TITE cumulative cohort design, and the rapid enrollment design. Clinical settings, design parameters, practical considerations, and dose-limiting toxicity (DLT) information were extracted from these published trials. RESULTS The TITE-CRM (61, 43.3%) and the rolling 6 design (76, 53.9%) were most frequently implemented in practice. Trials using the TITE-CRM had longer DLT assessment windows beyond the first cycle compared with the rolling 6 design (52.5% v 6.6%). Most trials implementing the TITE-CRM (91.8%, 56 of 61) failed to describe essential parameters in the protocols or the study result papers. Only five TITE-CRM trials (8.2%, 5 of 61) reported sufficient information to enable replication of the final analysis. CONCLUSION When compared with trials using the rolling 6 design, those implementing the TITE-CRM design exhibited notable deficiencies in reporting essential details necessary for reproducibility. Inadequate reporting quality of advanced model-based trial designs hinders their credibility. We provide recommendations that can improve transparency, reproducibility, and accurate interpretation of the results for such designs.
Collapse
Affiliation(s)
- Zhulin Yin
- Clinical Trials and Statistics Unit, Institute of Cancer Research, London, United Kingdom
| | - Adrian P Mander
- Centre for Trials Research, Cardiff University, Cardiff, United Kingdom
| | - Johann S de Bono
- Drug Development Unit, The Institute of Cancer Research and the Royal Marsden NHS Foundation Trust, London, United Kingdom
| | - Haiyan Zheng
- Department of Mathematical Sciences, University of Bath, Bath, United Kingdom
| | - Christina Yap
- Clinical Trials and Statistics Unit, Institute of Cancer Research, London, United Kingdom
| |
Collapse
|
3
|
Yap C. Let's make poor reporting of early phase dose finding clinical trials a thing of the past. BMJ 2023; 383:2865. [PMID: 38049170 DOI: 10.1136/bmj.p2865] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/06/2023]
Affiliation(s)
- Christina Yap
- Clinical Trials and Statistics Unit, Institute of Cancer Research, London, UK
| |
Collapse
|
4
|
Smith DM, Minichmayr IK, Standing JF, Giacomini KM, van der Graaf PH, Peck RW. Ensuring Transparency and Quality of Clinical Trial Reporting in Clinical Pharmacology & Therapeutics: Prospective Trial Registration and Compliance with Reporting Guidelines Are Required for all Clinical Trials. Clin Pharmacol Ther 2023; 114:1153-1157. [PMID: 37971383 DOI: 10.1002/cpt.3070] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2023] [Accepted: 10/02/2023] [Indexed: 11/19/2023]
Affiliation(s)
- D Max Smith
- MedStar Health, Columbia, Maryland, USA
- Department of Oncology, Georgetown University Medical Center, Washington, DC, USA
| | - Iris K Minichmayr
- Department of Clinical Pharmacology, Medical University of Vienna, Vienna, Austria
| | - Joseph F Standing
- Great Ormond Street Institute of Child Health, University College London, London, UK
- Department of Pharmacy, Great Ormond Street Hospital for Children, London, UK
| | - Kathleen M Giacomini
- Department of Bioengineering and Therapeutic Sciences, University of California San Francisco, San Francisco, California, USA
| | | | - Richard W Peck
- Department of Pharmacology & Therapeutics, University of Liverpool, Liverpool, UK
- Pharma Research & Development (pRED), Roche innovation Center, Basel, Switzerland
| |
Collapse
|
5
|
Yap C, Solovyeva O, de Bono J, Rekowski J, Patel D, Jaki T, Mander A, Evans TRJ, Peck R, Hayward KS, Hopewell S, Ursino M, Rantell KR, Calvert M, Lee S, Kightley A, Ashby D, Chan AW, Garrett-Mayer E, Isaacs JD, Golub R, Kholmanskikh O, Richards D, Boix O, Matcham J, Seymour L, Ivy SP, Marshall LV, Hommais A, Liu R, Tanaka Y, Berlin J, Espinasse A, Dimairo M, Weir CJ. Enhancing reporting quality and impact of early phase dose-finding clinical trials: CONSORT Dose-finding Extension (CONSORT-DEFINE) guidance. BMJ 2023; 383:e076387. [PMID: 37863501 PMCID: PMC10583500 DOI: 10.1136/bmj-2023-076387] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 08/05/2023] [Indexed: 10/22/2023]
Affiliation(s)
| | | | - Johann de Bono
- Institute of Cancer Research, London SM2 5NG, UK
- Royal Marsden NHS Foundation Trust, London, UK
| | - Jan Rekowski
- Institute of Cancer Research, London SM2 5NG, UK
| | | | - Thomas Jaki
- MRC Biostatistics Unit, Cambridge University, Cambridge, UK
- Computational Statistics Group, University of Regensburg, Regensburg, Germany
| | - Adrian Mander
- Centre For Trials Research, Cardiff University, Heath Park, Cardiff, UK
| | - Thomas R Jeffry Evans
- Institute of Cancer Sciences, CR-UK Beatson Institute, University of Glasgow, Glasgow, UK
| | - Richard Peck
- Department of Pharmacology and Therapeutics, University of Liverpool, Liverpool, UK
- Hoffmann-La Roche, Basel, Switzerland
| | - Kathryn S Hayward
- Departments of Physiotherapy, and Medicine (Royal Melbourne Hospital), University of Melbourne, VIC, Australia
- Florey Institute of Neuroscience and Mental Health, University of Melbourne, Melbourne, VIC, Australia
| | - Sally Hopewell
- Oxford Clinical Research Unit, NDORMS, University of Oxford, Oxford, UK
| | - Moreno Ursino
- ReCAP/F CRIN, INSERM, Paris, France
- Unit of Clinical Epidemiology, CHU Robert Debré, APHP, URC, INSERM CIC-EC 1426, Reims, France
- INSERM Centre de Recherche des Cordeliers, Sorbonne University, Paris Cité University, Paris, France
- Health data and model driven approaches for Knowledge Acquisition team, Centre Inria, Paris, France
| | | | - Melanie Calvert
- Centre for Patient Reported Outcomes Research, Institute of Applied Health Research, University of Birmingham, Birmingham, UK
- Birmingham Health Partners Centre for Regulatory Science and Innovation, University of Birmingham, Birmingham, UK
- National Institute for Health and Care Research (NIHR) Applied Research Collaboration West Midlands, University of Birmingham, Birmingham, UK
- NIHR Research Blood and Transplant Research Unit in Precision Transplant and Cellular Therapeutics, University of Birmingham, Edgbaston, Birmingham, UK
- NIHR Birmingham Biomedical Research Centre, Institute of Translational Medicine, University Hospital NHS Foundation Trust, Birmingham, UK
| | - Shing Lee
- Columbia University Mailman School of Public Health, New York, NY, USA
| | | | - Deborah Ashby
- School of Public Health, Imperial College London, London, UK
| | - An-Wen Chan
- Department of Medicine, Women's College Research Institute, University of Toronto, Toronto, ON, Canada
| | - Elizabeth Garrett-Mayer
- Center for Research and Analytics, American Society of Clinical Oncology, Alexandria, VA, USA
| | - John D Isaacs
- Translational and Clinical Research Institute, Newcastle University, Newcastle upon Tyne, UK
- Musculoskeletal Unit, Newcastle upon Tyne Hospitals NHS Foundation Trust, Freeman Hospital, Newcastle upon Tyne, UK
| | - Robert Golub
- Department of Medicine, Northwestern University Feinberg School of Medicine, 633 Clark Street, Evanston, IL, USA
| | - Olga Kholmanskikh
- Federal Agency for Medicines and Health Products, Brussels, Belgium
- European Medicines Agency, Amsterdam, Netherlands
| | - Dawn Richards
- Clinical Trials Ontario, MaRS Centre, Toronto, ON, Canada
| | | | - James Matcham
- Strategic Consulting, Cytel (Australia), Perth, WA, Australia
| | - Lesley Seymour
- Investigational New Drug Programme, Canadian Cancer Trials Group, Cancer Research Institute, Queen's University, Kingston, ON, Canada
| | - S Percy Ivy
- Investigational Drug Branch, Cancer Therapy Evaluation Program, Division of Cancer Treatment and Diagnosis, National Institute of Health, Bethesda, MD, USA
| | - Lynley V Marshall
- Institute of Cancer Research, London SM2 5NG, UK
- Royal Marsden NHS Foundation Trust, London, UK
| | - Antoine Hommais
- Department of Clinical Research, National Cancer Institute, Boulogne-Billancourt, France
| | - Rong Liu
- Bristol Myers Squibb, New York, NY, USA
| | - Yoshiya Tanaka
- First Department of Internal Medicine, University of Occupational and Environmental Health, Kitakyushu, Japan
| | | | | | - Munyaradzi Dimairo
- Division of Population Health, Sheffield Centre for Health and Related Research, University of Sheffield, Sheffield, UK
| | - Christopher J Weir
- Edinburgh Clinical Trials Unit, Usher Institute, University of Edinburgh, Edinburgh, UK
| |
Collapse
|
6
|
Yap C, Rekowski J, Ursino M, Solovyeva O, Patel D, Dimairo M, Weir CJ, Chan AW, Jaki T, Mander A, Evans TRJ, Peck R, Hayward KS, Calvert M, Rantell KR, Lee S, Kightley A, Hopewell S, Ashby D, Garrett-Mayer E, Isaacs J, Golub R, Kholmanskikh O, Richards DP, Boix O, Matcham J, Seymour L, Ivy SP, Marshall LV, Hommais A, Liu R, Tanaka Y, Berlin J, Espinasse A, de Bono J. Enhancing quality and impact of early phase dose-finding clinical trial protocols: SPIRIT Dose-finding Extension (SPIRIT-DEFINE) guidance. BMJ 2023; 383:e076386. [PMID: 37863491 DOI: 10.1136/bmj-2023-076386] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/22/2023]
Affiliation(s)
| | - Jan Rekowski
- Institute of Cancer Research, London SM2 5NG, UK
| | - Moreno Ursino
- ReCAP/F CRIN, INSERM, Paris, France
- Unit of Clinical Epidemiology, University Hospital Centre Robert Debré, Reims, France
- INSERM Centre de Recherche des Cordeliers, Sorbonne University, Paris, France
- Health data and model driven approaches for Knowledge Acquisition team, Centre Inria, Paris, France
| | | | | | - Munyaradzi Dimairo
- Division of Population Health, Sheffield Centre for Health and Related Research, University of Sheffield, Sheffield, UK
| | - Christopher J Weir
- Edinburgh Clinical Trials Unit, Usher Institute, University of Edinburgh, Edinburgh, UK
| | - An-Wen Chan
- Department of Medicine, Women's College Research Institute, University of Toronto, Toronto, Canada
| | - Thomas Jaki
- MRC Biostatistics Unit, Cambridge University, Cambridge, UK
- Computational Statistics Group, University of Regensburg, Regensburg, Germany
| | - Adrian Mander
- Centre For Trials Research, Cardiff University, Cardiff, UK
| | - Thomas R Jeffry Evans
- Institute of Cancer Sciences, CR-UK Beatson Institute, University of Glasgow, Glasgow, UK
| | - Richard Peck
- Department of Pharmacology and Therapeutics, University of Liverpool, Liverpool, UK
- Hoffmann-La Roche, Basel, Switzerland
| | - Kathryn S Hayward
- Departments of Physiotherapy, and Medicine (Royal Melbourne Hospital), University of Melbourne, Parkville, VIC, Australia
- Florey Institute of Neuroscience and Mental Health, University of Melbourne, Parkville, VIC, Australia
| | - Melanie Calvert
- Centre for Patient Reported Outcomes Research, Institute of Applied Health Research, University of Birmingham, Birmingham, UK
- Birmingham Health Partners Centre for Regulatory Science and Innovation, University of Birmingham, Birmingham, UK
- National Institute for Health and Care Research Applied Research Collaboration West Midlands, University of Birmingham, Birmingham, UK
- National Institute for Health and Care Research Blood and Transplant Research Unit in Precision Transplant and Cellular Therapeutics, University of Birmingham, Birmingham, UK
- National Institute for Health and Care Research Birmingham Biomedical Research Centre, NIHR Birmingham Biomedical Research Centre, Institute of Translational Medicine, University Hospital NHS Foundation Trust, Birmingham, UK
| | | | - Shing Lee
- Columbia University Mailman School of Public Health, New York, NY, USA
| | | | - Sally Hopewell
- Oxford Clinical Research Unit, NDORMS, University of Oxford, Oxford, UK
| | - Deborah Ashby
- School of Public Health, Imperial College London, St Mary's Hospital, London, UK
| | - Elizabeth Garrett-Mayer
- Center for Research and Analytics, American Society of Clinical Oncology, Alexandria, VA, USA
| | - John Isaacs
- Translational and Clinical Research Institute, Newcastle University, Newcastle upon Tyne, UK
- Musculoskeletal Unit, Newcastle upon Tyne Hospitals NHS Foundation Trust, Freeman Hospital, Newcastle upon Tyne, UK
| | - Robert Golub
- Department of Medicine, Northwestern University Feinberg School of Medicine, Evanston, IL, USA
| | | | | | | | - James Matcham
- Strategic Consulting, Cytel (Australia), Perth, WA, Australia
| | - Lesley Seymour
- Investigational New Drug Programme, Canadian Cancer Trials Group, Cancer Research Institute, Queen's University, Kingston, ON, Canada
| | - S Percy Ivy
- Investigational Drug Branch, Cancer Therapy Evaluation Program, Division of Cancer Treatment and Diagnosis, National Institute of Health, Bethesda, MD, USA
| | - Lynley V Marshall
- Institute of Cancer Research, London SM2 5NG, UK
- Royal Marsden NHS Foundation Trust, London, UK
| | - Antoine Hommais
- Department of Clinical Research, National Cancer Institute, Boulogne-Billancourt, France
| | - Rong Liu
- Bristol Myers Squibb, New York, NY, USA
| | - Yoshiya Tanaka
- First Department of Internal Medicine, University of Occupational and Environmental Health, Kitakyushu, Japan
| | | | | | - Johann de Bono
- Institute of Cancer Research, London SM2 5NG, UK
- Royal Marsden NHS Foundation Trust, London, UK
| |
Collapse
|
7
|
Alger E, Minchom A, Lee Aiyegbusi O, Schipper M, Yap C. Statistical methods and data visualisation of patient-reported outcomes in early phase dose-finding oncology trials: a methodological review. EClinicalMedicine 2023; 64:102228. [PMID: 37781154 PMCID: PMC10541462 DOI: 10.1016/j.eclinm.2023.102228] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/16/2023] [Revised: 08/25/2023] [Accepted: 09/05/2023] [Indexed: 10/03/2023] Open
Abstract
Background Traditionally, within dose-finding clinical trials, treatment toxicity and tolerability are assessed by clinicians. Research has shown that clinician reporting may have inadequate inter-rater reliability, poor correlation with patient reported outcomes, and under capture the true toxicity burden. The introduction of patient-reported outcomes (PROs), where the patient can assess their own symptomatic adverse events or quality of life, has potential to complement current practice to aid dose optimisation. There are no international recommendations offering guidance for the inclusion of PROs in dose-finding trial design and analysis. Our review aimed to identify and describe current statistical methods and data visualisation techniques employed to analyse and visualise PRO data in published early phase dose-finding oncology trials (DFOTs). Methods DFOTs published from June 2016-December 2022, which presented PRO analysis methods, were included in this methodological review. We extracted 35 eligible papers indexed in PubMed. Study characteristics extracted included: PRO objectives, PRO measures, statistical analysis and visualisation techniques, and whether the PRO was involved in interim and final dose selection decisions. Findings Most papers (30, 85.7%) did not include clear PRO objectives. 20 (57.1%) papers used inferential statistical techniques to analyse PROs, including survival analysis and mixed-effect models. One trial used PROs to classify a clinicians' assessed dose-limiting toxicities (DLTs). Three (8.6%) trials used PROs to confirm the tolerability of the recommended dose. 25 trial reports visually presented PRO data within a figure or table within their publication, of which 12 papers presented PRO score longitudinally. Interpretation This review highlighted that the statistical methods and reporting of PRO analysis in DFOTs are often poorly described and inconsistent. Many trials had PRO objectives which were not clearly described, making it challenging to evaluate the appropriateness of the statistical techniques used. Drawing conclusions based on DFOTs which are not powered for PROs may be misleading. With no guidance and standardisation of analysis methods for PROs in early phase DFOTs, it is challenging to compare study findings across trials. Therefore, there is a crucial need to establish international guidance to enhance statistical methods and graphical presentation for PRO analysis in the dose-finding setting. Funding EA has been supported to undertake this work as part of a PhD studentship from the Institute of Cancer Research within the MRC/NIHR Trials Methodology Research Partnership. AM is supported by the National Institute for Health Research (NIHR) Biomedical Research Centre at the Royal Marsden NHS Foundation Trust, the Institute of Cancer Research and Imperial College.
Collapse
Affiliation(s)
- Emily Alger
- Clinical Trial and Statistics Unit, Institute of Cancer Research, London, UK
| | - Anna Minchom
- Drug Development Unit, Royal Marsden/Institute of Cancer Research, London, UK
| | - Olalekan Lee Aiyegbusi
- Centre for Patient Reported Outcomes Research, Institute of Applied Health Research, College of Medical and Dental Sciences, University of Birmingham, UK
- National Institute for Health and Care Research (NIHR) Birmingham Biomedical Research Centre, University of Birmingham, Birmingham, UK
| | - Matthew Schipper
- Departments of Radiation Oncology and Biostatistics, University of Michigan, Ann Arbor, MI, USA
| | - Christina Yap
- Clinical Trial and Statistics Unit, Institute of Cancer Research, London, UK
| |
Collapse
|