1
|
Martins PN, Rizzari MD, Ghinolfi D, Jochmans I, Attia M, Jalan R, Friend PJ. Design, Analysis, and Pitfalls of Clinical Trials Using Ex Situ Liver Machine Perfusion: The International Liver Transplantation Society Consensus Guidelines. Transplantation 2021; 105:796-815. [PMID: 33760791 DOI: 10.1097/tp.0000000000003573] [Citation(s) in RCA: 44] [Impact Index Per Article: 14.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2022]
Abstract
BACKGROUND Recent trials in liver machine perfusion (MP) have revealed unique challenges beyond those seen in most clinical studies. Correct trial design and interpretation of data are essential to avoid drawing conclusions that may compromise patient safety and increase costs. METHODS The International Liver Transplantation Society, through the Special Interest Group "DCD, Preservation and Machine Perfusion," established a working group to write consensus statements and guidelines on how future clinical trials in liver perfusion should be designed, with particular focus on relevant clinical endpoints and how different techniques of liver perfusion should be compared. Protocols, abstracts, and full published papers of clinical trials using liver MP were reviewed. The use of a simplified Grading of Recommendations Assessment, Development, and Evaluation working group (GRADE) system was attempted to assess the level of evidence. The working group presented its conclusions at the International Liver Transplantation Society consensus conference "DCD, Liver Preservation, and Machine Perfusion" held in Venice, Italy, on January 31, 2020. RESULTS Twelve recommendations were proposed with the main conclusions that clinical trials investigating the effect of MP in liver transplantation should (1) make the protocol publicly available before the start of the trial, (2) be adequately powered, and (3) carefully consider timing of randomization in function of the primary outcome. CONCLUSIONS There are issues with using accepted primary outcomes of liver transplantation trials in the context of MP trials, and no ideal endpoint could be defined by the working group. The setup of an international registry was considered vital by the working group.
Collapse
Affiliation(s)
- Paulo N Martins
- Division of Organ Transplantation, Department of Surgery, University of Massachusetts Memorial Hospital, University of Massachusetts, Worcester, MA
| | - Michael D Rizzari
- Division of Transplant and Hepatobiliary Surgery, Henry Ford Hospital, Detroit, MI
| | - Davide Ghinolfi
- Division of Hepatobiliary Surgery and Liver Transplantation, University of Pisa Medical School Hospital, Pisa, Tuscany, Italy
| | - Ina Jochmans
- Transplantation Research Group, Lab of Abdominal Transplantation, Department of Microbiology, Immunology and Transplantation, KU Leuven, Belgium
- Department of Abdominal Transplant Surgery, University Hospitals Leuven, Leuven, Belgium
| | - Magdy Attia
- Department of Hepatobiliary & Transplantation Surgery, Leeds Teaching Hospitals Trust, Leeds, United Kingdom
| | - Rajiv Jalan
- Liver Failure Group, UCL Institute for Liver and Digestive Health, UCL Medical School, London, United Kingdom
| | - Peter J Friend
- Nuffield Department of Surgical Sciences, University of Oxford, Oxford, United Kingdom
| |
Collapse
|
2
|
Ortendahl JD, Harmon AL, Bentley TGK, Broder MS. A systematic literature review of methods of incorporating mortality in cost-effectiveness analyses of lipid-lowering therapies. J Med Econ 2017; 20:767-775. [PMID: 28562126 DOI: 10.1080/13696998.2017.1336449] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
AIMS Cost effectiveness analysis (CEA) is a useful tool for estimating the value of an intervention in relation to alternatives. In cardiovascular disease (CVD), CEA is especially important, given the high economic and clinical burden. One key driver of value is CVD mortality prevention. However, data used to inform CEA parameters can be limited, given the difficulty in demonstrating statistically significant mortality benefit in randomized clinical trials (RCTs), due in part to the frequency of fatal events and limited trial durations. This systematic review identifies and summarizes whether published CVD-related CEAs have incorporated mortality benefits, and the methodology among those that did. MATERIALS AND METHODS A systematic literature review was conducted of CEAs of lipid-lowering therapies published between 2000-2017. Health technology assessments (HTA) and full-length manuscripts were included, and sources of mortality data and methods of applying mortality benefits were extracted. Results were summarized as proportions of articles to articulate common practices in CEAs of CVD. RESULTS This review identified 100 studies for inclusion, comprising 93 full-length manuscripts and seven HTA reviews. Among these, 99% assumed a mortality benefit in the model. However, 87 of these studies that incorporated mortality differences did so despite the trials used to inform model parameters not demonstrating statistically significant differences in mortality. None of the 12 studies that used statistically significant findings from an individual RCT were based on active control studies. In a sub-group analysis considering the 60 CEAs that incorporated a direct mortality benefit, 48 (80%) did not have RCT evidence for statistically significant benefit in CVD mortality. LIMITATIONS AND CONCLUSIONS The finding that few CEA models included mortality inputs from individual RCTs of lipid-lowering therapy may be surprising, as one might expect that treatment efficacy should be based on robust clinical evidence. However, regulatory requirements in CVD-related RCTs often lead to insufficient sample sizes and observation periods for detecting a difference in CVD mortality, which results in the use of intermediate outcomes, composite end-points, or meta-analysis to extrapolate long-term mortality benefit in a lifetime CEA.
Collapse
Affiliation(s)
- Jesse D Ortendahl
- a Partnership for Health Analytic Research , Beverly Hills , CA , USA
| | - Amanda L Harmon
- a Partnership for Health Analytic Research , Beverly Hills , CA , USA
| | - Tanya G K Bentley
- a Partnership for Health Analytic Research , Beverly Hills , CA , USA
| | - Michael S Broder
- a Partnership for Health Analytic Research , Beverly Hills , CA , USA
| |
Collapse
|
3
|
Stegall MD, Morris RE, Alloway RR, Mannon RB. Developing New Immunosuppression for the Next Generation of Transplant Recipients: The Path Forward. Am J Transplant 2016; 16:1094-101. [PMID: 26730885 DOI: 10.1111/ajt.13582] [Citation(s) in RCA: 50] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2015] [Revised: 10/13/2015] [Accepted: 10/14/2015] [Indexed: 01/25/2023]
Abstract
The development of new immunosuppressive drugs has slowed markedly over the past several years, and the outlook that improved therapy will be available to the next generation of transplant recipients is bleak. In this viewpoint, the authors outline some of important barriers to new drug development and suggest specific steps that the transplant community can take to overcome them.
Collapse
Affiliation(s)
- M D Stegall
- Departments of Surgery and Immunology, von Liebig Transplant Center, Mayo Clinic, Rochester, MN
| | - R E Morris
- Department of Cardiothoracic Surgery, Stanford University School of Medicine, Stanford, CA
| | - R R Alloway
- Department of Medicine, University of Cincinnati School of Medicine, Cincinnati, OH
| | - R B Mannon
- Departments of Medicine and Surgery, Comprehensive Transplant Institute, University of Alabama at Birmingham, Birmingham, AL
| |
Collapse
|
4
|
Clyburne-Sherin AVP, Thurairajah P, Kapadia MZ, Sampson M, Chan WWY, Offringa M. Recommendations and evidence for reporting items in pediatric clinical trial protocols and reports: two systematic reviews. Trials 2015; 16:417. [PMID: 26385379 PMCID: PMC4574457 DOI: 10.1186/s13063-015-0954-0] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2015] [Accepted: 09/11/2015] [Indexed: 02/06/2023] Open
Abstract
BACKGROUND Complete and transparent reporting of clinical trial protocols and reports ensures that these documents are useful to all stakeholders, that bias is minimized, and that the research is not wasted. However, current studies repeatedly conclude that pediatric trial protocols and reports are not appropriately reported. Guidelines like SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials) and CONSORT (Consolidated Standards of Reporting Trials) may improve reporting, but do not offer guidance on issues unique to pediatric trials. This paper reports two systematic reviews conducted to build the evidence base for the development of pediatric reporting guideline extensions: 1) SPIRIT-Children (SPIRIT-C) for pediatric trial protocols, and 2) CONSORT-Children (CONSORT-C) for pediatric trial reports. METHOD MEDLINE, the Cochrane Methodology Register, and reference lists of included studies were searched. Publications of any type were eligible if they included explicit recommendations or empirical evidence for the reporting of potential items in a pediatric protocol (SPIRIT-C systematic review) or trial report (CONSORT-C systematic review). Study characteristics, recommendations and evidence for pediatric extension items were extracted. Recurrent themes in the recommendations and evidence were identified and synthesized. All steps were conducted by two reviewers. RESULTS For the SPIRIT-C and CONSORT-C systematic reviews 366 and 429 publications were included, respectively. Recommendations were identified for 48 of 50 original reporting items and sub-items from SPIRIT, 15 of 20 potential SPIRIT-C reporting items, all 37 original CONSORT items and sub-items, and 16 of 22 potential CONSORT-C reporting items. The following overarching themes of evidence to support or refute the utility of reporting items were identified: transparency; reproducibility; interpretability; usefulness; internal validity; external validity; reporting bias; publication bias; accountability; scientific soundness; and research ethics. CONCLUSION These systematic reviews are the first to systematically gather evidence and recommendations for the reporting of specific items in pediatric protocols and trials. They provide useful and translatable evidence on which to build pediatric extensions to the SPIRIT and CONSORT reporting guidelines. The resulting SPIRIT-C and CONSORT-C will provide guidance to the authors of pediatric protocols and reports, respectively, helping to alleviate concerns of inappropriate and inconsistent reporting, and reduce research waste.
Collapse
Affiliation(s)
- April V P Clyburne-Sherin
- The Hospital for Sick Children, Peter Gilgan Centre for Research and Learning, SickKids Research Institute, Child Health Evaluative Sciences, 686 Bay Street, Toronto, ON, M5G 0A4, Canada.
| | - Pravheen Thurairajah
- The Hospital for Sick Children, Peter Gilgan Centre for Research and Learning, SickKids Research Institute, Child Health Evaluative Sciences, 686 Bay Street, Toronto, ON, M5G 0A4, Canada.
| | - Mufiza Z Kapadia
- The Hospital for Sick Children, Peter Gilgan Centre for Research and Learning, SickKids Research Institute, Child Health Evaluative Sciences, 686 Bay Street, Toronto, ON, M5G 0A4, Canada.
| | - Margaret Sampson
- Children's Hospital of Eastern Ontario, 401 Smyth Road, Ottawa, ON, K1H 8L1, Canada.
| | - Winnie W Y Chan
- The Hospital for Sick Children, Peter Gilgan Centre for Research and Learning, SickKids Research Institute, Child Health Evaluative Sciences, 686 Bay Street, Toronto, ON, M5G 0A4, Canada.
| | - Martin Offringa
- The Hospital for Sick Children, Peter Gilgan Centre for Research and Learning, SickKids Research Institute, Child Health Evaluative Sciences, 686 Bay Street, Toronto, ON, M5G 0A4, Canada. .,Senior Scientist and Program Head Child Health Evaluative Sciences, The Hospital for Sick Children, Peter Gilgan Centre for Research and Learning, SickKids Research Institute, 686 Bay Street, Toronto, ON, M5G 0A4, Canada.
| |
Collapse
|
5
|
Shakespeare TP, Gebski VJ, Thiagarajan A, Jay Lu J. Development of a spreadsheet for the calculation of new tools to improve the reporting of the resultsof medical research. ACTA ACUST UNITED AC 2009; 31:121-7. [PMID: 16777786 DOI: 10.1080/14639230600551397] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Abstract
PRIMARY OBJECTIVE Confidence levels, clinical significance curves and risk - benefit contours have recently been developed with the aim of improving the interpretation of clinical studies. It has been suggested that their use may complement traditional methods of result reporting (i.e. p values and 95% confidence intervals), and subsequently improve medical decision-making. These new methods have been used to report study results; however, widespread use may be hampered by the lack of available computer software. Our objective was to design user-friendly software to enable researchers to use these statistical methods. RESEARCH DESIGN A spreadsheet was designed to calculate these statistics for the assessment of two arm medical studies. The spreadsheet was tested using a wide range of input data and operating systems. User-friendliness was tested by researchers who had no background in statistics. MAIN OUTCOMES AND RESULTS The confidence calculator was successfully designed, and found to be user-friendly. The spreadsheet is MS Excel-based to allow wide usage. The spreadsheet is freely available from the author and from the web site http://www.primercollaboration.com/Tools/tools.html. CONCLUSIONS We have successfully designed a spreadsheet that is simple to use and freely accessible for researchers. This is the first such software that calculates confidence levels, clinical significance curves, and risk - benefit contours.
Collapse
|