1
|
Totton N, Waddingham E, Owen R, Julious S, Hughes D, Cook J. A proposal for using benefit-risk methods to improve the prominence of adverse event results when reporting trials. Trials 2024; 25:409. [PMID: 38909232 PMCID: PMC11193225 DOI: 10.1186/s13063-024-08228-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2023] [Accepted: 06/03/2024] [Indexed: 06/24/2024] Open
Abstract
Adverse events suffer from poor reporting within randomised controlled trials, despite them being crucial to the evaluation of a treatment. A recent update to the CONSORT harms checklist aims to improve reporting by providing structure and consistency to the information presented. We propose an extension wherein harms would be reported in conjunction with effectiveness outcome(s) rather than in silo to provide a more complete picture of the evidence acquired within a trial. Benefit-risk methods are designed to simultaneously consider both benefits and risks, and therefore, we believe these methods could be implemented to improve the prominence of adverse events when reporting trials. The aim of this article is to use case studies to demonstrate the practical utility of benefit-risk methods to present adverse events results alongside effectiveness results. Two randomised controlled trials have been selected as case studies, the Option-DM trial and the SANAD II trial. Using a previous review, a shortlist of 17 benefit-risk methods which could potentially be used for reporting RCTs was created. From this shortlist, three benefit-risk methods are applied across the two case studies. We selected these methods for their usefulness to achieve the aim of this paper and which are commonly used in the literature. The methods selected were the Benefit-Risk Action Team (BRAT) Framework, net clinical benefit (NCB), and the Outcome Measures in Rheumatology (OMERACT) 3 × 3 table. Results using the benefit-risk method added further context and detail to the clinical summaries made from the trials. In the case of the SANAD II trial, the clinicians concluded that despite the primary outcome being improved by the treatment, the increase in adverse events negated the improvement and the treatment was therefore not recommended. The benefit-risk methods applied to this case study outlined the data that this decision was based on in a clear and transparent way. Using benefit-risk methods to report the results of trials can increase the prominence of adverse event results by presenting them alongside the primary efficacy/effectiveness outcomes. This ensures that all the factors which would be used to determine whether a treatment would be recommended are transparent to the reader.
Collapse
Affiliation(s)
- Nikki Totton
- Sheffield Centre for Health and Related Research, School of Medicine and Population Health, University of Sheffield, Regent Court, 30 Regent Street, Sheffield, S1 4DA, UK.
| | - Ed Waddingham
- Imperial Clinical Trials Unit, School of Public Health, Imperial College London, London, UK
| | - Ruth Owen
- Department of Medical Statistics, London School of Hygiene and Tropical Medicine, London, UK
| | - Steven Julious
- Sheffield Centre for Health and Related Research, School of Medicine and Population Health, University of Sheffield, Regent Court, 30 Regent Street, Sheffield, S1 4DA, UK
| | - Dyfrig Hughes
- Centre for Health Economics and Medicines Evaluation, Bangor University, Bangor, UK
| | - Jonathan Cook
- Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK
| |
Collapse
|
2
|
Nishtar M, Mark R, Langford DJ, McDermott MP, Markman JD, Evans SR, France FO, Park M, Sharma S, Turk DC, Dworkin RH, Gewandter JS. Evaluating the balance of benefits and harms in chronic pain clinical trials: prioritizing individual participants over individual outcomes. Reg Anesth Pain Med 2024; 49:363-367. [PMID: 37963675 PMCID: PMC11081843 DOI: 10.1136/rapm-2023-104809] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2023] [Accepted: 09/26/2023] [Indexed: 11/16/2023]
Abstract
BACKGROUND Randomized clinical trials (RCTs) generally assess efficacy and safety separately, with the conclusion of whether a treatment is beneficial based solely on the efficacy endpoint. However, assessing and combining efficacy and safety domains, using a single composite outcome measure, can provide a more comprehensive assessment of the overall effect of a treatment. Furthermore, composite outcomes can incorporate information regarding the relationship between the individual outcomes. In fact, such outcomes have been suggested in the clinical trials literature for at least 15 years. OBJECTIVES To (1) identify whether recent primary publications of chronic pain RCTs from major pain journals included a composite outcome measure of benefits and harms and (2) discuss the potential benefits of such outcomes in various stages of treatment development, including as outcome measures in RCTs, and to support decisions of Data and Safety Monitoring Boards and ordering of treatments in the context of treatment guidelines. EVIDENCE REVIEW RCTs published in 6 major pain journals published between 2016 and 2021 that investigated interventions for chronic pain were reviewed. FINDINGS Of 73 RCTs identified, only 2 included a composite outcome measure of benefits and harms. Both of these articles compared 2 active treatments. CONCLUSIONS Composite outcomes of benefits and harms are underutilized in chronic pain RCTs. The advantages and challenges of using such outcomes are discussed.
Collapse
Affiliation(s)
- Mahd Nishtar
- Anesthesiology and Perioperative Medicine, University of Rochester, Rochester, New York, USA
| | - Remington Mark
- Anesthesiology and Perioperative Medicine, University of Rochester, Rochester, New York, USA
| | - Dale J Langford
- Anesthesiology, Critical Care & Pain Management, Hospital for Special Surgery, New York, New York, USA
| | - Michael P McDermott
- Department of Biostatistics and Computational Biology, University of Rochester, Rochester, NY, USA
| | - John D Markman
- Department of Neurosurgery, University of Rochester, Rochester, NY, USA
| | - Scott R Evans
- School of Medicine and Health Sciences, The George Washington University, Washington, DC, USA
| | - Fallon O France
- Anesthesiology and Perioperative Medicine, University of Rochester, Rochester, New York, USA
| | - Meghan Park
- Anesthesiology and Perioperative Medicine, University of Rochester, Rochester, New York, USA
| | - Sonia Sharma
- School of Medicine and Biomedical Sciences, University at Buffalo Jacobs, Buffalo, New York, USA
| | - Dennis C Turk
- Anesthesiology and Pain Medicine, University of Washington, Seattle, Washington, USA
| | - Robert H Dworkin
- Anesthesiology and Perioperative Medicine, University of Rochester, Rochester, New York, USA
| | - Jennifer S Gewandter
- Anesthesiology and Perioperative Medicine, University of Rochester, Rochester, New York, USA
| |
Collapse
|
3
|
Due Bruun K, Christensen R, Amris K, Vaegter HB, Blichfeldt-Eckhardt MR, Bye-Møller L, Holsgaard-Larsen A, Toft P. Naltrexone 6 mg once daily versus placebo in women with fibromyalgia: a randomised, double-blind, placebo-controlled trial. THE LANCET. RHEUMATOLOGY 2024; 6:e31-e39. [PMID: 38258677 DOI: 10.1016/s2665-9913(23)00278-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/10/2023] [Revised: 10/02/2023] [Accepted: 10/12/2023] [Indexed: 01/24/2024]
Abstract
BACKGROUND Low-dose naltrexone is used to treat fibromyalgia despite minimal evidence for its efficacy. This trial aimed to investigate whether 12-week treatment with 6 mg low-dose naltrexone was superior to placebo for reducing pain in women with fibromyalgia. METHODS We did a single-centre, randomised, double-blind, placebo-controlled trial in Denmark. We enrolled women aged 18-64 years who were diagnosed with fibromyalgia. Participants were randomly assigned 1:1 to receive low-dose naltrexone (6 mg) or an identical-appearing placebo, using a computerised algorithm with no stratifications applied. Participants, investigators, outcome assessors, and statistical analysts were all masked to treatment allocation. The primary outcome was change in pain intensity on an 11-point numeric rating scale from baseline to week 12, in the intention-to-treat population. Safety was assessed in participants in the intention-to-treat population who received at least one dose of their allocated intervention. This trial was registered with ClincalTrials.gov (NCT04270877) and EudraCT (2019-000702-30). FINDINGS We screened 158 participants for eligibility from Jan 6, 2021, to Dec 27, 2022, and 99 patients were randomly assigned to low-dose naltrexone (n=49) or placebo (n=50). The mean age was 50·6 years (SD 8·8), one (1%) of 99 participants was Arctic Asian and 98 (99%) were White. No participants were lost to follow-up. The mean change in pain intensity was -1·3 points (95% CI -1·7 to -0·8) in the low-dose naltrexone group and -0·9 (-1·4 to -0·5) in the placebo group, corresponding to a between-group difference of -0·34 (-0·95 to 0·27; p=0·27, Cohen's d 0·23). Discontinuations due to adverse events were four (8%) of 49 in the low-dose naltrexone group and three (6%) of 50 in the placebo group. 41 (84%) of 49 patients in the low-dose naltrexone group had an adverse event versus 43 (86%) of 50 in the placebo group. One serious adverse event occurred in the placebo group and no deaths occurred. INTERPRETATION This study did not show that treatment with low-dose naltrexone was superior to placebo in relieving pain. Our results indicate that low-dose naltrexone might improve memory problems associated with fibromyalgia, and we suggest that future trials investigate this further. FUNDING The Danish Rheumatism Association, Odense University Hospital, Danielsen's Foundation, and the Oak Foundation.
Collapse
Affiliation(s)
- Karin Due Bruun
- Pain Research Group, Pain Center, Odense University Hospital, Odense, Denmark; Department of Clinical Research, Faculty of Health Sciences, University of Southern Denmark, Odense, Denmark; The Parker Institute, Bispebjerg and Frederiksberg Hospital, Copenhagen, Denmark.
| | - Robin Christensen
- Department of Clinical Research, Faculty of Health Sciences, University of Southern Denmark, Odense, Denmark; The Parker Institute, Bispebjerg and Frederiksberg Hospital, Copenhagen, Denmark
| | - Kirstine Amris
- The Parker Institute, Bispebjerg and Frederiksberg Hospital, Copenhagen, Denmark; Department of Rheumatology, Bispebjerg and Frederiksberg Hospital, Frederiksberg, Denmark
| | - Henrik Bjarke Vaegter
- Pain Research Group, Pain Center, Odense University Hospital, Odense, Denmark; Department of Clinical Research, Faculty of Health Sciences, University of Southern Denmark, Odense, Denmark
| | - Morten Rune Blichfeldt-Eckhardt
- Pain Research Group, Pain Center, Odense University Hospital, Odense, Denmark; Department of Clinical Research, Faculty of Health Sciences, University of Southern Denmark, Odense, Denmark
| | - Lars Bye-Møller
- Patient Panel, Pain Center, Odense University Hospital, Odense, Denmark
| | - Anders Holsgaard-Larsen
- Department of Orthopedics and Traumatology, Odense University Hospital, Odense, Denmark; Department of Clinical Research, Faculty of Health Sciences, University of Southern Denmark, Odense, Denmark
| | - Palle Toft
- Department of Anesthesiology and Intensive Care, Odense University Hospital, Odense, Denmark; Department of Clinical Research, Faculty of Health Sciences, University of Southern Denmark, Odense, Denmark
| |
Collapse
|
4
|
Dworkin RH, Anderson BT, Andrews N, Edwards RR, Grob CS, Ross S, Satterthwaite TD, Strain EC. If the doors of perception were cleansed, would chronic pain be relieved? Evaluating the benefits and risks of psychedelics. THE JOURNAL OF PAIN 2022; 23:1666-1679. [PMID: 35643270 DOI: 10.1016/j.jpain.2022.05.003] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/05/2022] [Revised: 05/01/2022] [Accepted: 05/06/2022] [Indexed: 11/16/2022]
Abstract
Psychedelic substances have played important roles in diverse cultures, and ingesting various plant preparations to evoke altered states of consciousness has been described throughout recorded history. Accounts of the subjective effects of psychedelics typically focus on spiritual and mystical-type experiences, including feelings of unity, sacredness, and transcendence. Over the past two decades, there has been increasing interest in psychedelics as treatments for various medical disorders, including chronic pain. Although concerns about adverse medical and psychological effects contributed to their controlled status, contemporary knowledge of psychedelics suggests that risks are relatively rare when patients are carefully screened, prepared, and supervised. Clinical trial results have provided support for the effectiveness of psychedelics in different psychiatric conditions. However, there are only a small number of generally uncontrolled studies of psychedelics in patients with chronic pain (e.g., cancer pain, phantom limb pain, migraine, and cluster headache). Challenges in evaluating psychedelics as treatments for chronic pain include identifying neurobiologic and psychosocial mechanisms of action and determining which pain conditions to investigate. Truly informative proof-of-concept and confirmatory randomized clinical trials will require careful selection of control groups, efforts to minimize bias from unblinding, and attention to the roles of patient mental set and treatment setting. Perspective: There is considerable promise for the use of psychedelic therapy for pain, but evidence-based recommendations for the design of future studies are needed to ensure that the results of this research are truly informative.
Collapse
Affiliation(s)
- Robert H Dworkin
- Departments of Anesthesiology and Perioperative Medicine, Neurology, and Psychiatry, and Center for Health + Technology, University of Rochester School of Medicine and Dentistry, Rochester, NY, United States.
| | - Brian T Anderson
- Department of Psychiatry and Behavioral Sciences, UCSF Weill Institute for the Neurosciences and Zuckerberg San Francisco General Hospital, San Francisco, CA, United States, and UC Berkeley Center for the Science of Psychedelics, Berkeley, CA, United States
| | - Nick Andrews
- Behavior Testing Core, Salk Institute of Biological Studies, La Jolla, CA, United States
| | - Robert R Edwards
- Department of Anesthesiology, Perioperative and Pain Medicine, Brigham & Women's Hospital and Harvard Medical School, Boston, MA, United States
| | - Charles S Grob
- Departments of Psychiatry and Pediatrics, Harbor-UCLA Medical Center, Torrance, CA, United States, and UCLA School of Medicine, Los Angeles, CA, United States
| | - Stephen Ross
- Departments of Psychiatry and Child and Adolescent Psychiatry, and New York University Langone Center for Psychedelic Medicine, New York, NY, United States
| | - Theodore D Satterthwaite
- Department of Psychiatry, and Lifespan Informatics and Neuroimaging Center, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States
| | - Eric C Strain
- Behavioral Pharmacology Research Unit, Department of Psychiatry and Behavioral Sciences, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| |
Collapse
|