1
|
Agostinho M, Shani A, Canaipa R, Treister R. Test-retest and interrater reliability of experimental within-subject variability of pain reports as assessed by the focused analgesia selection test. Pain Rep 2024; 9:e1175. [PMID: 39161417 PMCID: PMC11332713 DOI: 10.1097/pr9.0000000000001175] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2024] [Revised: 05/30/2024] [Accepted: 06/01/2024] [Indexed: 08/21/2024] Open
Abstract
Introduction Within-subject variability (WSV) of pain intensity reports has been shown to predict the placebo response. The focused analgesia selection test (FAST), which allows to experimentally assess WSV of pain reports, has been used as a screening tool to identify participants who are likely to have a strong placebo response in drug-development clinical trials. Yet, the reliability of FAST has not been reported. Objectives To assess test-retest and interrater reliability of the FAST outcomes. To mimic pharma-sponsored clinical trials, we enlisted inexperienced assessors who underwent limited training. Methods Healthy volunteers performed the FAST twice within a week and were randomly assigned to either the test-retest group or the interrater group. T-tests, partial Pearson correlations, intraclass correlations (ICC), and Bland-Altman plots were generated to assess FAST outcomes' reliability. Results Sixty-three participants completed the study and were assigned to the test-retest (N = 33) or interrater (N = 30) arms. No statistically significant differences in the FAST outcomes were detected between the 2 sessions, except for the FAST covariance (FAST CoV) in the interrater assessment (P = 0.009). Test-retest reliabilities of the FAST-main outcomes were r = 0.461, ICC = 0.385 for the FAST R 2 and r = 0.605, ICC = 0.539 for the FAST ICC and in the interrater cohort, they were FAST R 2: r = 0.321, ICC = 0.337 and FAST ICC: r = 0.355, ICC = 0.330. Conclusion Using inexperienced assessors, the FAST outcomes test-retest ranged from moderate to strong, whereas the interrater reliability ranged from weak to poor. These results highlight the importance of adequately training study staff members before using this tool in multicentre clinical trials.
Collapse
Affiliation(s)
- Mariana Agostinho
- The Cheryl Spencer Department of Nursing, Faculty of Social Welfare and Health Sciences, University of Haifa, Haifa, Israel
- CIIS, Centre for Interdisciplinary Health Research, Faculty of Health Sciences and Nursing, Universidade Católica Portuguesa, Lisbon, Portugal
| | - Adi Shani
- The Cheryl Spencer Department of Nursing, Faculty of Social Welfare and Health Sciences, University of Haifa, Haifa, Israel
- Department of Orthopedics B and Spine Surgery, Galilee Medical Centre, Nahariya, Israel
- Oncologic Day Care Unit, Galilee Medical Centre, Nahariya, Israel
| | - Rita Canaipa
- CIIS, Centre for Interdisciplinary Health Research, Faculty of Health Sciences and Nursing, Universidade Católica Portuguesa, Lisbon, Portugal
| | - Roi Treister
- The Cheryl Spencer Department of Nursing, Faculty of Social Welfare and Health Sciences, University of Haifa, Haifa, Israel
| |
Collapse
|
2
|
Polasek TM, Peck RW. Beyond Population-Level Targets for Drug Concentrations: Precision Dosing Needs Individual-Level Targets that Include Superior Biomarkers of Drug Responses. Clin Pharmacol Ther 2024; 116:602-612. [PMID: 38328977 DOI: 10.1002/cpt.3197] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2023] [Accepted: 01/17/2024] [Indexed: 02/09/2024]
Abstract
The purpose of precision dosing is to increase the chances of therapeutic success in individual patients. This is achieved in practice by adjusting doses to reach precision dosing targets determined previously in relevant populations, ideally with robust supportive evidence showing improved clinical outcomes compared with standard dosing. But is this implicit assumption of translatable population-level precision dosing targets correct and the best for all patients? In this review, the types of precision dosing targets and how they are determined are outlined, problems with the translatability of these targets to individual patients are identified, and ways forward to address these challengers are proposed. Achieving improved clinical outcomes to support precision dosing over standard dosing is currently hampered by applying population-level targets to all patients. Just as "one-dose-fits-all" may be an inappropriate philosophy for drug treatment overall, a "one-target-fits-all" philosophy may limit the broad clinical benefits of precision dosing. Defining individual-level precision dosing targets may be needed for greatest therapeutic success. Superior future precision dosing targets will integrate several biomarkers that together account for the multiple sources of drug response variability.
Collapse
Affiliation(s)
- Thomas M Polasek
- Centre for Medicine Use and Safety, Monash University, Melbourne, Victoria, Australia
- CMAX Clinical Research, Adelaide, South Australia, Australia
| | - Richard W Peck
- Department of Pharmacology and Therapeutics, University of Liverpool, Liverpool, UK
- Pharma Research & Development (pRED), Roche Innovation Center Basel, Basel, Switzerland
| |
Collapse
|
3
|
Botvinik-Nezer R, Petre B, Ceko M, Lindquist MA, Friedman NP, Wager TD. Placebo treatment affects brain systems related to affective and cognitive processes, but not nociceptive pain. Nat Commun 2024; 15:6017. [PMID: 39019888 PMCID: PMC11255344 DOI: 10.1038/s41467-024-50103-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2024] [Accepted: 06/28/2024] [Indexed: 07/19/2024] Open
Abstract
Drug treatments for pain often do not outperform placebo, and a better understanding of placebo mechanisms is needed to improve treatment development and clinical practice. In a large-scale fMRI study (N = 392) with pre-registered analyses, we tested whether placebo analgesic treatment modulates nociceptive processes, and whether its effects generalize from conditioned to unconditioned pain modalities. Placebo treatment caused robust analgesia in conditioned thermal pain that generalized to unconditioned mechanical pain. However, placebo did not decrease pain-related fMRI activity in brain measures linked to nociceptive pain, including the Neurologic Pain Signature (NPS) and spinothalamic pathway regions, with strong support for null effects in Bayes Factor analyses. In addition, surprisingly, placebo increased activity in some spinothalamic regions for unconditioned mechanical pain. In contrast, placebo reduced activity in a neuromarker associated with higher-level contributions to pain, the Stimulus Intensity Independent Pain Signature (SIIPS), and affected activity in brain regions related to motivation and value, in both pain modalities. Individual differences in behavioral analgesia were correlated with neural changes in both modalities. Our results indicate that cognitive and affective processes primarily drive placebo analgesia, and show the potential of neuromarkers for separating treatment influences on nociception from influences on evaluative processes.
Collapse
Affiliation(s)
- Rotem Botvinik-Nezer
- Department of Psychology, The Hebrew University of Jerusalem, Jerusalem, Israel.
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA.
| | - Bogdan Petre
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA
| | - Marta Ceko
- Institute of Cognitive Science, University of Colorado Boulder, Boulder, CO, USA
| | - Martin A Lindquist
- Department of Biostatistics, Johns Hopkins University, Baltimore, MD, USA
| | - Naomi P Friedman
- Institute for Behavioral Genetics, University of Colorado Boulder, Boulder, CO, USA
- Department of Psychology and Neuroscience, University of Colorado Boulder, Boulder, CO, USA
| | - Tor D Wager
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA.
| |
Collapse
|
4
|
Selby JV, Maas CCHM, Fireman BH, Kent DM. Impact of the PATH Statement on Analysis and Reporting of Heterogeneity of Treatment Effect in Clinical Trials: A Scoping Review. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2024:2024.05.06.24306774. [PMID: 38766150 PMCID: PMC11100853 DOI: 10.1101/2024.05.06.24306774] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/22/2024]
Abstract
Background The Predictive Approaches to Treatment Effect Heterogeneity (PATH) Statement provides guidance for using predictive modeling to identify differences (i.e., heterogeneity) in treatment effects (benefits and harms) among participants in randomized clinical trials (RCTs). It distinguished risk modeling, which uses a multivariable model to predict risk of trial outcome(s) and then examines treatment effects within strata of predicted risk, from effect modeling, which predicts trial outcomes using models that include treatment, individual participant characteristics and interactions of treatment with selected characteristics. Purpose To describe studies of heterogeneous treatment effects (HTE) that use predictive modeling in RCT data and cite the PATH Statement. Data Sources The Cited By functions in PubMed, Google Scholar, Web of Science and SCOPUS databases (Jan 7, 2020 - June 5, 2023). Study Selection 42 reports presenting 45 predictive models. Data Extraction Double review with adjudication to identify risk and effect modeling and examine consistency with Statement consensus statements. Credibility of HTE findings was assessed using criteria adapted from the Instrument to assess Credibility of Effect Modification Analyses (ICEMAN). Clinical importance of credible HTE findings was also assessed. Data Synthesis The numbers of reports, especially risk modeling reports, increased year-on-year. Consistency with consensus statements was high, except for two: only 15 of 32 studies with positive overall findings included a risk model; and most effect models explored many candidate covariates with little prior evidence for effect modification. Risk modeling was more likely than effect modeling to identify both credible HTE (14/19 vs 5/26) and clinically important HTE (10/19 vs 4/26). Limitations Risk of reviewer bias: reviewers assessing credibility and clinical importance were not blinded to adherence to PATH recommendations. Conclusions The PATH Statement appears to be influencing research practice. Risk modeling often uncovered clinically important HTE; effect modeling was more often exploratory.
Collapse
Affiliation(s)
- Joe V Selby
- Division of Research, Kaiser Permanente Northern California, Oakland, CA (emeritus)
| | - Carolien C H M Maas
- Tufts Predictive Analytics and Comparative Effectiveness Center, Tufts University School of Medicine, Boston MA
- Department of Public Health, Erasmus University Medical Center, Rotterdam, The Netherlands
| | - Bruce H Fireman
- Division of Research, Kaiser Permanente Northern California, Oakland, CA
| | - David M Kent
- Tufts Predictive Analytics and Comparative Effectiveness Center, Tufts University School of Medicine, Boston MA
| |
Collapse
|
5
|
Langford DJ, Sharma S, McDermott MP, Beeram A, Besherat S, France FO, Mark R, Park M, Nishtar M, Turk DC, Dworkin RH, Gewandter JS. Covariate Adjustment in Chronic Pain Trials: An Oft-Missed Opportunity. THE JOURNAL OF PAIN 2023; 24:1555-1569. [PMID: 37327942 PMCID: PMC11261744 DOI: 10.1016/j.jpain.2023.06.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/27/2023] [Revised: 05/24/2023] [Accepted: 06/07/2023] [Indexed: 06/18/2023]
Abstract
Self-reported pain intensity, frequently used as an outcome in randomized clinical trials (RCTs) of chronic pain, is often highly variable and could be associated with multiple baseline factors. Thus, the assay sensitivity of pain trials (ie, the ability of the trial to detect a true treatment effect) could be improved by including prespecified baseline factors in the primary statistical model. The objective of this focus article was to characterize the baseline factors included in statistical analyses of chronic pain RCTs. Seventy-three RCTs published between 2016 and 2021 that investigated interventions for chronic pain were included. The majority of trials identified a single primary analysis (72.6%; n = 53). Of these, 60.4% (n = 32) included one or more covariates in the primary statistical model, most commonly baseline value of the primary outcome, study site, sex, and age. Only one of the trials reported information regarding associations between covariates and outcomes (ie, information that could inform prioritization of covariates for prespecification in future analyses). These findings demonstrate inconsistent use of covariates in the statistical models in chronic pain clinical trials. Prespecified adjustments for baseline covariates that could increase precision and assay sensitivity should be considered in future clinical trials of chronic pain treatments. PERSPECTIVE: This review demonstrates inconsistent inclusion and potential underutilization of covariate adjustment in analyses of chronic pain RCTs. This article highlights areas for possible improvement in design and reporting related to covariate adjustment to improve efficiency in future RCTs.
Collapse
Affiliation(s)
- Dale J. Langford
- Department of Anesthesiology, Critical Care & Pain Management, Hospital for Special Surgery, New York, NY, USA
- Department of Anesthesiology & Perioperative Medicine, University of Rochester School of Medicine and Dentistry, Rochester, NY, USA
- Department of Anesthesiology & Pain Medicine, University of Washington, Seattle, WA, USA
| | - Sonia Sharma
- Neuro Pain Management Center, Department of Neurosurgery, University of Rochester Medical Center, Rochester, NY, USA
| | - Michael P. McDermott
- Department of Biostatistics and Computational Biology, University of Rochester School of Medicine and Dentistry, Rochester, NY, USA
| | - Avinash Beeram
- Department of Anesthesiology & Perioperative Medicine, University of Rochester School of Medicine and Dentistry, Rochester, NY, USA
| | - Soroush Besherat
- Department of Anesthesiology & Perioperative Medicine, University of Rochester School of Medicine and Dentistry, Rochester, NY, USA
| | - Fallon O. France
- Department of Anesthesiology & Perioperative Medicine, University of Rochester School of Medicine and Dentistry, Rochester, NY, USA
| | - Remington Mark
- Department of Anesthesiology & Perioperative Medicine, University of Rochester School of Medicine and Dentistry, Rochester, NY, USA
| | - Meghan Park
- Department of Anesthesiology & Perioperative Medicine, University of Rochester School of Medicine and Dentistry, Rochester, NY, USA
| | - Mahd Nishtar
- Department of Anesthesiology & Perioperative Medicine, University of Rochester School of Medicine and Dentistry, Rochester, NY, USA
| | - Dennis C. Turk
- Department of Anesthesiology & Pain Medicine, University of Washington, Seattle, WA, USA
| | - Robert H. Dworkin
- Department of Anesthesiology & Perioperative Medicine, University of Rochester School of Medicine and Dentistry, Rochester, NY, USA
| | - Jennifer S. Gewandter
- Department of Anesthesiology & Perioperative Medicine, University of Rochester School of Medicine and Dentistry, Rochester, NY, USA
| |
Collapse
|