Application of Bayesian approaches in drug development: starting a virtuous cycle

Effectiveness of dexmedetomidine on patient-centred outcomes in surgical patients: a systematic review and Bayesian meta-analysis

BACKGROUND

Dexmedetomidine is increasingly used for surgical patients requiring general anaesthesia. However, its effectiveness on patient-centred outcomes remains uncertain. Our main objective was to evaluate the patient-centred effectiveness of intraoperative dexmedetomidine for adult patients requiring surgery under general anaesthesia.

METHODS

We conducted a systematic search of MEDLINE, Embase, CENTRAL, Web of Science, and CINAHL from inception to October 2023. Randomised controlled trials (RCTs) comparing intraoperative use of dexmedetomidine with placebo, opioid, or usual care in adult patients requiring surgery under general anaesthesia were included. Study selection, data extraction, and risk of bias assessment were performed by two reviewers independently. We synthesised data using a random-effects Bayesian regression framework to derive effect estimates and the probability of a clinically important effect. For continuous outcomes, we pooled instruments with similar constructs using standardised mean differences (SMDs) and converted SMDs and credible intervals (CrIs) to their original scale when appropriate. We assessed the certainty of evidence using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) methodology. Our primary outcome was quality of recovery after surgery. To guide interpretation on the original scale, the Quality of Recovery-15 (QoR-15) instrument was used (range 0-150 points, minimally important difference [MID] of 6 points).

RESULTS

We identified 49,069 citations, from which 44 RCTs involving 5904 participants were eligible. Intraoperative dexmedetomidine administration was associated with improvement in postoperative QoR-15 (mean difference 9, 95% CrI 4-14, n=21 RCTs, moderate certainty of evidence). We found 99% probability of any benefit and 88% probability of achieving the MID. There was a reduction in chronic pain incidence (odds ratio [OR] 0.42, 95% CrI 0.19-0.79, n=7 RCTs, low certainty of evidence). There was also increased risk of clinically significant hypotension (OR 1.98, 95% CrI 0.84-3.92, posterior probability of harm 94%, n=8 RCTs) and clinically significant bradycardia (OR 1.74, 95% CrI 0.93-3.34, posterior probability of harm 95%, n=10 RCTs), with very low certainty of evidence for both. There was limited evidence to inform other secondary patient-centred outcomes.

CONCLUSIONS

Compared with placebo or standard of care, intraoperative dexmedetomidine likely results in meaningful improvement in the quality of recovery and chronic pain after surgery. However, it might increase clinically important bradycardia and hypotension.

SYSTEMATIC REVIEW PROTOCOL

PROSPERO (CRD42023439896).

Bayesian Predictive Probability Based on a Bivariate Index Vector for Single-Arm Phase II Study With Binary Efficacy and Safety Endpoints

In oncology, Phase II studies are crucial for clinical development plans as such studies identify potent agents with sufficient activity to continue development in the subsequent Phase III trials. Traditionally, Phase II studies are single-arm studies, with the primary endpoint being short-term treatment efficacy. However, drug safety is also an important consideration. In the context of such multiple-outcome designs, predictive probability-based Bayesian monitoring strategies have been developed to assess whether a clinical trial will provide enough evidence to continue with a Phase III study at the scheduled end of the trial. Therefore, we propose a new simple index vector to summarize the results that cannot be captured by existing strategies. Specifically, we define the worst and most promising situations for the potential effect of a treatment, then use the proposed index vector to measure the deviation between the two situations. Finally, simulation studies are performed to evaluate the operating characteristics of the design. The obtained results demonstrate that the proposed method makes appropriate interim go/no-go decisions.

Multidisciplinary considerations for implementing Bayesian borrowing in basket trials

Drug development has historically relied on phase I-III clinical trials including participants sharing the same disease. However, drug development has evolved as the discovery of mechanistic drivers of disease demonstrated that the same therapeutic target may provide benefits across different diseases. A basket trial condenses evaluation of one therapy among multiple related diseases into a single trial and presents an opportunity to borrow information across them rather than viewing each in isolation. Borrowing is a statistical tool but requires a foundation of clinical and therapeutic mechanistic justification. We review the Bayesian borrowing approach, including its assumptions, and provide a framework for how this approach can be evaluated for successful use in a basket trial for drug development.

Toward Patient Centricity: Why Do Patients With Inflammatory Bowel Disease Participate in Pharmaceutical Clinical Trials? A Mixed-Methods Exploration of Study Participants

Background

A better understanding of motivations to participate as well as recommendations to reduce barriers to enrollment may assist in design of future clinical trials.

Methods

We developed a 32-item electronic questionnaire to explore motivations, experiences, and recommendations of inflammatory bowel disease patients, who had participated in pharmaceutical clinical trials in a tertiary center in Canada over the last decade. We employed a mixed-methods approach that integrates both quantitative and qualitative research methods.

Results

We distributed a total of 69 e-mails with surveys and received 46 responses (66.6% response rate). Study participants were mostly male (27/46, 58.7%), non-Hispanic White (43/46, 93.5%), with a mean age of 45.5 years (SD 10.9). Most decided to participate in a clinical trial to benefit future patients (29/46, 63.0%). Half of the participants (23/46, 50.0%) reported they were worried about the possibility of receiving placebo, although the majority (29/46, 63.0%) understood they could improve on placebo. The most challenging aspect reported was the number and length of questionnaires (15/46, 32.6%), as well as the number of colonoscopies (14/46, 30.4%). Strategies recommended to increase enrollment were reduction of the chance of receiving placebo (20/46, 43.5%), facilitating inclusion of patients who have failed multiple therapies (20/46, 43.5%), allowing virtual visits (18/46, 39.1%), including subtypes of disease traditionally excluded from trials (16/46, 34.8%) and improving outreach to underrepresented populations (13/46, 28.3%). The vast majority (37/46, 80.4%) reported their experience of participation to be better than expected.

Conclusions

These results should help inform the design of future clinical trials with a focus on patient-centricity.

Benford's Law and distributions for better drug design

INTRODUCTION

Modern drug discovery incorporates various tools and data, heralding the beginning of the data-driven drug design (DD) era. The distributions of chemical and physical data used for Artificial Intelligence (AI)/Machine Learning (ML) and to drive DD have thus become highly important to be understood and used effectively.

AREAS COVERED

The authors perform a comprehensive exploration of the statistical distributions driving the data-intensive era of drug discovery, including Benford's Law in AI/ML-based DD.

EXPERT OPINION

As the relevance of data-driven discovery escalates, we anticipate meticulous scrutiny of datasets utilizing principles like Benford's Law to enhance data integrity and guide efficient resource allocation and experimental planning. In this data-driven era of the pharmaceutical and medical industries, addressing critical aspects such as bias mitigation, algorithm effectiveness, data stewardship, effects, and fraud prevention are essential. Harnessing Benford's Law and other distributions and statistical tests in DD provides a potent strategy to detect data anomalies, fill data gaps, and enhance dataset quality. Benford's Law is a fast method for data integrity and quality of datasets, the backbone of AI/ML and other modeling approaches, proving very useful in the design process.

Estimating the effect of nintedanib on forced vital capacity in children and adolescents with fibrosing interstitial lung disease using a Bayesian dynamic borrowing approach

BACKGROUND

The rarity of childhood interstitial lung disease (chILD) makes it challenging to conduct powered trials. In the InPedILD trial, among 39 children and adolescents with fibrosing ILD, there was a numerical benefit of nintedanib versus placebo on change in forced vital capacity (FVC) over 24 weeks (difference in mean change in FVC % predicted of 1.21 [95% confidence interval: -3.40, 5.81]). Nintedanib has shown a consistent effect on FVC across populations of adults with different diagnoses of fibrosing ILD.

METHODS

In a Bayesian dynamic borrowing analysis, prespecified before data unblinding, we incorporated data on the effect of nintedanib in adults and the data from the InPedILD trial to estimate the effect of nintedanib on FVC in children and adolescents with fibrosing ILD. The data from adults were represented as a meta-analytic predictive (MAP) prior distribution with mean 1.69 (95% credible interval: 0.49, 3.08). The adult data were weighted according to expert judgment on their relevance to the efficacy of nintedanib in chILD, obtained in a formal elicitation exercise.

RESULTS

Combined data from the MAP prior and InPedILD trial analyzed within the Bayesian framework resulted in a median difference between nintedanib and placebo in change in FVC % predicted at Week 24 of 1.63 (95% credible interval: -0.69, 3.40). The posterior probability for superiority of nintedanib versus placebo was 95.5%, reaching the predefined success criterion of at least 90%.

CONCLUSION

These findings, together with the safety data from the InPedILD trial, support the use of nintedanib in children and adolescents with fibrosing ILDs.

Comparison of Quality of Recovery between Modified Thoracoabdominal Nerves Block through Perichondrial Approach versus Oblique Subcostal Transversus Abdominis Plane Block in Patients Undergoing Total Laparoscopic Hysterectomy: A Pilot Randomized Controlled Trial

Modified thoracoabdominal nerves block through a perichondrial approach (M-TAPA) provides a wide analgesic range. Herein, we examined the quality of recovery (QoR) of M-TAPA for total laparoscopic hysterectomy (TLH) compared with oblique subcostal transversus abdominis plane block (OSTAPB) and measured plasma levobupivacaine concentrations (PClevo). Forty female patients undergoing TLH were randomized to each group. Nerve blocks were performed bilaterally with 25 mL of 0.25% levobupivacaine administered per side. The primary outcome was changes in QoR-15 scores on postoperative days (POD) 1 and 2 from the preoperative baseline. The main secondary outcomes were PClevo at 15, 30, 45, 60, and 120 min after performing nerve block. Group differences (M-TAPA-OSTAPB) in mean changes from baseline in QoR-15 scores on POD 1 and 2 were -11.3 (95% confidence interval (CI), -24.9 to 2.4, p = 0.104; standard deviation (SD), 22.8) and -7.0 (95% CI, -20.5 to 6.6, p = 0.307; SD, 18.7), respectively. Changes in PClevo were similar in both groups. The post hoc analysis using Bayesian statistics revealed that posterior probabilities of M-TAPA being clinically more effective than OSTAPB were up to 22.4 and 24.4% for POD 1 and 2, respectively. In conclusion, M-TAPA may not be superior to OSTAPB for TLH.

Inflammation across tissues: can shared cell biology help design smarter trials?

Immune-mediated inflammatory diseases (IMIDs) are responsible for substantial global disease burden and associated health-care costs. Traditional models of research and service delivery silo their management within organ-based medical disciplines. Very often patients with disease in one organ have comorbid involvement in another, suggesting shared pathogenic pathways. Moreover, different IMIDs are often treated with the same drugs (including glucocorticoids, immunoregulators and biologics). Unlocking the cellular basis of these diseases remains a major challenge, leading us to ask why, if these diseases have so much in common, they are not investigated in a common manner. A tissue-based, cellular understanding of inflammation might pave the way for cross-disease, cross-discipline basket trials (testing one drug across two or more diseases) to reduce the risk of failure of early-phase drug development in IMIDs. This new approach will enable rapid assessment of the efficacy of new therapeutic agents in cross-disease translational research in humans.

Interpreting Randomized Controlled Trials

This article describes rationales and limitations for making inferences based on data from randomized controlled trials (RCTs). We argue that obtaining a representative random sample from a patient population is impossible for a clinical trial because patients are accrued sequentially over time and thus comprise a convenience sample, subject only to protocol entry criteria. Consequently, the trial's sample is unlikely to represent a definable patient population. We use causal diagrams to illustrate the difference between random allocation of interventions within a clinical trial sample and true simple or stratified random sampling, as executed in surveys. We argue that group-specific statistics, such as a median survival time estimate for a treatment arm in an RCT, have limited meaning as estimates of larger patient population parameters. In contrast, random allocation between interventions facilitates comparative causal inferences about between-treatment effects, such as hazard ratios or differences between probabilities of response. Comparative inferences also require the assumption of transportability from a clinical trial's convenience sample to a targeted patient population. We focus on the consequences and limitations of randomization procedures in order to clarify the distinctions between pairs of complementary concepts of fundamental importance to data science and RCT interpretation. These include internal and external validity, generalizability and transportability, uncertainty and variability, representativeness and inclusiveness, blocking and stratification, relevance and robustness, forward and reverse causal inference, intention to treat and per protocol analyses, and potential outcomes and counterfactuals.

Which severe COVID-19 patients could benefit from high dose dexamethasone? A Bayesian post-hoc reanalysis of the COVIDICUS randomized clinical trial

BACKGROUND

The respective benefits of high and low doses of dexamethasone (DXM) in patients with severe acute respiratory syndrome coronavirus 2 (SARS-Cov2) and acute respiratory failure (ARF) are controversial, with two large triple-blind RCTs reaching very important difference in the effect-size. In the COVIDICUS trial, no evidence of additional benefit of high-dose dexamethasone (DXM20) was found. We aimed to explore whether some specific patient phenotypes could benefit from DXM20 compared to the standard of care 6 mg dose of DXM (DXMSoC).

METHODS

We performed a post hoc exploratory Bayesian analysis of 473 patients who received either DXMSoc or DXM20 in the COVIDICUS trial. The outcome was the 60 day mortality rate of DXM20 over DXMSoC, with treatment effect measured on the hazard ratio (HR) estimated from Cox model. Bayesian analyses allowed to compute the posterior probability of a more than trivial benefit (HR < 0.95), and that of a potential harm (HR > 1.05). Bayesian measures of interaction then quantified the probability of interaction (Pr Interact) that the HR of death differed across the subsets by 20%. Primary analyses used noninformative priors, centred on HR = 1.00. Sensitivity analyses used sceptical and enthusiastic priors, based on null (HR = 1.00) or benefit (HR = 0.95) effects.

RESULTS

Overall, the posterior probability of a more than trivial benefit and potential harm was 29.0 and 51.1%, respectively. There was some evidence of treatment by subset interaction (i) according to age (Pr Interact, 84%), with a 86.5% probability of benefit in patients aged below 70 compared to 22% in those aged above 70; (ii) according to the time since symptoms onset (Pr Interact, 99%), with a 99.9% probability of a more than trivial benefit when lower than 7 days compared to a < 0.1% probability when delayed by 7 days or more; and (iii) according to use of remdesivir (Pr Interact, 91%), with a 90.1% probability of benefit in patients receiving remdesivir compared to 19.1% in those who did not.

CONCLUSIONS

In this exploratory post hoc Bayesian analysis, compared with standard-of-care DXM, high-dose DXM may benefit patients aged less than 70 years with severe ARF that occurred less than 7 days after symptoms onset. The use of remdesivir may also favour the benefit of DXM20. Further analysis is needed to confirm these findings.

TRIAL REGISTRATION

NCT04344730, date of registration April 14, 2020 ( https://clinicaltrials.gov/ct2/show/NCT04344730?term=NCT04344730&draw=2&rank=1 ); EudraCT: 2020-001457-43 ( https://www.clinicaltrialsregister.eu/ctr-search/search?query=2020-001457-43 ).

Comparison of Cystatin C and Creatinine in the Assessment of Measured Kidney Function during Critical Illness

BACKGROUND

Incomplete recovery of kidney function is an important adverse outcome in survivors of critical illness. However, unlike eGFR creatinine, eGFR cystatin C is not confounded by muscle loss and may improve identification of persistent kidney dysfunction.

METHODS

To assess kidney function during prolonged critical illness, we enrolled 38 mechanically ventilated patients with an expected length of stay of >72 hours near admission to intensive care unit (ICU) in a single academic medical center. We assessed sequential kidney function using creatinine, cystatin C, and iohexol clearance measurements. The primary outcome was difference between eGFR creatinine and eGFR cystatin C at ICU discharge using Bayesian regression modeling. We simultaneously measured muscle mass by ultrasound of the rectus femoris to assess the confounding effect on serum creatinine generation.

RESULTS

Longer length of ICU stay was associated with greater difference between eGFR creatinine and eGFR cystatin C at a predicted rate of 2 ml/min per 1.73 m 2 per day (95% confidence interval [CI], 1 to 2). By ICU discharge, the posterior mean difference between creatinine and cystatin C eGFR was 33 ml/min per 1.73 m 2 (95% credible interval [CrI], 24 to 42). In 27 patients with iohexol clearance measured close to ICU discharge, eGFR creatinine was on average two-fold greater than the iohexol gold standard, and posterior mean difference was 59 ml/min per 1.73 m 2 (95% CrI, 49 to 69). The posterior mean for eGFR cystatin C suggested a 22 ml/min per 1.73 m 2 (95% CrI, 13 to 31) overestimation of measured GFR. Each day in ICU resulted in a predicted 2% (95% CI, 1% to 3%) decrease in muscle area. Change in creatinine-to-cystatin C ratio showed good longitudinal, repeated measures correlation with muscle loss, R =0.61 (95% CI, 0.50 to 0.72).

CONCLUSIONS

eGFR creatinine systematically overestimated kidney function after prolonged critical illness. Cystatin C better estimated true kidney function because it seemed unaffected by the muscle loss from prolonged critical illness.

CLINICAL TRIAL REGISTRY NAME AND REGISTRATION NUMBER

Skeletal Muscle Wasting and Renal Dysfunction After Critical Illness Trauma - Outcomes Study (KRATOS), NCT03736005 .

A SuperLearner-enforced approach for the estimation of treatment effect in pediatric trials

Background

Randomized Clinical Trials (RCT) represent the gold standard among scientific evidence. RCTs are tailored to control selection bias and the confounding effect of baseline characteristics on the effect of treatment. However, trial conduction and enrolment procedures could be challenging, especially for rare diseases and paediatric research. In these research frameworks, the treatment effect estimation could be compromised. A potential countermeasure is to develop predictive models on the probability of the baseline disease based on previously collected observational data. Machine learning (ML) algorithms have recently become attractive in clinical research because of their flexibility and improved performance compared to standard statistical methods in developing predictive models.

Objective

This manuscript proposes an ML-enforced treatment effect estimation procedure based on an ensemble SuperLearner (SL) approach, trained on historical observational data, to control the confounding effect.

Methods

The REnal SCarring Urinary infEction trial served as a motivating example. Historical observational study data have been simulated through 10,000 Monte Carlo (MC) runs. Hypothetical RCTs have been also simulated, for each MC run, assuming different treatment effects of antibiotics combined with steroids. For each MC simulation, the SL tool has been applied to the simulated observational data. Furthermore, the average treatment effect (ATE), has been estimated on the trial data and adjusted for the SL predicted probability of renal scar.

Results

The simulation results revealed an increased power in ATE estimation for the SL-enforced estimation compared to the unadjusted estimates for all the algorithms composing the ensemble SL.

Unleashing the Power of Bayesian Re-Analysis: Enhancing Insights into Lecanemab (Clarity AD) Phase III Trial Through Informed t-Test

BACKGROUND

Clinical trials targeting Alzheimer's disease (AD) aim to alleviate clinical symptoms and alter the course of this complex neurodegenerative disorder. However, the conventional approach of null hypothesis significance testing (NHST) commonly employed in such trials has inherent limitations in assessing clinical significance and capturing nuanced evidence of effectiveness on a continuous scale.

OBJECTIVE

In this study, we conducted a re-analysis of the phase III trial of lecanemab, a recently proposed humanized IgG1 monoclonal antibody with high affinity for Aβ soluble protofibrils, using a Bayesian approach with informed t-test priors.

METHODS

To achieve this, we carefully selected trial data and derived effect size estimates for the primary endpoint, the Clinical Dementia Rating Scale-Sum of Boxes (CDR-SB). Subsequently, a series of Bayes Factor analyses were performed to compare evidence supporting the null hypothesis (no treatment effect) versus the alternative hypothesis (presence of an effect). Drawing on relevant literature and the lecanemab phase III trial, we incorporated different minimal clinically important difference (MCID) values for the primary endpoint CDR-SB as prior information.

RESULTS

Our findings, based on a standard prior, revealed anecdotal evidence favoring the null hypothesis. Additional robustness checks yielded consistent results. However, when employing informed priors, we observed varying evidence across different MCID values, ultimately indicating no support for the effectiveness of lecanemab over placebo.

CONCLUSION

Our study underscores the value of Bayesian analysis in clinical trials while emphasizing the importance of incorporating MCID and effect size granularity to accurately assess treatment efficacy.