Augmenting external control arms using Bayesian borrowing: a case study in first-line non-small cell lung cancer

Aim: This study aimed to improve comparative effectiveness estimates and discuss challenges encountered through the application of Bayesian borrowing (BB) methods to augment an external control arm (ECA) constructed from real-world data (RWD) using historical clinical trial data in first-line non-small-cell lung cancer (NSCLC). Materials & methods: An ECA for a randomized controlled trial (RCT) in first-line NSCLC was constructed using ConcertAI Patient360™ to assess chemotherapy with or without cetuximab, in the bevacizumab-inappropriate subpopulation. Cardinality matching was used to match patient characteristics between the treatment arm (cetuximab + chemotherapy) and ECA. Overall survival (OS) was assessed as the primary outcome using Cox proportional hazards (PH). BB was conducted using a static power prior under a Weibull PH parameterization with borrowing weights from 0.0 to 1.0 and augmentation of the ECA from a historical control trial. Results: The constructed ECA yielded a higher overall survival (OS) hazard ratio (HR) (HR = 1.53; 95% CI: 1.21-1.93) than observed in the matched population of the RCT (HR = 0.91; 95% CI: 0.73-1.13). The OS HR decreased through the incorporation of BB (HR = 1.30; 95% CI: 1.08-1.54, borrowing weight = 1.0). BB was applied to augment the RCT control arm via a historical control which improved the precision of the observed HR estimate (1.03; 95% CI: 0.86-1.22, borrowing weight = 1.0), in comparison to the matched population of the RCT alone. Conclusion: In this study, the RWD ECA was unable to successfully replicate the OS estimates from the matched population of the selected RCT. The inability to replicate could be due to unmeasured confounding and variations in time-periods, follow-up and subsequent therapy. Despite these findings, we demonstrate how BB can improve precision of comparative effectiveness estimates, potentially aid as a bias assessment tool and mitigate challenges of traditional methods when appropriate external data sources are available.

Propensity score stratified MAP prior and posterior inference for incorporating information across multiple potentially heterogeneous data sources

Incorporation of external information is becoming increasingly common when designing clinical trials. Availability of multiple sources of information has inspired the development of methodologies that account for potential heterogeneity not only between the prospective trial and the pooled external data sources but also between the different external data sources themselves. Our approach proposes an intuitive way of handling such a scenario for the continuous outcomes setting by using propensity score-based stratification and then utilizing robust meta-analytic predictive priors for each stratum to incorporate the prior data to distinguish among different external data sources in each stratum. Through extensive simulations, our approach proves to be more efficient and less biased than the currently available methods. A real case study using clinical trials that study schizophrenia from multiple different sources is also included.

A Modern Approach to Stability Studies via Bayesian Linear Mixed Models Incorporating Auxiliary Effects

In preparation to the launch of a pharmaceutical product, an estimate of its shelf life via stability testing is required by regulatory agencies. The ICH-Q1E guidance has been the worldwide reference to reach this objective, but in recent years several authors have criticized many of its aspects. To that end we discuss a complete Bayesian transcript of the ICH-Q1E, treating all the apparent shortcomings, while also addressing the presence of multiple batches using a linear mixed model (LMM) for proper shelf life prediction by explicitly modelling the batch-to-batch variability. This comprises a redefinition of the linear models proposed in the ICH-Q1E by suitable LMM counterparts, and a Bayesian analogue for model selection, which is more intuitive and remedies detrimental features of the ICH approach. In that context, a proper mathematical foundation of shelf life is provided that we use to investigate and mathematically compare the two available approaches to shelf life determination via shelf life distribution and batch distribution. The discussed method is then tested and evaluated using real data in comparison with the ICH-Q1E approach demonstrating their approximate equivalency for 6 batches. As a major objective, we extended the LMM with auxiliary fixed effects, here the concentration, which interconnect data sets allowing a prediction of shelf lives for concentrations lacking a sufficient number of batches. This establishes a novel approach to accelerate the speed to submission while retaining the patients' safety. Both case studies underline the inherent superiority of LMMs within a Bayesian framework regarding predictability and interpretability, and we hope that the relevant authorities will accept this approach in the future.

Streamlining Randomized Clinical Trials for Device Therapies in Heart Failure: Bayesian Borrowing of External Data

BACKGROUND

The Breakthrough Devices Program of the US Food and Drug Administration has accelerated the development and evaluation of medical devices for patients with heart failure. One such device is the Optimizer Smart System, which the US Food and Drug Administration approved in 2019.

METHODS AND RESULTS

The Optimizer device was evaluated in a pivotal randomized clinical trial (FIX-HF-5C [Confirmatory Randomized Trial Evaluating the Optimizer System]) that leveraged Bayesian borrowing of external data to reduce the sample size and determine therapeutic device benefit versus continued medical therapy. Bayesian borrowing is explained in the context of the FIX-HF-5C trial, including an overview of the statistical methodologies, regulatory considerations, and interpretations of trial results.

CONCLUSIONS

The US Food and Drug Administration Breakthrough Devices Program and novel Bayesian statistical methodology accelerated the path to regulatory approval and patient access to a potentially lifesaving device and may serve as a model for future clinical trials.

BEATS: Bayesian hybrid design with flexible sample size adaptation for time-to-event endpoints

As the roles of historical trials and real-world evidence in drug development have substantially increased, several approaches have been proposed to leverage external data and improve the design of clinical trials. While most of these approaches focus on methodology development for borrowing information during the analysis stage, there is a risk of inadequate or absent enrollment of concurrent control due to misspecification of heterogeneity from external data, which can result in unreliable estimates of treatment effect. In this study, we introduce a Bayesian hybrid design with flexible sample size adaptation (BEATS) that allows for adaptive borrowing of external data based on the level of heterogeneity to augment the control arm during both the design and interim analysis stages. Moreover, BEATS extends the Bayesian semiparametric meta-analytic predictive prior (BaSe-MAP) to incorporate time-to-event endpoints, enabling optimal borrowing performance. Initially, BEATS calibrates the expected sample size and initial randomization ratio based on heterogeneity among the external data. During the interim analysis, flexible sample size adaptation is performed to address conflicts between the concurrent and historical control, while also conducting futility analysis. At the final analysis, estimation is provided by incorporating the calibrated amount of external data. Therefore, our proposed design allows for an approximation of an ideal randomized controlled trial with an equal randomization ratio while controlling the size of the concurrent control to benefit patients and accelerate drug development. BEATS also offers optimal power and robust estimation through flexible sample size adaptation when conflicts arise between the concurrent control and external data.

Utility of propensity score-based Bayesian borrowing of external adult data in pediatric trials: A pragmatic evaluation through a case study in acute lymphoblastic leukemia (ALL)

A fully powered randomized controlled cancer trial can be challenging to conduct in children because of difficulties in enrollment of pediatric patients due to low disease incidence. One way to improve the feasibility of trials in pediatric patients, when clinically appropriate, is through borrowing information from comparable external adult trials in the same disease. Bayesian analysis of a pediatric trial provides a way of seamlessly augmenting pediatric trial efficacy data with data from external adult trials. However, not all external adult trial subjects may be equally clinically relevant with respect to the baseline disease severity, prognostic factors, co-morbidities, and prior therapy observed in the pediatric trial of interest. The propensity score matching method provides a way of matching the external adult subjects to the pediatric trial subjects on a set of clinically determined baseline covariates, such as baseline disease severity, prognostic factors and prior therapy. The matching then allows Bayesian information borrowing from only the most clinically relevant external adult subjects. Through a case study in pediatric acute lymphoblastic leukemia (ALL), we examine the utility of propensity score matched mixture and power priors in bringing appropriate external adult efficacy information into pediatric trial efficacy assessment, and present considerations for scaling fixed borrowing from external adult data.

Alone, together: On the benefits of Bayesian borrowing in a meta-analytic setting

It is common practice to use hierarchical Bayesian model for the informing of a pediatric randomized controlled trial (RCT) by adult data, using a prespecified borrowing fraction parameter (BFP). This implicitly assumes that the BFP is intuitive and corresponds to the degree of similarity between the populations. Generalizing this model to any K ≥ 1 historical studies, naturally leads to empirical Bayes meta-analysis. In this paper we calculate the Bayesian BFPs and study the factors that drive them. We prove that simultaneous mean squared error reduction relative to an uninformed model is always achievable through application of this model. Power and sample size calculations for a future RCT, designed to be informed by multiple external RCTs, are also provided. Potential applications include inference on treatment efficacy from independent trials involving either heterogeneous patient populations or different therapies from a common class.

Optimal sample size determination for single-arm trials in pediatric and rare populations with Bayesian borrowing

In many therapeutic areas with unmet medical needs, such as pediatric oncology and rare diseases, one of the deterrent factors for clinical trial interpretability is the limited sample size with less-than-ideal operating characteristics. Single arm is usually the only viable design due to feasibility and ethical concerns. For the trial results to be more interpretable and conclusive, the evaluation of operating characteristics, such as type I error rate and power, and the appropriate utilization of prior information for study design, shall be prespecified and fully investigated during the trial planning phase. So far, very few existing literature addressed optimal sample size determination issues for the planning of pediatric and rare population trials, with majority of research focusing on analysis perspective with focus on Bayesian borrowing. In practice, when a single-arm trial is designed for rare population, it is not uncommon that the only information available is from an earlier trial and/or a few clinical publications based on observational studies, often constituting mixed or uncertain conclusions. In light of this, an optimal Bayesian sample size determination method for single-arm trial with binary or continuous endpoint is proposed, where conflicting prior beliefs can be readily incorporated. Prior effective sample size can be calculated to assess the robustness as well as the prior information borrowed. Moreover, due to the lack of closed-form posterior distributions in general, an alternative approach for calculating Bayesian power is described. Simulation studies are provided to demonstrate the utility of the proposed methods. In addition, a case study in pediatric patients with leukemia is included to illustrate the proposed method with the existing approaches.

Propensity-score-based meta-analytic predictive prior for incorporating real-world and historical data

As the availability of real-world data sources (eg, EHRs, claims data, registries) and historical data has rapidly surged in recent years, there is an increasing interest and need from investigators and health authorities to leverage all available information to reduce patient burden and accelerate both drug development and regulatory decision making. Bayesian meta-analytic approaches are a popular historical borrowing method that has been developed to leverage such data using robust hierarchical models. The model structure accounts for various degrees of between-trial heterogeneity, resulting in adaptively discounting the external information in the case of data conflict. In this article, we propose to integrate the propensity score method and Bayesian meta-analytic-predictive (MAP) prior to leverage external real-world and historical data. The propensity score methodology is applied to select a subset of patients from external data that are similar to those in the current study with regards to key baseline covariates and to stratify the selected patients together with those in the current study into more homogeneous strata. The MAP prior approach is used to obtain stratum-specific MAP prior and derive the overall propensity score integrated meta-analytic predictive (PS-MAP) prior. Additionally, we allow for tuning the prior effective sample size for the proposed PS-MAP prior, which quantifies the amount of information borrowed from external data. We evaluate the performance of the proposed PS-MAP prior by comparing it to the existing propensity score-integrated power prior approach in a simulation study and illustrate its implementation with an example of a single-arm phase II trial.