Biomarker-driven basket trial designs: origins and new methodological developments

Due to increased use of gene sequencing techniques, understanding of cancer on a molecular level has evolved, in terms of both diagnosis and evaluation in response to initial therapies. In parallel, clinical trials meant to evaluate molecularly-driven interventions through assessment of both treatment effects and putative predictive biomarker effects are being employed to advance the goals of precision medicine. Basket trials investigate one or more biomarker-targeted therapies across multiple cancer types in a tumor location agnostic fashion. The review article offers an overview of the traditional forms of such designs, the practical challenges facing each type of design, and then review novel adaptations proposed in the last few years, categorized into Bayesian and Classical Frequentist perspectives. The review article concludes by summarizing potential advantages and limitations of the new trial design solutions.

Adaptive Bayesian information borrowing methods for finding and optimizing subgroup-specific doses

In precision oncology, integrating multiple cancer patient subgroups into a single master protocol allows for the simultaneous assessment of treatment effects in these subgroups and promotes the sharing of information between them, ultimately reducing sample sizes and costs and enhancing scientific validity. However, the safety and efficacy of these therapies may vary across different subgroups, resulting in heterogeneous outcomes. Therefore, identifying subgroup-specific optimal doses in early-phase clinical trials is crucial for the development of future trials. In this article, we review various innovative Bayesian information-borrowing strategies that aim to determine and optimize subgroup-specific doses. Specifically, we discuss Bayesian hierarchical modeling, Bayesian clustering, Bayesian model averaging or selection, pairwise borrowing, and other relevant approaches. By employing these Bayesian information-borrowing methods, investigators can gain a better understanding of the intricate relationships between dose, toxicity, and efficacy in each subgroup. This increased understanding significantly improves the chances of identifying an optimal dose tailored to each specific subgroup. Furthermore, we present several practical recommendations to guide the design of future early-phase oncology trials involving multiple subgroups when using the Bayesian information-borrowing methods.

A generalized calibrated Bayesian hierarchical modeling approach to basket trials with multiple endpoints

A basket trial simultaneously evaluates a treatment in multiple cancer subtypes, offering an effective way to accelerate drug development in multiple indications. Many basket trials are designed and monitored based on a single efficacy endpoint, primarily the tumor response. For molecular targeted or immunotherapy agents, however, a single efficacy endpoint cannot adequately characterize the treatment effect. It is increasingly important to use more complex endpoints to comprehensively assess the risk-benefit profile of such targeted therapies. We extend the calibrated Bayesian hierarchical modeling approach to monitor phase II basket trials with multiple endpoints. We propose two generalizations, one based on the latent variable approach and the other based on the multinomial-normal hierarchical model, to accommodate different types of endpoints and dependence assumptions regarding information sharing. We introduce shrinkage parameters as functions of statistics measuring homogeneity among subgroups and propose a general calibration approach to determine the functional forms. Theoretical properties of the generalized hierarchical models are investigated. Simulation studies demonstrate that the monitoring procedure based on the generalized approach yields desirable operating characteristics.

A basket trial design based on constrained hierarchical Bayesian model for latent subgroups

It is well known a basket trial consisting of multiple cancer types has the potential of borrowing strength across the baskets defined by the cancer types, leading to an efficient design in terms of sample size and trial duration. The treatment effects in those baskets are often heterogeneous and categorized by the cancer types being sensitive or insensitive to the treatment. Hence, the assumption of exchangeability in many existing basket trials may be violated, and there is a need to design trials without this assumption. In this paper, we simplify the constrained hierarchical Bayesian model for latent subgroups (CHBM-LS) for two classifiers to deal with the potential heterogeneity of treatment effects due to the single classifier of the cancer type. Different baskets are aggregated into subgroups using a latent subgroup modeling approach. The treatment effects are similar and exchangeable to facilitate information borrowing within each latent subgroup. Applying the simplified CHBM-LS approach to the real basket trials where baskets defined by only cancer types shows better performance than other available approaches. Further simulation study also demonstrates this CHBM-LS approach outperforms other approaches with higher statistical power and better-controlled type I error rates under various scenarios.

Tumor-Agnostic Approvals: Insights and Practical Considerations

Since the first approval of a tumor-agnostic indication in 2017, a total of seven tumor-agnostic indications involving six drugs have received approval from the FDA. In this paper, the master protocol subteam of the Statistical Methods in Oncology Scientific Working Group, Biopharmaceutical Session, American Statistical Association, provides a comprehensive summary of these seven tumor-agnostic approvals, describing their mechanisms of action; biomarker prevalence; study design; companion diagnostics; regulatory aspects, including comparisons of global regulatory requirements; and health technology assessment approval. Also discussed are practical considerations relating to the regulatory approval of tumor-agnostic indications, specifically (i) recommendations for the design stage to mitigate the risk that exceptions may occur if a treatment is initially hypothesized to be effective for all tumor types and (ii) because drug development continues after approval of a tumor-agnostic indication, recommendations for further development of tumor-specific indications in first-line patients in the setting of a randomized confirmatory basket trial, acknowledging the challenges in this area. These recommendations and practical considerations may provide insights for the future development of drugs for tumor-agnostic indications.

Bayesian Methods for Information Borrowing in Basket Trials: An Overview

Basket trials allow simultaneous evaluation of a single therapy across multiple cancer types or subtypes of the same cancer. Since the same treatment is tested across all baskets, it may be desirable to borrow information across them to improve the statistical precision and power in estimating and detecting the treatment effects in different baskets. We review recent developments in Bayesian methods for the design and analysis of basket trials, focusing on the mechanism of information borrowing. We explain the common components of these methods, such as a prior model for the treatment effects that embodies an assumption of exchangeability. We also discuss the distinct features of these methods that lead to different degrees of borrowing. Through simulation studies, we demonstrate the impact of information borrowing on the operating characteristics of these methods and discuss its broader implications for drug development. Examples of basket trials are presented in both phase I and phase II settings.

Basket trials in oncology: a systematic review of practices and methods, comparative analysis of innovative methods, and an appraisal of a missed opportunity

Background

Basket trials are increasingly used in oncology drug development for early signal detection, accelerated tumor-agnostic approvals, and prioritization of promising tumor types in selected patients with the same mutation or biomarker. Participants are grouped into so-called baskets according to tumor type, allowing investigators to identify tumors with promising responses to treatment for further study. However, it remains a question as to whether and how much the adoption of basket trial designs in oncology have translated into patient benefits, increased pace and scale of clinical development, and de-risking of downstream confirmatory trials.

Methods

Innovation in basket trial design and analysis includes methods that borrow information across tumor types to increase the quality of statistical inference within each tumor type. We build on the existing systematic reviews of basket trials in oncology to discuss the current practices and landscape. We conceptually illustrate recent innovative methods for basket trials, with application to actual data from recently completed basket trials. We explore and discuss the extent to which innovative basket trials can be used to de-risk future trials through their ability to aid prioritization of promising tumor types for subsequent clinical development.

Results

We found increasing adoption of basket trial design in oncology, but largely in the design of single-arm phase II trials with a very low adoption of innovative statistical methods. Furthermore, the current practice of basket trial design, which does not consider its impact on the clinical development plan, may lead to a missed opportunity in improving the probability of success of a future trial. Gating phase II with a phase Ib basket trial reduced the size of phase II trials, and losses in the probability of success as a result of not using innovative methods may not be recoverable by running a larger phase II trial.

Conclusion

Innovative basket trial methods can reduce the size of early phase clinical trials, with sustained improvement in the probability of success of the clinical development plan. We need to do more as a community to improve the adoption of these methods.

Bayesian sample size determination in basket trials borrowing information between subsets

Basket trials are increasingly used for the simultaneous evaluation of a new treatment in various patient subgroups under one overarching protocol. We propose a Bayesian approach to sample size determination in basket trials that permit borrowing of information between commensurate subsets. Specifically, we consider a randomized basket trial design where patients are randomly assigned to the new treatment or control within each trial subset ("subtrial" for short). Closed-form sample size formulae are derived to ensure that each subtrial has a specified chance of correctly deciding whether the new treatment is superior to or not better than the control by some clinically relevant difference. Given prespecified levels of pairwise (in)commensurability, the subtrial sample sizes are solved simultaneously. The proposed Bayesian approach resembles the frequentist formulation of the problem in yielding comparable sample sizes for circumstances of no borrowing. When borrowing is enabled between commensurate subtrials, a considerably smaller trial sample size is required compared to the widely implemented approach of no borrowing. We illustrate the use of our sample size formulae with two examples based on real basket trials. A comprehensive simulation study further shows that the proposed methodology can maintain the true positive and false positive rates at desired levels.

Bayesian approach for design and analysis of medical device trials in the era of modern clinical studies

Medical device technology develops rapidly, and the life cycle of a medical device is much shorter than drugs. It is necessary to evaluate the safety and effectiveness of a medical device in a timely manner to keep up with technology flux. Bayesian methods provides an efficient approach to addressing this challenge. In this article, we review the characteristics of the Bayesian approach and some Bayesian designs that were commonly used in medical device regulatory setting, including Bayesian adaptive design, Bayesian diagnostic design, Bayesian multiregional design, and Bayesian label expansion study. We illustrate these designs with medical devices approved by the US Food and Drug Administration (FDA). We also review several innovative Bayesian information borrowing methods, and briefly discuss the challenges and future directions of the Bayesian application in medical device trials. Our objective is to promote the use of the Bayesian approach to accelerate the development of innovative medical devices and their accessibility to patients for effective disease diagnoses and treatments.

Alone, together: On the benefits of Bayesian borrowing in a meta-analytic setting

It is common practice to use hierarchical Bayesian model for the informing of a pediatric randomized controlled trial (RCT) by adult data, using a prespecified borrowing fraction parameter (BFP). This implicitly assumes that the BFP is intuitive and corresponds to the degree of similarity between the populations. Generalizing this model to any K ≥ 1 historical studies, naturally leads to empirical Bayes meta-analysis. In this paper we calculate the Bayesian BFPs and study the factors that drive them. We prove that simultaneous mean squared error reduction relative to an uninformed model is always achievable through application of this model. Power and sample size calculations for a future RCT, designed to be informed by multiple external RCTs, are also provided. Potential applications include inference on treatment efficacy from independent trials involving either heterogeneous patient populations or different therapies from a common class.

Shotgun-2: A Bayesian phase I/II basket trial design to identify indication-specific optimal biological doses

For novel molecularly targeted agents and immunotherapies, the objective of dose-finding is often to identify the optimal biological dose, rather than the maximum tolerated dose. However, optimal biological doses may not be the same for different indications, challenging the traditional dose-finding framework. Therefore, we proposed a Bayesian phase I/II basket trial design, named "shotgun-2," to identify indication-specific optimal biological doses. A dose-escalation part is conducted in stage I to identify the maximum tolerated dose and admissible dose sets. In stage II, dose optimization is performed incorporating both toxicity and efficacy for each indication. Simulation studies under both fixed and random scenarios show that, compared with the traditional "phase I  +  cohort expansion" design, the shotgun-2 design is robust and can improve the probability of correctly selecting the optimal biological doses. Furthermore, this study provides a useful tool for identifying indication-specific optimal biological doses and accelerating drug development.

Practical basket design for binary outcomes with control of family-wise error rate

BACKGROUND

A basket trial is a type of clinical trial in which eligibility is based on the presence of specific molecular characteristics across subpopulations with different cancer types. The existing basket designs with Bayesian hierarchical models often improve the efficiency of evaluating therapeutic effects; however, these models calibrate the type I error rate based on the results of simulation studies under various selected scenarios. The theoretical control of family-wise error rate (FWER) is important for decision-making regarding drug approval.

METHODS

In this study, we propose a new Bayesian two-stage design with one interim analysis for controlling FWER at the target level, along with the formulations of type I and II error rates. Since the difficulty lies in the complexity of the theoretical formulation of the type I error rate, we devised the simulation-based method to approximate the type I error rate.

RESULTS

The proposed design enabled adjustment of the cutoff value to control the FWER at the target value in the final analysis. The simulation studies demonstrated that the proposed design can be used to control the well-approximated FWER below the target value even in situations where the number of enrolled patients differed among subpopulations.

CONCLUSIONS

The accrual number of patients is sometimes unable to reach the pre-defined value; therefore, existing basket designs may not ensure defined operating characteristics before beginning the trial. The proposed design that enables adjustment of the cutoff value to control FWER at the target value based on the results in the final analysis would be a better alternative.

An adaptive biomarker basket design in phase II oncology trials

The phase II basket trial in oncology is a novel design that enables the simultaneous assessment of treatment effects of one anti-cancer targeted agent in multiple cancer types. Biomarkers could potentially associate with the clinical outcomes and re-define clinically meaningful treatment effects. It is therefore natural to develop a biomarker-based basket design to allow the prospective enrichment of the trials with the adaptive selection of the biomarker-positive (BM+) subjects who are most sensitive to the experimental treatment. We propose a two-stage phase II adaptive biomarker basket (ABB) design based on a potential predictive biomarker measured on a continuous scale. At Stage 1, the design incorporates a biomarker cutoff estimation procedure via a hierarchical Bayesian model with biomarker as a covariate (HBMbc). At Stage 2, the design enrolls only BM+ subjects, defined as those with the biomarker values exceeding the biomarker cutoff within each cancer type, and subsequently assesses the early efficacy and/or futility stopping through the pre-defined interim analyses. At the end of the trial, the response rate of all BM+ subjects for each cancer type can guide drug development, while the data from all subjects can be used to further model the relationship between the biomarker value and the clinical outcome for potential future research. The extensive simulation studies show that the ABB design could produce a good estimate of the biomarker cutoff to select BM+ subjects with high accuracy and could outperform the existing phase II basket biomarker cutoff design under various scenarios.

Estimands and Complex Innovative Designs

Since the release of the ICH E9(R1) (International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use Addendum on Estimands and Sensitivity Analysis in Clinical Trials to the Guideline on Statistical Principles for Clinical Trials) document in 2019, the estimand framework has become a fundamental part of clinical trial protocols. In parallel, complex innovative designs have gained increased popularity in drug development, in particular in early development phases or in difficult experimental situations. While the estimand framework is relevant to any study in which a treatment effect is estimated, experience is lacking as regards its application to these designs. In a basket trial for example, should a different estimand be specified for each subpopulation of interest, defined, for example, by cancer site? Or can a single estimand focusing on the general population (defined, for example, by the positivity to a certain biomarker) be used? In the case of platform trials, should a different estimand be proposed for each drug investigated? In this work we discuss possible ways of implementing the estimand framework for different types of complex innovative designs. We consider trials that allow adding or selecting experimental treatment arms, modifying the control arm or the standard of care, and selecting or pooling populations. We also address the potentially data-driven, adaptive selection of estimands in an ongoing trial and disentangle certain statistical issues that pertain to estimation rather than to estimands, such as the borrowing of nonconcurrent information. We hope this discussion will facilitate the implementation of the estimand framework and its description in the study protocol when the objectives of the trial require complex innovative designs.

Bayesian modelling strategies for borrowing of information in randomised basket trials

Basket trials are an innovative precision medicine clinical trial design evaluating a single targeted therapy across multiple diseases that share a common characteristic. To date, most basket trials have been conducted in early-phase oncology settings, for which several Bayesian methods permitting information sharing across subtrials have been proposed. With the increasing interest of implementing randomised basket trials, information borrowing could be exploited in two ways; considering the commensurability of either the treatment effects or the outcomes specific to each of the treatment groups between the subtrials. In this article, we extend a previous analysis model based on distributional discrepancy for borrowing over the subtrial treatment effects ('treatment effect borrowing', TEB) to borrowing over the subtrial groupwise responses ('treatment response borrowing', TRB). Simulation results demonstrate that both modelling strategies provide substantial gains over an approach with no borrowing. TRB outperforms TEB especially when subtrial sample sizes are small on all operational characteristics, while the latter has considerable gains in performance over TRB when subtrial sample sizes are large, or the treatment effects and groupwise mean responses are noticeably heterogeneous across subtrials. Further, we notice that TRB, and TEB can potentially lead to different conclusions in the analysis of real data.

A bayesian platform trial design to simultaneously evaluate multiple drugs in multiple indications with mixed endpoints

In the era of targeted therapies and immunotherapies, the traditional drug development paradigm of testing one drug at a time in one indication has become increasingly inefficient. Motivated by a real-world application, we propose a master-protocol-based Bayesian platform trial design with mixed endpoints (PDME) to simultaneously evaluate multiple drugs in multiple indications, where different subsets of efficacy measures (e.g., objective response and landmark progression-free survival) may be used by different indications as single or multiple endpoints. We propose a Bayesian hierarchical model to accommodate mixed endpoints and reflect the trial structure of indications that are nested within treatments. We develop a two-stage approach that first clusters the indications into homogeneous subgroups and then applies the Bayesian hierarchical model to each subgroup to achieve precision information borrowing. Patients are enrolled in a group-sequential way and adaptively assigned to treatments according to their efficacy estimates. At each interim analysis, the posterior probabilities that the treatment effect exceeds prespecified clinically relevant thresholds are used to drop ineffective treatments and "graduate" effective treatments. Simulations show that the PDME design has desirable operating characteristics compared to existing method. This article is protected by copyright. All rights reserved.

Comparative Study of Bayesian Information Borrowing Methods in Oncology Clinical Trials

With deeper insight into precision medicine, more innovative oncology trial designs have been proposed to contribute to the characteristics of novel antitumor drugs. Bayesian information borrowing is an indispensable part of these designs, which shows great advantages in improving the efficiency of clinical trials. Bayesian methods provide an effective framework when incorporating information. However, the key point lies in how to choose an appropriate method for complex oncology clinical trials.

Regulatory issues and the potential use of Bayesian approaches for early drug approval systems in Japan

Bayesian methods quantify and interpret the therapeutic effects of investigational drugs based on probability statements of the posterior distribution. However, the basic principle underlying the use of Bayesian methods in registration trials for new drug applications in Japan has not been adequately discussed. Motivated by the two drug approval systems for early approval recently enacted in Japan, we present our perspectives on the application of the Bayesian approach in registration trials in Japan. These are based on discussions among academic, industry, and regulatory experts at invited workshops. Based on the aforementioned early approval systems, we discuss putative common regulatory issues related to the use of the Bayesian approach and introduce instances of clinical trials in which the Bayesian approach is expected to be used. This article provides a well-defined premise for the discussion between industry and regulatory agencies on the use of Bayesian approaches for early drug approval in Japan.

Constrained hierarchical Bayesian model for latent subgroups in basket trials with two classifiers

The basket trial in oncology is a novel clinical trial design that enables the simultaneous assessment of one treatment in multiple cancer types. In addition to the usual basket classifier of the cancer types, many recent basket trials further contain other classifiers like biomarkers that potentially affect the clinical outcomes. In other words, the treatment effects in those baskets are often categorized by not only the cancer types but also the levels of other classifiers. Therefore, the assumption of exchangeability is often violated when some baskets are more sensitive to the targeted treatment, whereas others are less. In this article, we propose a constrained hierarchical Bayesian model for latent subgroups (CHBM-LS) to deal with potential heterogeneity of treatment effects due to both the cancer type (first classifier) and another classifier (second classifier) in basket trials. Different baskets defined by multiple cancer types and multiple levels of the second classifier are aggregated into subgroups using a latent subgroup modeling approach. Within each latent subgroup, the treatment effects are similar and approximately exchangeable to borrow information. The CHBM-LS approach evaluates the treatment effect for each basket while allowing adaptive information borrowing across the baskets by identifying latent subgroups. The simulation study shows that the CHBM-LS approach outperforms other approaches with higher statistical power and better-controlled type I error rates under various scenarios with heterogeneous treatment effects across baskets.

Optimal Bayesian hierarchical model to accelerate the development of tissue-agnostic drugs and basket trials

Tissue-agnostic trials and basket trials enroll patients based on their genetic biomarkers, not tumor type, in an attempt to determine if a new drug can successfully treat disease conditions based on biomarkers. The Bayesian hierarchical model (BHM) provides an attractive approach to design phase II tissue-agnostic trials by allowing information borrowing across multiple disease types. In this article, we elucidate two intrinsic and inevitable issues that may limit the use of BHM to tissue-agnostic trials: sensitivity to the prior specification of the shrinkage parameter and the competing "interest" among disease types in increasing power and controlling type I error. To address these issues, we propose the optimal BHM (OBHM) and clustered OBHM (COBHM) approaches. In these approach, we first specify a flexible utility function to quantify the tradeoff between type I error and power across disease types based on the study objectives, and then we select the prior of the shrinkage parameter to optimize the utility function of clinical and regulatory interest. COBHM further utilizes a simple Bayesian rule to cluster tumor types into sensitive and insensitive subgroups to achieve more accurate information borrowing. Simulation study shows that the OBHM and especially COBHM have desirable operating characteristics, outperforming some existing methods. COBHM effectively balances power and type I error, addresses the sensitivity of the prior selection, and reduces the "unwarranted" subjectivity in the prior selection. It provides a systematic, rigorous way to apply BHM and solve the common problem of blindingly using a non-informative inverse-gamma prior (with a large variance) or priors arbitrarily chosen that may lead to problematic statistical properties.

Categories, components, and techniques in a modular construction of basket trials for application and further research

Basket trials have become a virulent topic in medical and statistical research during the last decade. The core idea of them is to treat patients, who express the same genetic predisposition-either personally or their disease-with the same treatment irrespective of the location of the disease. The location of the disease defines each basket and the pathway of the treatment uses the common genetic predisposition among the baskets. This opens the opportunity to share information among baskets, which can consequently increase the information of the basket-wise response with respect to the investigated treatment. This further allows dynamic decisions regarding futility and efficacy of individual baskets during the ongoing trial. Several statistical designs have been proposed on how a basket trial can be conducted and this has left an unclear situation with many options. The different designs propose different mathematical and statistical techniques, different decision rules, and also different trial purposes. This paper presents a broad overview of existing designs, categorizes them, and elaborates their similarities and differences. A uniform and consistent notation facilitates the first contact, introduction, and understanding of the statistical methodologies and techniques used in basket trials. Finally, this paper presents a modular approach for the construction of basket trials in applied medical science and forms a base for further research of basket trial designs and their techniques.

Shotgun: A Bayesian seamless phase I-II design to accelerate the development of targeted therapies and immunotherapy

Drug development of novel antitumor agents is conventionally divided by phase and cancer indication. With the advent of new molecularly targeted therapies and immunotherapies, this approach has become inefficient and dysfunctional. We propose a Bayesian seamless phase I-II "shotgun" design to evaluate the safety and antitumor efficacy of a new drug in multiple cancer indications simultaneously. "Shotgun" is used to describe the design feature that the trial begins with an all-comer dose finding phase to identify the maximum tolerated dose (MTD) or recommended phase II dose (RP2D), and then is seamlessly split to multiple indication-specific cohort expansions. Patients treated during dose finding are rolled over to the cohort expansion for more efficient evaluation of efficacy, while patients enrolled in cohort expansion contribute to the continuous learning of the safety and tolerability of the new drug. During cohort expansion, interim analyses are performed to discontinue ineffective or unsafe expansion cohorts early. To improve the efficiency of such interim analyses, we propose a clustered Bayesian hierarchical model (CBHM) to adaptively borrow information across indications. A simulation study shows that compared to conventional approaches and the standard Bayesian hierarchical model, the shotgun design has substantially higher probabilities to discover indications that are responsive to the treatment in question, and is associated with a reasonable false discovery rate. The shotgun provides a phase I-II trial design for accelerating drug development and to build a more robust foundation for subsequent phase III trials. The proposed CBHM methodology also provides an efficient design for basket trials.