TITE-BOIN12: A Bayesian phase I/II trial design to find the optimal biological dose with late-onset toxicity and efficacy

Challenges and Lessons Learned in Autologous Chimeric Antigen Receptor T-Cell Therapy Development from a Statistical Perspective

Chimeric antigen receptor (CAR) T-cell therapy is a human gene therapy product where T cells from a patient are genetically modified to enable them to recognize desired target antigen(s) more effectively. In recent years, promising antitumor activity has been seen with autologous CAR T cells. Since 2017, six CAR T-cell therapies for the treatment of hematological malignancies have been approved by the Food and Drug Administration (FDA). Despite the rapid progress of CAR T-cell therapies, considerable statistical challenges still exist for this category of products across all phases of clinical development that need to be addressed. These include (but not limited to) dose finding strategy, implementation of the estimand framework, use of real-world data in contextualizing single-arm CAR T trials, analysis of safety data and long-term follow-up studies. This paper is the first step in summarizing and addressing these statistical hurdles based on the development of the six approved CAR T-cell products.

Strategies for successful dose optimization in oncology drug development: a practical guide

Dose optimization is a critical challenge in drug development. Historically, dose determination in oncology has followed a divergent path from other non-oncology therapeutic areas due to the unique characteristics and requirements in Oncology. However, with the emergence of new drug modalities and mechanisms of drugs in oncology, such as immune therapies, radiopharmaceuticals, targeted therapies, cytostatic agents, and others, the dose-response relationship for efficacy and toxicity could be vastly varied compared to the cytotoxic chemotherapies. The doses below the MTD may demonstrate similar efficacy to the MTD with an improved tolerability profile, resembling what is commonly observed in non-oncology treatments. Hence, alternate strategies for dose optimization are required for new modalities in oncology drug development. This paper delves into the historical evolution of dose finding methods from non-oncology to oncology, highlighting examples and summarizing the underlying drivers of change. Subsequently, a practical framework and guidance are provided to illustrate how dose optimization can be incorporated into various stages of the development program. We provide the following general recommendations: 1) The objective for phase I is to identify a dose range rather than a single MTD dose for subsequent development to better characterize the safety and tolerability profile within the dose range. 2) At least two doses separable by PK are recommended for dose optimization in phase II. 3) Ideally, dose optimization should be performed before launching the confirmatory study. Nevertheless, innovative designs such as seamless II/III design can be implemented for dose selection and may accelerate the drug development program.

A generalized Bayesian optimal interval design for dose optimization in immunotherapy

For novel immuno-oncology therapies, the primary purpose of a dose-finding trial is to identify an optimal dose (OD), defined as the tolerable dose having adequate efficacy and immune response under the unpredictable dose-outcome (toxicity, efficacy, and immune response) relationships. In addition, the multiple low or moderate-grade toxicities rather than dose-limiting toxicities (DLTs) and multiple levels of efficacy should be evaluated differently in dose-finding to determine true OD for developing novel immuno-oncology therapies. We proposed a generalized Bayesian optimal interval design for immunotherapy, simultaneously considering efficacy and toxicity grades and immune response outcomes. The proposed design, named gBOIN-ETI design, is model-assisted and easy to implement to develop immunotherapy efficiently. The operating characteristics of the gBOIN-ETI are compared with other dose-finding trial designs in oncology by simulation across various realistic settings. Our simulations show that the gBOIN-ETI design could outperform the other available approaches in terms of both the percentage of correct OD selection and the average number of patients allocated to the OD across various realistic trial settings.

Adaptive phase I-II clinical trial designs identifying optimal biological doses for targeted agents and immunotherapies

Targeted agents and immunotherapies have revolutionized cancer treatment, offering promising options for various cancer types. Unlike traditional therapies the principle of "more is better" is not always applicable to these new therapies due to their unique biomedical mechanisms. As a result, various phase I-II clinical trial designs have been proposed to identify the optimal biological dose that maximizes the therapeutic effect of targeted therapies and immunotherapies by jointly monitoring both efficacy and toxicity outcomes. This review article examines several innovative phase I-II clinical trial designs that utilize accumulated efficacy and toxicity outcomes to adaptively determine doses for subsequent patients and identify the optimal biological dose, maximizing the overall therapeutic effect. Specifically, we highlight three categories of phase I-II designs: efficacy-driven, utility-based, and designs incorporating multiple efficacy endpoints. For each design, we review the dose-outcome model, the definition of the optimal biological dose, the dose-finding algorithm, and the software for trial implementation. To illustrate the concepts, we also present two real phase I-II trial examples utilizing the EffTox and ISO designs. Finally, we provide a classification tree to summarize the designs discussed in this article.

Statistical and practical considerations in planning and conduct of dose-optimization trials

The U.S. Food and Drug Administration launched Project Optimus with the aim of shifting the paradigm of dose-finding and selection toward identifying the optimal biological dose that offers the best balance between benefit and risk, rather than the maximum tolerated dose. However, achieving dose optimization is a challenging task that involves a variety of factors and is considerably more complicated than identifying the maximum tolerated dose, both in terms of design and implementation. This article provides a comprehensive review of various design strategies for dose-optimization trials, including phase 1/2 and 2/3 designs, and highlights their respective advantages and disadvantages. In addition, practical considerations for selecting an appropriate design and planning and executing the trial are discussed. The article also presents freely available software tools that can be utilized for designing and implementing dose-optimization trials. The approaches and their implementation are illustrated through real-world examples.

Dose optimization for cancer treatments with considerations for late-onset toxicities

Given that novel anticancer therapies have different toxicity profiles and mechanisms of action, it is important to reconsider the current approaches for dose selection. In an effort to move away from considering the maximum tolerated dose as the optimal dose, the Food and Drug Administration Project Optimus points to the need of incorporating long-term toxicity evaluation, given that many of these novel agents lead to late-onset or cumulative toxicities and there are no guidelines on how to handle them. Numerous methods have been proposed to handle late-onset toxicities in dose-finding clinical trials. A summary and comparison of these methods are provided. Moreover, using PI3K inhibitors as a case study, we show how late-onset toxicity can be integrated into the dose-optimization strategy using current available approaches. We illustrate a re-design of this trial to compare the approach to those that only consider early toxicity outcomes and disregard late-onset toxicities. We also provide proposals going forward for dose optimization in early development of novel anticancer agents with considerations for late-onset toxicities.

Accelerating drug development at Bristol Myers Squibb through innovation

This paper focuses on the use of novel technologies and innovative trial designs to accelerate evidence generation and increase pharmaceutical Research and Development (R&D) productivity, at Bristol Myers Squibb. We summarize learnings with case examples, on how we prepared and continuously evolved to address the increasing cost, complexities, and external pressures in drug development, to bring innovative medicines to patients much faster. These learnings were based on review of internal efforts toward accelerating R&D focusing on four key areas: adopting innovative trial designs, optimizing trial designs, leveraging external control data, and implementing novel methods using artificial intelligence and machine learning.

BOIN-ETC: A Bayesian optimal interval design considering efficacy and toxicity to identify the optimal dose combinations

One of the primary objectives of a dose-finding trial for novel anti-cancer agent combination therapies, such as molecular targeted agents and immune-oncology therapies, is to identify optimal dose combinations that are tolerable and therapeutically beneficial for subjects in subsequent clinical trials. The goal differs from that of a dose-finding trial for traditional cytotoxic agents, in which the goal is to determine the maximum tolerated dose combinations. This paper proposes the new design, named 'BOIN-ETC' design, to identify optimal dose combinations based on both efficacy and toxicity outcomes using the waterfall approach. The BOIN-ETC design is model-assisted, so it is expected to be robust, and straightforward to implement in actual oncology dose-finding trials. These characteristics are quite valuable from a practical perspective. Simulation studies show that the BOIN-ETC design has advantages compared with the other approaches in the percentage of correct optimal dose combination selection and the average number of patients allocated to the optimal dose combinations across various realistic settings.

A Bayesian optimal interval design for dose optimization with a randomization scheme based on pharmacokinetics outcomes in oncology

The primary objective of an oncology dose-finding trial for novel therapies, such as molecularly targeted agents and immune-oncology therapies, is to identify the optimal dose (OD) that is tolerable and therapeutically beneficial for subjects in subsequent clinical trials. Pharmacokinetic (PK) information is considered an appropriate indicator for evaluating the level of drug intervention in humans from a pharmacological perspective. Several novel anticancer agents have been shown to have significant exposure-efficacy relationships, and some PK information has been considered an important predictor of efficacy. This paper proposes a Bayesian optimal interval design for dose optimization with a randomization scheme based on PK outcomes in oncology. A simulation study shows that the proposed design has advantages compared to the other designs in the percentage of correct OD selection and the average number of patients allocated to OD in various realistic settings.

TITE-gBOIN-ET: Time-to-event generalized Bayesian optimal interval design to accelerate dose-finding accounting for ordinal graded efficacy and toxicity outcomes

One of the primary objectives of an oncology dose-finding trial for novel therapies, such as molecular-targeted agents and immune-oncology therapies, is to identify an optimal dose (OD) that is tolerable and therapeutically beneficial for subjects in subsequent clinical trials. These new therapeutic agents appear more likely to induce multiple low or moderate-grade toxicities than dose-limiting toxicities. Besides, for efficacy, evaluating the overall response and long-term stable disease in solid tumors and considering the difference between complete remission and partial remission in lymphoma are preferable. It is also essential to accelerate early-stage trials to shorten the entire period of drug development. However, it is often challenging to make real-time adaptive decisions due to late-onset outcomes, fast accrual rates, and differences in outcome evaluation periods for efficacy and toxicity. To solve the issues, we propose a time-to-event generalized Bayesian optimal interval design to accelerate dose finding, accounting for efficacy and toxicity grades. The new design named "TITE-gBOIN-ET" design is model-assisted and straightforward to implement in actual oncology dose-finding trials. Simulation studies show that the TITE-gBOIN-ET design significantly shortens the trial duration compared with the designs without sequential enrollment while having comparable or higher performance in the percentage of correct OD selection and the average number of patients allocated to the ODs across various realistic settings.

A comparative study of adaptive trial designs for dose optimization

Recently, the US Food and Drug Administration Oncology Center of Excellence initiated Project Optimus to reform the dose optimization and dose selection paradigm in oncology drug development. The agency pointed out that the current paradigm for dose selection-based on the maximum tolerated dose (MTD)-is not sufficient for molecularly targeted therapies and immunotherapies, for which efficacy may not increase after the dose reaches a certain level. In these cases, it is more appropriate to identify the optimal biological dose (OBD) that optimizes the risk-benefit tradeoff of the drug. Project Optimus has spurred tremendous interest and urgent need for guidance on designing dose optimization trials. In this article, we review several representative dose optimization designs, including model-based and model-assisted designs, and compare their operating characteristics based on 10,000 randomly generated scenarios with various dose-toxicity and dose-efficacy curves and some fixed representative scenarios. The results show that, compared with model-based designs, model-assisted methods have advantages of easy-to-implement, robustness, and high accuracy to identify OBD. Some guidance is provided to help biostatisticians and clinicians to choose appropriate dose optimization methods in practice.

Comparison Between Simultaneous and Sequential Utilization of Safety and Efficacy for Optimal Dose Determination in Bayesian Model-Assisted Designs

It has become quite common in recent early oncology trials to include both the dose-finding and the dose-expansion parts within the same study. This shift can be viewed as a seamless way of conducting the trials to obtain information on safety and efficacy hence identifying an optimal dose (OD) rather than just the maximum tolerated dose (MTD). One approach is to conduct a dose-finding part based solely on toxicity outcomes, followed by a dose expansion part to evaluate efficacy outcomes. Another approach employs only the dose-finding part, where the dose-finding decisions are made utilizing both the efficacy and toxicity outcomes of those enrolled patients. In this paper, we compared the two approaches through simulation studies under various realistic settings. The percentage of correct ODs selection, the average number of patients allocated to the ODs, and the average trial duration are reported in choosing the appropriate designs for their early-stage dose-finding trials, including expansion cohorts.

Adaptive Cohort Size Determination Method for Bayesian Optimal Interval Phase I/II Design to Shorten Clinical Trial Duration

PURPOSE

Recently, the strategy for dose optimization in oncology has shifted toward conducting phase II randomized controlled trials with multiple doses. Optimal biologic dose (OBD) selection from phase I trial data to determine candidate doses for phase II trials has been gaining attention. Trials to identify the OBD have a fixed cohort size, which increases the trial duration. We propose a method to increase the cohort size using trial data and shorten the trial duration while maintaining accuracy.

METHODS

We propose a novel adaptive cohort size determination method in which the increase of cohort size is determined using desirability probability on the basis of toxicity and efficacy data. The desirability probability is a measure of how desirable a dose is and thus how close it is to the OBD. However, during the trial, the desirability probability does not need to be calculated. Instead, the cohort size expansion can be determined by a simple table generated in advance from toxicity and efficacy data. An illustrated example is provided and the performance was evaluated in a simulation study with 16 scenarios.

RESULTS

In the simulation study, the trial duration was reduced by an average of 20% compared with the conventional design. The percentages of correct OBD selection are almost the same as those with the conventional design.

CONCLUSION

The proposed adaptive cohort size determination method described in this study reduces trial duration while maintaining accuracy.

Trial designs and endpoints for immune therapies in multiple myeloma

Immune therapies, including CAR-T cells, bispecific antibodies, and antibody-drug conjugates, are revolutionizing the treatment of multiple myeloma. In this review, we discuss clinical trial design considerations relevant to immune therapies. We first examine issues pertinent to specific populations, including elderly, patients with renal impairment, high-risk/extramedullary disease, and prior immune therapies. We then highlight trial designs to optimize the selection of dose and schedule, explore rational combination therapies based on preclinical data, and evaluate the nuances of commonly used endpoints. By exploiting their pharmacokinetic/pharmacodynamic profiles and utilizing novel translational insights, we can optimize the use of immune therapies in multiple myeloma.

Data-dependent early completion of dose-finding trials for drug-combination

PURPOSE

Model-assisted designs for drug combination trials have been proposed as novel designs with simple and superior performance. However, model-assisted designs have the disadvantage that the sample size must be set in advance, and trials cannot be completed until the number of patients treated reaches the pre-set sample size. Model-assisted designs have a stopping rule that can be used to terminate the trial if the number of patients treated exceeds the predetermined number, there is no statistical basis for the predetermined number. Here, I propose two methods for data-dependent early completion of dose-finding trials for drug combination: (1) an early completion method based on dose retainment probability, and (2) an early completion method in which the dose retainment probability is adjusted by a bivariate isotonic regression.

METHODS

Early completion is determined when the dose retainment probability using both trial data and the number of remaining patients is high. Early completion of a virtual trial was demonstrated. The performances of the early completion methods were evaluated by simulation studies with 12 scenarios.

RESULTS

The simulation studies showed that the percentage of early completion was an average of approximately 70%, and the number of patients treated was 25% less than the planned sample size. The percentage of correct maximum tolerated dose combination selection for the early completion methods was similar to that of non-early completion methods with an average difference of approximately 3%.

CONCLUSION

The performance of the proposed early completion methods was similar to that of the non-early completion methods. Furthermore, the number of patients for determining early completion before the trial starts was determined and a program code for calculating the dose retainment probability was proposed.

Improving early phase oncology clinical trial design: The case for finding the optimal biological dose

Historically early phase oncology drug development programmes have been based on the belief that "more is better". Furthermore, rule-based study designs such as the "3 + 3" design are still often used to identify the MTD. Phillips and Clark argue that newer Bayesian model-assisted designs such as the BOIN design should become the go to designs for statisticians for MTD finding. This short communication goes one stage further and argues that Bayesian model-assisted designs such as the BOIN12 which balances risk-benefit should be included as one of the go to designs for early phase oncology trials, depending on the study objectives. Identifying the optimal biological dose for future research for many modern targeted drugs, immunotherapies, cell therapies and vaccine therapies can save significant time and resources.

Improving early phase oncology clinical trial design: An opportunity for statisticians

This short communication supports that rule-based study designs such as the '3 + 3' study design are still being used in early phase oncology development programs despite their inferior performance to model-based and model-assisted designs. Statisticians have an opportunity to shape and improve early phase oncology drug development programs by introducing newer, more efficient study designs that estimate the Optimal Biological dose to their oncology trialist colleges.

An overview of the BOIN design and its current extensions for novel early-phase oncology trials

Bayesian Optimal Interval (BOIN) designs are a class of model-assisted dose-finding designs that can be used in oncology trials to determine the maximum tolerated dose (MTD) of a study drug based on safety or the optimal biological dose (OBD) based on safety and efficacy. BOIN designs provide a complete suite for dose finding in early phase trials, as well as a consistent way to explore different scenarios such as toxicity, efficacy, continuous outcomes, delayed toxicity or efficacy and drug combinations in a unified manner with easy access to software to implement most of these designs. Although built upon Bayesian probability models, BOIN designs are operationally simple in general and have good statistical operating characteristics compared to other dose-finding designs. This review paper describes the original BOIN design and its many extensions, their advantages and limitations, the software used to implement them, and the most suitable situation for use of each of these designs. Published examples of the implementation of BOIN designs are provided in the Appendix.

Dosing Regimens of Immune Checkpoint Inhibitors: Attempts at Lower Dose, Less Frequency, Shorter Course

Immune checkpoint inhibitors (ICIs) are a revolutionary breakthrough in the field of cancer by modulating patient's own immune system to exert anti-tumor effects. The clinical application of ICIs is still in its infancy, and their dosing regimens need to be continuously adjusted. Pharmacokinetic/pharmacodynamic studies showed a significant plateau in the exposure-response curve, with high receptor occupancy and plasma concentrations achieved at low dose levels. Coupled with concerns about drug toxicity and heavy economic costs, there has been an ongoing quest to reevaluate the current ICI dosing regimens while preserving maximum clinical efficacy. Many clinical data showed remarkable anticancer effects with ICIs at the doses far below the approved regimens, indicating the possibility of dose reduction. Our review attempts to summarize the clinical evidence for ICIs regimens with lower-dose, less-frequency, shorter-course, and provide clues for further ICIs regimen optimization.