Short-Term Efficacy Reliably Predicts Long-Term Clinical Benefit in Rheumatoid Arthritis Clinical Trials as Demonstrated by Model-Based Meta-Analysis

Joint longitudinal model-based meta-analysis of FEV1 and exacerbation rate in randomized COPD trials

Model-based meta-analysis (MBMA) is an approach that integrates relevant summary level data from heterogeneously designed randomized controlled trials (RCTs). This study not only evaluated the predictability of a published MBMA for forced expiratory volume in one second (FEV₁) and its link to annual exacerbation rate in patients with chronic obstructive pulmonary disease (COPD) but also included data from new RCTs. A comparative effectiveness analysis across all drugs was also performed. Aggregated level data were collected from RCTs published between July 2013 and November 2020 (n = 132 references comprising 156 studies) and combined with data used in the legacy MBMA (published RCTs up to July 2013 - n = 142). The augmented data (n = 298) were used to evaluate the predictive performance of the published MBMA using goodness-of-fit plots for assessment. Furthermore, the model was extended including drugs that were not available before July 2013, estimating a new set of parameters. The legacy MBMA model predicted the post-2013 FEV₁ data well, and new estimated parameters were similar to those of drugs in the same class. However, the exacerbation model overpredicted the post-2013 mean annual exacerbation rate data. Inclusion of year when the study started on the pre-treatment placebo rate improved the model predictive performance perhaps explaining potential improvements in the disease management over time. The addition of new data to the legacy COPD MBMA enabled a more robust model with increased predictability performance for both endpoints FEV₁ and mean annual exacerbation rate.

Applications of Model-Based Meta-Analysis in Drug Development

Model-based meta-analysis (MBMA) is a quantitative approach that leverages published summary data along with internal data and can be applied to inform key drug development decisions, including the benefit-risk assessment of a treatment under investigation. These risk-benefit assessments may involve determining an optimal dose compared against historic external comparators of a particular disease indication. MBMA can provide a flexible framework for interpreting aggregated data from historic reference studies and therefore should be a standard tool for the model-informed drug development (MIDD) framework.In addition to pairwise and network meta-analyses, MBMA provides further contributions in the quantitative approaches with its ability to incorporate longitudinal data and the pharmacologic concept of dose-response relationship, as well as to combine individual- and summary-level data and routinely incorporate covariates in the analysis.A common application of MBMA is the selection of optimal dose and dosing regimen of the internal investigational molecule to evaluate external benchmarking and to support comparator selection. Two case studies provided examples in applications of MBMA in biologics (durvalumab + tremelimumab for safety) and small molecule (fenebrutinib for efficacy) to support drug development decision-making in two different but well-studied disease areas, i.e., oncology and rheumatoid arthritis, respectively.Important to the future directions of MBMA include additional recognition and engagement from drug development stakeholders for the MBMA approach, stronger collaboration between pharmacometrics and statistics, expanded data access, and the use of machine learning for database building. Timely, cost-effective, and successful application of MBMA should be part of providing an integrated view of MIDD.

Establishment of a clinical diagnostic model for gouty arthritis based on the serum biochemical profile: A case-control study

The disease progression of gouty arthritis (GA) is relatively clear, with the 4 stages of hyperuricemia (HUA), acute gouty arthritis (AGA), gouty arthritis during the intermittent period (GIP), and chronic gouty arthritis (CGA). This paper attempts to construct a clinical diagnostic model based on blood routine test data, in order to avoid the need for bursa fluid examination and other tedious steps, and at the same time to predict the development direction of GA.Serum samples from 579 subjects were collected within 3 years in this study and were divided into a training set (n = 379) and validation set (n = 200). After a series of multivariate statistical analyses, the serum biochemical profile was obtained, which could effectively distinguish different stages of GA. A clinical diagnosis model based on the biochemical index of the training set was established to maximize the probability of the stage as a diagnosis, and the serum biochemical data from 200 patients were used for validation.The total area under the curve (AUC) of the clinical diagnostic model was 0.9534, and the AUCs of the 5 models were 0.9814 (Control), 0.9288 (HUA), 0.9752 (AGA), 0.9056 (GIP), and 0.9759 (CGA). The kappa coefficient of the clinical diagnostic model was 0.80.This clinical diagnostic model could be applied clinically and in research to improve the accuracy of the identification of the different stages of GA. Meanwhile, the serum biochemical profile revealed by this study could be used to assist the clinical diagnosis and prediction of GA.

Model-Based Meta-Analysis Compares DAS28 Rheumatoid Arthritis Treatment Effects and Suggests an Expedited Trial Design for Early Clinical Development

A nonlinear mixed effects modeling approach was used to conduct a model‐based meta‐analysis (MBMA) of longitudinal, summary‐level, baseline‐corrected 28‐joint Disease Activity Score (ΔDAS28) clinical trial data from seven approved rheumatoid arthritis (RA) drugs (abatacept, adalimumab, certolizumab, etanercept, rituximab, tocilizumab, and tofacitinib), representing 130 randomized clinical trials in 27,355 patients. All of the drugs except tocilizumab were found to have relatively similar ΔDAS28 time courses and efficacy (baseline‐corrected and placebo‐corrected) at 24 weeks and beyond of approximately 0.87–1.3 units in the typical RA patient population. Tocilizumab was estimated to have a differentially greater response of 1.99 at 24 weeks, likely due to its disproportionate effect on the acute‐phase cytokine interleukin‐6. Baseline DAS28, disease duration, percentage of male participants, and the year of conduct of the trial were found to have statistically significant effects on the timing and/or magnitude of ΔDAS28 in the control arms. Clinical trial simulations using the present MBMA indicated that abatacept, certolizumab, etanercept, tocilizumab, and tofacitinib would be expected to have a greater than 70% probability of showing a statistically significant difference vs. control at Week 6 with a sample size of ~ 30 patients per arm. In future RA clinical trials, an interim analysis conducted as early as 6 weeks after treatment initiation, with relatively small sample sizes, should be sufficient to detect the ΔDAS28 treatment effect vs. placebo.

Population Pharmacokinetics, Efficacy Exposure-response Analysis, and Model-based Meta-analysis of Fenebrutinib in Subjects with Rheumatoid Arthritis [corrected]

Purpose

Fenebrutinib (GDC-0853), a Bruton’s tyrosine kinase (BTK) inhibitor was investigated in a Phase 2 clinical trial in patients with rheumatoid arthritis (RA). Our aim was to apply a model-informed drug development (MIDD) approach to examine the totality of available clinical efficacy data.

Methods

Population pharmacokinetics (popPK) modeling, exposure-response (E-R) analysis, and model-based meta-analysis (MBMA) of fenebrutinib were performed based on the Phase 2 data.

Results

PopPK of fenebrutinib after oral administration was described using a 3-compartment model with linear elimination and a flexible absorption transit compartment model. Healthy subjects had a 52% higher apparent clearance than patients. E-R analyses based on longitudinal ACR20, ACR50, and ACR70 and DAS28 (CRP) data modeled fenebrutinib effect with an E_max function, and an efficacy plateau was achieved within the exposure range obtained in the Phase 2 clinical trial. Based on literature data, a summary-level clinical efficacy database was constructed, and MBMA determined ACR20, ACR50, and ACR70 responder rates in the placebo and adalimumab arms of the Phase 2 clinical trial were found to be consistent with historical data for these treatments.

Conclusions

Our multi-pronged approach applied MIDD to maximize knowledge extraction of efficacy data and enabled robust interpretation from a Phase 2 clinical trial.

Electronic supplementary material

The online version of this article (10.1007/s11095-019-2752-y) contains supplementary material, which is available to authorized users.

Assessing prognosis and prediction of treatment response in early rheumatoid arthritis: systematic reviews

BACKGROUND

Rheumatoid arthritis (RA) is a chronic, debilitating disease associated with reduced quality of life and substantial costs. It is unclear which tests and assessment tools allow the best assessment of prognosis in people with early RA and whether or not variables predict the response of patients to different drug treatments.

OBJECTIVE

To systematically review evidence on the use of selected tests and assessment tools in patients with early RA (1) in the evaluation of a prognosis (review 1) and (2) as predictive markers of treatment response (review 2).

DATA SOURCES

Electronic databases (e.g. MEDLINE, EMBASE, The Cochrane Library, Web of Science Conference Proceedings; searched to September 2016), registers, key websites, hand-searching of reference lists of included studies and key systematic reviews and contact with experts.

STUDY SELECTION

Review 1 - primary studies on the development, external validation and impact of clinical prediction models for selected outcomes in adult early RA patients. Review 2 - primary studies on the interaction between selected baseline covariates and treatment (conventional and biological disease-modifying antirheumatic drugs) on salient outcomes in adult early RA patients.

RESULTS

Review 1 - 22 model development studies and one combined model development/external validation study reporting 39 clinical prediction models were included. Five external validation studies evaluating eight clinical prediction models for radiographic joint damage were also included. c-statistics from internal validation ranged from 0.63 to 0.87 for radiographic progression (different definitions, six studies) and 0.78 to 0.82 for the Health Assessment Questionnaire (HAQ). Predictive performance in external validations varied considerably. Three models [(1) Active controlled Study of Patients receiving Infliximab for the treatment of Rheumatoid arthritis of Early onset (ASPIRE) C-reactive protein (ASPIRE CRP), (2) ASPIRE erythrocyte sedimentation rate (ASPIRE ESR) and (3) Behandelings Strategie (BeSt)] were externally validated using the same outcome definition in more than one population. Results of the random-effects meta-analysis suggested substantial uncertainty in the expected predictive performance of models in a new sample of patients. Review 2 - 12 studies were identified. Covariates examined included anti-citrullinated protein/peptide anti-body (ACPA) status, smoking status, erosions, rheumatoid factor status, C-reactive protein level, erythrocyte sedimentation rate, swollen joint count (SJC), body mass index and vascularity of synovium on power Doppler ultrasound (PDUS). Outcomes examined included erosions/radiographic progression, disease activity, physical function and Disease Activity Score-28 remission. There was statistical evidence to suggest that ACPA status, SJC and PDUS status at baseline may be treatment effect modifiers, but not necessarily that they are prognostic of response for all treatments. Most of the results were subject to considerable uncertainty and were not statistically significant.

LIMITATIONS

The meta-analysis in review 1 was limited by the availability of only a small number of external validation studies. Studies rarely investigated the interaction between predictors and treatment.

SUGGESTED RESEARCH PRIORITIES

Collaborative research (including the use of individual participant data) is needed to further develop and externally validate the clinical prediction models. The clinical prediction models should be validated with respect to individual treatments. Future assessments of treatment by covariate interactions should follow good statistical practice.

CONCLUSIONS

Review 1 - uncertainty remains over the optimal prediction model(s) for use in clinical practice. Review 2 - in general, there was insufficient evidence that the effect of treatment depended on baseline characteristics.

STUDY REGISTRATION

This study is registered as PROSPERO CRD42016042402.

FUNDING

The National Institute for Health Research Health Technology Assessment programme.

Many Flavors of Model-Based Meta-Analysis: Part II - Modeling Summary Level Longitudinal Responses

Meta-analyses typically assess comparative treatment response for an end point at specific timepoints across studies. However, during drug development, it is often of interest to understand the response time-course of competitor compounds for a variety of purposes. Examples of such application include informing study design and characterizing the onset, maintenance, and offset of action. This tutorial acts as a "points for consideration" document, reviews relevant literature, and fits a longitudinal model to an example dataset.

Model-Based Meta-Analysis for Multiple Myeloma: A Quantitative Drug-Independent Framework for Efficient Decisions in Oncology Drug Development

The failure rate for phase III trials in oncology is high; quantitative predictive approaches are needed. We developed a model‐based meta‐analysis (MBMA) framework to predict progression‐free survival (PFS) from overall response rates (ORR) in relapsed/refractory multiple myeloma (RRMM), using data from seven phase III trials. A Bayesian analysis was used to predict the probability of technical success (PTS) for achieving desired phase III PFS targets based on phase II ORR data. The model demonstrated a strongly correlated (R² = 0.84) linear relationship between ORR and median PFS. As a representative application of the framework, MBMA predicted that an ORR of ∼66% would be needed in a phase II study of 50 patients to achieve a target median PFS of 13.5 months in a phase III study. This model can be used to help estimate PTS to achieve gold‐standard targets in a target product profile, thereby enabling objectively informed decision‐making.

Model-based Meta-Analysis on the Efficacy of Pharmacological Treatments for Idiopathic Pulmonary Fibrosis

Recently, the US Food and Drug Administration (FDA) approved the first two drugs (pirfenidone and nintedanib) indicated for the treatment of idiopathic pulmonary fibrosis (IPF). The purpose of this analysis was to leverage publicly available data to quantify comparative efficacy of compounds that are approved or in development. An analysis-ready database was developed, and the analysis dataset is composed of summary-level data from 43 arms in 20 trials, with treatment durations ranging from 8-104 weeks. A hierarchical multivariable regression model with nonparametric placebo estimation was used to fit the longitudinal profile of change from baseline of percent predicted forced vital capacity (%predicted FVC) data. Pirfenidone and nintedanib were the only drugs identified to have significant estimated positive treatment effects. Model simulations were performed to further evaluate the covariate and time course of treatment effects on longitudinal change from baseline %predicted FVC to inform future trial designs and support decision making.

Model-Based Network Meta-Analysis: A Framework for Evidence Synthesis of Clinical Trial Data

Model-based meta-analysis (MBMA) is increasingly used in drug development to inform decision-making and future trial designs, through the use of complex dose and/or time course models. Network meta-analysis (NMA) is increasingly being used by reimbursement agencies to estimate a set of coherent relative treatment effects for multiple treatments that respect the randomization within the trials. However, NMAs typically either consider different doses completely independently or lump them together, with few examples of models for dose. We propose a framework, model-based network meta-analysis (MBNMA), that combines both approaches, that respects randomization, and allows estimation and prediction for multiple agents and a range of doses, using plausible physiological dose-response models. We illustrate our approach with an example comparing the efficacies of triptans for migraine relief. This uses a binary endpoint, although we note that the model can be easily modified for other outcome types.