1
|
Bjugård Nyberg H, Chen X, Donnelly M, Fang L, Zhao L, Karlsson MO, Hooker AC. Evaluation of model-integrated evidence approaches for pharmacokinetic bioequivalence studies using model averaging methods. CPT Pharmacometrics Syst Pharmacol 2024; 13:1748-1761. [PMID: 39205490 PMCID: PMC11494900 DOI: 10.1002/psp4.13217] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2023] [Revised: 06/26/2024] [Accepted: 07/19/2024] [Indexed: 09/04/2024] Open
Abstract
Conventional approaches for establishing bioequivalence (BE) between test and reference formulations using non-compartmental analysis (NCA) may demonstrate low power in pharmacokinetic (PK) studies with sparse sampling. In this case, model-integrated evidence (MIE) approaches for BE assessment have been shown to increase power, but may suffer from selection bias problems if models are built on the same data used for BE assessment. This work presents model averaging methods for BE evaluation and compares the power and type I error of these methods to conventional BE approaches for simulated studies of oral and ophthalmic formulations. Two model averaging methods were examined: bootstrap model selection and weight-based model averaging with parameter uncertainty from three different sources, either from a sandwich covariance matrix, a bootstrap, or from sampling importance resampling (SIR). The proposed approaches increased power compared with conventional NCA-based BE approaches, especially for the ophthalmic formulation scenarios, and were simultaneously able to adequately control type I error. In the rich sampling scenario considered for oral formulation, the weight-based model averaging method with SIR uncertainty provided controlled type I error, that was closest to the target of 5%. In sparse-sampling designs, especially the single sample ophthalmic scenarios, the type I error was best controlled by the bootstrap model selection method.
Collapse
Affiliation(s)
| | - Xiaomei Chen
- Department of PharmacyUppsala UniversityUppsalaSweden
| | - Mark Donnelly
- Division of Quantitative Methods and ModellingOffice of Research and Standards, Office of Generic Drugs, Food and Drug AdministrationSilver SpringMarylandUSA
| | - Lanyan Fang
- Division of Quantitative Methods and ModellingOffice of Research and Standards, Office of Generic Drugs, Food and Drug AdministrationSilver SpringMarylandUSA
| | - Liang Zhao
- Division of Quantitative Methods and ModellingOffice of Research and Standards, Office of Generic Drugs, Food and Drug AdministrationSilver SpringMarylandUSA
| | | | | |
Collapse
|
2
|
Chen X, Nyberg HB, Donnelly M, Zhao L, Fang L, Karlsson MO, Hooker AC. Development and comparison of model-integrated evidence approaches for bioequivalence studies with pharmacokinetic end points. CPT Pharmacometrics Syst Pharmacol 2024; 13:1734-1747. [PMID: 39177211 PMCID: PMC11494825 DOI: 10.1002/psp4.13216] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2023] [Revised: 06/26/2024] [Accepted: 07/19/2024] [Indexed: 08/24/2024] Open
Abstract
By applying nonlinear mixed-effect (NLME) models, model-integrated evidence (MIE) approaches are able to analyze bioequivalence (BE) data with pharmacokinetic end points that have sparse sampling, which is problematic for non-compartmental analysis (NCA). However, MIE approaches may suffer from inflation of type I error due to underestimation of parameter uncertainty and to the assumption of asymptotic normality. In this study, we developed a MIE BE analysis method that is based on a pre-defined model and consists of several steps including model fitting, uncertainty assessment, simulation, and BE determination. The presented MIE approach has several improvements compared with the previously reported model-integrated methods: (1) treatment, sequence, and period effects are only added to absorption parameters (such as relative bioavailability and rate of absorption) instead of all PK parameters; (2) a simulation step is performed to generate confidence intervals of the pharmacokinetic metrics for BE assessment; and (3) in an effort to maintain type I error, two more advanced parameter uncertainty evaluation approaches are explored, a nonparametric (case resampling) bootstrap, and sampling importance resampling (SIR). To evaluate the developed method and compare the uncertainty assessment methods, simulation experiments were performed for BE studies using a two-way crossover design with different amounts of information (sparse to rich designs) and levels of variability. Based on the simulation results, the method using SIR for parameter uncertainty quantification controls type I error at the nominal level of 0.05 (i.e., the significance level set for BE evaluation) even for studies with small sample size and/or sparse sampling. As expected, our MIE approach for BE assessment exhibited higher power than the NCA-based method, especially as the data becomes sparser and/or more variable.
Collapse
Affiliation(s)
- Xiaomei Chen
- Department of PharmacyUppsala UniversityUppsalaSweden
| | | | - Mark Donnelly
- Division of Quantitative Methods and ModelingOffice of Research Standards, Office of Generic Drugs, Center for Drug Evaluation and Research, Food and Drug AdministrationSilver SpringMarylandUSA
| | - Liang Zhao
- Division of Quantitative Methods and ModelingOffice of Research Standards, Office of Generic Drugs, Center for Drug Evaluation and Research, Food and Drug AdministrationSilver SpringMarylandUSA
| | - Lanyan Fang
- Division of Quantitative Methods and ModelingOffice of Research Standards, Office of Generic Drugs, Center for Drug Evaluation and Research, Food and Drug AdministrationSilver SpringMarylandUSA
| | | | | |
Collapse
|
3
|
Bois FY, Brochot C. A Bayesian framework for virtual comparative trials and bioequivalence assessments. Front Pharmacol 2024; 15:1404619. [PMID: 39139647 PMCID: PMC11319711 DOI: 10.3389/fphar.2024.1404619] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2024] [Accepted: 07/02/2024] [Indexed: 08/15/2024] Open
Abstract
Introduction In virtual bioequivalence (VBE) assessments, pharmacokinetic models informed with in vitro data and verified with small clinical trials' data are used to simulate otherwise unfeasibly large trials. Simulated VBE trials are assessed in a frequentist framework as if they were real despite the unlimited number of virtual subjects they can use. This may adequately control consumer risk but imposes unnecessary risks on producers. We propose a fully Bayesian model-integrated VBE assessment framework that circumvents these limitations. Methods We illustrate our approach with a case study on a hypothetical paliperidone palmitate (PP) generic long-acting injectable suspension formulation using a validated population pharmacokinetic model published for the reference formulation. BE testing, study power, type I and type II error analyses or their Bayesian equivalents, and safe-space analyses are demonstrated. Results The fully Bayesian workflow is more precise than the frequentist workflow. Decisions about bioequivalence and safe space analyses in the two workflows can differ markedly because the Bayesian analyses are more accurate. Discussion A Bayesian framework can adequately control consumer risk and minimize producer risk . It rewards data gathering and model integration to make the best use of prior information. The frequentist approach is less precise but faster to compute, and it can still be used as a first step to narrow down the parameter space to explore in safe-space analyses.
Collapse
Affiliation(s)
- Frederic Y. Bois
- Certara UK Limited, Certara Predictive Technologies Division, Sheffield, United Kingdom
| | | |
Collapse
|
4
|
Guhl M, Bertrand J, Fayette L, Mercier F, Comets E. Uncertainty Computation at Finite Distance in Nonlinear Mixed Effects Models-a New Method Based on Metropolis-Hastings Algorithm. AAPS J 2024; 26:53. [PMID: 38722435 DOI: 10.1208/s12248-024-00905-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2023] [Accepted: 02/29/2024] [Indexed: 06/07/2024] Open
Abstract
The standard errors (SE) of the maximum likelihood estimates (MLE) of the population parameter vector in nonlinear mixed effect models (NLMEM) are usually estimated using the inverse of the Fisher information matrix (FIM). However, at a finite distance, i.e. far from the asymptotic, the FIM can underestimate the SE of NLMEM parameters. Alternatively, the standard deviation of the posterior distribution, obtained in Stan via the Hamiltonian Monte Carlo algorithm, has been shown to be a proxy for the SE, since, under some regularity conditions on the prior, the limiting distributions of the MLE and of the maximum a posterior estimator in a Bayesian framework are equivalent. In this work, we develop a similar method using the Metropolis-Hastings (MH) algorithm in parallel to the stochastic approximation expectation maximisation (SAEM) algorithm, implemented in the saemix R package. We assess this method on different simulation scenarios and data from a real case study, comparing it to other SE computation methods. The simulation study shows that our method improves the results obtained with frequentist methods at finite distance. However, it performed poorly in a scenario with the high variability and correlations observed in the real case study, stressing the need for calibration.
Collapse
Affiliation(s)
- Mélanie Guhl
- Université Paris Cité, Inserm, IAME, F-75018, Paris, France.
| | - Julie Bertrand
- Université Paris Cité, Inserm, IAME, F-75018, Paris, France
| | - Lucie Fayette
- Université Paris Cité, Inserm, IAME, F-75018, Paris, France
| | - François Mercier
- Department of Biostatistics, Roche Innovation Center Basel, Basel, Switzerland
| | - Emmanuelle Comets
- Université Paris Cité, Inserm, IAME, F-75018, Paris, France
- Univ Rennes, Inserm, EHESP, Irset - UMR_S 1085, F-35000, Rennes, France
| |
Collapse
|
5
|
Wen YF, Ji P, Schrieber SJ, Rathi S, McGuirt D, Liu J, Chen J, Wang YM, Doddapaneni S, Sahajwalla C. Evaluation of Truncated AUC as an Alternative Measure to Assess Pharmacokinetic Comparability in Bridging Biologic-Device Using Prefilled Syringes and Autoinjectors. J Clin Pharmacol 2023; 63:1417-1429. [PMID: 37507728 DOI: 10.1002/jcph.2322] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Accepted: 07/24/2023] [Indexed: 07/30/2023]
Abstract
Pharmacokinetic (PK) comparisons between therapeutic biologics have largely been based on the total area under the concentration-time curve (AUC) and the maximum concentration (Cmax ). For biologics with a long half-life, a PK comparability study may be long in duration and costly to conduct. The goal of this study was to evaluate whether a truncated AUC (tAUC) can be used to assess PK comparability when bridging prefilled syringe (PFS) and autoinjector (AI) treatment options for biologics with a long half-life. Fifteen biologics license applications (BLAs) were included to determine the concordance and geometric percent coefficient of variation (%CV) between tAUCs evaluated on days 7, 14, 21, and 28 and AUC evaluated to infinity (AUC0-inf ). Concordance is established if the tAUCs are comparable with AUC0-inf . Trial simulation was performed to examine the effect of the absorption rate constant (ka ) and sample size on the concordance of tAUCs. The tAUCs evaluated on day 14, 21, and 28 had 100% concordance with AUC0-inf for all 15 BLAs. The concordance of tAUC evaluated at day 7 was 87.5%. Based on the trial simulation, tAUC evaluated to day 28 post-dose can achieve high concordance (≥85%) for biologics exhibiting linear or nonlinear elimination with a ka of ≥0.1/day and with a sample size of 70 subjects per arm. tAUC appears to be a promising alternative PK measure, relative to AUC0-inf , for PK comparability assessments.
Collapse
Affiliation(s)
- Ya-Feng Wen
- Division of Inflammation and Immune Pharmacology, Office of Clinical Pharmacology, Office of Translational Sciences, Center for Drug Evaluation and Research, Food and Drug Administration, Silver Spring, MD, USA
| | - Ping Ji
- Division of Inflammation and Immune Pharmacology, Office of Clinical Pharmacology, Office of Translational Sciences, Center for Drug Evaluation and Research, Food and Drug Administration, Silver Spring, MD, USA
| | - Sarah J Schrieber
- Office of Therapeutic Biologics and Biosimilars, Office of New Drugs, Center for Drug Evaluation and Research, Food and Drug Administration, Silver Spring, MD, USA
| | - Sneha Rathi
- Division of Inflammation and Immune Pharmacology, Office of Clinical Pharmacology, Office of Translational Sciences, Center for Drug Evaluation and Research, Food and Drug Administration, Silver Spring, MD, USA
| | - Delaney McGuirt
- Division of Inflammation and Immune Pharmacology, Office of Clinical Pharmacology, Office of Translational Sciences, Center for Drug Evaluation and Research, Food and Drug Administration, Silver Spring, MD, USA
| | - Jiang Liu
- Division of Pharmacometrics, Office of Clinical Pharmacology, Office of Translational Sciences, Center for Drug Evaluation and Research, Food and Drug Administration, Silver Spring, MD, USA
| | - Jianmeng Chen
- Division of Inflammation and Immune Pharmacology, Office of Clinical Pharmacology, Office of Translational Sciences, Center for Drug Evaluation and Research, Food and Drug Administration, Silver Spring, MD, USA
| | - Yow-Ming Wang
- Therapeutic Biologics Program, Office of Clinical Pharmacology, Office of Translational Sciences, Center for Drug Evaluation and Research, Food and Drug Administration, Silver Spring, MD, USA
| | - Suresh Doddapaneni
- Division of Inflammation and Immune Pharmacology, Office of Clinical Pharmacology, Office of Translational Sciences, Center for Drug Evaluation and Research, Food and Drug Administration, Silver Spring, MD, USA
| | - Chandrahas Sahajwalla
- Division of Inflammation and Immune Pharmacology, Office of Clinical Pharmacology, Office of Translational Sciences, Center for Drug Evaluation and Research, Food and Drug Administration, Silver Spring, MD, USA
| |
Collapse
|
6
|
Tardivon C, Loingeville F, Donnelly M, Feng K, Sun W, Sun G, Grosser S, Zhao L, Fang L, Mentré F, Bertrand J. Evaluation of model-based bioequivalence approach for single sample pharmacokinetic studies. CPT Pharmacometrics Syst Pharmacol 2023; 12:904-915. [PMID: 37114321 PMCID: PMC10349197 DOI: 10.1002/psp4.12960] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2022] [Revised: 03/02/2023] [Accepted: 03/03/2023] [Indexed: 04/29/2023] Open
Abstract
In a traditional pharmacokinetic (PK) bioequivalence (BE) study, a two-way crossover study is conducted, PK parameters (namely the area under the time-concentration curve [AUC] and the maximal concentration [C max ]) are obtained by noncompartmental analysis (NCA), and the BE analysis is performed using the two one-sided test (TOST) method. For ophthalmic drugs, however, only one sample of aqueous humor, in one eye, per eye can be obtained in each patient, which precludes the traditional BE analysis. To circumvent this issue, the U.S. Food and Drug Administration (FDA) has proposed an approach coupling NCA with either parametric or nonparametric bootstrap (NCA bootstrap). The model-based TOST (MB-TOST) has previously been proposed and evaluated successfully for various settings of sparse PK BE studies. In this paper, we evaluate, via simulations, MB-TOST in the specific setting of single sample PK BE study and compare its performance to NCA bootstrap. We performed BE study simulations using a published PK model and parameter values and evaluated multiple scenarios, including study design (parallel or crossover), sampling times (5 or 10 spread across the dosing interval), and geometric mean ratio (of 0.8, 0.9, 1, and 1.25). Using the simulated structural PK model, MB-TOST performed similarly to NCA bootstrap for AUC. ForC max , the latter tended to be conservative and less powerful. Our research suggests that MB-TOST may be considered as an alternative BE approach for single sample PK studies, provided that the PK model is correctly specified and the test drug has the same structural model as the reference drug.
Collapse
Affiliation(s)
- Coralie Tardivon
- INSERM, IAMEUniversité de ParisParisFrance
- Département Epidémiologie Biostatistiques et Recherche CliniqueAP‐HP, Hôpital BichatParisFrance
| | - Florence Loingeville
- INSERM, IAMEUniversité de ParisParisFrance
- METRICS: Evaluation of Health Technologies and Medical PracticesUniversity of Lille, CHU Lille, ULR 2694LilleFrance
| | - Mark Donnelly
- Division of Quantitative Methods and Modeling, Office of Research Standards, Office of Generic DrugsCenter for Drug Evaluation and Research, Food and Drug AdministrationSilver SpringMaryland20993USA
| | - Kairui Feng
- Division of Quantitative Methods and Modeling, Office of Research Standards, Office of Generic DrugsCenter for Drug Evaluation and Research, Food and Drug AdministrationSilver SpringMaryland20993USA
| | - Wanjie Sun
- Office of Biostatistics, Office of Translational SciencesCenter for Drug Evaluation and Research, U.S. Food and Drug AdministrationSilver SpringMaryland20993USA
| | - Guoying Sun
- Office of Biostatistics, Office of Translational SciencesCenter for Drug Evaluation and Research, U.S. Food and Drug AdministrationSilver SpringMaryland20993USA
| | - Stella Grosser
- Office of Biostatistics, Office of Translational SciencesCenter for Drug Evaluation and Research, U.S. Food and Drug AdministrationSilver SpringMaryland20993USA
| | - Liang Zhao
- Division of Quantitative Methods and Modeling, Office of Research Standards, Office of Generic DrugsCenter for Drug Evaluation and Research, Food and Drug AdministrationSilver SpringMaryland20993USA
| | - Lanyan Fang
- Division of Quantitative Methods and Modeling, Office of Research Standards, Office of Generic DrugsCenter for Drug Evaluation and Research, Food and Drug AdministrationSilver SpringMaryland20993USA
| | | | | |
Collapse
|
7
|
Guhl M, Mercier F, Hofmann C, Sharan S, Donnelly M, Feng K, Sun W, Sun G, Grosser S, Zhao L, Fang L, Mentré F, Comets E, Bertrand J. Impact of model misspecification on model-based tests in PK studies with parallel design: real case and simulation studies. J Pharmacokinet Pharmacodyn 2022; 49:557-577. [PMID: 36112338 PMCID: PMC9483500 DOI: 10.1007/s10928-022-09821-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2022] [Accepted: 08/11/2022] [Indexed: 11/26/2022]
Abstract
This article evaluates the performance of pharmacokinetic (PK) equivalence testing between two formulations of a drug through the Two-One Sided Tests (TOST) by a model-based approach (MB-TOST), as an alternative to the classical non-compartmental approach (NCA-TOST), for a sparse design with a few time points per subject. We focused on the impact of model misspecification and the relevance of model selection for the reference data. We first analysed PK data from phase I studies of gantenerumab, a monoclonal antibody for the treatment of Alzheimer’s disease. Using the original rich sample data, we compared MB-TOST to NCA-TOST for validation. Then, the analysis was repeated on a sparse subset of the original data with MB-TOST. This analysis inspired a simulation study with rich and sparse designs. With rich designs, we compared NCA-TOST and MB-TOST in terms of type I error and study power. With both designs, we explored the impact of misspecifying the model on the performance of MB-TOST and adding a model selection step. Using the observed data, the results of both approaches were in general concordance. MB-TOST results were robust with sparse designs when the underlying PK structural model was correctly specified. Using the simulated data with a rich design, the type I error of NCA-TOST was close to the nominal level. When using the simulated model, the type I error of MB-TOST was controlled on rich and sparse designs, but using a misspecified model led to inflated type I errors. Adding a model selection step on the reference data reduced the inflation. MB-TOST appears as a robust alternative to NCA-TOST, provided that the PK model is correctly specified and the test drug has the same PK structural model as the reference drug.
Collapse
|