1
|
Fayette L, Leroux R, Mentré F, Seurat J. Robust and Adaptive Two-stage Designs in Nonlinear Mixed Effect Models. AAPS J 2023; 25:71. [PMID: 37466809 DOI: 10.1208/s12248-023-00810-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2023] [Accepted: 04/06/2023] [Indexed: 07/20/2023] Open
Abstract
To get informative studies for nonlinear mixed effect models (NLMEM), design optimization can be performed based on Fisher Information Matrix (FIM) using the D-criterion. Its computation requires knowledge about models and parameters, which are often prior guesses. Thus, adaptive designs composed of several stages may be used. Robust approach can also be used to account for various candidate models. In the estimation step of a given stage, model selection (MS) or model averaging (MA) can be performed. In this work we propose a new two-stage adaptive design strategy, based on the robust expected FIM and MA over several candidate models. The methodology is applied to a clinical trial simulation in ophthalmology to optimize doses and time measurements. A set of dose-response candidate models is defined, and one-stage designs are compared to two-stage 50/50 designs (i.e., each stage performed with half of the available subjects), using either local optimal design or robust design, and performing analysis with one model, MS or MA. Performing a two-stage design with MS at the interim analysis can correct the choice of a wrong model for designing the first stage. Overall, starting from a robust design (1- or 2-stage) is valuable and leads to reasonable bias and precision. The proposed robust adaptive design strategy is a new tool to design longitudinal studies that could be used in different therapeutic areas.
Collapse
Affiliation(s)
- Lucie Fayette
- Inserm, IAME, Université Paris Cité and Université Sorbonne Paris Nord, F-75018, Paris, France
- École des Ponts, UGE, Champs-sur-Marne, France
| | - Romain Leroux
- Inserm, IAME, Université Paris Cité and Université Sorbonne Paris Nord, F-75018, Paris, France
| | - France Mentré
- Inserm, IAME, Université Paris Cité and Université Sorbonne Paris Nord, F-75018, Paris, France
| | - Jérémy Seurat
- Inserm, IAME, Université Paris Cité and Université Sorbonne Paris Nord, F-75018, Paris, France.
| |
Collapse
|
2
|
Loingeville F, Nguyen TT, Riviere MK, Mentré F. Robust designs in longitudinal studies accounting for parameter and model uncertainties – application to count data. J Biopharm Stat 2019; 30:31-45. [DOI: 10.1080/10543406.2019.1607367] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Affiliation(s)
- Florence Loingeville
- INSERM, IAME, UMR 1137, F-75018, Paris, France
- University Paris Diderot, Sorbonne Paris Cité, F-75018, Paris, France
- Faculty of Pharmacy, University of Lille, EA 2694, Public Health: Epidemiology and Healthcare quality, F-59000 Lille, France
| | - Thu Thuy Nguyen
- INSERM, IAME, UMR 1137, F-75018, Paris, France
- University Paris Diderot, Sorbonne Paris Cité, F-75018, Paris, France
| | - Marie-Karelle Riviere
- Statistical Methodology Group, Biostatistics and Programming department, Sanofi-Aventis R&D, Chilly-Mazarin, France
| | - France Mentré
- INSERM, IAME, UMR 1137, F-75018, Paris, France
- University Paris Diderot, Sorbonne Paris Cité, F-75018, Paris, France
| |
Collapse
|
3
|
Hilgers RD, Bogdan M, Burman CF, Dette H, Karlsson M, König F, Male C, Mentré F, Molenberghs G, Senn S. Lessons learned from IDeAl - 33 recommendations from the IDeAl-net about design and analysis of small population clinical trials. Orphanet J Rare Dis 2018; 13:77. [PMID: 29751809 PMCID: PMC5948846 DOI: 10.1186/s13023-018-0820-8] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2017] [Accepted: 05/01/2018] [Indexed: 01/01/2023] Open
Abstract
BACKGROUND IDeAl (Integrated designs and analysis of small population clinical trials) is an EU funded project developing new statistical design and analysis methodologies for clinical trials in small population groups. Here we provide an overview of IDeAl findings and give recommendations to applied researchers. METHOD The description of the findings is broken down by the nine scientific IDeAl work packages and summarizes results from the project's more than 60 publications to date in peer reviewed journals. In addition, we applied text mining to evaluate the publications and the IDeAl work packages' output in relation to the design and analysis terms derived from in the IRDiRC task force report on small population clinical trials. RESULTS The results are summarized, describing the developments from an applied viewpoint. The main result presented here are 33 practical recommendations drawn from the work, giving researchers a comprehensive guidance to the improved methodology. In particular, the findings will help design and analyse efficient clinical trials in rare diseases with limited number of patients available. We developed a network representation relating the hot topics developed by the IRDiRC task force on small population clinical trials to IDeAl's work as well as relating important methodologies by IDeAl's definition necessary to consider in design and analysis of small-population clinical trials. These network representation establish a new perspective on design and analysis of small-population clinical trials. CONCLUSION IDeAl has provided a huge number of options to refine the statistical methodology for small-population clinical trials from various perspectives. A total of 33 recommendations developed and related to the work packages help the researcher to design small population clinical trial. The route to improvements is displayed in IDeAl-network representing important statistical methodological skills necessary to design and analysis of small-population clinical trials. The methods are ready for use.
Collapse
Affiliation(s)
- Ralf-Dieter Hilgers
- Department of Medical Statistics, RWTH Aachen University, Pauwelsstr. 19, D-52074, Aachen, Germany.
| | - Malgorzata Bogdan
- Department of Medical Statistics, RWTH Aachen University, Pauwelsstr. 19, D-52074, Aachen, Germany
| | - Carl-Fredrik Burman
- Department of Medical Statistics, RWTH Aachen University, Pauwelsstr. 19, D-52074, Aachen, Germany
| | - Holger Dette
- Department of Medical Statistics, RWTH Aachen University, Pauwelsstr. 19, D-52074, Aachen, Germany
| | - Mats Karlsson
- Department of Medical Statistics, RWTH Aachen University, Pauwelsstr. 19, D-52074, Aachen, Germany
| | - Franz König
- Department of Medical Statistics, RWTH Aachen University, Pauwelsstr. 19, D-52074, Aachen, Germany
| | - Christoph Male
- Department of Medical Statistics, RWTH Aachen University, Pauwelsstr. 19, D-52074, Aachen, Germany
| | - France Mentré
- Department of Medical Statistics, RWTH Aachen University, Pauwelsstr. 19, D-52074, Aachen, Germany
| | - Geert Molenberghs
- Department of Medical Statistics, RWTH Aachen University, Pauwelsstr. 19, D-52074, Aachen, Germany
| | - Stephen Senn
- Department of Medical Statistics, RWTH Aachen University, Pauwelsstr. 19, D-52074, Aachen, Germany
| |
Collapse
|
4
|
Dumont C, Lestini G, Le Nagard H, Mentré F, Comets E, Nguyen TT. PFIM 4.0, an extended R program for design evaluation and optimization in nonlinear mixed-effect models. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2018; 156:217-229. [PMID: 29428073 DOI: 10.1016/j.cmpb.2018.01.008] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/05/2017] [Revised: 12/22/2017] [Accepted: 01/10/2018] [Indexed: 06/08/2023]
Abstract
BACKGROUND AND OBJECTIVE Nonlinear mixed-effect models (NLMEMs) are increasingly used for the analysis of longitudinal studies during drug development. When designing these studies, the expected Fisher information matrix (FIM) can be used instead of performing time-consuming clinical trial simulations. The function PFIM is the first tool for design evaluation and optimization that has been developed in R. In this article, we present an extended version, PFIM 4.0, which includes several new features. METHODS Compared with version 3.0, PFIM 4.0 includes a more complete pharmacokinetic/pharmacodynamic library of models and accommodates models including additional random effects for inter-occasion variability as well as discrete covariates. A new input method has been added to specify user-defined models through an R function. Optimization can be performed assuming some fixed parameters or some fixed sampling times. New outputs have been added regarding the FIM such as eigenvalues, conditional numbers, and the option of saving the matrix obtained after evaluation or optimization. Previously obtained results, which are summarized in a FIM, can be taken into account in evaluation or optimization of one-group protocols. This feature enables the use of PFIM for adaptive designs. The Bayesian individual FIM has been implemented, taking into account a priori distribution of random effects. Designs for maximum a posteriori Bayesian estimation of individual parameters can now be evaluated or optimized and the predicted shrinkage is also reported. It is also possible to visualize the graphs of the model and the sensitivity functions without performing evaluation or optimization. RESULTS The usefulness of these approaches and the simplicity of use of PFIM 4.0 are illustrated by two examples: (i) an example of designing a population pharmacokinetic study accounting for previous results, which highlights the advantage of adaptive designs; (ii) an example of Bayesian individual design optimization for a pharmacodynamic study, showing that the Bayesian individual FIM can be a useful tool in therapeutic drug monitoring, allowing efficient prediction of estimation precision and shrinkage for individual parameters. CONCLUSION PFIM 4.0 is a useful tool for design evaluation and optimization of longitudinal studies in pharmacometrics and is freely available at http://www.pfim.biostat.fr.
Collapse
Affiliation(s)
- Cyrielle Dumont
- IAME, UMR 1137, INSERM and University Paris Diderot, Sorbonne Paris Cité, Paris, F-75018, France; University of Lille, EA 2694, Public Health: Epidemiology and Healthcare Quality, ILIS, Lille, F-59000, France
| | - Giulia Lestini
- IAME, UMR 1137, INSERM and University Paris Diderot, Sorbonne Paris Cité, Paris, F-75018, France
| | - Hervé Le Nagard
- IAME, UMR 1137, INSERM and University Paris Diderot, Sorbonne Paris Cité, Paris, F-75018, France
| | - France Mentré
- IAME, UMR 1137, INSERM and University Paris Diderot, Sorbonne Paris Cité, Paris, F-75018, France
| | - Emmanuelle Comets
- IAME, UMR 1137, INSERM and University Paris Diderot, Sorbonne Paris Cité, Paris, F-75018, France
| | - Thu Thuy Nguyen
- IAME, UMR 1137, INSERM and University Paris Diderot, Sorbonne Paris Cité, Paris, F-75018, France.
| |
Collapse
|
5
|
Designing a Pediatric Study for an Antimalarial Drug by Using Information from Adults. Antimicrob Agents Chemother 2015; 60:1481-91. [PMID: 26711749 DOI: 10.1128/aac.01125-15] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2015] [Accepted: 12/08/2015] [Indexed: 12/19/2022] Open
Abstract
The objectives of this study were to design a pharmacokinetic (PK) study by using information about adults and evaluate the robustness of the recommended design through a case study of mefloquine. PK data about adults and children were available from two different randomized studies of the treatment of malaria with the same artesunate-mefloquine combination regimen. A recommended design for pediatric studies of mefloquine was optimized on the basis of an extrapolated model built from adult data through the following approach. (i) An adult PK model was built, and parameters were estimated by using the stochastic approximation expectation-maximization algorithm. (ii) Pediatric PK parameters were then obtained by adding allometry and maturation to the adult model. (iii) A D-optimal design for children was obtained with PFIM by assuming the extrapolated design. Finally, the robustness of the recommended design was evaluated in terms of the relative bias and relative standard errors (RSE) of the parameters in a simulation study with four different models and was compared to the empirical design used for the pediatric study. Combining PK modeling, extrapolation, and design optimization led to a design for children with five sampling times. PK parameters were well estimated by this design with few RSE. Although the extrapolated model did not predict the observed mefloquine concentrations in children very accurately, it allowed precise and unbiased estimates across various model assumptions, contrary to the empirical design. Using information from adult studies combined with allometry and maturation can help provide robust designs for pediatric studies.
Collapse
|
6
|
Stockmann C, Barrett JS, Roberts JK, Sherwin CMT. Use of Modeling and Simulation in the Design and Conduct of Pediatric Clinical Trials and the Optimization of Individualized Dosing Regimens. CPT Pharmacometrics Syst Pharmacol 2015; 4:630-40. [PMID: 26783499 PMCID: PMC4716585 DOI: 10.1002/psp4.12038] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2015] [Revised: 09/01/2015] [Accepted: 09/07/2015] [Indexed: 12/11/2022] Open
Abstract
Mathematical models of drug action and disease progression can inform pediatric pharmacotherapy. In this tutorial, we explore the key issues that differentiate pediatric from adult pharmacokinetic (PK) / pharmacodynamic (PD) studies, describe methods to calculate the number of participants to be enrolled and the optimal times at which blood samples should be collected, and therapeutic drug monitoring methods for individualizing pharmacotherapy. The development of pediatric-specific drug dosing dashboards is also highlighted, with an emphasis on clinical-relevance and ease of use.
Collapse
Affiliation(s)
- C Stockmann
- Department of PediatricsUniversity of Utah School of MedicineSalt Lake CityUtahUSA
| | | | - JK Roberts
- Department of PediatricsUniversity of Utah School of MedicineSalt Lake CityUtahUSA
| | - CMT Sherwin
- Department of PediatricsUniversity of Utah School of MedicineSalt Lake CityUtahUSA
| |
Collapse
|
7
|
Lestini G, Dumont C, Mentré F. Influence of the Size of Cohorts in Adaptive Design for Nonlinear Mixed Effects Models: An Evaluation by Simulation for a Pharmacokinetic and Pharmacodynamic Model for a Biomarker in Oncology. Pharm Res 2015; 32:3159-69. [PMID: 26123680 PMCID: PMC5385211 DOI: 10.1007/s11095-015-1693-3] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2014] [Accepted: 03/31/2015] [Indexed: 10/23/2022]
Abstract
PURPOSE In this study we aimed to evaluate adaptive designs (ADs) by clinical trial simulation for a pharmacokinetic-pharmacodynamic model in oncology and to compare them with one-stage designs, i.e., when no adaptation is performed, using wrong prior parameters. METHODS We evaluated two one-stage designs, ξ0 and ξ*, optimised for prior and true population parameters, Ψ0 and Ψ*, and several ADs (two-, three- and five-stage). All designs had 50 patients. For ADs, the first cohort design was ξ0. The next cohort design was optimised using prior information updated from the previous cohort. Optimal design was based on the determinant of the Fisher information matrix using PFIM. Design evaluation was performed by clinical trial simulations using data simulated from Ψ*. RESULTS Estimation results of two-stage ADs and ξ * were close and much better than those obtained with ξ 0. The balanced two-stage AD performed better than two-stage ADs with different cohort sizes. Three- and five-stage ADs were better than two-stage with small first cohort, but not better than the balanced two-stage design. CONCLUSIONS Two-stage ADs are useful when prior parameters are unreliable. In case of small first cohort, more adaptations are needed but these designs are complex to implement.
Collapse
Affiliation(s)
- Giulia Lestini
- IAME, UMR 1137, INSERM, Université Paris Diderot, Sorbonne Paris Cité, F-75018, Paris, France.
| | - Cyrielle Dumont
- IAME, UMR 1137, INSERM, Université Paris Diderot, Sorbonne Paris Cité, F-75018, Paris, France
| | - France Mentré
- IAME, UMR 1137, INSERM, Université Paris Diderot, Sorbonne Paris Cité, F-75018, Paris, France
| |
Collapse
|