1
|
Scala A, Cavallo P. Measuring the efficacy of a vaccine during an epidemic. PLoS One 2023; 18:e0290652. [PMID: 37708163 PMCID: PMC10501570 DOI: 10.1371/journal.pone.0290652] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2022] [Accepted: 08/11/2023] [Indexed: 09/16/2023] Open
Abstract
The urgency to develop vaccines during the COVID-19 pandemic has resulted in the acceleration of clinical trials. Specifically, a broad spectrum of efficacy levels has been reported for various vaccines based on phase III cohort studies. Our study demonstrates that conducting large cohort phase III clinical trials during the peak of an epidemic leads to a significant underestimation of vaccine efficacy, even in the absence of confounding factors. Furthermore, we find that this underestimation increases with the proportion of infectious individuals in the population during the experiment and the severity of the epidemic, as measured by its basic reproduction number.
Collapse
Affiliation(s)
- Antonio Scala
- CNR-ISC, Applico Lab, Roma, Italy
- Centro Ricerche Enrico Fermi, Roma, Italy
- Big Data in Health Society, Roma, Italy
- Global Health Security Agenda - GHSA, Italy
| | | |
Collapse
|
2
|
Loria J, Albani VVL, Coutinho FAB, Covas DT, Struchiner CJ, Zubelli JP, Massad E. Time-dependent vaccine efficacy estimation quantified by a mathematical model. PLoS One 2023; 18:e0285466. [PMID: 37167285 PMCID: PMC10174497 DOI: 10.1371/journal.pone.0285466] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2023] [Accepted: 04/23/2023] [Indexed: 05/13/2023] Open
Abstract
In this paper we calculate the variation of the estimated vaccine efficacy (VE) due to the time-dependent force of infection resulting from the difference between the moment the Clinical Trial (CT) begins and the peak in the outbreak intensity. Using a simple mathematical model we tested the hypothesis that the time difference between the moment the CT begins and the peak in the outbreak intensity determines substantially different values for VE. We exemplify the method with the case of the VE efficacy estimation for one of the vaccines against the new coronavirus SARS-CoV-2.
Collapse
Affiliation(s)
- Jennifer Loria
- Instituto de Matemática Pura e Aplicada, Rio de Janeiro, Brazil
- School of Mathematics, Universidad de Costa Rica, San José, Costa Rica
| | - Vinicius V L Albani
- LAMMCA, Department of Mathematics, Federal University of Santa Catarina, Florianopolis, Brazil
| | | | | | | | | | - Eduardo Massad
- School of Applied Mathematics, Fundação Getúlio Vargas, Rio de Janeiro, Brazil
- School of Medicine, University of São Paulo and LIM01-HCFMUSP, São Paulo, Brazil
| |
Collapse
|
3
|
Madewell ZJ, Dean NE, Berlin JA, Coplan PM, Davis KJ, Struchiner CJ, Halloran ME. Challenges of evaluating and modelling vaccination in emerging infectious diseases. Epidemics 2021; 37:100506. [PMID: 34628108 PMCID: PMC8491997 DOI: 10.1016/j.epidem.2021.100506] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2021] [Revised: 08/25/2021] [Accepted: 10/04/2021] [Indexed: 12/17/2022] Open
Abstract
Outbreaks of emerging pathogens pose unique methodological and practical challenges for the design, implementation, and evaluation of vaccine efficacy trials. Lessons learned from COVID-19 highlight the need for innovative and flexible study design and application to quickly identify promising candidate vaccines. Trial design strategies should be tailored to the dynamics of the specific pathogen, location of the outbreak, and vaccine prototypes, within the regional socioeconomic constraints. Mathematical and statistical models can assist investigators in designing infectious disease clinical trials. We introduce key challenges for planning, evaluating, and modelling vaccine efficacy trials for emerging pathogens.
Collapse
Affiliation(s)
- Zachary J Madewell
- Department of Biostatistics, University of Florida, Gainesville, FL, USA.
| | - Natalie E Dean
- Department of Biostatistics, University of Florida, Gainesville, FL, USA
| | - Jesse A Berlin
- Global Epidemiology, Johnson & Johnson, Titusville, NJ, USA
| | - Paul M Coplan
- Medical Device Epidemiology and Real World Data Sciences, Johnson & Johnson, New Brunswick, NJ, USA; Department of Epidemiology and Biostatistics, Perelman School of Medicine, University of Pennsylvania, PA, USA
| | | | | | - M Elizabeth Halloran
- Fred Hutchinson Cancer Research Center, Seattle, WA, USA; Department of Biostatistics, University of Washington, Seattle, WA, USA
| |
Collapse
|
4
|
Halloran ME, Auranen K, Baird S, Basta NE, Bellan SE, Brookmeyer R, Cooper BS, DeGruttola V, Hughes JP, Lessler J, Lofgren ET, Longini IM, Onnela JP, Özler B, Seage GR, Smith TA, Vespignani A, Vynnycky E, Lipsitch M. Simulations for designing and interpreting intervention trials in infectious diseases. BMC Med 2017; 15:223. [PMID: 29287587 PMCID: PMC5747936 DOI: 10.1186/s12916-017-0985-3] [Citation(s) in RCA: 50] [Impact Index Per Article: 7.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/10/2017] [Accepted: 12/05/2017] [Indexed: 11/16/2022] Open
Abstract
BACKGROUND Interventions in infectious diseases can have both direct effects on individuals who receive the intervention as well as indirect effects in the population. In addition, intervention combinations can have complex interactions at the population level, which are often difficult to adequately assess with standard study designs and analytical methods. DISCUSSION Herein, we urge the adoption of a new paradigm for the design and interpretation of intervention trials in infectious diseases, particularly with regard to emerging infectious diseases, one that more accurately reflects the dynamics of the transmission process. In an increasingly complex world, simulations can explicitly represent transmission dynamics, which are critical for proper trial design and interpretation. Certain ethical aspects of a trial can also be quantified using simulations. Further, after a trial has been conducted, simulations can be used to explore the possible explanations for the observed effects. CONCLUSION Much is to be gained through a multidisciplinary approach that builds collaborations among experts in infectious disease dynamics, epidemiology, statistical science, economics, simulation methods, and the conduct of clinical trials.
Collapse
Affiliation(s)
- M Elizabeth Halloran
- Vaccine and Infectious Disease Division, Fred Hutchinson Research Center, 1100 Fairview Ave N, Seattle, WA, 98109, USA.
- Department of Biostatistics, School of Public Health, University of Washington, Seattle, WA, USA.
| | - Kari Auranen
- Department of Mathematics and Statistics, University of Turku, Turku, Finland
| | - Sarah Baird
- Department of Global Health, Milken Institute School of Public Health, The George Washington University, Washington DC, USA
| | - Nicole E Basta
- Division of Epidemiology and Community Health, School of Public Health, University of Minnesota, Minneapolis, MN, USA
| | - Steven E Bellan
- Department of Epidemiology and Biostatistics, College of Public Health, University of Georgia, Athens, GA, USA
| | - Ron Brookmeyer
- Department of Biostatistics, The Fielding School of Public Health, UCLA, Los Angeles, CA, USA
| | - Ben S Cooper
- Mahidol Oxford Tropical Medicine Research Unit, Bangkok, Thailand
| | - Victor DeGruttola
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | - James P Hughes
- Department of Biostatistics, School of Public Health, University of Washington, Seattle, WA, USA
| | - Justin Lessler
- Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA
| | - Eric T Lofgren
- Paul G. Allen School for Global Animal Health, Washington State University, Pullman, WA, USA
| | - Ira M Longini
- Department of Biostatistics, University of Florida, Gainesville, FL, USA
| | - Jukka-Pekka Onnela
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | - Berk Özler
- Development Research Group, The World Bank, Washington DC, USA
| | - George R Seage
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | - Thomas A Smith
- Department of Epidemiology and Public Health, Swiss Tropical & Public Health Institute, Basel, Switzerland
- University of Basel, Basel, Switzerland
| | | | - Emilia Vynnycky
- Modelling and Economics Unit, Public Health England, Colindale, UK
- TB Modelling Group, Centre for Mathematical Modelling of Infectious Diseases, TB Centre and Faculty of Epidemiology and Population Health, London School of Hygiene and Tropical Medicine, London, UK
| | - Marc Lipsitch
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, MA, USA
| |
Collapse
|
5
|
Auranen K, Rinta-Kokko H, Halloran ME. Estimating strain-specific and overall efficacy of polyvalent vaccines against recurrent pathogens from a cross-sectional study. Biometrics 2013; 69:235-44. [PMID: 23379663 PMCID: PMC3622115 DOI: 10.1111/j.1541-0420.2012.01826.x] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022]
Abstract
Evaluating vaccine efficacy for protection against colonization with bacterial pathogens is an area of growing interest. Colonization of the nasopharynx is an asymptomatic carrier state responsible for person-to-person transmission. It differs from most clinical outcomes in that it is common, recurrent, and observed only in its prevalent state. To estimate rates of acquisition and clearance of colonization requires repeated active sampling of the same individuals over time, an expensive and invasive undertaking. Motivated by feasibility constraints in efficacy trials with colonization endpoints, investigators have been estimating vaccine efficacy from cross-sectional studies without principled methods. We present two examples of vaccine studies estimating vaccine efficacy from cross-sectional data on nasopharyngeal colonization by Streptococcus pneumoniae (pneumococcus). This study presents a framework for defining and estimating strain-specific and overall vaccine efficacy for susceptibility to acquisition of colonization (VE(acq)) when there is a large number of strains with mutual interactions and recurrent dynamics of colonization. We develop estimators based on one observation of the current status per study subject, evaluate their robustness, and re-analyze the two vaccine trials. Methodologically, the proposed estimators are closely related to case-control studies with prevalent cases, with appropriate consideration of the at-risk time in choosing the controls.
Collapse
Affiliation(s)
- Kari Auranen
- Department of Vaccination and Immune Protection, National Institute for Health and Welfare, Finland.
| | | | | |
Collapse
|
6
|
Valim C, Mezzetti M, Maguire J, Urdaneta M, Wypij D. Estimation of vaccine efficacy in a repeated measures study under heterogeneity of exposure or susceptibility to infection. PHILOSOPHICAL TRANSACTIONS. SERIES A, MATHEMATICAL, PHYSICAL, AND ENGINEERING SCIENCES 2008; 366:2347-2360. [PMID: 18407892 PMCID: PMC3227149 DOI: 10.1098/rsta.2008.0044] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 05/26/2023]
Abstract
Vaccine efficacy (VE) is commonly estimated through proportional hazards modelling of the time to first infection or disease, even when the event of interest can recur. These methods can result in biased estimates when VE is heterogeneous across levels of exposure and susceptibility in subjects. These two factors are important sources of unmeasured heterogeneity, since they vary within and across areas, and often cannot be individually quantified. We propose an estimator of VE per exposure that accounts for heterogeneous susceptibility and exposure for a repeated measures study with binary recurrent outcomes. The estimator requires only information about the probability distribution of environmental exposures. Through simulation studies, we compare the properties of this estimator with proportional hazards estimation under the heterogeneity of exposure. The methods are applied to a reanalysis of a malaria vaccine trial in Brazil.
Collapse
Affiliation(s)
- Clarissa Valim
- Clinical Research Program, Children's Hospital Boston, 300 Longwood Ave. Boston, MA 02115, USA.
| | | | | | | | | |
Collapse
|
7
|
Levy MZ, Kawai V, Bowman NM, Waller LA, Cabrera L, Pinedo-Cancino VV, Seitz AE, Steurer FJ, Cornejo del Carpio JG, Cordova-Benzaquen E, Maguire JH, Gilman RH, Bern C. Targeted screening strategies to detect Trypanosoma cruzi infection in children. PLoS Negl Trop Dis 2007; 1:e103. [PMID: 18160979 PMCID: PMC2154390 DOI: 10.1371/journal.pntd.0000103] [Citation(s) in RCA: 29] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2007] [Accepted: 09/12/2007] [Indexed: 11/27/2022] Open
Abstract
BACKGROUND Millions of people are infected with Trypanosoma cruzi, the causative agent of Chagas disease in Latin America. Anti-trypanosomal drug therapy can cure infected individuals, but treatment efficacy is highest early in infection. Vector control campaigns disrupt transmission of T. cruzi, but without timely diagnosis, children infected prior to vector control often miss the window of opportunity for effective chemotherapy. METHODS AND FINDINGS We performed a serological survey in children 2-18 years old living in a peri-urban community of Arequipa, Peru, and linked the results to entomologic, spatial and census data gathered during a vector control campaign. 23 of 433 (5.3% [95% CI 3.4-7.9]) children were confirmed seropositive for T. cruzi infection by two methods. Spatial analysis revealed that households with infected children were very tightly clustered within looser clusters of households with parasite-infected vectors. Bayesian hierarchical mixed models, which controlled for clustering of infection, showed that a child's risk of being seropositive increased by 20% per year of age and 4% per vector captured within the child's house. Receiver operator characteristic (ROC) plots of best-fit models suggest that more than 83% of infected children could be identified while testing only 22% of eligible children. CONCLUSIONS We found evidence of spatially-focal vector-borne T. cruzi transmission in peri-urban Arequipa. Ongoing vector control campaigns, in addition to preventing further parasite transmission, facilitate the collection of data essential to identifying children at high risk of T. cruzi infection. Targeted screening strategies could make integration of diagnosis and treatment of children into Chagas disease control programs feasible in lower-resource settings.
Collapse
Affiliation(s)
- Michael Z Levy
- Division of Parasitic Diseases, Centers for Disease Control and Prevention, Atlanta, Georgia, USA.
| | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
8
|
Struchiner CJ, Halloran ME. Randomization and baseline transmission in vaccine field trials. Epidemiol Infect 2007; 135:181-94. [PMID: 17291359 PMCID: PMC2870563 DOI: 10.1017/s0950268806006716] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/08/2006] [Indexed: 11/07/2022] Open
Abstract
In randomized trials, the treatment assignment mechanism is independent of the outcome of interest and other covariates thought to be relevant in determining this outcome. It also allows, on average, for a balanced distribution of these covariates in the vaccine and placebo groups. Randomization, however, does not guarantee that the estimated effect is an unbiased estimate of the biological effect of interest. We show how exposure to infection can be a confounder even in randomized vaccine field trials. Based on a simple model of the biological efficacy of interest, we extend the arguments on comparability and collapsibility to examine the limits of randomization to control for unmeasured covariates. Estimates from randomized, placebo-controlled Phase III vaccine field trials that differ in baseline transmission are not comparable unless explicit control for baseline transmission is taken into account.
Collapse
Affiliation(s)
- C J Struchiner
- IMS/UERJ and Escola Nacional de Saúde Pública, Fundação Oswaldo Cruz, Rio de Janeiro, Brazil.
| | | |
Collapse
|
9
|
Abstract
Vaccination produces many different types of effects in individuals and in populations. The scientific and public health questions of interest determine the choice of measures of effect and study designs. Here we review some of the various measures and study designs for evaluating different effects of vaccination.
Collapse
Affiliation(s)
- M E Halloran
- Program in Biostatistics and Biomathematics, Public Health Sciences, Fred Hutchinson Cancer Research Center, Department of Biostatistics, University of Washington, Seattle, USA.
| |
Collapse
|
10
|
Urdaneta M, Prata A, Struchiner CJ, Tosta CE, Tauil P, Boulos M. SPf66 vaccine trial in Brazil: conceptual framework study design and analytical approach. Rev Soc Bras Med Trop 1996; 29:259-69. [PMID: 8701046 DOI: 10.1590/s0037-86821996000300007] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/01/2023] Open
Abstract
This paper describes the study population and the study design of the phase III field trail of the SPf66 vaccine in Brazil. Assessment of validity and precision principles necessary for the appropriate evaluation of the protective effect of the vaccine are discussed, as well as the results of the preliminary analyses of the gathered data. The analytical approach for the estimation of the protective effect of the vaccine is presented. This paper provides the conceptual framework for future publications.
Collapse
Affiliation(s)
- M Urdaneta
- Escola Nacional de Saúde Pública, Fundação Oswaldo Cruz, Faculdade de Medicina do Triângulo Mineiro, Uberaba, Minas Gerais
| | | | | | | | | | | |
Collapse
|