126
|
Magaret CA, Benkeser DC, Williamson BD, Borate BR, Carpp LN, Georgiev IS, Setliff I, Dingens AS, Simon N, Carone M, Simpkins C, Montefiori D, Alter G, Yu WH, Juraska M, Edlefsen PT, Karuna S, Mgodi NM, Edugupanti S, Gilbert PB. Prediction of VRC01 neutralization sensitivity by HIV-1 gp160 sequence features. PLoS Comput Biol 2019; 15:e1006952. [PMID: 30933973 PMCID: PMC6459550 DOI: 10.1371/journal.pcbi.1006952] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2018] [Revised: 04/11/2019] [Accepted: 03/14/2019] [Indexed: 11/29/2022] Open
Abstract
The broadly neutralizing antibody (bnAb) VRC01 is being evaluated for its efficacy to prevent HIV-1 infection in the Antibody Mediated Prevention (AMP) trials. A secondary objective of AMP utilizes sieve analysis to investigate how VRC01 prevention efficacy (PE) varies with HIV-1 envelope (Env) amino acid (AA) sequence features. An exhaustive analysis that tests how PE depends on every AA feature with sufficient variation would have low statistical power. To design an adequately powered primary sieve analysis for AMP, we modeled VRC01 neutralization as a function of Env AA sequence features of 611 HIV-1 gp160 pseudoviruses from the CATNAP database, with objectives: (1) to develop models that best predict the neutralization readouts; and (2) to rank AA features by their predictive importance with classification and regression methods. The dataset was split in half, and machine learning algorithms were applied to each half, each analyzed separately using cross-validation and hold-out validation. We selected Super Learner, a nonparametric ensemble-based cross-validated learning method, for advancement to the primary sieve analysis. This method predicted the dichotomous resistance outcome of whether the IC50 neutralization titer of VRC01 for a given Env pseudovirus is right-censored (indicating resistance) with an average validated AUC of 0.868 across the two hold-out datasets. Quantitative log IC50 was predicted with an average validated R2 of 0.355. Features predicting neutralization sensitivity or resistance included 26 surface-accessible residues in the VRC01 and CD4 binding footprints, the length of gp120, the length of Env, the number of cysteines in gp120, the number of cysteines in Env, and 4 potential N-linked glycosylation sites; the top features will be advanced to the primary sieve analysis. This modeling framework may also inform the study of VRC01 in the treatment of HIV-infected persons.
Collapse
|
127
|
Duke ER, Williamson BD, Stevens-Ayers TL, Cossrow N, Marks MA, Wan H, Mast TC, Huang MLW, Gilbert PB, Schiffer JT, Boeckh MJ. Determination of Optimal Viral Kinetic Markers for Predicting Antiviral Treatment Effect for the Prevention of Cytomegalovirus (CMV) Disease after Hematopoietic Cell Transplant (HCT) Using Machine Learning and a Novel Non-Parametric Estimation Method. Biol Blood Marrow Transplant 2019. [DOI: 10.1016/j.bbmt.2018.12.559] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
128
|
Fourati S, Ribeiro SP, Blasco Tavares Pereira Lopes F, Talla A, Lefebvre F, Cameron M, Kaewkungwal J, Pitisuttithum P, Nitayaphan S, Rerks-Ngarm S, Kim JH, Thomas R, Gilbert PB, Tomaras GD, Koup RA, Michael NL, McElrath MJ, Gottardo R, Sékaly RP. Integrated systems approach defines the antiviral pathways conferring protection by the RV144 HIV vaccine. Nat Commun 2019; 10:863. [PMID: 30787294 PMCID: PMC6382801 DOI: 10.1038/s41467-019-08854-2] [Citation(s) in RCA: 23] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2018] [Accepted: 01/25/2019] [Indexed: 12/31/2022] Open
Abstract
The RV144 vaccine trial showed reduced risk of HIV-1 acquisition by 31.2%, although mechanisms that led to protection remain poorly understood. Here we identify transcriptional correlates for reduced HIV-1 acquisition after vaccination. We assess the transcriptomic profile of blood collected from 223 participants and 40 placebo recipients. Pathway-level analysis of HIV-1 negative vaccinees reveals that type I interferons that activate the IRF7 antiviral program and type II interferon-stimulated genes implicated in antigen-presentation are both associated with a reduced risk of HIV-1 acquisition. In contrast, genes upstream and downstream of NF-κB, mTORC1 and host genes required for viral infection are associated with an increased risk of HIV-1 acquisition among vaccinees and placebo recipients, defining a vaccine independent association with HIV-1 acquisition. Our transcriptomic analysis of RV144 trial samples identifies IRF7 as a mediator of protection and the activation of mTORC1 as a correlate of the risk of HIV-1 acquisition. The RV144 vaccine trial showed reduced risk of HIV-1 acquisition, but mechanisms underlying protection are poorly understood. Here, Fourati et al. assess the transcriptomic profile of blood collected from 223 vaccinees and 40 placebo recipients and identify IRF7 as a mediator of protection.
Collapse
|
129
|
Westling T, Juraska M, Seaton KE, Tomaras GD, Gilbert PB, Janes H. Methods for comparing durability of immune responses between vaccine regimens in early-phase trials. Stat Methods Med Res 2019; 29:78-93. [PMID: 30623732 DOI: 10.1177/0962280218820881] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
The ability to produce a long-lasting, or durable, immune response is a crucial characteristic of many highly effective vaccines. A goal of early-phase vaccine trials is often to compare the immune response durability of multiple tested vaccine regimens. One parameter for measuring immune response durability is the area under the mean post-peak log immune response profile. In this paper, we compare immune response durability across vaccine regimens within and between two phase I trials of DNA-primed HIV vaccine regimens, HVTN 094 and HVTN 096. We compare four estimators of this durability parameter and the resulting statistical inferences for comparing vaccine regimens. Two of these estimators use the trapezoid rule as an empirical approximation of the area under the marginal log response curve, and the other two estimators are based on linear and nonlinear models for the marginal mean log response. We conduct a simulation study to compare the four estimators, provide guidance on estimator selection, and use the nonlinear marginal mean model to analyze immunogenicity data from the two HIV vaccine trials.
Collapse
|
130
|
Gilbert PB. Ongoing Vaccine and Monoclonal Antibody HIV Prevention Efficacy Trials and Considerations for Sequel Efficacy Trial Designs. ACTA ACUST UNITED AC 2019; 11. [PMID: 33312415 DOI: 10.1515/scid-2019-0003] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023]
Abstract
Four randomized placebo-controlled efficacy trials of a candidate vaccine or passively infused monoclonal antibody for prevention of HIV-1 infection are underway (HVTN 702 in South African men and women; HVTN 705 in sub-Saharan African women; HVTN 703/HPTN 081 in sub-Saharan African women; HVTN 704/HPTN 085 in U.S., Peruvian, Brazilian, and Swiss men or transgender persons who have sex with men). Several challenges are posed to the optimal design of the sequel efficacy trials, including: (1) how to account for the evolving mosaic of effective prevention interventions that may be part of the trial design or standard of prevention; (2) how to define viable and optimal sequel trial designs depending on the primary efficacy results and secondary "correlates of protection" results of each of the ongoing trials; and (3) how to define the primary objective of sequel efficacy trials if HIV-1 incidence is expected to be very low in all study arms such that a standard trial design has a steep opportunity cost. After summarizing the ongoing trials, I discuss statistical science considerations for sequel efficacy trial designs, both generally and specifically to each trial listed above. One conclusion is that the results of "correlates of protection" analyses, which ascertain how different host immunological markers and HIV-1 viral features impact HIV-1 risk and prevention efficacy, have an important influence on sequel trial design. This influence is especially relevant for the monoclonal antibody trials because of the focused pre-trial hypothesis that potency and coverage of serum neutralization constitutes a surrogate endpoint for HIV-1 infection. Another conclusion is that while assessing prevention efficacy against a counterfactual placebo group is fraught with risks for bias, such analysis is nonetheless important and study designs coupled with analysis methods should be developed to optimize such inferences. I draw a parallel with non-inferiority designs, which are fraught with risks given the necessity of making unverifiable assumptions for interpreting results, but nevertheless have been accepted when a superiority design is not possible and a rigorous/conservative non-inferiority margin is used. In a similar way, counterfactual placebo group efficacy analysis should use rigorous/conservative inference techniques that formally build in a rigorous/conservative margin to potential biases that could occur due to departures from unverifiable assumptions. Because reliability of this approach would require new techniques for verifying that the study cohort experienced substantial exposure to HIV-1, currently it may be appropriate as a secondary objective but not as a primary objective.
Collapse
|
131
|
Pasin C, Halloran ME, Gilbert PB, Langevin E, Ochiai RL, Pitisuttithum P, Capeding MR, Carrasquilla G, Frago C, Cortés M, Chambonneau L, Moodie Z. Periods of high dengue transmission defined by rainfall do not impact efficacy of dengue vaccine in regions of endemic disease. PLoS One 2018; 13:e0207878. [PMID: 30543657 PMCID: PMC6292612 DOI: 10.1371/journal.pone.0207878] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2018] [Accepted: 11/07/2018] [Indexed: 11/22/2022] Open
Abstract
OBJECTIVE To evaluate the association of rainy season with overall dengue disease incidence and with the efficacy of the Sanofi Pasteur recombinant, live, attenuated, tetravalent vaccine (CYD-TDV) in two randomized, controlled multicenter phase III clinical trials in Asia and Latin America. METHODS Rainy seasons were defined for each study site using climatological information from the World Meteorological Organization. The dengue attack rate in the placebo group for each study month was calculated as the number of symptomatic, virologically-confirmed dengue events in a given month divided by the number of participants at risk in the same month. Time-dependent Cox proportional hazard models were used to test whether rainy season was associated with dengue disease and whether it modified vaccine efficacy in each of the two trials and in both of the trials combined. FINDINGS Rainy season, country, and age were all significantly associated with dengue disease in both studies. Vaccine efficacy did not change during the rainy season in any of the analyses. CONCLUSIONS Although dengue transmission and exposure are expected to increase during the rainy season, our results indicate that CYD-TDV vaccine efficacy remains constant throughout the year in endemic regions.
Collapse
|
132
|
Price BL, Gilbert PB, van der Laan MJ. Estimation of the optimal surrogate based on a randomized trial. Biometrics 2018; 74:1271-1281. [PMID: 29701875 PMCID: PMC6393111 DOI: 10.1111/biom.12879] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2016] [Revised: 12/01/2017] [Accepted: 02/01/2018] [Indexed: 11/27/2022]
Abstract
A common scientific problem is to determine a surrogate outcome for a long-term outcome so that future randomized studies can restrict themselves to only collecting the surrogate outcome. We consider the setting that we observe n independent and identically distributed observations of a random variable consisting of baseline covariates, a treatment, a vector of candidate surrogate outcomes at an intermediate time point, and the final outcome of interest at a final time point. We assume the treatment is randomized, conditional on the baseline covariates. The goal is to use these data to learn a most-promising surrogate for use in future trials for inference about a mean contrast treatment effect on the final outcome. We define an optimal surrogate for the current study as the function of the data generating distribution collected by the intermediate time point that satisfies the Prentice definition of a valid surrogate endpoint and that optimally predicts the final outcome: this optimal surrogate is an unknown parameter. We show that this optimal surrogate is a conditional mean and present super-learner and targeted super-learner based estimators, whose predicted outcomes are used as the surrogate in applications. We demonstrate a number of desirable properties of this optimal surrogate and its estimators, and study the methodology in simulations and an application to dengue vaccine efficacy trials.
Collapse
|
133
|
Janes H, Corey L, Ramjee G, Carpp LN, Lombard C, Cohen MS, Gilbert PB, Gray GE. Weighing the Evidence of Efficacy of Oral PrEP for HIV Prevention in Women in Southern Africa. AIDS Res Hum Retroviruses 2018; 34:645-656. [PMID: 29732896 PMCID: PMC6080090 DOI: 10.1089/aid.2018.0031] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2023] Open
Abstract
As oral tenofovir-based regimens for preexposure prophylaxis (PrEP) are adopted as standard of care for HIV prevention, their utilization in clinical trials among women in southern Africa will require an accurate estimate of oral PrEP efficacy in this population. This information is critical for women in choosing this prevention strategy, and in public health policy making. Estimates of the efficacy of oral PrEP regimens containing tenofovir have varied widely across trials that enrolled women, with some studies reporting high efficacy and others reporting no efficacy. Although poor adherence is strongly associated with lack of efficacy, other factors, such as mode of transmission (sexual vs. parenteral), predominant HIV subtype (C vs. non-C), intensity of exposure, and percentage of stable serodiscordant couples, may also contribute to the variation in efficacy estimates. In this article, we evaluate the evidence for PrEP efficacy in women and propose potential explanations for the observed differences in efficacy among studies. Our review emphasizes the need to continue to refine estimates of efficacy and effectiveness of tenofovir-based oral PrEP so as to best develop the next generation of HIV prevention tools, and to inform public policies directed toward HIV prevention.
Collapse
|
134
|
Sridhar S, Luedtke A, Langevin E, Zhu M, Bonaparte M, Machabert T, Savarino S, Zambrano B, Moureau A, Khromava A, Moodie Z, Westling T, Mascareñas C, Frago C, Cortés M, Chansinghakul D, Noriega F, Bouckenooghe A, Chen J, Ng SP, Gilbert PB, Gurunathan S, DiazGranados CA. Effect of Dengue Serostatus on Dengue Vaccine Safety and Efficacy. N Engl J Med 2018; 379:327-340. [PMID: 29897841 DOI: 10.1056/nejmoa1800820] [Citation(s) in RCA: 485] [Impact Index Per Article: 80.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Abstract
BACKGROUND In efficacy trials of a tetravalent dengue vaccine (CYD-TDV), excess hospitalizations for dengue were observed among vaccine recipients 2 to 5 years of age. Precise risk estimates according to observed dengue serostatus could not be ascertained because of the limited numbers of samples collected at baseline. We developed a dengue anti-nonstructural protein 1 (NS1) IgG enzyme-linked immunosorbent assay and used samples from month 13 to infer serostatus for a post hoc analysis of safety and efficacy. METHODS In a case-cohort study, we reanalyzed data from three efficacy trials. For the principal analyses, we used baseline serostatus determined on the basis of measured (when baseline values were available) or imputed (when baseline values were missing) titers from a 50% plaque-reduction neutralization test (PRNT50), with imputation conducted with the use of covariates that included the month 13 anti-NS1 assay results. The risk of hospitalization for virologically confirmed dengue (VCD), of severe VCD, and of symptomatic VCD according to dengue serostatus was estimated by weighted Cox regression and targeted minimum loss-based estimation. RESULTS Among dengue-seronegative participants 2 to 16 years of age, the cumulative 5-year incidence of hospitalization for VCD was 3.06% among vaccine recipients and 1.87% among controls, with a hazard ratio (vaccine vs. control) through data cutoff of 1.75 (95% confidence interval [CI], 1.14 to 2.70). Among dengue-seronegative participants 9 to 16 years of age, the cumulative incidence of hospitalization for VCD was 1.57% among vaccine recipients and 1.09% among controls, with a hazard ratio of 1.41 (95% CI, 0.74 to 2.68). Similar trends toward a higher risk among seronegative vaccine recipients than among seronegative controls were also found for severe VCD. Among dengue-seropositive participants 2 to 16 years of age and those 9 to 16 years of age, the cumulative incidence of hospitalization for VCD was 0.75% and 0.38%, respectively, among vaccine recipients and 2.47% and 1.88% among controls, with hazard ratios of 0.32 (95% CI, 0.23 to 0.45) and 0.21 (95% CI, 0.14 to 0.31). The risk of severe VCD was also lower among seropositive vaccine recipients than among seropositive controls. CONCLUSIONS CYD-TDV protected against severe VCD and hospitalization for VCD for 5 years in persons who had exposure to dengue before vaccination, and there was evidence of a higher risk of these outcomes in vaccinated persons who had not been exposed to dengue. (Funded by Sanofi Pasteur; ClinicalTrials.gov numbers, NCT00842530 , NCT01983553 , NCT01373281 , and NCT01374516 .).
Collapse
|
135
|
Bekker LG, Moodie Z, Grunenberg N, Laher F, Tomaras GD, Cohen KW, Allen M, Malahleha M, Mngadi K, Daniels B, Innes C, Bentley C, Frahm N, Morris DE, Morris L, Mkhize NN, Montefiori DC, Sarzotti-Kelsoe M, Grant S, Yu C, Mehra VL, Pensiero MN, Phogat S, DiazGranados CA, Barnett SW, Kanesa-Thasan N, Koutsoukos M, Michael NL, Robb ML, Kublin JG, Gilbert PB, Corey L, Gray GE, McElrath MJ. Subtype C ALVAC-HIV and bivalent subtype C gp120/MF59 HIV-1 vaccine in low-risk, HIV-uninfected, South African adults: a phase 1/2 trial. Lancet HIV 2018; 5:e366-e378. [PMID: 29898870 PMCID: PMC6028742 DOI: 10.1016/s2352-3018(18)30071-7] [Citation(s) in RCA: 71] [Impact Index Per Article: 11.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2017] [Revised: 04/03/2018] [Accepted: 04/14/2018] [Indexed: 12/15/2022]
Abstract
BACKGROUND Modest efficacy was reported for the HIV vaccine tested in the RV144 trial, which comprised a canarypox vector (ALVAC) and envelope (env) glycoprotein (gp120). These vaccine components were adapted to express HIV-1 antigens from strains circulating in South Africa, and the adjuvant was changed to increase immunogenicity. Furthermore, 12-month immunisation was added to improve durability. In the HIV Vaccine Trials Network (HVTN) 100 trial, we aimed to assess this new regionally adapted regimen for advancement to efficacy testing. METHODS HVTN 100 is a phase 1/2, randomised controlled, double-blind trial at six community research sites in South Africa. We randomly allocated adults (aged 18-40 years) without HIV infection and at low risk of HIV infection to either the vaccine regimen (intramuscular injection of ALVAC-HIV vector [vCP2438] at 0, 1, 3, 6, and 12 months plus bivalent subtype C gp120 and MF59 adjuvant at 3, 6, and 12 months) or placebo, in a 5:1 ratio. Randomisation was done by computer-generated list. Participants, investigators, and those assessing outcomes were masked to random assignments. Primary outcomes included safety and immune responses associated with correlates of HIV risk in RV144, 2 weeks after vaccination at 6 months (month 6·5). We compared per-protocol participants (ie, those who completed the first four vaccinations and provided samples at month 6·5) from HVTN 100 with stored RV144 samples assayed contemporaneously. This trial is registered with the South African National Clinical Trials Registry (DOH-27-0215-4796) and ClinicalTrials.gov (NCT02404311). FINDINGS Between Feb 9, 2015, and May 26, 2015, 252 participants were enrolled, of whom 210 were assigned vaccine and 42 placebo. 222 participants were included in the per-protocol analysis (185 vaccine and 37 placebo). 185 (100%) vaccine recipients developed IgG binding antibodies to all three vaccine-matched gp120 antigens with significantly higher titres (3·6-8·8 fold; all p<0·0001) than the corresponding vaccine-matched responses of RV144. The CD4+ T-cell response to the ZM96.C env protein in HVTN 100 was 56·4% (n=102 responders), compared with a response of 41·4% (n=79 responders) to 92TH023.AE in RV144 (p=0·0050). The IgG response to the 1086.C variable loops 1 and 2 (V1V2) env antigen in HVTN 100 was 70·5% (95% CI 63·5-76·6; n=129 responders), lower than the response to V1V2 in RV144 (99·0%, 95% CI 96·4-99·7; n=199 responders). INTERPRETATION Although the IgG response to the HVTN 100 vaccine was lower than that reported in RV144, it exceeded the predicted 63% threshold needed for 50% vaccine efficacy using a V1V2 correlate of protection model. Thus, the subtype C HIV vaccine regimen qualified for phase 2b/3 efficacy testing, a critical next step of vaccine development. FUNDING US National Institute of Allergy and Infectious Diseases (NIAID), and Bill & Melinda Gates Foundation.
Collapse
|
136
|
Lee U, Sun Y, Scheike TH, Gilbert PB. Analysis of Generalized Semiparametric Regression Models for Cumulative Incidence Functions with Missing Covariates. Comput Stat Data Anal 2018; 122:59-79. [PMID: 29892140 DOI: 10.1016/j.csda.2018.01.003] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Abstract
The cumulative incidence function quantifies the probability of failure over time due to a specific cause for competing risks data. The generalized semiparametric regression models for the cumulative incidence functions with missing covariates are investigated. The effects of some covariates are modeled as non-parametric functions of time while others are modeled as parametric functions of time. Different link functions can be selected to add flexibility in modeling the cumulative incidence functions. The estimation procedures based on the direct binomial regression and the inverse probability weighting of complete cases are developed. This approach modifies the full data weighted least squares equations by weighting the contributions of observed members through the inverses of estimated sampling probabilities which depend on the censoring status and the event types among other subject characteristics. The asymptotic properties of the proposed estimators are established. The finite-sample performances of the proposed estimators and their relative efficiencies under different two-phase sampling designs are examined in simulations. The methods are applied to analyze data from the RV144 vaccine efficacy trial to investigate the associations of immune response biomarkers with the cumulative incidence of HIV-1 infection.
Collapse
|
137
|
Huang Y, Karuna S, Carpp LN, Reeves D, Pegu A, Seaton K, Mayer K, Schiffer J, Mascola J, Gilbert PB. Modeling cumulative overall prevention efficacy for the VRC01 phase 2b efficacy trials. Hum Vaccin Immunother 2018; 14:2116-2127. [PMID: 29683765 PMCID: PMC6183277 DOI: 10.1080/21645515.2018.1462640] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023] Open
Abstract
The Antibody Mediated Prevention trials are assessing whether intravenously-administered VRC01 (10 mg/kg or 30 mg/kg vs placebo) can prevent HIV infection. In a modeling exercise, we used two models to predict the overall prevention efficacy (PE) of each VRC01 dose in preventing HIV infection. For the first per-exposure PE model, parameters were estimated from studies where nonhuman primates (NHPs) were administered high-dose intra-rectal simian-human immunodeficiency virus challenge two days post-VRC01 infusion at various dosages ("NHP model"). To account for the fact that humans may require greater VRC01 concentration to achieve the same level of protection, we next assumed that a 5-fold greater VRC01 serum concentration would be needed to provide the same level of per-exposure PE as seen in the NHP data ("5-fold model"). For the 10 mg/kg regimen, the 5-fold and NHP models predict an overall PE of 37% and 64%, respectively; for the 30 mg/kg regimen, the two models predict an overall PE of 53% and 82%, respectively. Our results support that VRC01 may plausibly confer positive PE in the AMP trials. Given the lack of available knowledge and data to verify the assumptions undergirding our modeling framework, its quantitative predictions of overall PE are preliminary. Its current main applications are to supplement decisions to advance mAb regimens to efficacy trials, and to enable mAb regimen ranking by their potential for PE in humans.
Collapse
|
138
|
de Montigny S, Adamson BJS, Mâsse BR, Garrison LP, Kublin JG, Gilbert PB, Dimitrov DT. Projected effectiveness and added value of HIV vaccination campaigns in South Africa: A modeling study. Sci Rep 2018; 8:6066. [PMID: 29666455 PMCID: PMC5904131 DOI: 10.1038/s41598-018-24268-4] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2017] [Accepted: 03/26/2018] [Indexed: 01/14/2023] Open
Abstract
Promising multi-dose HIV vaccine regimens are being tested in trials in South Africa. We estimated the potential epidemiological and economic impact of HIV vaccine campaigns compared to continuous vaccination, assuming that vaccine efficacy is transient and dependent on immune response. We used a dynamic economic mathematical model of HIV transmission calibrated to 2012 epidemiological data to simulate vaccination with anticipated antiretroviral treatment scale-up in South Africa. We estimate that biennial vaccination with a 70% efficacious vaccine reaching 20% of the sexually active population could prevent 480,000-650,000 HIV infections (13.8-15.3% of all infections) over 10 years. Assuming a launch price of $15 per dose, vaccination was found to be cost-effective, with an incremental cost-effectiveness ratio of $13,746 per quality-adjusted life-year as compared to no vaccination. Increasing vaccination coverage to 50% will prevent more infections but is less likely to achieve cost-effectiveness. Campaign vaccination is consistently more effective and costs less than continuous vaccination across scenarios. Results suggest that a partially effective HIV vaccine will have substantial impact on the HIV epidemic in South Africa and offer good value if priced less than $105 for a five-dose series. Vaccination campaigns every two years may offer greater value for money than continuous vaccination reaching the same coverage level.
Collapse
|
139
|
Fiore-Gartland A, Kullman N, deCamp AC, Clenaghan G, Yang W, Magaret CA, Edlefsen PT, Gilbert PB. SieveSifter: a web-based tool for visualizing the sieve analyses of HIV-1 vaccine efficacy trials. Bioinformatics 2018; 33:2386-2388. [PMID: 28379332 PMCID: PMC5860116 DOI: 10.1093/bioinformatics/btx168] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2016] [Accepted: 03/21/2017] [Indexed: 11/13/2022] Open
Abstract
Summary Analysis of HIV-1 virions from participants infected in a randomized controlled preventive HIV-1 vaccine efficacy trial can help elucidate mechanisms of partial protection. By comparing the genetic sequence of viruses from vaccine and placebo recipients to the sequence of the vaccine itself, a technique called 'sieve analysis', one can identify functional specificities of vaccine-induced immune responses. We have created an interactive web-based visualization and data access tool for exploring the results of sieve analyses performed on four major preventive HIV-1 vaccine efficacy trials: (i) the HIV Vaccine Trial Network (HVTN) 502/Step trial, (ii) the RV144/Thai trial, (iii) the HVTN 503/Phambili trial and (iv) the HVTN 505 trial. The tool acts simultaneously as a platform for rapid reinterpretation of sieve effects and as a portal for organizing and sharing the viral sequence data. Access to these valuable datasets also enables the development of novel methodology for future sieve analyses. Availability and Implementation Visualization: http://sieve.fredhutch.org/viz . Source code: https://github.com/nkullman/SIEVE . Data API: http://sieve.fredhutch.org/data . Contact agartlan@fredhutch.org.
Collapse
|
140
|
Duke ER, Gilbert PB, Stevens-Ayers TL, Golob JL, Cossrow N, Marks MA, Wan H, Mast TC, Huang MLW, Jerome KR, Corey L, Schiffer JT, Boeckh MJ. Viral Kinetic Correlates of Cytomegalovirus Disease and Death after Hematopoietic Cell Transplant. Biol Blood Marrow Transplant 2018. [DOI: 10.1016/j.bbmt.2017.12.006] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
141
|
Sun Y, Qi L, Yang G, Gilbert PB. Hypothesis tests for stratified mark-specific proportional hazards models with missing covariates, with application to HIV vaccine efficacy trials. Biom J 2018; 60:516-536. [PMID: 29488249 DOI: 10.1002/bimj.201700002] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2017] [Revised: 08/13/2017] [Accepted: 11/09/2017] [Indexed: 11/06/2022]
Abstract
This article develops hypothesis testing procedures for the stratified mark-specific proportional hazards model with missing covariates where the baseline functions may vary with strata. The mark-specific proportional hazards model has been studied to evaluate mark-specific relative risks where the mark is the genetic distance of an infecting HIV sequence to an HIV sequence represented inside the vaccine. This research is motivated by analyzing the RV144 phase 3 HIV vaccine efficacy trial, to understand associations of immune response biomarkers on the mark-specific hazard of HIV infection, where the biomarkers are sampled via a two-phase sampling nested case-control design. We test whether the mark-specific relative risks are unity and how they change with the mark. The developed procedures enable assessment of whether risk of HIV infection with HIV variants close or far from the vaccine sequence are modified by immune responses induced by the HIV vaccine; this question is interesting because vaccine protection occurs through immune responses directed at specific HIV sequences. The test statistics are constructed based on augmented inverse probability weighted complete-case estimators. The asymptotic properties and finite-sample performances of the testing procedures are investigated, demonstrating double-robustness and effectiveness of the predictive auxiliaries to recover efficiency. The finite-sample performance of the proposed tests are examined through a comprehensive simulation study. The methods are applied to the RV144 trial.
Collapse
|
142
|
Moodie Z, Juraska M, Huang Y, Zhuang Y, Fong Y, Carpp LN, Self SG, Chambonneau L, Small R, Jackson N, Noriega F, Gilbert PB. Neutralizing Antibody Correlates Analysis of Tetravalent Dengue Vaccine Efficacy Trials in Asia and Latin America. J Infect Dis 2018; 217:742-753. [PMID: 29194547 PMCID: PMC5854020 DOI: 10.1093/infdis/jix609] [Citation(s) in RCA: 76] [Impact Index Per Article: 12.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2017] [Accepted: 11/07/2017] [Indexed: 01/16/2023] Open
Abstract
Background In the CYD14 and CYD15 Phase 3 trials of the CYD-TDV dengue vaccine, estimated vaccine efficacy (VE) against symptomatic, virologically confirmed dengue (VCD) occurring between months 13 and 25 was 56.5% and 60.8%, respectively. Methods Neutralizing antibody titers to the 4 dengue serotypes in the CYD-TDV vaccine insert were measured at month 13 in a randomly sampled immunogenicity subcohort and in all VCD cases through month 25 (2848 vaccine, 1574 placebo) and studied for their association with VCD and with the level of VE to prevent VCD. Results For each trial and serotype, vaccinees with higher month 13 titer to the serotype had significantly lower risk of VCD with that serotype (hazard ratios, 0.19-0.43 per 10-fold increase). Moreover, for each trial, vaccinees with higher month 13 average titer to the 4 serotypes had significantly higher VE against VCD of any serotype (P < .001). Conclusions Neutralizing antibody titers postdose 3 correlate with CYD-TDV VE to prevent dengue. High titers associate with high VE for all serotypes, baseline serostatus groups, age groups, and both trials. However, lowest titers do not fully correspond to zero VE, indicating that other factors influence VE.
Collapse
|
143
|
Qiu Z, Wan ATK, Zhou Y, Gilbert PB. Smoothed Rank Regression for the Accelerated Failure Time Competing Risks Model with Missing Cause of Failure. Stat Sin 2018; 29:23-46. [PMID: 30740005 DOI: 10.5705/ss.202016.0231] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
This paper examines the accelerated failure time competing risks model with missing cause of failure using the monotone class rank-based estimating equations approach. We handle the non-smoothness of the rank-based estimating equations using a kernel smoothed estimation method, and estimate the unknown selection probability and the conditional expectation by non-parametric techniques. Under this setup, we propose three methods for estimating the unknown regression parameters based on 1) inverse probability weighting, 2) estimating equations imputation and 3) augmented inverse probability weighting. We also obtain the associated asymptotic theories of the proposed estimators and investigate the estimators' small sample behaviour in a simulation study. A direct plug-in method is suggested for estimating the asymptotic variances of the proposed estimators. A real data application based on a HIV vaccine efficacy trial study is considered.
Collapse
|
144
|
Benkeser D, Carone M, Laan MJVD, Gilbert PB. Doubly robust nonparametric inference on the average treatment effect. Biometrika 2017; 104:863-880. [PMID: 29430041 PMCID: PMC5793673 DOI: 10.1093/biomet/asx053] [Citation(s) in RCA: 54] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2016] [Indexed: 11/12/2022] Open
Abstract
Doubly robust estimators are widely used to draw inference about the average effect of a treatment. Such estimators are consistent for the effect of interest if either one of two nuisance parameters is consistently estimated. However, if flexible, data-adaptive estimators of these nuisance parameters are used, double robustness does not readily extend to inference. We present a general theoretical study of the behaviour of doubly robust estimators of an average treatment effect when one of the nuisance parameters is inconsistently estimated. We contrast different methods for constructing such estimators and investigate the extent to which they may be modified to also allow doubly robust inference. We find that while targeted minimum loss-based estimation can be used to solve this problem very naturally, common alternative frameworks appear to be inappropriate for this purpose. We provide a theoretical study and a numerical evaluation of the alternatives considered. Our simulations highlight the need for and usefulness of these approaches in practice, while our theoretical developments have broad implications for the construction of estimators that permit doubly robust inference in other problems.
Collapse
|
145
|
deCamp AC, Rolland M, Edlefsen PT, Sanders-Buell E, Hall B, Magaret CA, Fiore-Gartland AJ, Juraska M, Carpp LN, Karuna ST, Bose M, LePore S, Miller S, O'Sullivan A, Poltavee K, Bai H, Dommaraju K, Zhao H, Wong K, Chen L, Ahmed H, Goodman D, Tay MZ, Gottardo R, Koup RA, Bailer R, Mascola JR, Graham BS, Roederer M, O’Connell RJ, Michael NL, Robb ML, Adams E, D’Souza P, Kublin J, Corey L, Geraghty DE, Frahm N, Tomaras GD, McElrath MJ, Frenkel L, Styrchak S, Tovanabutra S, Sobieszczyk ME, Hammer SM, Kim JH, Mullins JI, Gilbert PB. Sieve analysis of breakthrough HIV-1 sequences in HVTN 505 identifies vaccine pressure targeting the CD4 binding site of Env-gp120. PLoS One 2017; 12:e0185959. [PMID: 29149197 PMCID: PMC5693417 DOI: 10.1371/journal.pone.0185959] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2017] [Accepted: 09/24/2017] [Indexed: 11/18/2022] Open
Abstract
Although the HVTN 505 DNA/recombinant adenovirus type 5 vector HIV-1 vaccine trial showed no overall efficacy, analysis of breakthrough HIV-1 sequences in participants can help determine whether vaccine-induced immune responses impacted viruses that caused infection. We analyzed 480 HIV-1 genomes sampled from 27 vaccine and 20 placebo recipients and found that intra-host HIV-1 diversity was significantly lower in vaccine recipients (P ≤ 0.04, Q-values ≤ 0.09) in Gag, Pol, Vif and envelope glycoprotein gp120 (Env-gp120). Furthermore, Env-gp120 sequences from vaccine recipients were significantly more distant from the subtype B vaccine insert than sequences from placebo recipients (P = 0.01, Q-value = 0.12). These vaccine effects were associated with signatures mapping to CD4 binding site and CD4-induced monoclonal antibody footprints. These results suggest either (i) no vaccine efficacy to block acquisition of any viral genotype but vaccine-accelerated Env evolution post-acquisition; or (ii) vaccine efficacy against HIV-1s with Env sequences closest to the vaccine insert combined with increased acquisition due to other factors, potentially including the vaccine vector.
Collapse
|
146
|
Fong Y, Huang Y, Gilbert PB, Permar SR. chngpt: threshold regression model estimation and inference. BMC Bioinformatics 2017; 18:454. [PMID: 29037149 PMCID: PMC5644082 DOI: 10.1186/s12859-017-1863-x] [Citation(s) in RCA: 72] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2017] [Accepted: 10/09/2017] [Indexed: 11/17/2022] Open
Abstract
Background Threshold regression models are a diverse set of non-regular regression models that all depend on change points or thresholds. They provide a simple but elegant and interpretable way to model certain kinds of nonlinear relationships between the outcome and a predictor. Results The R package chngpt provides both estimation and hypothesis testing functionalities for four common variants of threshold regression models. All allow for adjustment of additional covariates not subjected to thresholding. We demonstrate the consistency of the estimating procedures and the type 1 error rates of the testing procedures by Monte Carlo studies, and illustrate their practical uses using an example from the study of immune response biomarkers in the context of Mother-To-Child-Transmission of HIV-1 viruses. Conclusion chngpt makes several unique contributions to the software for threshold regression models and will make these models more accessible to practitioners interested in modeling threshold effects. Electronic supplementary material The online version of this article (doi:10.1186/s12859-017-1863-x) contains supplementary material, which is available to authorized users.
Collapse
|
147
|
Gabriel EE, Sachs MC, Gilbert PB. Comparing and combining biomarkers as principal surrogates for time-to-event clinical endpoints. Stat Med 2017; 36:3440. [DOI: 10.1002/sim.7354] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
148
|
Yang G, Sun Y, Qi L, Gilbert PB. Estimation of Stratified Mark-Specific Proportional Hazards Models under Two-Phase Sampling with Application to HIV Vaccine Efficacy Trials. STATISTICS IN BIOSCIENCES 2017; 9:259-283. [PMID: 28781713 DOI: 10.1007/s12561-016-9177-5] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
An objective of preventive HIV vaccine efficacy trials is to understand how vaccine-induced immune responses to specific protein sequences of HIV-1 associate with subsequent infection with specific sequences of HIV, where the immune response biomarkers are measured in vaccine recipients via a two-phase sampling design. Motivated by this objective, we investigate the stratified mark-specific proportional hazards model under two-phase biomarker sampling, where the mark is the genetic distance of an infecting HIV-1 sequence to an HIV-1 sequence represented inside the vaccine. Estimation and inference procedures based on inverse probability weighting of complete-cases and on augmented inverse probability weighting of complete-cases are developed. Asymptotic properties of the estimators are derived and their finite-sample performances are examined in simulation studies. The methods are shown to have satisfactory performance, and are applied to the RV144 vaccine trial to assess whether immune response correlates of HIV-1 infection are stronger for HIV-1 infecting sequences similar to the vaccine than for sequences distant from the vaccine. Augmented inverse probability weighting; auxiliary variables; case-cohort design; censored failure time; competing risks; HIV vaccine efficacy trial.
Collapse
|
149
|
Huang Y, Gilbert PB, Fu R, Janes H. Statistical methods for down-selection of treatment regimens based on multiple endpoints, with application to HIV vaccine trials. Biostatistics 2017; 18:230-243. [PMID: 27649715 DOI: 10.1093/biostatistics/kxw043] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2015] [Accepted: 07/21/2016] [Indexed: 11/12/2022] Open
Abstract
Biomarker endpoints measuring vaccine-induced immune responses are essential to HIV vaccine development because of their potential to predict the effect of a vaccine in preventing HIV infection. A vaccine's immune response profile observed in phase I immunogenicity studies is a key factor in determining whether it is advanced for further study in phase II and III efficacy trials. The multiplicity of immune variables and scientific uncertainty in their relative importance, however, pose great challenges to the development of formal algorithms for selecting vaccines to study further. Motivated by the practical need to identify a set of promising vaccines from a pool of candidate regimens for inclusion in an upcoming HIV vaccine efficacy trial, we propose a new statistical framework for the selection of vaccine regimens based on their immune response profile. In particular, we propose superiority and non-redundancy criteria to be achieved in down-selection, and develop novel statistical algorithms that integrate hypothesis testing and ranking for selecting vaccine regimens satisfying these criteria. Performance of the proposed selection algorithms are evaluated through extensive numerical studies. We demonstrate the application of the proposed methods through the comparison of immune responses between several HIV vaccine regimens. The methods are applicable to general down-selection applications in clinical trials.
Collapse
|
150
|
Buchbinder SP, Grunenberg NA, Sanchez BJ, Seaton KE, Ferrari G, Moody MA, Frahm N, Montefiori DC, Hay CM, Goepfert PA, Baden LR, Robinson HL, Yu X, Gilbert PB, McElrath MJ, Huang Y, Tomaras GD. Immunogenicity of a novel Clade B HIV-1 vaccine combination: Results of phase 1 randomized placebo controlled trial of an HIV-1 GM-CSF-expressing DNA prime with a modified vaccinia Ankara vaccine boost in healthy HIV-1 uninfected adults. PLoS One 2017; 12:e0179597. [PMID: 28727817 PMCID: PMC5519050 DOI: 10.1371/journal.pone.0179597] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2017] [Accepted: 05/30/2017] [Indexed: 12/20/2022] Open
Abstract
Background A phase 1 trial of a clade B HIV vaccine in HIV-uninfected adults evaluated the safety and immunogenicity of a DNA prime co-expressing GM-CSF (Dg) followed by different numbers and intervals of modified vaccinia Ankara Boosts (M). Both vaccines produce virus-like particles presenting membrane-bound Env. Methods Four US sites randomized 48 participants to receiving 1/10th the DNA dose as DgDgMMM given at 0, 2, 4, 6 and 8 months, or full dose DgDgM_M or DgDgMM_M regimens, given at 0, 2, 4, and 8 months, and 0, 2, 4, 6, and 10 months, respectively. Peak immunogenicity was measured 2 weeks post-last vaccination. Results All regimens were well tolerated and safe. Full dose DgDgM_M and DgDgMM_M regimens generated Env-specific IgG to HIV-1 Env in >90%, IgG3 in >80%, and IgA in <20% of participants. Responses to gp140 and gp41 targets were more common and of higher magnitude than to gp120 and V1V2. The gp41 antibody included reactivity to the conserved immunodominant region with specificities known to mediate virus capture and phagocytosis and did not cross-react with a panel of intestinal flora antigens. The 3rd dose of MVA increased the avidity of elicited antibody (7.5% to 39%), the ADCC response to Bal gp120 (14% to 64%), and the one-year durability of the IgG3 responses to gp41 by 4-fold (13% vs. 3.5% retention of peak response). The co-expressed GM-CSF did not enhance responses over those in trials testing this vaccine without GM-CSF. Conclusion This DNA/MVA prime-boost regimen induced durable, functional humoral responses that included ADCC, high antibody avidity, and Env IgG1 and IgG3 binding responses to the immunodominant region of gp41. The third, spaced MVA boost improved the overall quality of the antibody response. These products without co-expressed GM-CSF but combined with protein boosts will be considered for efficacy evaluation. Trial registration ClinicalTrials.gov NCT01571960
Collapse
|