COVID-19 vaccine efficacy in participants with weakened immune systems from four randomized-controlled trials

BACKGROUND

Although the SARS-CoV-2 vaccines are highly efficacious at preventing severe disease in the general population, current data are lacking regarding vaccine efficacy (VE) for individuals with mild immunocompromising conditions.

METHODS

A post-hoc, cross-protocol analysis of participant-level data from the blinded phase of four randomized, placebo-controlled, COVID-19 vaccine phase 3 trials (Moderna, AstraZeneca, Janssen, and Novavax) was performed. We defined a "tempered immune system" (TIS) variable via a consensus panel based on medical history and medications to determine VE against symptomatic and severe COVID-19 cases in TIS participants versus non-TIS (NTIS) individuals starting at 14 days after completion of the primary series through the blinded phase for each of the four trials. An analysis of participants living with well-controlled HIV was conducted using the same methods.

RESULTS

3,852/30,351 (12.7%) Moderna participants, 3,088/29,868 (10.3%) Novavax participants, 3,549/32,380 (11.0%) AstraZeneca participants, and 5,047/43,788 (11.5%) Janssen participants were identified as having a TIS. Most TIS conditions (73.9%) were due to metabolism and nutritional disorders. Vaccination (versus placebo) significantly reduced the likelihood of symptomatic and severe COVID-19 for all participants for each trial. VE was not significantly different for TIS participants vs NTIS for either symptomatic or severe COVID-19 for each trial, nor was VE significantly different in the symptomatic endpoint for participants with HIV.

CONCLUSIONS

For individuals with mildly immunocompromising conditions, there is no evidence of differences in VE against symptomatic or severe COVID-19 compared to those with non-tempered immune systems in the four COVID-19 vaccine randomized controlled efficacy trials.

Four statistical frameworks for assessing an immune correlate of protection (surrogate endpoint) from a randomized, controlled, vaccine efficacy trial

A central goal of vaccine research is to characterize and validate immune correlates of protection (CoPs). In addition to helping elucidate immunological mechanisms, a CoP can serve as a valid surrogate endpoint for an infectious disease clinical outcome and thus qualifies as a primary endpoint for vaccine authorization or approval without requiring resource-intensive randomized, controlled phase 3 trials. Yet, it is challenging to persuasively validate a CoP, because a prognostic immune marker can fail as a reliable basis for predicting/inferring the level of vaccine efficacy against a clinical outcome, and because the statistical analysis of phase 3 trials only has limited capacity to disentangle association from cause. Moreover, the multitude of statistical methods garnered for CoP evaluation in phase 3 trials renders the comparison, interpretation, and synthesis of CoP results challenging. Toward promoting broader harmonization and standardization of CoP evaluation, this article summarizes four complementary statistical frameworks for evaluating CoPs in a phase 3 trial, focusing on the frameworks' distinct scientific objectives as measured and communicated by distinct causal vaccine efficacy parameters. Advantages and disadvantages of the frameworks are considered, dependent on phase 3 trial context, and perspectives are offered on how the frameworks can be applied and their results synthesized.

A HIV-1 Gp41 Peptide-Liposome Vaccine Elicits Neutralizing Epitope-Targeted Antibody Responses in Healthy Individuals

Background

HIV-1 vaccine development is a global health priority. Broadly neutralizing antibodies (bnAbs) which target the HIV-1 gp41 membrane-proximal external region (MPER) have some of the highest neutralization breadth. An MPER peptide-liposome vaccine has been found to expand bnAb precursors in monkeys.

Methods

The HVTN133 phase 1 clinical trial (NCT03934541) studied the MPER-peptide liposome immunogen in 24 HIV-1 seronegative individuals. Participants were recruited between 15 July 2019 and 18 October 2019 and were randomized in a dose-escalation design to either 500 mcg or 2000 mcg of the MPER-peptide liposome or placebo. Four intramuscular injections were planned at months 0, 2, 6, and 12.

Results

The trial was stopped prematurely due to an anaphylaxis reaction in one participant ultimately attributed to vaccine-associated polyethylene glycol. The immunogen induced robust immune responses, including MPER+ serum and blood CD4+ T-cell responses in 95% and 100% of vaccinees, respectively, and 35% (7/20) of vaccine recipients had blood IgG memory B cells with MPER-bnAb binding phenotype. Affinity purification of plasma MPER+ IgG demonstrated tier 2 HIV-1 neutralizing activity in two of five participants after 3 immunizations.

Conclusions

MPER-peptide liposomes induced gp41 serum neutralizing epitope-targeted antibodies and memory B-cell responses in humans despite the early termination of the study. These results suggest that the MPER region is a promising target for a candidate HIV vaccine.

Quantifying how single dose Ad26.COV2.S vaccine efficacy depends on Spike sequence features

In the ENSEMBLE randomized, placebo-controlled phase 3 trial (NCT04505722), estimated single-dose Ad26.COV2.S vaccine efficacy (VE) was 56% against moderate to severe-critical COVID-19. SARS-CoV-2 Spike sequences were determined from 484 vaccine and 1,067 placebo recipients who acquired COVID-19. In this set of prespecified analyses, we show that in Latin America, VE was significantly lower against Lambda vs. Reference and against Lambda vs. non-Lambda [family-wise error rate (FWER) p < 0.05]. VE differed by residue match vs. mismatch to the vaccine-insert at 16 amino acid positions (4 FWER p < 0.05; 12 q-value ≤ 0.20); significantly decreased with physicochemical-weighted Hamming distance to the vaccine-strain sequence for Spike, receptor-binding domain, N-terminal domain, and S1 (FWER p < 0.001); differed (FWER ≤ 0.05) by distance to the vaccine strain measured by 9 antibody-epitope escape scores and 4 NTD neutralization-impacting features; and decreased (p = 0.011) with neutralization resistance level to vaccinee sera. VE against severe-critical COVID-19 was stable across most sequence features but lower against the most distant viruses.

Prevention efficacy of the broadly neutralizing antibody VRC01 depends on HIV-1 envelope sequence features

In the Antibody Mediated Prevention (AMP) trials (HVTN 704/HPTN 085 and HVTN 703/HPTN 081), prevention efficacy (PE) of the monoclonal broadly neutralizing antibody (bnAb) VRC01 (vs. placebo) against HIV-1 acquisition diagnosis varied according to the HIV-1 Envelope (Env) neutralization sensitivity to VRC01, as measured by 80% inhibitory concentration (IC80). Here, we performed a genotypic sieve analysis, a complementary approach to gaining insight into correlates of protection that assesses how PE varies with HIV-1 sequence features. We analyzed HIV-1 Env amino acid (AA) sequences from the earliest available HIV-1 RNA-positive plasma samples from AMP participants diagnosed with HIV-1 and identified Env sequence features that associated with PE. The strongest Env AA sequence correlate in both trials was VRC01 epitope distance that quantifies the divergence of the VRC01 epitope in an acquired HIV-1 isolate from the VRC01 epitope of reference HIV-1 strains that were most sensitive to VRC01-mediated neutralization. In HVTN 704/HPTN 085, the Env sequence-based predicted probability that VRC01 IC80 against the acquired isolate exceeded 1 µg/mL also significantly associated with PE. In HVTN 703/HPTN 081, a physicochemical-weighted Hamming distance across 50 VRC01 binding-associated Env AA positions of the acquired isolate from the most VRC01-sensitive HIV-1 strain significantly associated with PE. These results suggest that incorporating mutation scoring by BLOSUM62 and weighting by the strength of interactions at AA positions in the epitope:VRC01 interface can optimize performance of an Env sequence-based biomarker of VRC01 prevention efficacy. Future work could determine whether these results extend to other bnAbs and bnAb combinations.

Study design approaches for future active-controlled HIV prevention trials

Objectives

Vigorous discussions are ongoing about future efficacy trial designs of candidate human immunodeficiency virus (HIV) prevention interventions. The study design challenges of HIV prevention interventions are considerable given rapid evolution of the prevention landscape and evidence of multiple modalities of highly effective products; future trials will likely be 'active-controlled', i.e., not include a placebo arm. Thus, novel design approaches are needed to accurately assess new interventions against these highly effective active controls.

Methods

To discuss active control design challenges and identify solutions, an initial virtual workshop series was hosted and supported by the International AIDS Enterprise (October 2020-March 2021). Subsequent symposia discussions continue to advance these efforts. As the non-inferiority design is an important conceptual reference design for guiding active control trials, we adopt several of its principles in our proposed design approaches.

Results

We discuss six potential study design approaches for formally evaluating absolute prevention efficacy given data from an active-controlled HIV prevention trial including using data from: 1) a registrational cohort, 2) recency assays, 3) an external trial placebo arm, 4) a biomarker of HIV incidence/exposure, 5) an anti-retroviral drug concentration as a mediator of prevention efficacy, and 6) immune biomarkers as a mediator of prevention efficacy.

Conclusions

Our understanding of these proposed novel approaches to future trial designs remains incomplete and there are many future statistical research needs. Yet, each of these approaches, within the context of an active-controlled trial, have the potential to yield reliable evidence of efficacy for future biomedical interventions.

Predicting neutralization susceptibility to combination HIV-1 monoclonal broadly neutralizing antibody regimens

Combination monoclonal broadly neutralizing antibodies (bnAbs) are currently being developed for preventing HIV-1 infection. Recent work has focused on predicting in vitro neutralization potency of both individual bnAbs and combination regimens against HIV-1 pseudoviruses using Env sequence features. To predict in vitro combination regimen neutralization potency against a given HIV-1 pseudovirus, previous approaches have applied mathematical models to combine individual-bnAb neutralization and have predicted this combined neutralization value; we call this the combine-then-predict (CP) approach. However, prediction performance for some individual bnAbs has exceeded that for the combination, leading to another possibility: combining the individual-bnAb predicted values and using these to predict combination regimen neutralization; we call this the predict-then-combine (PC) approach. We explore both approaches in both simulated data and data from the Los Alamos National Laboratory's Compile, Neutralize, and Tally NAb Panels repository. The CP approach is superior to the PC approach when the neutralization outcome of interest is binary (e.g., neutralization susceptibility, defined as inhibitory concentration < 1 μg/mL. For continuous outcomes, the CP approach performs at least as well as the PC approach, and is superior to the PC approach when the individual-bnAb prediction algorithms have poor performance. This knowledge may be used when building prediction models for novel antibody combinations in the absence of in vitro neutralization data for the antibody combination; this, in turn, will aid in the evaluation and down-selection of these antibody combinations into prevention efficacy trials.

High monoclonal neutralization titers reduced breakthrough HIV-1 viral loads in the Antibody Mediated Prevention trials

The Antibody Mediated Prevention (AMP) trials (NCT02716675 and NCT02568215) demonstrated that passive administration of the broadly neutralizing monoclonal antibody VRC01 could prevent some HIV-1 acquisition events. Here, we use mathematical modeling in a post hoc analysis to demonstrate that VRC01 influenced viral loads in AMP participants who acquired HIV. Instantaneous inhibitory potential (IIP), which integrates VRC01 serum concentration and VRC01 sensitivity of acquired viruses in terms of both IC50 and IC80, follows a dose-response relationship with first positive viral load (p = 0.03), which is particularly strong above a threshold of IIP = 1.6 (r = -0.6, p = 2e-4). Mathematical modeling reveals that VRC01 activity predicted from in vitro IC80s and serum VRC01 concentrations overestimates in vivo neutralization by 600-fold (95% CI: 300-1200). The trained model projects that even if future therapeutic HIV trials of combination monoclonal antibodies do not always prevent acquisition, reductions in viremia and reservoir size could be expected.

A semiparametric Cox-Aalen transformation model with censored data

We propose a broad class of so-called Cox-Aalen transformation models that incorporate both multiplicative and additive covariate effects on the baseline hazard function within a transformation. The proposed models provide a highly flexible and versatile class of semiparametric models that include the transformation models and the Cox-Aalen model as special cases. Specifically, it extends the transformation models by allowing potentially time-dependent covariates to work additively on the baseline hazard and extends the Cox-Aalen model through a predetermined transformation function. We propose an estimating equation approach and devise an expectation-solving (ES) algorithm that involves fast and robust calculations. The resulting estimator is shown to be consistent and asymptotically normal via modern empirical process techniques. The ES algorithm yields a computationally simple method for estimating the variance of both parametric and nonparametric estimators. Finally, we demonstrate the performance of our procedures through extensive simulation studies and applications in two randomized, placebo-controlled human immunodeficiency virus (HIV) prevention efficacy trials. The data example shows the utility of the proposed Cox-Aalen transformation models in enhancing statistical power for discovering covariate effects.

Stochastic interventional approach to assessing immune correlates of protection: Application to the COVE messenger RNA-1273 vaccine trial

BACKGROUND

Stochastic interventional vaccine efficacy (SVE) analysis is a new approach to correlate of protection (CoP) analysis of a phase III trial that estimates how vaccine efficacy (VE) would change under hypothetical shifts of an immune marker.

METHODS

We applied nonparametric SVE methodology to the COVE trial of messenger RNA-1273 vs placebo to evaluate post-dose 2 pseudovirus neutralizing antibody (nAb) titer against the D614G strain as a CoP against COVID-19. Secondly, we evaluated the ability of these results to predict VE against variants based on shifts of geometric mean titers to variants vs D614G. Prediction accuracy was evaluated by 13 validation studies, including 12 test-negative designs.

RESULTS

SVE analysis of COVE supported post-dose 2 D614G titer as a CoP: estimated VE ranged from 66.9% (95% confidence interval: 36.2, 82.8%) to 99.3% (99.1, 99.4%) at 10-fold decreased or increased titer shifts, respectively. The SVE estimates only weakly predicted variant-specific VE estimates (concordance correlation coefficient 0.062 for post 2-dose VE).

CONCLUSION

SVE analysis of COVE supports nAb titer as a CoP for messenger RNA vaccines. Predicting variant-specific VE proved difficult due to many limitations. Greater anti-Omicron titers may be needed for high-level protection against Omicron vs anti-D614G titers needed for high-level protection against pre-Omicron COVID-19.

Adults on pre-exposure prophylaxis (tenofovir-emtricitabine) have faster clearance of anti-HIV monoclonal antibody VRC01

Broadly neutralizing monoclonal antibodies (mAbs) are being developed for HIV-1 prevention. Hence, these mAbs and licensed oral pre-exposure prophylaxis (PrEP) (tenofovir-emtricitabine) can be concomitantly administered in clinical trials. In 48 US participants (men and transgender persons who have sex with men) who received the HIV-1 mAb VRC01 and remained HIV-free in an antibody-mediated-prevention trial (ClinicalTrials.gov #NCT02716675), we conduct a post-hoc analysis and find that VRC01 clearance is 0.08 L/day faster (p = 0.005), and dose-normalized area-under-the-curve of VRC01 serum concentration over-time is 0.29 day/mL lower (p < 0.001) in PrEP users (n = 24) vs. non-PrEP users (n = 24). Consequently, PrEP users are predicted to have 14% lower VRC01 neutralization-mediated prevention efficacy against circulating HIV-1 strains. VRC01 clearance is positively associated (r = 0.33, p = 0.03) with levels of serum intestinal Fatty Acid Binding protein (I-FABP), a marker of epithelial intestinal permeability, which is elevated upon starting PrEP (p = 0.04) and after months of self-reported use (p = 0.001). These findings have implications for the evaluation of future HIV-1 mAbs and postulate a potential mechanism for mAb clearance in the context of PrEP.

Baseline malaria infection status and RTS,S/AS01E malaria vaccine efficacy

Background

The only licensed malaria vaccine, RTS,S/AS01 E , confers moderate protection against symptomatic disease. Because many malaria infections are asymptomatic, we conducted a large-scale longitudinal parasite genotyping study of samples from a clinical trial exploring how vaccine dosing regimen affects vaccine efficacy (VE).

Methods

1,500 children aged 5-17 months were randomized to receive four different RTS,S/AS01 E regimens or a rabies control vaccine in a phase 2b clinical trial in Ghana and Kenya. We evaluated the time to the first new genotypically detected infection and the total number of new infections during two follow-up periods in over 36K participant specimens. We performed a post hoc analysis of VE based on malaria infection status at first vaccination and force of infection.

Results

We observed significant and comparable VE (25-43%, 95% CI union 9-53%) against first new infection for all four RTS,S/AS01 E regimens across both follow-up periods (12 and 20 months). Each RTS,S/AS01 E regimen significantly reduced the number of new infections in the 20-month follow-up period (control mean 4.1 vs. RTS,S/AS01 E mean 2.6-3.0). VE against first new infection was significantly higher in participants who were malaria-infected (68%; 95% CI, 50 to 80%) versus uninfected (37%; 95% CI, 23 to 48%) at the first vaccination (P=0.0053) and in participants experiencing greater force of infection between dose 1 and 3 (P=0.059).

Conclusions

All tested dosing regimens blocked some infections to a similar degree. Improved VE in participants infected during vaccination could suggest new strategies for highly efficacious malaria vaccine development and implementation. ( ClinicalTrials.gov number, NCT03276962 ).

A framework for the definition and interpretation of the use of surrogate endpoints in interventional trials

Background

Interventional trials that evaluate treatment effects using surrogate endpoints have become increasingly common. This paper describes four linked empirical studies and the development of a framework for defining, interpreting and reporting surrogate endpoints in trials.

Methods

As part of developing the CONSORT (Consolidated Standards of Reporting Trials) and SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials) extensions for randomised trials reporting surrogate endpoints, we undertook a scoping review, e-Delphi study, consensus meeting, and a web survey to examine current definitions and stakeholder (including clinicians, trial investigators, patients and public partners, journal editors, and health technology experts) interpretations of surrogate endpoints as primary outcome measures in trials.

Findings

Current surrogate endpoint definitional frameworks are inconsistent and unclear. Surrogate endpoints are used in trials as a substitute of the treatment effects of an intervention on the target outcome(s) of ultimate interest, events measuring how patients feel, function, or survive. Traditionally the consideration of surrogate endpoints in trials has focused on biomarkers (e.g., HDL cholesterol, blood pressure, tumour response), especially in the medical product regulatory setting. Nevertheless, the concept of surrogacy in trials is potentially broader. Intermediate outcomes that include a measure of function or symptoms (e.g., angina frequency, exercise tolerance) can also be used as substitute for target outcomes (e.g., all-cause mortality)-thereby acting as surrogate endpoints. However, we found a lack of consensus among stakeholders on accepting and interpreting intermediate outcomes in trials as surrogate endpoints or target outcomes. In our assessment, patients and health technology assessment experts appeared more likely to consider intermediate outcomes to be surrogate endpoints than clinicians and regulators.

Interpretation

There is an urgent need for better understanding and reporting on the use of surrogate endpoints, especially in the setting of interventional trials. We provide a framework for the definition of surrogate endpoints (biomarkers and intermediate outcomes) and target outcomes in trials to improve future reporting and aid stakeholders' interpretation and use of trial surrogate endpoint evidence.

Funding

SPIRIT-SURROGATE/CONSORT-SURROGATE project is Medical Research Council Better Research Better Health (MR/V038400/1) funded.

A controlled effects approach to assessing immune correlates of protection

An immune correlate of risk (CoR) is an immunologic biomarker in vaccine recipients associated with an infectious disease clinical endpoint. An immune correlate of protection (CoP) is a CoR that can be used to reliably predict vaccine efficacy (VE) against the clinical endpoint and hence is accepted as a surrogate endpoint that can be used for accelerated approval or guide use of vaccines. In randomized, placebo-controlled trials, CoR analysis is limited by not assessing a causal vaccine effect. To address this limitation, we construct the controlled risk curve of a biomarker, which provides the causal risk of an endpoint if all participants are assigned vaccine and the biomarker is set to different levels. Furthermore, we propose a causal CoP analysis based on controlled effects, where for the important special case that the biomarker is constant in the placebo arm, we study the controlled vaccine efficacy curve that contrasts the controlled risk curve with placebo arm risk. We provide identification conditions and formulae that account for right censoring of the clinical endpoint and two-phase sampling of the biomarker, and consider G-computation estimation and inference under a semiparametric model such as the Cox model. We add modular approaches to sensitivity analysis that quantify robustness of CoP evidence to unmeasured confounding. We provide an application to two phase 3 trials of a dengue vaccine indicating that controlled risk of dengue strongly varies with 50$\%$ neutralizing antibody titer. Our work introduces controlled effects causal mediation analysis to immune CoP evaluation.

Violence Exposure Among Women in the Sex Industry and Their Children in El Alto, Bolivia: A Comparative Cross-Sectional Study

We conducted a comparative cross-sectional study to compare the prevalence of exposure to workplace violence and intimate partner violence (IPV) in 125 female sex workers (FSWs) and 125 age-matched control women working in other professions (non-FSWs) and their children in El Alto, Bolivia. Violence exposure was assessed using the Demographic Health Survey Domestic Violence Module. To determine associations between work type and violence exposure, we conducted multivariate logistic regression. One-third of working mothers experienced sexual IPV, regardless of their profession. FSWs experienced higher rates of severe physical IPV and workplace violence. Children of FSWs were approximately three times more likely to be exposed to violence in the workplace. In Bolivia, strategies to reduce exposure to violence within the home and in FSW workplaces are paramount to minimizing negative impacts on women and their children. These findings have implications for policies to improve education, living wages, and social interventions to prevent and mitigate violence against women and children.

Risk of COVID-19 after natural infection or vaccination

BACKGROUND

While vaccines have established utility against COVID-19, phase 3 efficacy studies have generally not comprehensively evaluated protection provided by previous infection or hybrid immunity (previous infection plus vaccination). Individual patient data from US government-supported harmonized vaccine trials provide an unprecedented sample population to address this issue. We characterized the protective efficacy of previous SARS-CoV-2 infection and hybrid immunity against COVID-19 early in the pandemic over three-to six-month follow-up and compared with vaccine-associated protection.

METHODS

In this post-hoc cross-protocol analysis of the Moderna, AstraZeneca, Janssen, and Novavax COVID-19 vaccine clinical trials, we allocated participants into four groups based on previous-infection status at enrolment and treatment: no previous infection/placebo; previous infection/placebo; no previous infection/vaccine; and previous infection/vaccine. The main outcome was RT-PCR-confirmed COVID-19 >7-15 days (per original protocols) after final study injection. We calculated crude and adjusted efficacy measures.

FINDINGS

Previous infection/placebo participants had a 92% decreased risk of future COVID-19 compared to no previous infection/placebo participants (overall hazard ratio [HR] ratio: 0.08; 95% CI: 0.05-0.13). Among single-dose Janssen participants, hybrid immunity conferred greater protection than vaccine alone (HR: 0.03; 95% CI: 0.01-0.10). Too few infections were observed to draw statistical inferences comparing hybrid immunity to vaccine alone for other trials. Vaccination, previous infection, and hybrid immunity all provided near-complete protection against severe disease.

INTERPRETATION

Previous infection, any hybrid immunity, and two-dose vaccination all provided substantial protection against symptomatic and severe COVID-19 through the early Delta period. Thus, as a surrogate for natural infection, vaccination remains the safest approach to protection.

FUNDING

National Institutes of Health.

Stochastic Interventional Vaccine Efficacy and Principal Surrogate Analyses of Antibody Markers as Correlates of Protection against Symptomatic COVID-19 in the COVE mRNA-1273 Trial

The COVE trial randomized participants to receive two doses of mRNA-1273 vaccine or placebo on Days 1 and 29 (D1, D29). Anti-SARS-CoV-2 Spike IgG binding antibodies (bAbs), anti-receptor binding domain IgG bAbs, 50% inhibitory dilution neutralizing antibody (nAb) titers, and 80% inhibitory dilution nAb titers were measured at D29 and D57. We assessed these markers as correlates of protection (CoPs) against COVID-19 using stochastic interventional vaccine efficacy (SVE) analysis and principal surrogate (PS) analysis, frameworks not used in our previous COVE immune correlates analyses. By SVE analysis, hypothetical shifts of the D57 Spike IgG distribution from a geometric mean concentration (GMC) of 2737 binding antibody units (BAU)/mL (estimated vaccine efficacy (VE): 92.9% (95% CI: 91.7%, 93.9%)) to 274 BAU/mL or to 27,368 BAU/mL resulted in an overall estimated VE of 84.2% (79.0%, 88.1%) and 97.6% (97.4%, 97.7%), respectively. By binary marker PS analysis of Low and High subgroups (cut-point: 2094 BAU/mL), the ignorance interval (IGI) and estimated uncertainty interval (EUI) for VE were [85%, 90%] and (78%, 93%) for Low compared to [95%, 96%] and (92%, 97%) for High. By continuous marker PS analysis, the IGI and 95% EUI for VE at the 2.5th percentile (519.4 BAU/mL) vs. at the 97.5th percentile (9262.9 BAU/mL) of D57 Spike IgG concentration were [92.6%, 93.4%] and (89.2%, 95.7%) vs. [94.3%, 94.6%] and (89.7%, 97.0%). Results were similar for other D29 and D57 markers. Thus, the SVE and PS analyses additionally support all four markers at both time points as CoPs.

Application of the SLAPNAP statistical learning tool to broadly neutralizing antibody HIV prevention research

Combination monoclonal broadly neutralizing antibody (bnAb) regimens are in clinical development for HIV prevention, necessitating additional knowledge of bnAb neutralization potency/breadth against circulating viruses. Williamson et al. (2021) described a software tool, Super LeArner Prediction of NAb Panels (SLAPNAP), with application to any HIV bnAb regimen with sufficient neutralization data against a set of viruses in the Los Alamos National Laboratory's Compile, Neutralize, and Tally Nab Panels repository. SLAPNAP produces a proteomic antibody resistance (PAR) score for Env sequences based on predicted neutralization resistance and estimates variable importance of Env amino acid features. We apply SLAPNAP to compare HIV bnAb regimens undergoing clinical testing, finding improved power for downstream sieve analyses and increased precision for comparing neutralization potency/breadth of bnAb regimens due to the inclusion of PAR scores of Env sequences with much larger sample sizes available than for neutralization outcomes. SLAPNAP substantially improves bnAb regimen characterization, ranking, and down-selection.

Modifiers of COVID-19 vaccine efficacy: Results from four COVID-19 prevention network efficacy trials

Questions remain regarding the effect of baseline host and exposure factors on vaccine efficacy (VE) across pathogens and vaccine platforms. We report placebo-controlled data from four Phase 3 COVID-19 trials during the early period of the pandemic. This was a cross-protocol analysis of four randomized, placebo-controlled efficacy trials (Moderna/mRNA1273, AstraZeneca/AZD1222, Janssen/Ad26.COV2.S, and Novavax/NVX-CoV2373) using a harmonized design. Trials were conducted in the United States and international sites in adults ≥ 18 years of age. VE was assessed for symptomatic and severe COVID-19. We analyzed 114,480 participants from both placebo and vaccine arms, enrolled July 2020 to February 2021, with follow up through July 2021. VE against symptomatic COVID-19 showed little heterogeneity across baseline socio-demographic, clinical or exposure characteristics, in either univariate or multivariate analysis, regardless of vaccine platform. Similarly, VE against severe COVID-19 in the single trial (Janssen) with sufficient endpoints for analysis showed little evidence of heterogeneity. COVID-19 VE is not influenced by baseline host or exposure characteristics across efficacy trials of different vaccine platforms and countries when well matched to circulating virus strains. This supports use of these vaccines, regardless of platform type, as effective tools in the near term for reducing symptomatic and severe COVID-19, particularly for older individuals and those with common co-morbidities during major variant shifts. Clinical trial registration numbers: NCT04470427, NCT04516746, NCT04505722, and NCT04611802.

Clinical and Demographic Factors Associated With COVID-19, Severe COVID-19, and SARS-CoV-2 Infection in Adults: A Secondary Cross-Protocol Analysis of 4 Randomized Clinical Trials

Importance

Current data identifying COVID-19 risk factors lack standardized outcomes and insufficiently control for confounders.

Objective

To identify risk factors associated with COVID-19, severe COVID-19, and SARS-CoV-2 infection.

Design, Setting, and Participants

This secondary cross-protocol analysis included 4 multicenter, international, randomized, blinded, placebo-controlled, COVID-19 vaccine efficacy trials with harmonized protocols established by the COVID-19 Prevention Network. Individual-level data from participants randomized to receive placebo within each trial were combined and analyzed. Enrollment began July 2020 and the last data cutoff was in July 2021. Participants included adults in stable health, at risk for SARS-CoV-2, and assigned to the placebo group within each vaccine trial. Data were analyzed from April 2022 to February 2023.

Exposures

Comorbid conditions, demographic factors, and SARS-CoV-2 exposure risk at the time of enrollment.

Main Outcomes and Measures

Coprimary outcomes were COVID-19 and severe COVID-19. Multivariate Cox proportional regression models estimated adjusted hazard ratios (aHRs) and 95% CIs for baseline covariates, accounting for trial, region, and calendar time. Secondary outcomes included severe COVID-19 among people with COVID-19, subclinical SARS-CoV-2 infection, and SARS-CoV-2 infection.

Results

A total of 57 692 participants (median [range] age, 51 [18-95] years; 11 720 participants [20.3%] aged ≥65 years; 31 058 participants [53.8%] assigned male at birth) were included. The analysis population included 3270 American Indian or Alaska Native participants (5.7%), 7849 Black or African American participants (13.6%), 17 678 Hispanic or Latino participants (30.6%), and 40 745 White participants (70.6%). Annualized incidence was 13.9% (95% CI, 13.3%-14.4%) for COVID-19 and 2.0% (95% CI, 1.8%-2.2%) for severe COVID-19. Factors associated with increased rates of COVID-19 included workplace exposure (high vs low: aHR, 1.35 [95% CI, 1.16-1.58]; medium vs low: aHR, 1.41 [95% CI, 1.21-1.65]; P < .001) and living condition risk (very high vs low risk: aHR, 1.41 [95% CI, 1.21-1.66]; medium vs low risk: aHR, 1.19 [95% CI, 1.08-1.32]; P < .001). Factors associated with decreased rates of COVID-19 included previous SARS-CoV-2 infection (aHR, 0.13 [95% CI, 0.09-0.19]; P < .001), age 65 years or older (aHR vs age <65 years, 0.57 [95% CI, 0.50-0.64]; P < .001) and Black or African American race (aHR vs White race, 0.78 [95% CI, 0.67-0.91]; P = .002). Factors associated with increased rates of severe COVID-19 included race (American Indian or Alaska Native vs White: aHR, 2.61 [95% CI, 1.85-3.69]; multiracial vs White: aHR, 2.19 [95% CI, 1.50-3.20]; P < .001), diabetes (aHR, 1.54 [95% CI, 1.14-2.08]; P = .005) and at least 2 comorbidities (aHR vs none, 1.39 [95% CI, 1.09-1.76]; P = .008). In analyses restricted to participants who contracted COVID-19, increased severe COVID-19 rates were associated with age 65 years or older (aHR vs <65 years, 1.75 [95% CI, 1.32-2.31]; P < .001), race (American Indian or Alaska Native vs White: aHR, 1.98 [95% CI, 1.38-2.83]; Black or African American vs White: aHR, 1.49 [95% CI, 1.03-2.14]; multiracial: aHR, 1.81 [95% CI, 1.21-2.69]; overall P = .001), body mass index (aHR per 1-unit increase, 1.03 [95% CI, 1.01-1.04]; P = .001), and diabetes (aHR, 1.85 [95% CI, 1.37-2.49]; P < .001). Previous SARS-CoV-2 infection was associated with decreased severe COVID-19 rates (aHR, 0.04 [95% CI, 0.01-0.14]; P < .001).

Conclusions and Relevance

In this secondary cross-protocol analysis of 4 randomized clinical trials, exposure and demographic factors had the strongest associations with outcomes; results could inform mitigation strategies for SARS-CoV-2 and viruses with comparable epidemiological characteristics.

Pharmacokinetic serum concentrations of VRC01 correlate with prevention of HIV-1 acquisition

BACKGROUND

The phase 2b proof-of-concept Antibody Mediated Prevention (AMP) trials showed that VRC01, an anti-HIV-1 broadly neutralising antibody (bnAb), prevented acquisition of HIV-1 sensitive to VRC01. To inform future study design and dosing regimen selection of candidate bnAbs, we investigated the association of VRC01 serum concentration with HIV-1 acquisition using AMP trial data.

METHODS

The case-control sample included 107 VRC01 recipients who acquired HIV-1 and 82 VRC01 recipients who remained without HIV-1 during the study. We measured VRC01 serum concentrations with a qualified pharmacokinetic (PK) Binding Antibody Multiplex Assay. We employed nonlinear mixed effects PK modelling to estimate daily-grid VRC01 concentrations. Cox regression models were used to assess the association of VRC01 concentration at exposure and baseline body weight, with the hazard of HIV-1 acquisition and prevention efficacy as a function of VRC01 concentration. We also compared fixed dosing vs. body weight-based dosing via simulations.

FINDINGS

Estimated VRC01 concentrations in VRC01 recipients without HIV-1 were higher than those in VRC01 recipients who acquired HIV-1. Body weight was inversely associated with HIV-1 acquisition among both placebo and VRC01 recipients but did not modify the prevention efficacy of VRC01. VRC01 concentration was inversely correlated with HIV-1 acquisition, and positively correlated with prevention efficacy of VRC01. Simulation studies suggest that fixed dosing may be comparable to weight-based dosing in overall predicted prevention efficacy.

INTERPRETATION

These findings suggest that bnAb serum concentration may be a useful marker for dosing regimen selection, and operationally efficient fixed dosing regimens could be considered for future trials of HIV-1 bnAbs.

FUNDING

Was provided by the National Institutes of Health, National Institute of Allergy and Infectious Diseases (NIAID) (UM1 AI068614, to the HIV Vaccine Trials Network [HVTN]; UM1 AI068635, to the HVTN Statistical Data and Management Center [SDMC], Fred Hutchinson Cancer Center [FHCC]; 2R37 054165 to the FHCC; UM1 AI068618, to HVTN Laboratory Center, FHCC; UM1 AI068619, to the HPTN Leadership and Operations Center; UM1 AI068613, to the HIV Prevention Trials Network [HPTN] Laboratory Center; UM1 AI068617, to the HPTN SDMC; and P30 AI027757, to the Center for AIDS Research, Duke University (AI P30 AI064518) and University of Washington (P30 AI027757) Centers for AIDS Research; R37AI054165 from NIAID to the FHCC; and OPP1032144 CA-VIMC Bill & Melinda Gates Foundation.

Examining protective effects of SARS-CoV-2 neutralizing antibodies after vaccination or monoclonal antibody administration

While new vaccines for SARS-CoV-2 are authorized based on neutralizing antibody (nAb) titer against emerging variants of concern, an analogous pathway does not exist for preventative monoclonal antibodies. In this work, nAb titers were assessed as correlates of protection against COVID-19 in the casirivimab + imdevimab monoclonal antibody (mAb) prevention trial (ClinicalTrials.gov #NCT4452318) and in the mRNA-1273 vaccine trial (ClinicalTrials.gov #NCT04470427). In the mAb trial, protective efficacy of 92% (95% confidence interval (CI): 84%, 98%) is associated with a nAb titer of 1000 IU50/ml, with lower efficacy at lower nAb titers. In the vaccine trial, protective efficacies of 93% [95% CI: 91%, 95%] and 97% (95% CI: 95%, 98%) are associated with nAb titers of 100 and 1000 IU50/ml, respectively. These data quantitate a nAb titer correlate of protection for mAbs benchmarked alongside vaccine induced nAb titers and support nAb titer as a surrogate endpoint for authorizing new mAbs.

Robust joint modelling of left-censored longitudinal data and survival data with application to HIV vaccine studies

In jointly modelling longitudinal and survival data, the longitudinal data may be complex in the sense that they may contain outliers and may be left censored. Motivated from an HIV vaccine study, we propose a robust method for joint models of longitudinal and survival data, where the outliers in longitudinal data are addressed using a multivariate t-distribution for b-outliers and using an M-estimator for e-outliers. We also propose a computationally efficient method for approximate likelihood inference. The proposed method is evaluated by simulation studies. Based on the proposed models and method, we analyze the HIV vaccine data and find a strong association between longitudinal biomarkers and the risk of HIV infection.

Neutralization profiles of HIV-1 viruses from the VRC01 Antibody Mediated Prevention (AMP) trials

The VRC01 Antibody Mediated Prevention (AMP) efficacy trials conducted between 2016 and 2020 showed for the first time that passively administered broadly neutralizing antibodies (bnAbs) could prevent HIV-1 acquisition against bnAb-sensitive viruses. HIV-1 viruses isolated from AMP participants who acquired infection during the study in the sub-Saharan African (HVTN 703/HPTN 081) and the Americas/European (HVTN 704/HPTN 085) trials represent a panel of currently circulating strains of HIV-1 and offer a unique opportunity to investigate the sensitivity of the virus to broadly neutralizing antibodies (bnAbs) being considered for clinical development. Pseudoviruses were constructed using envelope sequences from 218 individuals. The majority of viruses identified were clade B and C; with clades A, D, F and G and recombinants AC and BF detected at lower frequencies. We tested eight bnAbs in clinical development (VRC01, VRC07-523LS, 3BNC117, CAP256.25, PGDM1400, PGT121, 10-1074 and 10E8v4) for neutralization against all AMP placebo viruses (n = 76). Compared to older clade C viruses (1998-2010), the HVTN703/HPTN081 clade C viruses showed increased resistance to VRC07-523LS and CAP256.25. At a concentration of 1μg/ml (IC80), predictive modeling identified the triple combination of V3/V2-glycan/CD4bs-targeting bnAbs (10-1074/PGDM1400/VRC07-523LS) as the best against clade C viruses and a combination of MPER/V3/CD4bs-targeting bnAbs (10E8v4/10-1074/VRC07-523LS) as the best against clade B viruses, due to low coverage of V2-glycan directed bnAbs against clade B viruses. Overall, the AMP placebo viruses represent a valuable resource for defining the sensitivity of contemporaneous circulating viral strains to bnAbs and highlight the need to update reference panels regularly. Our data also suggests that combining bnAbs in passive immunization trials would improve coverage of global viruses.

Analysis of the Cox Model with Longitudinal Covariates with Measurement Errors and Partly Interval Censored Failure Times, with Application to an AIDS Clinical Trial

Time-dependent covariates are often measured intermittently and with measurement errors. Motivated by the AIDS Clinical Trials Group (ACTG) 175 trial, this paper develops statistical inferences for the Cox model for partly interval censored failure times and longitudinal covariates with measurement errors. The conditional score methods developed for the Cox model with measurement errors and right censored data are no longer applicable to interval censored data. Assuming an additive measurement error model for a longitudinal covariate, we propose a nonparametric maximum likelihood estimation approach by deriving the measurement error induced hazard model that shows the attenuating effect of using the plug-in estimate for the true underlying longitudinal covariate. An EM algorithm is devised to facilitate maximum likelihood estimation that accounts for the partly interval censored failure times. The proposed methods can accommodate different numbers of replicates for different individuals and at different times. Simulation studies show that the proposed methods perform well with satisfactory finite-sample performances and that the naive methods ignoring measurement error or using the plug-in estimate can yield large biases. A hypothesis testing procedure for the measurement error model is proposed. The proposed methods are applied to the ACTG 175 trial to assess the associations of treatment arm and time-dependent CD4 cell count on the composite clinical endpoint of AIDS or death.

Supplementary Information

The online version contains supplementary material available at 10.1007/s12561-023-09372-y.

Comparing antibody assays as correlates of protection against COVID-19 in the COVE mRNA-1273 vaccine efficacy trial

The best assay or marker to define mRNA-1273 vaccine-induced antibodies as a correlate of protection (CoP) is unclear. In the COVE trial, participants received two doses of the mRNA-1273 COVID-19 vaccine or placebo. We previously assessed IgG binding antibodies to the spike protein (spike IgG) or receptor binding domain (RBD IgG) and pseudovirus neutralizing antibody 50 or 80% inhibitory dilution titer measured on day 29 or day 57, as correlates of risk (CoRs) and CoPs against symptomatic COVID-19 over 4 months after dose. Here, we assessed a new marker, live virus 50% microneutralization titer (LV-MN50), and compared and combined markers in multivariable analyses. LV-MN50 was an inverse CoR, with a hazard ratio of 0.39 (95% confidence interval, 0.19 to 0.83) at day 29 and 0.51 (95% confidence interval, 0.25 to 1.04) at day 57 per 10-fold increase. In multivariable analyses, pseudovirus neutralization titers and anti-spike binding antibodies performed best as CoRs; combining antibody markers did not improve correlates. Pseudovirus neutralization titer was the strongest independent correlate in a multivariable model. Overall, these results supported pseudovirus neutralizing and binding antibody assays as CoRs and CoPs, with the live virus assay as a weaker correlate in this sample set. Day 29 markers performed as well as day 57 markers as CoPs, which could accelerate immunogenicity and immunobridging studies.

Immune correlates analysis of a phase 3 trial of the AZD1222 (ChAdOx1 nCoV-19) vaccine

In the phase 3 trial of the AZD1222 (ChAdOx1 nCoV-19) vaccine conducted in the U.S., Chile, and Peru, anti-spike binding IgG concentration (spike IgG) and pseudovirus 50% neutralizing antibody titer (nAb ID50) measured four weeks after two doses were assessed as correlates of risk and protection against PCR-confirmed symptomatic SARS-CoV-2 infection (COVID-19). These analyses of SARS-CoV-2 negative participants were based on case-cohort sampling of vaccine recipients (33 COVID-19 cases by 4 months post dose two, 463 non-cases). The adjusted hazard ratio of COVID-19 was 0.32 (95% CI: 0.14, 0.76) per 10-fold increase in spike IgG concentration and 0.28 (0.10, 0.77) per 10-fold increase in nAb ID50 titer. At nAb ID50 below the limit of detection (< 2.612 IU50/ml), 10, 100, and 270 IU50/ml, vaccine efficacy was -5.8% (-651%, 75.6%), 64.9% (56.4%, 86.9%), 90.0% (55.8%, 97.6%) and 94.2% (69.4%, 99.1%). These findings provide further evidence towards defining an immune marker correlate of protection to help guide regulatory/approval decisions for COVID-19 vaccines.

Threshold protective levels of serum IgG to Shigella lipopolysaccharide: re-analysis of Shigella vaccine trials data

OBJECTIVES

Establishing a correlate of protection is essential for the development and licensure of Shigella vaccines. We examined potential threshold levels of serum IgG to Shigella lipopolysaccharide (LPS) that could predict protection against shigellosis.

METHODS

We performed new analyses of serologic and vaccine efficacy (VE) data from two randomized vaccine-controlled trials of the Shigella sonnei-Pseudomonas aeruginosa recombinant exoprotein A (rEPA) conjugate conducted in young adults and children aged 1-4 years in Israel. Adults received either S. sonnei-rEPA (n = 183) or control vaccines (n = 277). Children received the S. sonnei-rEPA conjugate (n = 1384) or S. flexneri 2a-rEPA conjugate (n = 1315). VE against culture-proven shigellosis was determined. Sera were tested for IgG anti-S. sonnei LPS antibodies. We assessed the association of various levels of IgG anti-S. sonnei LPS antibodies with S. sonnei shigellosis risk using logistic regression models and the reverse cumulative distribution of IgG levels.

RESULTS

Among adults, four vaccinees and 23 controls developed S. sonnei shigellosis; the VE was 74% (95% CI, 28-100%). A threshold of ≥1:1600 IgG anti-S. sonnei LPS titre was associated with a reduced risk of S. sonnei shigellosis and a predicted VE of 73.6% (95% CI, 65-80%). The IgG anti-S. sonnei LPS correlated with serum bactericidal titres. In children, a population-based level of 4.5 ELISA Units (EU) corresponding to 1:1072 titre, predicted VE of 63%, versus 71% observed VE in children aged 3-4 years. The predicted VE in children aged 2-4 years was 49%, consistent with the 52% observed VE.

CONCLUSION

Serum IgG anti-S. sonnei LPS threshold levels can predict the degree of VE and can be used for the evaluation of new vaccine candidates.

Estimation of conditional cumulative incidence functions under generalized semiparametric regression models with missing covariates, with application to analysis of biomarker correlates in vaccine trials

This article studies generalized semiparametric regression models for conditional cumulative incidence functions with competing risks data when covariates are missing by sampling design or happenstance. A doubly-robust augmented inverse probability weighted complete-case (AIPW) approach to estimation and inference is investigated. This approach modifies IPW complete-case estimating equations by exploiting the key features in the relationship between the missing covariates and the phase-one data to improve efficiency. An iterative numerical procedure is derived to solve the nonlinear estimating equations. The asymptotic properties of the proposed estimators are established. A simulation study examining the finite-sample performances of the proposed estimators shows that the AIPW estimators are more efficient than the IPW estimators. The developed method is applied to the RV144 HIV-1 vaccine efficacy trial to investigate vaccine-induced IgG binding antibodies to HIV-1 as correlates of acquisition of HIV-1 infection while taking account of whether the HIV-1 sequences are near or far from the HIV-1 sequences represented in the vaccine construct.

Trivalent mosaic or consensus HIV immunogens prime humoral and broader cellular immune responses in adults

BACKGROUNDMosaic and consensus HIV-1 immunogens provide two distinct approaches to elicit greater breadth of coverage against globally circulating HIV-1 and have shown improved immunologic breadth in nonhuman primate models.METHODSThis double-blind randomized trial enrolled 105 healthy HIV-uninfected adults who received 3 doses of either a trivalent global mosaic, a group M consensus (CON-S), or a natural clade B (Nat-B) gp160 env DNA vaccine followed by 2 doses of a heterologous modified vaccinia Ankara-vectored HIV-1 vaccine or placebo. We performed prespecified blinded immunogenicity analyses at day 70 and day 238 after the first immunization. T cell responses to vaccine antigens and 5 heterologous Env variants were fully mapped.RESULTSEnv-specific CD4+ T cell responses were induced in 71% of the mosaic vaccine recipients versus 48% of the CON-S recipients and 48% of the natural Env recipients. The mean number of T cell epitopes recognized was 2.5 (95% CI, 1.2-4.2) for mosaic recipients, 1.6 (95% CI, 0.82-2.6) for CON-S recipients, and 1.1 (95% CI, 0.62-1.71) for Nat-B recipients. Mean breadth was significantly greater in the mosaic group than in the Nat-B group using overall (P = 0.014), prime-matched (P = 0.002), heterologous (P = 0.046), and boost-matched (P = 0.009) measures. Overall T cell breadth was largely due to Env-specific CD4+ T cell responses.CONCLUSIONPriming with a mosaic antigen significantly increased the number of epitopes recognized by Env-specific T cells and enabled more, albeit still limited, cross-recognition of heterologous variants. Mosaic and consensus immunogens are promising approaches to address global diversity of HIV-1.TRIAL REGISTRATIONClinicalTrials.gov NCT02296541.FUNDINGUS NIH grants UM1 AI068614, UM1 AI068635, UM1 AI068618, UM1 AI069412, UL1 RR025758, P30 AI064518, UM1 AI100645, and UM1 AI144371, and Bill & Melinda Gates Foundation grant OPP52282.

Correlates of Protection, Thresholds of Protection, and Immunobridging among Persons with SARS-CoV-2 Infection

Several studies have shown that neutralizing antibody levels correlate with immune protection from COVID-19 and have estimated the relationship between neutralizing antibodies and protection. However, results of these studies vary in terms of estimates of the level of neutralizing antibodies required for protection. By normalizing antibody titers, we found that study results converge on a consistent relationship between antibody levels and protection from COVID-19. This finding can be useful for planning future vaccine use, determining population immunity, and reducing the global effects of the COVID-19 pandemic.

Immune correlates analysis of the PREVENT-19 COVID-19 vaccine efficacy clinical trial

In the PREVENT-19 phase 3 trial of the NVX-CoV2373 vaccine (NCT04611802), anti-spike binding IgG concentration (spike IgG), anti-RBD binding IgG concentration (RBD IgG), and pseudovirus 50% neutralizing antibody titer (nAb ID50) measured two weeks post-dose two are assessed as correlates of risk and as correlates of protection against COVID-19. Analyses are conducted in the U.S. cohort of baseline SARS-CoV-2 negative per-protocol participants using a case-cohort design that measures the markers from all 12 vaccine recipient breakthrough COVID-19 cases starting 7 days post antibody measurement and from 639 vaccine recipient non-cases. All markers are inversely associated with COVID-19 risk and directly associated with vaccine efficacy. In vaccine recipients with nAb ID50 titers of 50, 100, and 7230 international units (IU50)/ml, vaccine efficacy estimates are 75.7% (49.8%, 93.2%), 81.7% (66.3%, 93.2%), and 96.8% (88.3%, 99.3%). The results support potential cross-vaccine platform applications of these markers for guiding decisions about vaccine approval and use.

Antibody Correlates of Protection From Severe Respiratory Syncytial Virus Disease in a Vaccine Efficacy Trial

Background

Respiratory syncytial virus (RSV) can cause serious lung infections in young children and there is currently no available vaccine.

Methods

We used complementary statistical frameworks to analyze 4 RSV serology measurements in mothers and their infants in South Africa who participated in a phase 3 maternal immunization trial of an RSV F protein nanoparticle vaccine as correlates of risk and of protection against different RSV disease endpoints.

Results

We found evidence to support each antibody measurement-encompassing RSV-neutralizing antibodies and F surface glycoprotein-binding antibodies-as an inverse correlate of risk of RSV-associated acute lower respiratory tract infection with severe hypoxia in at least 1 framework, with vaccine-induced fold-rise from the maternal enrollment to day 14 samples of anti-F immunoglobulin G (IgG) binding antibodies having the most consistent evidence. This evidence includes a significant association of fold-rise anti-F IgG with vaccine efficacy (VE); achieving a baseline covariate-adjusted VE of 75% requires a vaccine-induced maternal anti-F IgG fold-rise of around 16. Neither multivariable logistic regression nor superlearning analyses showed benefit to including multiple time points or assays in the same model, suggesting a parsimonious correlate. Post hoc exploratory analyses supported adherence of vaccine-induced maternal anti-F IgG fold-rise to the Prentice criteria for a valid surrogate endpoint.

Conclusions

Our results suggest that the vaccine induced protective anti-F antibody responses. If this finding is confirmed, VE could potentially be augmented by increasing these responses.

Prediction of serum HIV-1 neutralization titers of VRC01 in HIV-uninfected Antibody Mediated Prevention (AMP) trial participants

VRC01 is being evaluated in the AMP efficacy trials, the first assessment of a passively administered broadly neutralizing monoclonal antibody (bnAb) for HIV-1 prevention. A key analysis will assess serum VRC01-mediated neutralization as a potential correlate of protection. To prepare for this analysis, we conducted a pilot study where we measured longitudinal VRC01 serum concentrations and serum VRC01-mediated neutralization in 47 and 31 HIV-1 uninfected AMP participants, respectively. We applied four different statistical approaches to predict serum VRC01-mediated neutralization titer against Env-pseudotyped viruses, including breakthrough viruses isolated from AMP placebo recipients who became HIV-1 infected during the trial, using VRC01 serum concentration and neutralization potency (IC50 or IC80) of the VRC01 clinical lot against the same virus. Approaches 3 and 4, which utilized pharmacokinetics/pharmacodynamics joint modeling of concentration and neutralization titer, generally performed the best or comparably to Approaches 1 and 2, which, respectively, utilized only measured and model-predicted concentration. For prediction of ID80 titers against breakthrough viruses, Approaches 1 and 2 rendered comparable performance to Approaches 3 and 4, and could be reasonable approaches to adopt in practice as they entail reduced assay cost and less complicated statistical analysis. Our results may be applied to future studies of other bnAbs and bnAb combinations to maximize resource efficiency in serum neutralization titer measurement.

Immune correlates analysis of the ENSEMBLE single Ad26.COV2.S dose vaccine efficacy clinical trial

Measuring immune correlates of disease acquisition and protection in the context of a clinical trial is a prerequisite for improved vaccine design. We analysed binding and neutralizing antibody measurements 4 weeks post vaccination as correlates of risk of moderate to severe-critical COVID-19 through 83 d post vaccination in the phase 3, double-blind placebo-controlled phase of ENSEMBLE, an international randomized efficacy trial of a single dose of Ad26.COV2.S. We also evaluated correlates of protection in the trial cohort. Of the three antibody immune markers we measured, we found most support for 50% inhibitory dilution (ID50) neutralizing antibody titre as a correlate of risk and of protection. The outcome hazard ratio was 0.49 (95% confidence interval 0.29, 0.81; P = 0.006) per 10-fold increase in ID50; vaccine efficacy was 60% (43%, 72%) at non-quantifiable ID50 (<2.7 IU50 ml-1) and increased to 89% (78%, 96%) at ID50 = 96.3 IU50 ml-1. Comparison of the vaccine efficacy by ID50 titre curves for ENSEMBLE-US, the COVE trial of the mRNA-1273 vaccine and the COV002-UK trial of the AZD1222 vaccine supported the ID50 titre as a correlate of protection across trials and vaccine types.

Rapidly identifying new coronavirus mutations of potential concern in the Omicron variant using an unsupervised learning strategy

Extensive mutations in the Omicron spike protein appear to accelerate the transmission of SARS-CoV-2, and rapid infections increase the odds that additional mutants will emerge. To build an investigative framework, we have applied an unsupervised machine learning approach to 4296 Omicron viral genomes collected and deposited to GISAID as of December 14, 2021, and have identified a core haplotype of 28 polymutants (A67V, T95I, G339D, R346K, S371L, S373P, S375F, K417N, N440K, G446S, S477N, T478K, E484A, Q493R, G496S, Q498R, N501Y, Y505H, T547K, D614G, H655Y, N679K, P681H, N764K, K796Y, N856K, Q954H, N69K, L981F) in the spike protein and a separate core haplotype of 17 polymutants in non-spike genes: (K38, A1892) in nsp3, T492 in nsp4, (P132, V247, T280, S284) in 3C-like proteinase, I189 in nsp6, P323 in RNA-dependent RNA polymerase, I42 in Exonuclease, T9 in envelope protein, (D3, Q19, A63) in membrane glycoprotein, and (P13, R203, G204) in nucleocapsid phosphoprotein. Using these core haplotypes as reference, we have identified four newly emerging polymutants (R346, A701, I1081, N1192) in the spike protein (p value = 9.37*10-4, 1.0*10-15, 4.76*10-7 and 1.56*10-4, respectively), and five additional polymutants in non-spike genes (D343G in nucleocapsid phosphoprotein, V1069I in nsp3, V94A in nsp4, F694Y in the RNA-dependent RNA polymerase and L106L/F of ORF3a) that exhibit significant increasing trajectories (all p values < 1.0*10-15). In the absence of relevant clinical data for these newly emerging mutations, it is important to monitor them closely. Two emerging mutations may be of particular concern: the N1192S mutation in spike protein locates in an extremely highly conserved region of all human coronaviruses that is integral to the viral fusion process, and the F694Y mutation in the RNA polymerase may induce conformational changes that could impact remdesivir binding.

Neutralizing antibody correlates of sequence specific dengue disease in a tetravalent dengue vaccine efficacy trial in Asia

In the CYD14 trial of the CYD-TDV dengue vaccine in 2-14 year-olds, neutralizing antibody (nAb) titers to the vaccine-insert dengue strains correlated inversely with symptomatic, virologically-confirmed dengue (VCD). Also, vaccine efficacy against VCD was higher against dengue prM/E amino acid sequences closer to the vaccine inserts. We integrated the nAb and sequence data types by assessing nAb titers as a correlate of sequence-specific VCD separately in the vaccine arm and in the placebo arm. In both vaccine and placebo recipients the correlation of nAb titer with sequence-specific VCD was stronger for dengue nAb contact site sequences closer to the vaccine (p = 0.005 and p = 0.012, respectively). The risk of VCD in vaccine (placebo) recipients was 6.7- (1.80)-fold lower at the 90th vs 10th percentile of nAb for viruses perfectly matched to CYD-TDV, compared to 2.1- (0.78)-fold lower at the 90th vs 10th percentile for viruses with five amino acid mismatches. The evidence for a stronger sequence-distance dependent correlate of risk for the vaccine arm indicates departure from the Prentice criteria for a valid sequence-distance specific surrogate endpoint and suggests that the nAb marker may affect dengue risk differently depending on whether nAbs arise from infection or also by vaccination. However, when restricting to baseline-seropositive 9-14 year-olds, the correlation pattern became more similar between the vaccine and placebo arms, supporting nAb titers as an approximate surrogate endpoint in this population. No sequence-specific nAb titer correlates of VCD were seen in baseline-seronegative participants. Integrated immune response/pathogen sequence data correlates analyses could help increase knowledge of correlates of risk and surrogate endpoints for other vaccines against genetically diverse pathogens. Trial registration: EU Clinical Trials Register 2014-001708-24; registration date 2014-05-26.

Neutralization titer biomarker for antibody-mediated prevention of HIV-1 acquisition

The Antibody Mediated Prevention trials showed that the broadly neutralizing antibody (bnAb) VRC01 prevented acquisition of human immunodeficiency virus-1 (HIV-1) sensitive to VRC01. Using AMP trial data, here we show that the predicted serum neutralization 80% inhibitory dilution titer (PT80) biomarker-which quantifies the neutralization potency of antibodies in an individual's serum against an HIV-1 isolate-can be used to predict HIV-1 prevention efficacy. Similar to the results of nonhuman primate studies, an average PT80 of 200 (meaning a bnAb concentration 200-fold higher than that required to reduce infection by 80% in vitro) against a population of probable exposing viruses was estimated to be required for 90% prevention efficacy against acquisition of these viruses. Based on this result, we suggest that the goal of sustained PT80 <200 against 90% of circulating viruses can be achieved by promising bnAb regimens engineered for long half-lives. We propose the PT80 biomarker as a surrogate endpoint for evaluatinon of bnAb regimens, and as a tool for benchmarking candidate bnAb-inducing vaccines.

Analysis of the HIV Vaccine Trials Network 702 Phase 2b-3 HIV-1 Vaccine Trial in South Africa Assessing RV144 Antibody and T-Cell Correlates of HIV-1 Acquisition Risk

BACKGROUND

The ALVAC/gp120 + MF59 vaccines in the HIV Vaccine Trials Network (HVTN) 702 efficacy trial did not prevent human immunodeficiency virus-1 (HIV-1) acquisition. Vaccine-matched immunological endpoints that were correlates of HIV-1 acquisition risk in RV144 were measured in HVTN 702 and evaluated as correlates of HIV-1 acquisition.

METHODS

Among 1893 HVTN 702 female vaccinees, 60 HIV-1-seropositive cases and 60 matched seronegative noncases were sampled. HIV-specific CD4+ T-cell and binding antibody responses were measured 2 weeks after fourth and fifth immunizations. Cox proportional hazards models assessed prespecified responses as predictors of HIV-1 acquisition.

RESULTS

The HVTN 702 Env-specific CD4+ T-cell response rate was significantly higher than in RV144 (63% vs 40%, P = .03) with significantly lower IgG binding antibody response rate and magnitude to 1086.C V1V2 (67% vs 100%, P < .001; Pmag < .001). Although no significant univariate associations were observed between any T-cell or binding antibody response and HIV-1 acquisition, significant interactions were observed (multiplicity-adjusted P ≤.03). Among vaccinees with high IgG A244 V1V2 binding antibody responses, vaccine-matched CD4+ T-cell endpoints associated with decreased HIV-1 acquisition (estimated hazard ratios = 0.40-0.49 per 1-SD increase in CD4+ T-cell endpoint).

CONCLUSIONS

HVTN 702 and RV144 had distinct immunogenicity profiles. However, both identified significant correlations (univariate or interaction) for IgG V1V2 and polyfunctional CD4+ T cells with HIV-1 acquisition. Clinical Trials Registration . NCT02968849.

Methodology for a correlate of protection for group B Streptococcus: Report from the Bill & Melinda Gates Foundation workshop held on 10 and 11 February 2021

Worldwide, childhood mortality has declined significantly, with improvements in hygiene and vaccinations against common childhood illnesses, yet newborn mortality remains high. Group B Streptococcus (GBS) disease significantly contributes to newborn mortality and is the leading cause of meningitis in infants. Many years of research have demonstrated the potential for maternal vaccination against GBS to confer protection to the infant, and at least three vaccine candidates are currently undergoing clinical trials. Given the relatively low disease incidence, any clinical vaccine efficacy study would need to include at least 40,000 to 60,000 participants. Therefore, a path to vaccine licensure based on a correlate of protection (CoP) would be the preferred route, with post-approval effectiveness studies demonstrating vaccine impact on reduction of disease burden likely to be required as part of conditional marketing approval. This workshop, hosted by the Bill & Melinda Gates Foundation on 10 and 11 February 2021, discussed considerations and potential statistical methodologies for establishing a CoP for GBS disease. Consensus was reached that an antibody marker with global threshold predictive of a high level of vaccine protection would be most beneficial for licensure assessments. IgG binding antibody in cord blood would likely serve as the CoP, with additional studies needed to confirm a high correlation with functional antibody and to demonstrate comparable kinetics of natural versus vaccine-induced antibody. Common analyses of ongoing seroepidemiological studies include estimation of absolute and relative disease risk as a function of infant antibody concentration, with adjustment for confounders of the impact of antibody concentration on infant GBS disease including gestational age and maternal age. Estimation of an antibody concentration threshold indicative of high protection should build in margin for uncertainties from sources including unmeasured confounders, imperfect causal mediation, and variability in point and confidence interval estimates across regions and/or serotypes.

A controlled effects approach to assessing immune correlates of protection

An immune correlate of risk (CoR) is an immunologic biomarker in vaccine recipients associated with an infectious disease clinical endpoint. An immune correlate of protection (CoP) is a CoR that can be used to reliably predict vaccine efficacy (VE) against the clinical endpoint and hence is accepted as a surrogate endpoint that can be used for accelerated approval or guide use of vaccines. In randomized, placebo-controlled trials, CoR analysis is limited by not assessing a causal vaccine effect. To address this limitation, we construct the controlled risk curve of a biomarker, which provides the causal risk of an endpoint if all participants are assigned vaccine and the biomarker is set to different levels. Furthermore, we propose a causal CoP analysis based on controlled effects, where for the important special case that the biomarker is constant in the placebo arm, we study the controlled vaccine efficacy curve that contrasts the controlled risk curve with placebo arm risk. We provide identification conditions and formulae that account for right censoring of the clinical endpoint and two-phase sampling of the biomarker, and consider G-computation estimation and inference under a semiparametric model such as the Cox model. We add modular approaches to sensitivity analysis that quantify robustness of CoP evidence to unmeasured confounding. We provide an application to two phase 3 trials of a dengue vaccine indicating that controlled risk of dengue strongly varies with 50$\%$ neutralizing antibody titer. Our work introduces controlled effects causal mediation analysis to immune CoP evaluation.

HLA-B∗46 associates with rapid HIV disease progression in Asian cohorts and prominent differences in NK cell phenotype

Human leukocyte antigen (HLA) alleles have been linked to HIV disease progression and attributed to differences in cytotoxic T lymphocyte (CTL) epitope representation. These findings are largely based on treatment-naive individuals of European and African ancestry. We assessed HLA associations with HIV-1 outcomes in 1,318 individuals from Thailand and found HLA-B∗46:01 (B∗46) associated with accelerated disease in three independent cohorts. B∗46 had no detectable effect on HIV-specific T cell responses, but this allele is unusual in containing an HLA-C epitope that binds inhibitory receptors on natural killer (NK) cells. Unbiased transcriptomic screens showed increased NK cell activation in people with HIV, without B∗46, and simultaneous single-cell profiling of surface proteins and transcriptomes revealed a NK cell subset primed for increased responses in the absence of B∗46. These findings support a role for NK cells in HIV pathogenesis, revealed by the unique properties of the B∗46 allele common only in Asia.

Nonparametric estimation of the causal effect of a stochastic threshold-based intervention

Identifying a biomarker or treatment-dose threshold that marks a specified level of risk is an important problem, especially in clinical trials. In view of this goal, we consider a covariate-adjusted threshold-based interventional estimand, which happens to equal the binary treatment-specific mean estimand from the causal inference literature obtained by dichotomizing the continuous biomarker or treatment as above or below a threshold. The unadjusted version of this estimand was considered in Donovan et al.. Expanding upon Stitelman et al., we show that this estimand, under conditions, identifies the expected outcome of a stochastic intervention that sets the treatment dose of all participants above the threshold. We propose a novel nonparametric efficient estimator for the covariate-adjusted threshold-response function for the case of informative outcome missingness, which utilizes machine learning and targeted minimum-loss estimation (TMLE). We prove the estimator is efficient and characterize its asymptotic distribution and robustness properties. Construction of simultaneous 95% confidence bands for the threshold-specific estimand across a set of thresholds is discussed. In the Supporting Information, we discuss how to adjust our estimator when the biomarker is missing at random, as occurs in clinical trials with biased sampling designs, using inverse probability weighting. Efficiency and bias reduction of the proposed estimator are assessed in simulations. The methods are employed to estimate neutralizing antibody thresholds for virologically confirmed dengue risk in the CYD14 and CYD15 dengue vaccine trials.

Immune Correlates Analysis of a Single Ad26.COV2.S Dose in the ENSEMBLE COVID-19 Vaccine Efficacy Clinical Trial

Anti-spike IgG binding antibody, anti-receptor binding domain IgG antibody, and pseudovirus neutralizing antibody measurements four weeks post-vaccination were assessed as correlates of risk of moderate to severe-critical COVID-19 outcomes through 83 days post-vaccination and as correlates of protection following a single dose of Ad26.COV2.S COVID-19 vaccine in the placebo-controlled phase of ENSEMBLE, an international, randomized efficacy trial. Each marker had evidence as a correlate of risk and of protection, with strongest evidence for 50% inhibitory dilution (ID50) neutralizing antibody titer. The outcome hazard ratio was 0.49 (95% confidence interval 0.29, 0.81; p=0.006) per 10-fold increase in ID50; vaccine efficacy was 60% (43, 72%) at nonquantifiable ID50 (< 2.7 IU50/ml) and rose to 89% (78, 96%) at ID50 = 96.3 IU50/ml. Comparison of the vaccine efficacy by ID50 titer curves for ENSEMBLE-US, the COVE trial of the mRNA-1273 vaccine, and the COV002-UK trial of the AZD1222 vaccine supported consistency of the ID50 titer correlate of protection across trials and vaccine types.

Optimizing clinical dosing of combination broadly neutralizing antibodies for HIV prevention

Broadly neutralizing antibodies (bNAbs) are promising agents to prevent HIV infection and achieve HIV remission without antiretroviral therapy (ART). As with ART, bNAb combinations are likely needed to cover HIV's extensive diversity. Not all bNAbs are identical in terms of their breadth, potency, and in vivo longevity (half-life). Given these differences, it is important to optimally select the composition, or dose ratio, of combination bNAb therapies for future clinical studies. We developed a model that synthesizes 1) pharmacokinetics, 2) potency against a wide HIV diversity, 3) interaction models for how drugs work together, and 4) correlates that translate in vitro potency to clinical protection. We found optimization requires drug-specific balances between potency, longevity, and interaction type. As an example, tradeoffs between longevity and potency are shown by comparing a combination therapy to a bi-specific antibody (a single protein merging both bNAbs) that takes the better potency but the worse longevity of the two components. Then, we illustrate a realistic dose ratio optimization of a triple combination of VRC07, 3BNC117, and 10-1074 bNAbs. We apply protection estimates derived from both a non-human primate (NHP) challenge study meta-analysis and the human antibody mediated prevention (AMP) trials. In both cases, we find a 2:1:1 dose emphasizing VRC07 is nearly optimal. Our approach can be immediately applied to optimize the next generation of combination antibody prevention and cure studies.

Innovative vaccine approaches-a Keystone Symposia report

The rapid development of COVID-19 vaccines was the result of decades of research to establish flexible vaccine platforms and understand pathogens with pandemic potential, as well as several novel changes to the vaccine discovery and development processes that partnered industry and governments. And while vaccines offer the potential to drastically improve global health, low-and-middle-income countries around the world often experience reduced access to vaccines and reduced vaccine efficacy. Addressing these issues will require novel vaccine approaches and platforms, deeper insight how vaccines mediate protection, and innovative trial designs and models. On June 28-30, 2021, experts in vaccine research, development, manufacturing, and deployment met virtually for the Keystone eSymposium "Innovative Vaccine Approaches" to discuss advances in vaccine research and development.

Immune correlates analysis of the mRNA-1273 COVID-19 vaccine efficacy clinical trial

In the coronavirus efficacy (COVE) phase 3 clinical trial, vaccine recipients were assessed for neutralizing and binding antibodies as correlates of risk for COVID-19 disease and as correlates of protection. These immune markers were measured at the time of second vaccination and 4 weeks later, with values reported in standardized World Health Organization international units. All markers were inversely associated with COVID-19 risk and directly associated with vaccine efficacy. Vaccine recipients with postvaccination 50% neutralization titers 10, 100, and 1000 had estimated vaccine efficacies of 78% (95% confidence interval, 54 to 89%), 91% (87 to 94%), and 96% (94 to 98%), respectively. These results help define immune marker correlates of protection and may guide approval decisions for messenger RNA (mRNA) COVID-19 vaccines and other COVID-19 vaccines.