Interlaboratory reproducibility of female genital tract cytokine measurements by Luminex: implications for microbicide safety studies

Considerations for Choosing Soluble Immune Markers to Determine Safety of Novel Vaginal Products

Several soluble cytokines have been associated with microbicide-induced cervicovaginal inflammation, non-optimal vaginal microbiota, and risk of HIV acquisition. Many of these biomarkers are used in preclinical assays to estimate the safety of vaginally applied products. However, there are currently no validated biomarkers to evaluate the safety of novel vaginal products in clinical trials. This hinders the rapid and rational selection of novel products being tested in first-in-human trials. We reviewed available literature to assess how best to select and measure soluble immune markers to determine product safety in first in human clinical trials of novel vaginal products.

Longitudinal Assessment of Systemic and Genital Tract Inflammatory Markers and Endogenous Genital Tract E. coli Inhibitory Activity in HIV-Infected and Uninfected Women

PROBLEM

Stability over time of systemic and mucosal immunity and their associations with bacterial vaginosis (BV) and HIV-specific parameters were assessed.

METHOD OF STUDY

Immune mediators and HIV viral load in plasma and cervicovaginal lavage (CVL), E. coli inhibition, and Nugent score were measured at three semiannual visits among 94 participants in the Women's Interagency HIV Study. Mixed models identified the factors associated with immune mediators.

RESULTS

There was higher E. coli inhibition and lower inflammation over time in the genital tract and systemically. BV was consistently associated with higher CVL inflammatory mediators and lower CVL E. coli inhibition. HIV-infected women with higher CD4 counts had lower systemic and genital inflammatory mediators, and genital HIV shedding was associated with higher CVL inflammatory mediators. Use of antiretroviral therapy (ART) was associated with lower plasma and CVL mediators, but higher E. coli inhibition.

CONCLUSION

HIV and BV are linked to inflammation, and ART may be associated with improved vaginal health.

Accurate measurement of female genital tract fluid dilution in cervicovaginal lavage samples

An ion chromatographic method with conductivity detection for the precise and accurate analysis of lithium ions in phosphate-buffered saline, used as a cervicovaginal lavage (CVL) fluid, was developed and validated. The lithium ion dilution factor during the CVL is used to calculate the volume of cervicovaginal fluid (CVF) collected. Initial CVL Li(+) concentrations of 1mM and 10mM were evaluated. The method is robust, practical, and afforded an accurate measurement (5% of the measurement, or better) at 24μL of vaginal fluid simulant collected per mL of CVL fluid, as low as 5μLmL(-1) using 10mM Li(+) with a measurement accuracy of 6.7%. Ion chromatograms of real-world CVL samples collected in vivo from common animal models (sheep and pig-tailed macaque) and a human volunteer demonstrate that the analysis is interference-free. The method is readily transferrable and should enable the accurate measurement of CVF volume collected during CVLs benefitting a broad range of research disciplines, including pharmacokinetic, pharmacodynamic, metabolomic, and microbiome studies.

Diversity of Cervicovaginal Cytokine Response to Incident Chlamydia trachomatis Infection Among a Prospective Cohort of Young Women

PROBLEM

Animal, in vitro, and ex vivo studies have identified several cytokines involved in host immunity to genital Chlamydia trachomatis (CT) infection. However, in vivo cytokine responses are not well described. Our objectives were to document cervicovaginal cytokine levels and intrawoman cytokine changes during incident CT in a prospective cohort.

METHODS

From our prospective cohort, 62 women had incident CT, comprising a CT-negative visit followed by a CT-positive visit. At these visits, cytokine protein levels (IL-6, IL-8, IL-1α, IL-1β, MIP-1α, RANTES, IFN-γ) were measured using cervicovaginal lavages and the MILLIPLEX(™) /Luminex(®) multiplex assay. Quartiles were defined for each cytokine from all 124 visits.

RESULTS

At the group level, RANTES was higher (P < 0.01) at the CT-positive visit than at baseline, but the other cytokines did not significantly differ. For intrawoman cytokine changes, women with a cytokine level that increased at least one quartile higher (going from baseline to the CT-positive visit) ranged between 26 and 53%. Women with a cytokine level staying in the same quartile ranged between 32 and 48%. Women with a cytokine level that decreased at least one quartile lower ranged between 15 and 37%.

CONCLUSION

Intrawoman cervicovaginal cytokine changes during incident CT appear heterogeneous and may reflect differences in natural host immunity.

Systemic cytokine levels show limited correlation with risk of HIV-1 acquisition

It has been hypothesized that immune activation and inflammation may increase HIV-1 susceptibility, and that cytokines may be useful biomarkers for risk. Within a prospective cohort, we conducted a nested case-control analysis of plasma cytokine levels among women who acquired HIV-1 <3 months after sampling, compared with 3 different control groups. We observed associations between lower interleukin (IL)-6 and IL-10 and higher IL-7 levels with HIV-1 acquisition, however, these associations were inconsistent when comparing with different control groups. Inconsistent results within our study and among previous studies suggest that reproducible findings are needed before cytokines are useful biomarkers for HIV-1 susceptibility.

Development and implementation of a proficiency testing program for Luminex bead-based cytokine assays

Luminex bead array assays are widely used for rapid biomarker quantification due to the ability to measure up to 100 unique analytes in a single well of a 96-well plate. There has been, however, no comprehensive analysis of variables impacting assay performance, nor development of a standardized proficiency testing program for laboratories performing these assays. To meet this need, the NIH/NIAID and the Cancer Immunotherapy Consortium of the Cancer Research Institute collaborated to develop and implement a Luminex assay proficiency testing program as part of the NIH/NIAID-sponsored External Quality Assurance Program Oversight Laboratory (EQAPOL) at Duke University. The program currently monitors 25 domestic and international sites with two external proficiency panels per year. Each panel includes a de-identified commercial Luminex assay kit with standards to quantify human IFNγ, TNFα, IL-6, IL-10 and IL-2, and a series of recombinant cytokine-spiked human serum samples. All aspects of panel development, testing and shipping are performed under GCLP by EQAPOL support teams. Following development testing, a comprehensive site proficiency scoring system comprised of timeliness, protocol adherence, accuracy and precision was implemented. The overall mean proficiency score across three rounds of testing has remained stable (EP3: 76%, EP4: 75%, EP5: 77%); however, a more detailed analysis of site reported results indicates a significant improvement of intra- (within) and inter- (between) site variation, suggesting that training and remediation for poor performing sites may be having a positive impact on proficiency. Through continued proficiency testing, identification of variables affecting Luminex assay outcomes will strengthen efforts to bring standardization to the field.

Statistical methods for the assessment of EQAPOL proficiency testing: ELISpot, Luminex, and Flow Cytometry

In September 2011 Duke University was awarded a contract to develop the National Institutes of Health/National Institute of Allergy and Infectious Diseases (NIH/NIAID) External Quality Assurance Program Oversight Laboratory (EQAPOL). Through EQAPOL, proficiency testing programs are administered for Interferon-γ (IFN-γ) Enzyme-linked immunosorbent spot (ELISpot), Intracellular Cytokine Staining Flow Cytometry (ICS) and Luminex-based cytokine assays. One of the charges of the EQAPOL program was to apply statistical methods to determine overall site performance. We utilized various statistical methods for each program to find the most appropriate for assessing laboratory performance using the consensus average as the target value. Accuracy ranges were calculated based on Wald-type confidence intervals, exact Poisson confidence intervals, or via simulations. Given the nature of proficiency testing data, which has repeated measures within donor/sample made across several laboratories; the use of mixed effects models with alpha adjustments for multiple comparisons was also explored. Mixed effects models were found to be the most useful method to assess laboratory performance with respect to accuracy to the consensus. Model based approaches to the proficiency testing data in EQAPOL will continue to be utilized. Mixed effects models also provided a means of performing more complex analyses that would address secondary research questions regarding within and between laboratory variability as well as longitudinal analyses.

In vivo evaluation of safety and toxicity of a Lactobacillus jensenii producing modified cyanovirin-N in a rhesus macaque vaginal challenge model

Sexual transmission of human immunodeficiency virus type 1 (HIV-1) across the cervicovaginal mucosa in women is influenced by many factors including the microbiota and the presence of underlying inflammation. It is important that potential HIV preventative agents do not alter the mucosal environment in a way that enhances HIV acquisition. We examined the impact of a "live" microbicide on the vaginal mucosal environment in a rhesus macaque repeated vaginal simian-HIV (SHIVSF162P3) challenge model. The microbicide contained a human vaginal Lactobacillus jensenii expressing the HIV-1 entry inhibitor, modified Cyanovirin-N (mCV-N), and henceforth called LB-mCV-N. Macaques were colonized vaginally each week with LB-mCV-N and sampled six days after colonization for culturable bacteria, pH and cervical-vaginal cytokines during the duration of the six-week study. We show that macaques that retained the engineered LB-mCV-N strain in their vaginal microbiota, during SHIV challenge, had lower pH, when colonization levels were higher, and had no evidence of inflammatory cytokines. Indeed, Interleukin-13, a mediator of inflammation, was detected less often in LB-mCV-N colonized macaques than in controls and we found higher levels of Interleukin 1 receptor antagonist (IL-1RA) in LB-mCV-N colonized macaques during the SHIV challenge period. We noted an inverse correlation between levels of mucosal IL-1RA and peak plasma viral load, thus higher IL-1RA correlated with lower viral load in LB-mCV-N treated macaques. These data support the use of LB-mCV-N as a safe "live" microbicide and suggest that lactobacilli themselves may positively impact the mucosal environment.

Inflammation biomarkers in vaginal fluid and preterm delivery

STUDY QUESTION

Which inflammation biomarkers detected in the vaginal fluid are most informative for identifying preterm delivery (PTD) risk?

SUMMARY ANSWER

Elevated interleukin (IL)-6 at mid-trimester was associated with increased odds of spontaneous PTD at <35 weeks and with PTD plus histologic chorioamnionitis (HCA), and had the greatest sensitivity for detecting these two PTD subtypes.

WHAT IS KNOWN ALREADY

Maternal and/or fetal inflammation play a role in some preterm deliveries, therefore inflammation biomarkers might help to identify women at greater risk.

STUDY DESIGN, SIZE, DURATION

We examined 1115 women from the Pregnancy Outcomes and Community Health Study, a cohort study conducted from September 1998 through June 2004, for whom data were available on mid-pregnancy inflammatory biomarkers.

PARTICIPANTS/MATERIALS, SETTING, METHODS

At enrollment at 16-27 weeks gestation, vaginal fluid samples were collected from a swab and 15 eluted biomarkers were measured using the Meso Scale Discovery multiplex electrochemiluminescence platform. Associations of biomarkers with PTD were examined, according to clinical circumstance, week at delivery and presence/absence of HCA. Weighted logistic regression was used to determine odds ratios (OR) and 95% confidence intervals (CI) adjusted for race. Sensitivity and specificity were compared between individual and multiple biomarkers, identified by a bootstrapping method.

MAIN RESULTS AND THE ROLE OF CHANCE

Elevated IL-6 (>75th percentile) displayed the strongest association with spontaneous PTD <35 weeks (OR 2.3; CI 1.3-4.0) and PTD with HCA (OR 2.8; CI 1.4-6.0). The sensitivity of IL-6 to detect spontaneous PTD <35 weeks or PTD with HCA was 0.43 and 0.51, respectively, while specificity was 0.74 and 0.75, respectively. IL-6 plus IL1β, IL-6r, tumor necrosis factor-alpha or granulocyte-macrophage colony-stimulating factor increased specificity (range 0.84-0.88), but decreased sensitivity (range 0.28-0.34) to detect both PTD subtypes. Results were similar when a combination of IL-6 and bacterial vaginosis (BV) was explored. Thus, the use of multiple biomarkers did not detect PTD subtypes with a greater sensitivity than IL-6 alone, and IL-6 is a specific but non-sensitive marker for the detection of spontaneous PTD.

LIMITATIONS, REASONS FOR CAUTION

Our ability to find small effect size associations between PTD and inflammation biomarkers (OR <2.0) might have been limited by the modest number of less common PTD subtypes in our population (e.g. spontaneous delivery <35 weeks, PTD accompanied by HCA) and by relatively higher variability for some cytokines, for example tumor necrosis factor-α, IL-12p70, IL-10 and granulocyte-macrophage colony-stimulating factor, that are less stable and commonly undetectable or detectable at low levels in human vaginal secretions.

WIDER IMPLICATIONS OF THE FINDINGS

Larger studies are needed to further explore a role of inflammation biomarkers in combination with other risk factors, including specific BV-associated organisms, for the prediction of PTD subtypes.

STUDY FUNDING/COMPETING INTEREST(S)

This work was supported by the National Institute of Child Health and Human Development, National Institute of Nursing, March of Dimes Foundation, Thrasher Research Foundation and Centers for Disease Control and Prevention. The authors have no conflicts of interest.

Cervical cytokines and clearance of incident human papillomavirus infection: Hawaii HPV cohort study

Mechanisms for the control and resolution of human papillomavirus (HPV) infection of the cervix include the local production of cytokines, which control recruitment and function of cells integral to pathogen control. We established a cohort of women for long-term follow-up to examine the mucosal expression of antiviral (IFN-α2), Type-1 (IFN-γ, IL-12), regulatory (IL-10), and proinflammatory (IL-1α, IL-1β, IL-6, IL-8, MIP-1α, and TNF) cytokines in association with the clearance of incident cervical HPV infection. Interviews and specimens for HPV DNA analysis and cytokine protein measurement were obtained at baseline and at 4-month intervals. A Cox proportional hazards model was used to study the relationship between clearance of 107 high-risk and 111 low-risk incident HPV infections and cytokine levels among 154 women. Positive changes from baseline levels of IL-10, IL-12, MIP-1α, and TNF were associated with significantly longer times to type-specific HPV clearance. Inverse trends in the hazard ratios associated with clearance of high-risk HPV infections were monotonic and significant for IL-12 (ptrend  = 0.02) and TNF (ptrend  = 0.02); the likelihood of high-risk HPV clearance was reduced by 65% and 67%, respectively, among women in the highest as compared with the lowest quartile of change from baseline. Our results suggest that in women with a nontransient cervical HPV infection, proinflammatory, Type-1, and regulatory cytokines are elevated, underscoring the long-term commitment of local immune mediators to viral eradication.

Searching for lower female genital tract soluble and cellular biomarkers: defining levels and predictors in a cohort of healthy Caucasian women

Background

High concentrations of pro-inflammatory cytokines have been previously observed in the genital fluids of women enrolled in microbicide trials and may explain observed increased HIV transmission in some of these trials. Although the longitudinal nature of these studies allows within-subject comparisons of post-product levels to baseline levels, the fact that the physiologic variations of these cytokines and other markers of immune activation are not fully defined in different populations, makes it difficult to assess changes that can be directly attributed to microbicide use as opposed to other biological and behavioural factors.

Methods

Cervicovaginal lavage samples were collected from 30 healthy Caucasian and assayed for concentrations of ten cytokines/chemokines, total protein content and two antimicrobial proteins using a multiplex immunoassay and ELISA. Cellular markers were characterized by flow cytometry on mononuclear cells collected from the endocervix using flocked swabs. Bacterial quantification was performed using quantitative PCR.

Results

Ectopy, menstrual cycle phase, prostate-specific antigen and presence of leucocytes in endocervical cells' supernatant were associated with the concentrations of cyto-/chemokines in cervicovaginal secretions. Approximately 3% of endocervical cells collected were monocytes of which a median of 52% (SD  = 17) expressed both CD4 and CCR5 markers. Approximately 1% of the total cells were T-cells with a median of 61% (SD  = 10) CD4 and CCR5 expression. Around 5% of the monocytes and 16% of the T-cells expressed the immune activation marker HLA-DR. Higher percentages of T-cells were associated with greater quantities of IL-1RA, GM-CSF and elafin.

Conclusion

We demonstrate the presence of selected soluble and cellular immune activation markers and identify their predictors in the female genital tract of healthy women. Future clinical trials should consider ectopy, sexual activity, menstrual cycle phase and presence of bacterial species as possible confounders when evaluating the possible inflammatory effects of microbicide compounds.