The External Quality Assurance Oversight Laboratory (EQAPOL) proficiency program for IFN-gamma enzyme-linked immunospot (IFN-γ ELISpot) assay

Decreased variability in the site-specific results during participation in the External Quality Assurance Program Oversight Laboratory (EQAPOL) proficiency program for IFN-gamma enzyme-linked immunospot (IFN-γ ELISpot) assay

The NIAID DAIDS-sponsored External Quality Assurance Program Oversight Laboratory (EQAPOL) manages an interferon-gamma (IFN-γ) enzyme-linked immunospot (ELISpot) external proficiency program. The ELISpot program evaluates the accuracy and variability of results across laboratories. The variability in the program is quantified via the dispersion, which is the ratio of the variance over the mean of the background-corrected spot-forming cells (SFC) replicates obtained under stimulation with different peptide pools (CMV, CEF). This report includes the longitudinal analysis of the ELISpot program cohort composed of 22 laboratories from 2011 to 2022 to assess whether the within-lab variability has improved over time. Random intercept models of the dispersion over time showed a significant decrease in overall dispersion from an average of approximately 1.8 in 2011 to approximately 1.25 in 2022. Out of the 21 sites, 16 sites (4 being statistically significant) had a negative trend for dispersion over time. Our finding of a reduction of overall within-lab variability demonstrates the need for and benefit of proficiency testing programs.

Proficiency tests to evaluate the impact on assay outcomes of harmonized influenza-specific Intracellular Cytokine Staining (ICS) and IFN-ɣ Enzyme-Linked ImmunoSpot (ELISpot) protocols

The magnitude and quality of cell-mediated immune responses elicited by natural infection or vaccination are commonly measured by Interferon-ɣ (IFN-ɣ) Enzyme-Linked ImmunoSpot (ELISpot) and Intracellular Cytokine Staining (ICS). To date, laboratories apply a variety of in-house procedures which leads to diverging results, complicates interlaboratory comparisons and hampers vaccine evaluations. During the FLUCOP project, efforts have been made to develop harmonized Standard Operating Procedures (SOPs) for influenza-specific IFN-ɣ ELISpot and ICS assays. Exploratory pilot studies provided information about the interlaboratory variation before harmonization efforts were initiated. Here we report the results of two proficiency tests organized to evaluate the impact of the harmonization effort on assay results and the performance of participating FLUCOP partners. The introduction of the IFN-ɣ ELISpot SOP reduced variation of both background and stimulated responses. Post-harmonization background responses were all lower than an arbitrary threshold of 50 SFU/million cells. When stimulated with A/California and B/Phuket, a statistically significant reduction in variation (p < 0.0001) was observed and CV values were strongly reduced, from 148% to 77% for A/California and from 126% to 73% for B/Phuket. The harmonizing effect of applying an ICS SOP was also confirmed by an increased homogeneity of data obtained by the individual labs. The application of acceptance criteria on cell viability and background responses further enhanced the data homogeneity. Finally, as the same set of samples was analyzed by both the IFN-ɣ ELISpot and the ICS assays, a method comparison was performed. A clear correlation between the two methods was observed, but they cannot be considered interchangeable. In conclusion, proficiency tests show that a limited harmonization effort consisting of the introduction of SOPs and the use of the same in vitro stimulating antigens leads to a reduction of the interlaboratory variation of IFN-ɣ ELISpot data and demonstrate that substantial improvements for the ICS assay are achieved as comparable laboratory datasets could be generated. Additional steps to further reduce the interlaboratory variation of ICS data can consist of standardized gating templates and detailed data reporting instructions as well as further efforts to harmonize reagent and instrument use.

Validation of the performance and suitability of a new class of FBS optimized for use in single-cell functional assays

The use of conventional serum for supplementation of media in cell-based and single-cell functional assays has been a major challenge for assay performance, standardization, optimization, and reproducibility. It has been identified as the leading cause of variability and suboptimal performance in large, international Elispot proficiency panels (Janetzki et al., 2008; Rountree et al., 2016). Extensive pretesting and optimization activities are one approach to overcome these challenges, but they are time-consuming and resource-intensive because suitable lots of serum are difficult to identify and secure in sufficient quantities to provide stability in long-term studies. Advancements in manufacturing methods have resulted in a new class of serum with the potential to solve these challenges. An IFNɣ Elispot study was designed by the External Quality Assurance Program Oversight Laboratory (EQAPOL) at Duke Human Vaccine Institute's (DHVI) Immunology and Virology Quality Assessment Center (IVQAC) to test this new class of serum against their in-house, validated control serum, which is regarded as a global standard in performance for high functionality, recovery, and viability. Commonly used serum-free media were also included in the study. The results of this study compellingly demonstrate that this new class of serum produces high responses and low background reactivity comparable to the included serum standard, with excellent recovery and viability of cells. A protocol for ongoing testing has been developed to continuously validate new batches of this serum with the goal to make available to the field a pretested and validated serum that can be used with confidence in functional cell-based assays.

Harmonization and qualification of an IFN-γ Enzyme-Linked ImmunoSpot assay (ELISPOT) to measure influenza-specific cell-mediated immunity within the FLUCOP consortium

Influenza continues to be the most important cause of viral respiratory disease, despite the availability of vaccines. Today’s evaluation of influenza vaccines mainly focuses on the quantitative and functional analyses of antibodies to the surface proteins haemagglutinin (HA) and neuraminidase (NA). However, there is an increasing interest in measuring cellular immune responses targeting not only mutation-prone surface HA and NA but also conserved internal proteins as these are less explored yet potential correlates of protection. To date, laboratories that monitor cellular immune responses use a variety of in-house procedures. This generates diverging results, complicates interlaboratory comparisons, and hampers influenza vaccine evaluation. The European FLUCOP project aims to develop and standardize assays for the assessment of influenza vaccine correlates of protection. This report describes the harmonization and qualification of the influenza-specific interferon-gamma (IFN-γ) Enzyme-Linked ImmunoSpot (ELISpot) assay. Initially, two pilot studies were conducted to identify sources of variability during sample analysis and spot enumeration in order to develop a harmonized Standard Operating Procedure (SOP). Subsequently, an assay qualification study was performed to investigate the linearity, intermediate precision (reproducibility), repeatability, specificity, Lower and Upper Limits of Quantification (LLOQ-ULOQ), Limit of Detection (LOD) and the stability of signal over time. We were able to demonstrate that the FLUCOP harmonized IFN-γ ELISpot assay procedure can accurately enumerate IFN-γ secreting cells in the analytical range of 34.4 Spot Forming Units (SFU) per million cells up to the technical limit of the used reader and in the linear range from 120 000 to 360 000 cells per well, in plates stored up to 6 weeks after development. This IFN-γ ELISpot procedure will hopefully become a useful and reliable tool to investigate influenza-specific cellular immune responses induced by natural infection or vaccination and can be an additional instrument in the search for novel correlates of protection.

Mouse and human antibodies bind HLA-E-leader peptide complexes and enhance NK cell cytotoxicity

The non-classical class Ib molecule human leukocyte antigen E (HLA-E) has limited polymorphism and can bind HLA class Ia leader peptides (VL9). HLA-E-VL9 complexes interact with the natural killer (NK) cell receptors NKG2A-C/CD94 and regulate NK cell-mediated cytotoxicity. Here we report the isolation of 3H4, a murine HLA-E-VL9-specific IgM antibody that enhances killing of HLA-E-VL9-expressing cells by an NKG2A+ NK cell line. Structural analysis reveal that 3H4 acts by preventing CD94/NKG2A docking on HLA-E-VL9. Upon in vitro maturation, an affinity-optimized IgG form of 3H4 showes enhanced NK killing of HLA-E-VL9-expressing cells. HLA-E-VL9-specific IgM antibodies similar in function to 3H4 are also isolated from naïve B cells of cytomegalovirus (CMV)-negative, healthy humans. Thus, HLA-E-VL9-targeting mouse and human antibodies isolated from the naïve B cell antibody pool have the capacity to enhance NK cell cytotoxicity.

Detection of Cytokine-Secreting Cells by Enzyme-Linked Immunospot (ELISpot)

The enzyme-linked immunospot (ELISpot) is a highly sensitive immunoassay that measures the frequency of cytokine-secreting cells at the single-cell level. The secreted molecules are detected by using a detection antibody system similar to that used in the enzyme-linked immunosorbent assay (ELISA). The ELISpot assay is carried out in a 96-well plate and an automated ELISpot reader is used for analysis. The assay is easy to perform, robust and allows rapid analysis of a large number of samples and is not limited to measurement of cytokines; it is suitable for almost any secreted protein where single-cell analysis is of interest.

Performance of International AIDS Vaccine Initiative African clinical research laboratories in standardised ELISpot and peripheral blood mononuclear cell processing in support of HIV vaccine clinical trials

Background

Standardisation of procedures for performing cellular functional assays across laboratories participating in multicentre clinical trials is key for generating comparable and reliable data.

Objective

This article describes the performance of accredited laboratories in Africa and Europe on testing done in support of clinical trials.

Methods

For enzyme-linked immunospot assay (ELISpot) proficiency, characterised peripheral blood mononuclear cells (PBMCs) obtained from 48 HIV-negative blood donors in Johannesburg, South Africa, were sent to participating laboratories between February 2010 and February 2014. The PBMCs were tested for responses against cytomegalovirus, Epstein Barr and influenza peptide pools in a total of 1751 assays. In a separate study, a total of 1297 PBMC samples isolated from healthy HIV-negative participants in clinical trials of two prophylactic HIV vaccine candidates in Kenya, Uganda, Rwanda and Zambia were analysed for cell viability, cell yield and cell recovery from frozen PBMCs.

Results

Most (99%) of the 1751 ELISpot proficiency assays had data within acceptable ranges with low responses to mock stimuli. No significant statistical difference were observed in ELISpot responses at the five laboratories actively conducting immunological analyses. Of the 1297 clinical trial PBMCs processed, 94% had cell viability above 90% and 96% had cell yield above 0.7 million per mL of blood in freshly isolated cells. All parameters were within the predefined acceptance criteria.

Conclusion

We demonstrate that multiple laboratories can generate reliable, accurate and comparable data by using standardised procedures, having regular training, having regular equipment maintenance and using centrally sourced reagents.

A Cytometrist's Guide to Coordinating and Performing Effective COVID-19 Research

Cytometry is playing a crucial role in addressing the COVID-19 pandemic. In this commentary-written by a variety of stakeholders in the cytometry, immunology, and infectious disease communities-we review cytometry's role in the COVID-19 response and discuss workflow issues critical to planning and executing effective research in this emerging field. We discuss sample procurement and processing, biosafety, technology options, data sharing, and the translation of research findings into clinical environments. © 2020 International Society for Advancement of Cytometry.

Screening of a ScFv Antibody With High Affinity for Application in Human IFN-γ Immunoassay

Interferon gamma (IFN-γ), a signal proinflammatory cytokine secreted by immune cell, and plays a critical role in the pathogenesis and progression of many diseases. It has been regarded as an important marker for determination of disease-specific immune responses. Therefore, it is urgent to develop a feasible and accurate method to detect IFN-γ in clinic real blood samples. Until now, the immunoassay based on singe chain variable fragment (scFv) antibody for human IFN-γ is still not reported. In the present study, an scFv antibody named scFv-A8 with high specificity was obtained by phage display and biopanning, with the affinity 2.6 × 10⁹ L/mol. Maltose binding protein (MBP) was used to improve the solubility of scFv by inserting an linker DNA between scFv and MBP tag, and the resulted fusion protein (MBP-LK-scFv) has high solubility and antigen biding activity. The expressed and purified MBP-LK-scFv antibody was used to develop the indirect competitive enzyme-linked immunosorbent assay (ELISA) (ic-ELISA) for detection of human IFN-γ, and the result indicated that the linear range to detect IFN-γ was 6–60 pg/mL with IC₅₀ of 25 pg/mL. The limit of detection was 2 pg/mL (1.3 fm), and the average recovery was 85.05%, further demonstrating that the detection method based on scFv has higher recovery and accuracy. Hence, the developed ic-ELISA can be used to detect IFN-γ in real samples, and it may be further provided a scientific basis for disease diagnosis.

Toward Optimal Cryopreservation and Storage for Achievement of High Cell Recovery and Maintenance of Cell Viability and T Cell Functionality

Cryopreservation of biological materials such as cells, tissues, and organs is a prevailing topic of high importance. It is employed not only in many research fields but also in the clinical area. Cryopreservation is of great importance for reproductive medicine and clinical studies, as well as for the development of vaccines. Peripheral blood mononuclear cells (PBMCs) are commonly used in vaccine research where comparable and reliable results between different research institutions and laboratories are of high importance. Whereas freezing and thawing processes are well studied, controlled, and standardized, storage conditions are often disregarded. To close this gap, we investigated the influence of suboptimal storage conditions during low-temperature storage on PBMC viability, recovery, and T cell functionality. For this purpose, PBMCs were isolated and exposed with help of a robotic system in a low-temperature environment from 0 up to 350 temperature fluctuation cycles in steps of 50 cycles to simulate storage conditions in large biorepositories with sample storage, removal, and sorting functions. After the simulation, the viability, recovery, and T cell functionality were analyzed to determine the number of temperature rises, which ultimately lead to significant cell damage. All studied parameters decreased with increasing number of temperature cycles. Sometimes after as little as only 50 temperature cycles, a significant effect was observed. These results are very important for all fields in which cell cryopreservation is employed, particularly for clinical and multicenter studies wherein the comparability and reproducibility of results play a crucial role. To obtain reliable results and to maintain the quality of the cells, not only the freezing and thawing processes but also the storage conditions should be controlled and standardized, and any deviations should be documented.

Validation of an IFNγ/IL2 FluoroSpot assay for clinical trial monitoring

Background

The FluoroSpot assay, an advancement of the ELISpot assay, enables simultaneous measurement of different analytes secreted at a single-cell level. This allows parallel detection of several cytokines secreted by immune cells upon antigen recognition. Easier standardization, higher sensitivity and reduced labour intensity render FluoroSpot assays an interesting alternative to flow-cytometry based assays for analysis of clinical samples. While the use of immunoassays to study immunological primary and secondary endpoints becomes increasingly attractive, assays used require pre-trial validation. Here we describe the assay validation (precision, specificity and linearity) of a FluoroSpot immunological endpoint assay detecting Interferon γ (IFNγ) and Interleukin 2 (IL2) for use in clinical trial immune monitoring.

Methods

We validated an IFNγ/IL2 FluoroSpot assay to determine Epstein-Barr virus (EBV)-specific cellular immune responses (IFNγ, IL2 and double positive IFNγ + IL2 responses), using overlapping peptide pools corresponding to EBV-proteins BZLF1 and EBNA3A. Assay validation was performed using cryopreserved PBMC of 16 EBV-seropositive and 6 EBV-seronegative donors. Precision was assessed by (i) testing 16 donors using three replicates per assay (intra-assay precision/repeatability) (ii) using two plates in parallel (intermediate precision/plate-to-plate variability) and (iii) by performing the assays on three different days (inter-assay precision/reproducibility). In addition, we determined specificity, linearity and quantification limits of the assay. Further we tested precision across the two assay systems, IFNγ/IL2 FluoroSpot and the corresponding enzymatic single cytokine ELISpot.

Results

The validation revealed: (1) a high intra-assay precision (coefficient of variation (CV) 9.96, 8.85 and 13.05 %), intermediate precision (CV 6.48, 10.20 and 12.97 %) and reproducibility (CV 20.81 %, 12,75 % and 12.07 %) depending on the analyte and antigen used; (2) a specificity of 100 %; (3) a linearity with R² values from 0.93 to 0.99 depending on the analyte. The testing of the precision across the two assay systems, adduced a concordance correlation coefficient p_c = 0.99 for IFNγ responses and p_c = 0.93 for IL2 responses, indicating a large agreement between both assay methods.

Conclusions

The validated primary endpoint assay, an EBV peptide pool specific IFNγ/IL2 FluoroSpot assay was found to be suitable for the detection of EBV-specific immune responses subject to the requirement of standardized assay procedure and data analysis.

Electronic supplementary material

The online version of this article (doi:10.1186/s12967-016-0932-7) contains supplementary material, which is available to authorized users.

Variability of the IFN-γ ELISpot assay in the context of proficiency testing and bridging studies

Assays that assess cellular mediated immune responses performed under Good Clinical Laboratory Practice (GCLP) guidelines are required to provide specific and reproducible results. Defined validation procedures are required to establish the Standard Operating Procedure (SOP), include pass and fail criteria, as well as implement positivity criteria. However, little to no guidance is provided on how to perform longitudinal assessment of the key reagents utilized in the assay. Through the External Quality Assurance Program Oversight Laboratory (EQAPOL), an Interferon-gamma (IFN-γ) Enzyme-linked immunosorbent spot (ELISpot) assay proficiency testing program is administered. A limit of acceptable within site variability was estimated after six rounds of proficiency testing (PT). Previously, a PT send-out specific within site variability limit was calculated based on the dispersion (variance/mean) of the nine replicate wells of data. Now an overall 'dispersion limit' for the ELISpot PT program within site variability has been calculated as a dispersion of 3.3. The utility of this metric was assessed using a control sample to calculate the within (precision) and between (accuracy) experiment variability to determine if the dispersion limit could be applied to bridging studies (studies that assess lot-to-lot variations of key reagents) for comparing the accuracy of results with new lots to results with old lots. Finally, simulations were conducted to explore how this dispersion limit could provide guidance in the number of replicate wells needed for within and between experiment variability and the appropriate donor reactivity (number of antigen-specific cells) to be used for the evaluation of new reagents. Our bridging study simulations indicate using a minimum of six replicate wells of a control donor sample with reactivity of at least 150 spot forming cells per well is optimal. To determine significant lot-to-lot variations use the 3.3 dispersion limit for between and within experiment variability.

Stepping up ELISpot: Multi-Level Analysis in FluoroSpot Assays

ELISpot is one of the most commonly used immune monitoring assays, which allows the functional assessment of the immune system at the single cell level. With its outstanding sensitivity and ease of performance, the assay has recently advanced from the mere single function cell analysis to multifunctional analysis by implementing detection reagents that are labeled with fluorophores (FluoroSpot), allowing the detection of secretion patterns of two or more analytes in a single well. However, the automated evaluation of such assays presents various challenges for image analysis. Here we dissect the technical and methodological requirements for a reliable analysis of FluoroSpot assays, introduce important quality control measures and provide advice for proper interpretation of results obtained by automated imaging systems.

Introduction to a Special Issue of the Journal of Immunological Methods: Building global resource programs to support HIV/AIDS clinical trial studies

This Special Issue of the Journal of Immunological Methods includes 16 manuscripts describing quality assurance activities related to virologic and immunologic monitoring of six global laboratory resource programs that support international HIV/AIDS clinical trial studies: Collaboration for AIDS Vaccine Discovery (CAVD); Center for HIV/AIDS Vaccine Immunology (CHAVI); External Quality Assurance Program Oversight Laboratory (EQAPOL); HIV Vaccine Trial Network (HVTN); International AIDS Vaccine Initiative (IAVI); and Immunology Quality Assessment (IQA). The reports from these programs address the many components required to develop comprehensive quality control activities and subsequent quality assurance programs for immune monitoring in global clinical trials including: all aspects of processing, storing, and quality assessment of PBMC preparations used ubiquitously in HIV clinical trials, the development and optimization of assays for CD8 HIV responses and HIV neutralization, a comprehensive global HIV virus repository, and reports on the development and execution of novel external proficiency testing programs for immunophenotyping, intracellular cytokine staining, ELISPOT and luminex based cytokine measurements. In addition, there are articles describing the implementation of Good Clinical Laboratory Practices (GCLP) in a large quality assurance laboratory, the development of statistical methods specific for external proficiency testing assessment, a discussion on the ability to set objective thresholds for measuring rare events by flow cytometry, and finally, a manuscript which addresses a framework for the structured reporting of T cell immune function based assays. It is anticipated that this series of manuscripts covering a wide range of quality assurance activities associated with the conduct of global clinical trials will provide a resource for individuals and programs involved in improving the harmonization, standardization, accuracy, and sensitivity of virologic and immunologic testing.