Toward the harmonization of immune monitoring in clinical trials: quo vadis?

Proficiency tests to evaluate the impact on assay outcomes of harmonized influenza-specific Intracellular Cytokine Staining (ICS) and IFN-ɣ Enzyme-Linked ImmunoSpot (ELISpot) protocols

The magnitude and quality of cell-mediated immune responses elicited by natural infection or vaccination are commonly measured by Interferon-ɣ (IFN-ɣ) Enzyme-Linked ImmunoSpot (ELISpot) and Intracellular Cytokine Staining (ICS). To date, laboratories apply a variety of in-house procedures which leads to diverging results, complicates interlaboratory comparisons and hampers vaccine evaluations. During the FLUCOP project, efforts have been made to develop harmonized Standard Operating Procedures (SOPs) for influenza-specific IFN-ɣ ELISpot and ICS assays. Exploratory pilot studies provided information about the interlaboratory variation before harmonization efforts were initiated. Here we report the results of two proficiency tests organized to evaluate the impact of the harmonization effort on assay results and the performance of participating FLUCOP partners. The introduction of the IFN-ɣ ELISpot SOP reduced variation of both background and stimulated responses. Post-harmonization background responses were all lower than an arbitrary threshold of 50 SFU/million cells. When stimulated with A/California and B/Phuket, a statistically significant reduction in variation (p < 0.0001) was observed and CV values were strongly reduced, from 148% to 77% for A/California and from 126% to 73% for B/Phuket. The harmonizing effect of applying an ICS SOP was also confirmed by an increased homogeneity of data obtained by the individual labs. The application of acceptance criteria on cell viability and background responses further enhanced the data homogeneity. Finally, as the same set of samples was analyzed by both the IFN-ɣ ELISpot and the ICS assays, a method comparison was performed. A clear correlation between the two methods was observed, but they cannot be considered interchangeable. In conclusion, proficiency tests show that a limited harmonization effort consisting of the introduction of SOPs and the use of the same in vitro stimulating antigens leads to a reduction of the interlaboratory variation of IFN-ɣ ELISpot data and demonstrate that substantial improvements for the ICS assay are achieved as comparable laboratory datasets could be generated. Additional steps to further reduce the interlaboratory variation of ICS data can consist of standardized gating templates and detailed data reporting instructions as well as further efforts to harmonize reagent and instrument use.

Harmonization and qualification of an IFN-γ Enzyme-Linked ImmunoSpot assay (ELISPOT) to measure influenza-specific cell-mediated immunity within the FLUCOP consortium

Influenza continues to be the most important cause of viral respiratory disease, despite the availability of vaccines. Today’s evaluation of influenza vaccines mainly focuses on the quantitative and functional analyses of antibodies to the surface proteins haemagglutinin (HA) and neuraminidase (NA). However, there is an increasing interest in measuring cellular immune responses targeting not only mutation-prone surface HA and NA but also conserved internal proteins as these are less explored yet potential correlates of protection. To date, laboratories that monitor cellular immune responses use a variety of in-house procedures. This generates diverging results, complicates interlaboratory comparisons, and hampers influenza vaccine evaluation. The European FLUCOP project aims to develop and standardize assays for the assessment of influenza vaccine correlates of protection. This report describes the harmonization and qualification of the influenza-specific interferon-gamma (IFN-γ) Enzyme-Linked ImmunoSpot (ELISpot) assay. Initially, two pilot studies were conducted to identify sources of variability during sample analysis and spot enumeration in order to develop a harmonized Standard Operating Procedure (SOP). Subsequently, an assay qualification study was performed to investigate the linearity, intermediate precision (reproducibility), repeatability, specificity, Lower and Upper Limits of Quantification (LLOQ-ULOQ), Limit of Detection (LOD) and the stability of signal over time. We were able to demonstrate that the FLUCOP harmonized IFN-γ ELISpot assay procedure can accurately enumerate IFN-γ secreting cells in the analytical range of 34.4 Spot Forming Units (SFU) per million cells up to the technical limit of the used reader and in the linear range from 120 000 to 360 000 cells per well, in plates stored up to 6 weeks after development. This IFN-γ ELISpot procedure will hopefully become a useful and reliable tool to investigate influenza-specific cellular immune responses induced by natural infection or vaccination and can be an additional instrument in the search for novel correlates of protection.

Activation-induced Markers Detect Vaccine-Specific CD4⁺ T Cell Responses Not Measured by Assays Conventionally Used in Clinical Trials

Immunogenicity of T cell-inducing vaccines, such as viral vectors or DNA vaccines and Bacillus Calmette-Guérin (BCG), are frequently assessed by cytokine-based approaches. While these are sensitive methods that have shown correlates of protection in various vaccine studies, they only identify a small proportion of the vaccine-specific T cell response. Responses to vaccination are likely to be heterogeneous, particularly when comparing prime and boost or assessing vaccine performance across diverse populations. Activation-induced markers (AIM) can provide a broader view of the total antigen-specific T cell response to enable a more comprehensive evaluation of vaccine immunogenicity. We tested an AIM assay for the detection of vaccine-specific CD4⁺ and CD8⁺ T cell responses in healthy UK adults vaccinated with viral vectored Ebola vaccine candidates, ChAd3-EBO-Z and MVA-EBO-Z. We used the markers, CD25, CD134 (OX40), CD274 (PDL1), and CD107a, to sensitively identify vaccine-responsive T cells. We compared the use of OX40⁺CD25⁺ and OX40⁺PDL1⁺ in CD4⁺ T cells and OX40⁺CD25⁺ and CD25⁺CD107a⁺ in CD8⁺ T cells for their sensitivity, specificity, and associations with other measures of vaccine immunogenicity. We show that activation-induced markers can be used as an additional method of demonstrating vaccine immunogenicity, providing a broader picture of the global T cell response to vaccination.

Validation of Immunomonitoring Methods for Application in Clinical Studies: The HLA-Peptide Multimer Staining Assay

BACKGROUND

Validated assays are essential to generate data with defined specificity, consistency, and reliability. Although the process of validation is required for applying immunoassays in the context of clinical studies, reports on systematic validation of in vitro T cell assays are scarce so far. We recently validated our HLA-peptide multimer staining assay in a systematic manner so as to qualify the method for monitoring antigen-specific T cell responses after immunotherapy.

METHODS

Parameters of the assay, specificity, precision, linearity, sensitivity, and robustness were assessed systematically. Experiments were designed to address specifically each parameter and are detailed.

RESULTS

Nonspecific multimer staining was below the acceptance limit of 0.02% multimer(+) CD8(+) cells. The assay showed acceptable precision in all dimensions it was repeated (CV < 10%) and also demonstrated a linear detection (R2  > 0.99) of antigen specific cells.

CONCLUSIONS

We succeeded in validating the HLA-multimer staining assay in a systematic manner. Additionally, we propose a technical framework and recommendations that can be applied for validating other T cell assessment methods. © 2016 International Clinical Cytometry Society.

Managing Multi-center Flow Cytometry Data for Immune Monitoring

With the recent results of promising cancer vaccines and immunotherapy1–5, immune monitoring has become increasingly relevant for measuring treatment-induced effects on T cells, and an essential tool for shedding light on the mechanisms responsible for a successful treatment. Flow cytometry is the canonical multi-parameter assay for the fine characterization of single cells in solution, and is ubiquitously used in pre-clinical tumor immunology and in cancer immunotherapy trials. Current state-of-the-art polychromatic flow cytometry involves multi-step, multi-reagent assays followed by sample acquisition on sophisticated instruments capable of capturing up to 20 parameters per cell at a rate of tens of thousands of cells per second. Given the complexity of flow cytometry assays, reproducibility is a major concern, especially for multi-center studies. A promising approach for improving reproducibility is the use of automated analysis borrowing from statistics, machine learning and information visualization21–23, as these methods directly address the subjectivity, operator-dependence, labor-intensive and low fidelity of manual analysis. However, it is quite time-consuming to investigate and test new automated analysis techniques on large data sets without some centralized information management system. For large-scale automated analysis to be practical, the presence of consistent and high-quality data linked to the raw FCS files is indispensable. In particular, the use of machine-readable standard vocabularies to characterize channel metadata is essential when constructing analytic pipelines to avoid errors in processing, analysis and interpretation of results. For automation, this high-quality metadata needs to be programmatically accessible, implying the need for a consistent Application Programming Interface (API). In this manuscript, we propose that upfront time spent normalizing flow cytometry data to conform to carefully designed data models enables automated analysis, potentially saving time in the long run. The ReFlow informatics framework was developed to address these data management challenges.

Evaluation of tumor response to cytokine-induced killer cells therapy in malignant solid tumors

CIK cells therapy has been evaluated as an adoptive cell immunotherapy for cancer patients, but there still have not been any standardized systems for evaluating the antitumor efficacy yet. The WHO and RECIST criteria have already been established for a few years but not sufficient to fully characterize the activity of immunotherapy. Based on these two criteria, the irRC was proposed for evaluating the efficacy of immunotherapy. A variety of bioassays for immune monitoring including the specific and non-specific methods, have been established. We recommend detect levels of various immunocytes, immune molecules and soluble molecules to find the correlations among them and clinicopathological characteristics to establish criteria for immunological classification. We also recommend a paradigm shift for the oncologists in the evaluation of immune therapies to ensure assessment of activity based on clinically relevant criteria and time points.

Quality control, analysis and secure sharing of Luminex® immunoassay data using the open source LabKey Server platform

BACKGROUND

Immunoassays that employ multiplexed bead arrays produce high information content per sample. Such assays are now frequently used to evaluate humoral responses in clinical trials. Integrated software is needed for the analysis, quality control, and secure sharing of the high volume of data produced by such multiplexed assays. Software that facilitates data exchange and provides flexibility to perform customized analyses (including multiple curve fits and visualizations of assay performance over time) could increase scientists' capacity to use these immunoassays to evaluate human clinical trials.

RESULTS

The HIV Vaccine Trials Network and the Statistical Center for HIV/AIDS Research and Prevention collaborated with LabKey Software to enhance the open source LabKey Server platform to facilitate workflows for multiplexed bead assays. This system now supports the management, analysis, quality control, and secure sharing of data from multiplexed immunoassays that leverage Luminex xMAP® technology. These assays may be custom or kit-based. Newly added features enable labs to: (i) import run data from spreadsheets output by Bio-Plex Manager™ software; (ii) customize data processing, curve fits, and algorithms through scripts written in common languages, such as R; (iii) select script-defined calculation options through a graphical user interface; (iv) collect custom metadata for each titration, analyte, run and batch of runs; (v) calculate dose-response curves for titrations; (vi) interpolate unknown concentrations from curves for titrated standards; (vii) flag run data for exclusion from analysis; (viii) track quality control metrics across runs using Levey-Jennings plots; and (ix) automatically flag outliers based on expected values. Existing system features allow researchers to analyze, integrate, visualize, export and securely share their data, as well as to construct custom user interfaces and workflows.

CONCLUSIONS

Unlike other tools tailored for Luminex immunoassays, LabKey Server allows labs to customize their Luminex analyses using scripting while still presenting users with a single, graphical interface for processing and analyzing data. The LabKey Server system also stands out among Luminex tools for enabling smooth, secure transfer of data, quality control information, and analyses between collaborators. LabKey Server and its Luminex features are freely available as open source software at http://www.labkey.com under the Apache 2.0 license.

Ancillary study management systems: a review of needs

BACKGROUND

The valuable clinical data, specimens, and assay results collected during a primary clinical trial or observational study can enable researchers to answer additional, pressing questions with relatively small investments in new measurements. However, management of such follow-on, "ancillary" studies is complex. It requires coordinating across institutions, sites, repositories, and approval boards, as well as distributing, integrating, and analyzing diverse data types. General-purpose software systems that simplify the management of ancillary studies have not yet been explored in the research literature.

METHODS

We have identified requirements for ancillary study management primarily as part of our ongoing work with a number of large research consortia. These organizations include the Center for HIV/AIDS Vaccine Immunology (CHAVI), the Immune Tolerance Network (ITN), the HIV Vaccine Trials Network (HVTN), the U.S. Military HIV Research Program (MHRP), and the Network for Pancreatic Organ Donors with Diabetes (nPOD). We also consulted with researchers at a range of other disease research organizations regarding their workflows and data management strategies. Lastly, to enhance breadth, we reviewed process documents for ancillary study management from other organizations.

RESULTS

By exploring characteristics of ancillary studies, we identify differentiating requirements and scenarios for ancillary study management systems (ASMSs). Distinguishing characteristics of ancillary studies may include the collection of additional measurements (particularly new analyses of existing specimens); the initiation of studies by investigators unaffiliated with the original study; cross-protocol data pooling and analysis; pre-existing participant consent; and pre-existing data context and provenance. For an ASMS to address these characteristics, it would need to address both operational requirements (e.g., allocating existing specimens) and data management requirements (e.g., securely distributing and integrating primary and ancillary data).

CONCLUSIONS

The scenarios and requirements we describe can help guide the development of systems that make conducting ancillary studies easier, less expensive, and less error-prone. Given the relatively consistent characteristics and challenges of ancillary study management, general-purpose ASMSs are likely to be useful to a wide range of organizations. Using the requirements identified in this paper, we are currently developing an open-source, general-purpose ASMS based on LabKey Server (http://www.labkey.org) in collaboration with CHAVI, the ITN and nPOD.

mRNA electroporation as a tool for immunomonitoring

Monitoring the immune response is an essential aspect of numerous clinical vaccination trials in order to evaluate the efficacy. In these clinical vaccination trials, peripheral blood mononuclear cells (PBMC) are isolated at different time points from patient blood samples and subsequently cryopreserved to allow batch analysis at a later time point. Here, we present a newly developed short-time assay which allows direct ex vivo analysis of multi-epitope antigen-specific immune responses using mRNA electroporation of cryopreserved PBMC. This novel method is a rapid and elegant tool and will be convenient for monitoring the cellular immune status of patients in clinical vaccination settings.

Harmonization of immune biomarker assays for clinical studies

Assays that measure a patient's immune response play an increasingly important role in the development of immunotherapies. The inherent complexity of these assays and independent protocol development between laboratories result in high data variability and poor reproducibility. Quality control through harmonization--based on integration of laboratory-specific protocols with standard operating procedures and assay performance benchmarks--is one way to overcome these limitations. Harmonization guidelines can be widely implemented to address assay performance variables. This process enables objective interpretation and comparison of data across clinical trial sites and also facilitates the identification of relevant immune biomarkers, guiding the development of new therapies.

The immuno-oncology framework: Enabling a new era of cancer therapy

Developers of cancer immunotherapy have struggled for decades to achieve clinical success in using the patient's immune system to treat cancer. In the absence of a defined development paradigm for immunotherapies, conventional criteria established for chemotherapy were applied to these agents. This article summarizes the recent lessons for development of agents in the immunotherapy space, describes the systematic creation of a new clinical development paradigm for cancer immunotherapies and integrates this paradigm with the emerging methodological framework for a new clinical sub-specialty of immuno-oncology, which was driven by the collaborative work between the Cancer Immunotherapy Consortium (CIC) of the Cancer Research Institute in the US and the Association for Cancer Immunotherapy (CIMT) in Europe. This new framework provides a better defined development path and a foundation for more reproducible success of future therapies.

The impact of harmonization on ELISPOT assay performance

During more than 25 years of application in immunological sciences, ELISPOT has been established as a routine, robust, versatile, and reliable assay. From basic research to clinical immune monitoring, ELISPOT is being used to address the quantification and (to a lesser extent) functional characterization of immune cells secreting different molecules in the context of health and disease, immune intervention, and therapy in humans and other species [Kalyuzhny (Ed.) (2005) Handbook of Elispot: methods and protocols, Vol. 302, Humana Press Inc., Totowa, NJ]. Over the last decade, ELISPOT assays have been increasingly implemented as an immune-monitoring tool in clinical trials [Schmittel et al. J Immunother 23:289-295, 2000; Whiteside Immunol Invest 29:149-162, 2000; Nagata et al. Ann N Y Acad Sci 1037:10-15, 2004; Cox et al. (2005) Cellular immune assays for evaluation of vaccine efficacy in developing countries., In Manual of Clinical Immunology Laboratory (Rose, N. R., Hamilton, R. G., and Detrick, B., Eds.), p 301, ASM Press, Washington, DC; Cox et al. Methods 38:274-282, 2006]. While the principles of the original protocol have changed little since its first introduction [Czerkinsky J Immunol Methods 110:29-36, 1988], individual laboratories have adapted assay procedures based on experimental needs, availability of reagents and equipment, obtained recommendations, and gained experience, leading to a wide disparity of applied ELISPOT protocols with inevitable consequences. This chapter addresses the resulting challenges for ELISPOT use in clinical trial settings, and discusses the influence of harmonization strategies as a tool for overcoming these challenges. Furthermore, harmonization is discussed in the context of assay standardization and validation strategies.

Novel cancer immunotherapy agents with survival benefit: recent successes and next steps

The US Food and Drug Administration (FDA) recently approved two novel immunotherapy agents, sipuleucel-T and ipilimumab, which showed a survival benefit for patients with metastatic prostate cancer and melanoma, respectively. The mechanisms by which these agents provideclinical benefit are not completely understood. However, knowledge of these mechanisms will be crucial for probing human immune responses and tumour biology in order to understand what distinguishes responders from non-responders. The following next steps are necessary: first, the development of immune-monitoring strategies for the identification of relevant biomarkers; second, the establishment of guidelines for the assessment of clinical end points; and third, the evaluation of combination therapy strategies to improve clinical benefit.

Immunotherapy in prostate cancer: emerging strategies against a formidable foe

Recent clinical trials have shown therapeutic vaccines to be promising treatment modalities against prostate cancer. Unlike preventive vaccines that teach the immune system to fight off specific microorganisms, therapeutic vaccines stimulate the immune system to recognize and attack certain cancer-associated proteins. Additional strategies are being investigated that combine vaccines and standard therapeutics, including radiation, chemotherapy, targeted therapies, and hormonal therapy, to optimize the vaccines' effects. Recent vaccine late-phase clinical trials have reported evidence of clinical benefit while maintaining excellent quality of life. One such vaccine, sipuleucel-T, was recently FDA-approved for the treatment of metastatic prostate cancer. Another vaccine, PSA-TRICOM, is also showing promise in completed and ongoing randomized multicenter clinical trials in both early- and late-stage prostate cancer. Clinical results available to date indicate that immune-based therapies could play a significant role in the treatment of prostate and other malignancies.

Immune response in patients with newly diagnosed glioblastoma multiforme treated with intranodal autologous tumor lysate-dendritic cell vaccination after radiation chemotherapy

Patients with glioblastoma multiforme (GBM) are profoundly immunosuppressed and may benefit from restoration of an antitumor immune response in combination with conventional radiation therapy and temozolomide (TMZ). The optimal strategies to evaluate clinically relevant immune responses to treatment have yet to be determined. The primary objective of our study was to determine immunologic response to cervical intranodal vaccination with autologous tumor lysate-loaded dendritic cells (DCs) in patients with GBM after radiation therapy and TMZ. We used a novel hierarchical clustering analysis of immune parameters measured before and after vaccination. Secondary objectives were to assess treatment feasibility and to correlate immune response with progression-free survival (PFS) and overall survival. Ten eligible patients received vaccination. Tumor-specific cytotoxic T-cell response measured after vaccination was enhanced for the precursor frequency of CD4+ T and CD4+ interferon γ-producing cells. Hierarchical clustering analysis of multiple functional outcomes discerned 2 groups of patients according to their immune response, and additionally showed that patients in the top quintile for at least one immune function parameter had improved survival. There were no serious adverse events related to DC vaccination. All patients were alive at 6 months after diagnosis and the 6-month PFS was 90%. The median PFS was 9.5 months and overall survival was 28 months. In patients with GBM, immune therapy with DC vaccination after radiation and TMZ resulted in tumor-specific immune responses that were associated with prolonged survival. Our data suggest that DC vaccination in combination with radiation and chemotherapy in patients with GBM is feasible, safe, and may induce tumor-specific immune responses.

Therapeutic vaccines for malignant brain tumors

Malignant gliomas are the most common and aggressive form of brain tumors. Current therapy consists of surgical resection, followed by radiation therapy and concomitant chemotherapy. Despite these treatments, the prognosis for patients is poor. As such, investigative therapies including tumor vaccines have targeted this devastating condition. Recent clinical trials involving immunotherapy, specifically dendritic cell (DC) based vaccines, have shown promising results. Overall, these vaccines are well tolerated with few documented side effects. In many patients receiving vaccines, tumor progression was delayed and the median overall survival of these patients was prolonged. Despite these encouraging results, several factors have limited the efficacy of DC vaccines. Here we discuss the potential of DC vaccines as adjuvant therapy and current obstacles of generating highly pure and potent DC vaccines in the context of malignant glioma. Taken together, the results from earlier clinical studies justify additional clinical trials aimed at improving the efficacy of DC vaccines.

A critical assessment for the value of markers to gate-out undesired events in HLA-peptide multimer staining protocols

BACKGROUND

The introduction of antibody markers to identify undesired cell populations in flow-cytometry based assays, so called DUMP channel markers, has become a practice in an increasing number of labs performing HLA-peptide multimer assays. However, the impact of the introduction of a DUMP channel in multimer assays has so far not been systematically investigated across a broad variety of protocols.

METHODS

The Cancer Research Institute's Cancer Immunotherapy Consortium (CRI-CIC) conducted a multimer proficiency panel with a specific focus on the impact of DUMP channel use. The panel design allowed individual laboratories to use their own protocol for thawing, staining, gating, and data analysis. Each experiment was performed twice and in parallel, with and without the application of a dump channel strategy.

RESULTS

The introduction of a DUMP channel is an effective measure to reduce the amount of non-specific MULTIMER binding to T cells. Beneficial effects for the use of a DUMP channel were observed across a wide range of individual laboratories and for all tested donor-antigen combinations. In 48% of experiments we observed a reduction of the background MULTIMER-binding. In this subgroup of experiments the median background reduction observed after introduction of a DUMP channel was 0.053%.

CONCLUSIONS

We conclude that appropriate use of a DUMP channel can significantly reduce background staining across a large fraction of protocols and improve the ability to accurately detect and quantify the frequency of antigen-specific T cells by multimer reagents. Thus, use of a DUMP channel may become crucial for detecting low frequency antigen-specific immune responses. Further recommendations on assay performance and data presentation guidelines for publication of MULTIMER experimental data are provided.

Recommendations from the iSBTc-SITC/FDA/NCI Workshop on Immunotherapy Biomarkers

PURPOSE

To facilitate development of innovative immunotherapy approaches, especially for treatment concepts exploiting the potential benefits of personalized therapy, there is a need to develop and validate tools to identify patients who can benefit from immunotherapy. Despite substantial effort, we do not yet know which parameters of antitumor immunity to measure and which assays are optimal for those measurements.

EXPERIMENTAL DESIGN

The iSBTc-SITC (International Society for Biological Therapy of Cancer-Society for Immunotherapy of Cancer), FDA (Food and Drug Administration), and NCI (National Cancer Institute) partnered to address these issues for immunotherapy of cancer. Here, we review the major challenges, give examples of approaches and solutions, and present our recommendations.

RESULTS AND CONCLUSIONS

Although specific immune parameters and assays are not yet validated, we recommend following standardized (accurate, precise, and reproducible) protocols and use of functional assays for the primary immunologic readouts of a trial; consideration of central laboratories for immune monitoring of large, multi-institutional trials; and standardized testing of several phenotypic and functional potential potency assays specific to any cellular product. When reporting results, the full QA (quality assessment)/QC (quality control) should be conducted and selected examples of truly representative raw data and assay performance characteristics should be included. Finally, to promote broader analysis of multiple aspects of immunity, and gather data on variability, we recommend that in addition to cells and serum, RNA and DNA samples be banked (under standardized conditions) for later testing. We also recommend that sufficient blood be drawn to allow for planned testing of the primary hypothesis being addressed in the trial, and that additional baseline and posttreatment blood is banked for testing novel hypotheses (or generating new hypotheses) that arise in the field.

Dendritic cell based tumor vaccination in prostate and renal cell cancer: a systematic review and meta-analysis

BACKGROUND

More than 200 clinical trials have been performed using dendritic cells (DC) as cellular adjuvants in cancer. Yet the key question whether there is a link between immune and clinical response remains unanswered. Prostate and renal cell cancer (RCC) have been extensively studied for DC-based immunotherapeutic interventions and were therefore chosen to address the above question by means of a systematic review and meta-analysis.

METHODOLOGY/PRINCIPAL FINDINGS

Data was obtained after a systematic literature search from clinical trials that enrolled at least 6 patients. Individual patient data meta-analysis was performed by means of conditional logistic regression grouped by study. Twenty nine trials involving a total of 906 patients were identified in prostate cancer (17) and RCC (12). Objective response rates were 7.7% in prostate cancer and 12.7% in RCC. The combined percentages of objective responses and stable diseases (SD) amounted to a clinical benefit rate (CBR) of 54% in prostate cancer and 48% in RCC. Meta-analysis of individual patient data (n = 403) revealed the cellular immune response to have a significant influence on CBR, both in prostate cancer (OR 10.6, 95% CI 2.5-44.1) and in RCC (OR 8.4, 95% CI 1.3-53.0). Furthermore, DC dose was found to have a significant influence on CBR in both entities. Finally, for the larger cohort of prostate cancer patients, an influence of DC maturity and DC subtype (density enriched versus monocyte derived DC) as well as access to draining lymph nodes on clinical outcome could be demonstrated.

CONCLUSIONS/SIGNIFICANCE

As a 'proof of principle' a statistically significant effect of DC-mediated cellular immune response and of DC dose on CBR could be demonstrated. Further findings concerning vaccine composition, quality control, and the effect of DC maturation status are relevant for the immunological development of DC-based vaccines.

Tumor vaccination using messenger RNA: prospects of a future therapy

While the endeavor to vaccinate against cancer has been pursued for over 20 years, only recently was the first tumor vaccine approved. Among the different antigen formats assessed for vaccination, coding messenger RNA (mRNA) is emerging as a particularly attractive option. It can code for all types of transcript based proteins, is easy and cost efficient to produce, has a favorable safety profile and enables induction of combined immune responses. Within the last few years major developments have been achieved in this field. Clinical approaches use mRNA either for direct administration or for engineering of adoptively transferred dendritic cells. However, there are still challenges to be overcome for successful clinical application of mRNA-based immunotherapies.

New approaches to design HIV-1 T-cell vaccines

PURPOSE OF REVIEW

Following the evidence that T-cell responses are crucial in the control of HIV-1 infection, vaccines targeting T-cell responses were tested in recent clinical trials. However, these vaccines showed a lack of efficacy. This review attempts to define the qualitative and quantitative features that are desirable for T-cell-induced responses by vaccines. We also describe strategies that could lead to achievement of this goal.

RECENT FINDINGS

Using the yellow fever vaccine as a benchmark of an efficient vaccine, recent studies identified factors of immune protection and more importantly innate immune pathways needed for the establishment of long-term protective adaptive immunity.

SUMMARY

To prevent or control HIV-1 infection, a vaccine must induce efficient and persistent antigen-specific T cells endowed with mucosal homing capacity. Such cells should have the capability to counteract HIV-1 diversity and its rapid spread from the initial site of infection. To achieve this goal, the activation of a diversified innate immune response is critical. New systems biology approaches will provide more precise correlates of immune protection that will pave the way for new approaches in T-cell-based vaccines.

Improved endpoints for cancer immunotherapy trials

Unlike chemotherapy, which acts directly on the tumor, cancer immunotherapies exert their effects on the immune system and demonstrate new kinetics that involve building a cellular immune response, followed by changes in tumor burden or patient survival. Thus, adequate design and evaluation of some immunotherapy clinical trials require a new development paradigm that includes reconsideration of established endpoints. Between 2004 and 2009, several initiatives facilitated by the Cancer Immunotherapy Consortium of the Cancer Research Institute and partner organizations systematically evaluated an immunotherapy-focused clinical development paradigm and created the principles for redefining trial endpoints. On this basis, a body of clinical and laboratory data was generated that supports three novel endpoint recommendations. First, cellular immune response assays generate highly variable results. Assay harmonization in multicenter trials may minimize variability and help to establish cellular immune response as a reproducible biomarker, thus allowing investigation of its relationship with clinical outcomes. Second, immunotherapy may induce novel patterns of antitumor response not captured by Response Evaluation Criteria in Solid Tumors or World Health Organization criteria. New immune-related response criteria were defined to more comprehensively capture all response patterns. Third, delayed separation of Kaplan–Meier curves in randomized immunotherapy trials can affect results. Altered statistical models describing hazard ratios as a function of time and recognizing differences before and after separation of curves may allow improved planning of phase III trials. These recommendations may improve our tools for cancer immunotherapy trials and may offer a more realistic and useful model for clinical investigation.

Vaccine-induced antibody responses in patients with carcinoma

Cancer vaccines based on defined antigens are capable of inducing antibodies that recognize and kill tumor cells. Antibodies are ideally suited to address minimal residual disease, and vaccination in an adjuvant setting may favorably influence the outcome of a disease. The present article gives a short summary of antibody production by B cells, and the mechanism of action of antibodies, as well as a description of the current methods for measuring antibody responses and for assessing their antitumor efficacy in the context of clinical trials. It concludes with an overview of antibody responses induced by vaccines based on structurally defined tumor-associated antigens tested in patients with carcinomas. Correlation between antibody responses, T-cell responses and clinical outcome has been noted in a few studies, signaling the importance of vaccine design and adjuvants to exploit the interactions of the innate and adaptive immune system. However, humoral responses, which may provide a surrogate marker for T-helper responses and simplify monitoring of large Phase III trials, are still not or incompletely explored in many vaccination trials.

Response definition criteria for ELISPOT assays revisited

No consensus has been reached on how to determine if an immune response has been detected based on raw data from an ELISPOT assay. The goal of this paper is to enable investigators to understand and readily implement currently available methods for response determination. We describe empirical and statistical approaches, identifying the strengths and limitations of each approach to allow readers to rationally select and apply a scientifically sound method appropriate to their specific laboratory setting. Five representative approaches were applied to data sets from the CIMT Immunoguiding Program and the response detection and false positive rates were compared. Simulation studies were also performed to compare empirical and statistical approaches. Based on these, we recommend the use of a non-parametric statistical test. Further, we recommend that six medium control wells or four wells each for both medium control and experimental conditions be performed to increase the sensitivity in detecting a response, that replicates with large variation in spot counts be filtered out, and that positive responses arising from experimental spot counts below the estimated limit of detection be interpreted with caution. Moreover, a web-based user interface was developed to allow easy access to the recommended statistical methods. This interface allows the user to upload data from an ELISPOT assay and obtain an output file of the binary responses.

Molecularly defined vaccines for cancer immunotherapy, and protective T cell immunity

Malignant cells are frequently recognized and destroyed by T cells, hence the development of T cell vaccines against established tumors. The challenge is to induce protective type 1 immune responses, with efficient Th1 and CTL activation, and long-term immunological memory. These goals are similar as in many infectious diseases, where successful immune protection is ideally induced with live vaccines. However, large-scale development of live vaccines is prevented by their very limited availability and vector immunogenicity. Synthetic vaccines have multiple advantages. Each of their components (antigens, adjuvants, delivery systems) contributes specifically to induction and maintenance of T cell responses. Here we summarize current experience with vaccines based on proteins and peptide antigens, and discuss approaches for the molecular characterization of clonotypic T cell responses. With carefully designed step-by-step modifications of innovative vaccine formulations, T cell vaccination can be optimized towards the goal of inducing therapeutic immune responses in humans.

Performance of serum-supplemented and serum-free media in IFNgamma Elispot Assays for human T cells

The choice of serum for supplementation of media for T cell assays and in particular, Elispot has been a major challenge for assay performance, standardization, optimization, and reproducibility. The Assay Working Group of the Cancer Vaccine Consortium (CVC-CRI) has recently identified the choice of serum to be the leading cause for variability and suboptimal performance in large international Elispot proficiency panels. Therefore, a serum task force was initiated to compare the performance of commercially available serum-free media to laboratories' own medium/serum combinations. The objective of this project was to investigate whether a serum-free medium exists that performs as well as lab-own serum/media combinations with regard to antigen-specific responses and background reactivity in Elispot. In this way, a straightforward solution could be provided to address the serum challenge. Eleven laboratories tested peripheral blood mononuclear cells (PBMC) from four donors for their reactivity against two peptide pools, following their own Standard Operating Procedure (SOP). Each laboratory performed five simultaneous experiments with the same SOP, the only difference between the experiments was the medium used. The five media were lab-own serum-supplemented medium, AIM-V, CTL, Optmizer, and X-Vivo. The serum task force results demonstrate compellingly that serum-free media perform as well as qualified medium/serum combinations, independent of the applied SOP. Recovery and viability of cells are largely unaffected by serum-free conditions even after overnight resting. Furthermore, one serum-free medium was identified that appears to enhance antigen-specific IFNgamma-secretion.

Vitespen: a preclinical and clinical review

Vitespen is a heat shock protein (gp96)-peptide complex purified from resected autologous tumors, developed as a means of capturing the antigenic 'fingerprint' of a specific cancer for use as a patient-specific vaccine. Vitespen has been extensively assessed in animal models, and clinically in a range of cancers, including Phase I and II trials in colorectal cancer, glioblastoma, lung cancer, melanoma and renal cell carcinoma, and two Phase III studies in melanoma and renal cell carcinoma. Vitespen has shown itself capable of inducing major histocompatibility class I-restricted immune responses in a range of tumor types, and clinical responses in patients with earlier-stage disease, in line with previously published data on cancer vaccines. Vitespen is almost devoid of side effects aside from minor injection-site reactions.

ELISPOT assays provide reproducible results among different laboratories for T-cell immune monitoring--even in hands of ELISPOT-inexperienced investigators

Measurements of antibodies in bodily fluids (e.g., by ELISA) have provided robust and reproducible results for decades and such assays have been validated for monitoring of B-cell immunity. In contrast, measuring T-cell immunity has proven to be a challenge due to the need to test live cells in functional assays ex vivo. Several previous efforts looking into the reproducibility of ex vivo T-cell assays between different laboratories, or even within the same laboratory, have provided rather discouraging results. The hypothesis we tested in this study is that those poor results are due to the lack of assay and data analysis standardization, rather than the inherent complexity of T-cell assays. In this study, 11 laboratories across Europe and the United States were provided identical reagents and were asked to follow the same protocol while testing aliquots of the same three cryopreserved peripheral blood mononuclear cells (PBMC) in an interferon-gamma (IFNgamma) ELISPOT assay measuring the antigen-specific T-cell response to a CMV peptide. All individuals performing the assays were ELISPOT novices. At their first attempt, while three of these individuals failed with the basic logistics of the trial, eight detected the peptide-specific CD8+ T-cells in frequencies approximating the values established by the Reference Laboratory. The data show that ELISPOT assays provide reproducible results among different laboratories when the assay procedure and data analysis is standardized. Since ELISPOT assays have been qualified and validated for regulated studies, they are ideal candidates for robust and reproducible monitoring of T-cell activity in vivo.

Serum is not required for ex vivo IFN-gamma ELISPOT: a collaborative study of different protocols from the European CIMT Immunoguiding Program

The Cancer Immunotherapy Immunoguiding Program has conducted an IFN-γ ELISPOT proficiency panel to examine the influence of serum supplementation of test media on assay performance. Sixteen European laboratories analyzed the same PBMC samples using different locally established protocols. Participants generated two simultaneous data sets—one using medium supplemented with serum and one without serum. Performances of the two test conditions were compared by quantifying: (1) the number of viable cells, (2) background spot formation induced in the medium only control and (3) the ability to detect antigen-specific T cell responses. The study demonstrated that the number of viable cells recovered and the overall background spot production were not significantly different between the two conditions. Furthermore, overall laboratory performance was equivalent for the two test conditions; 11 out of 16 laboratories reported equal or greater detection rates using serum-free medium, while 5 laboratories reported decreased detections rates under serum-free conditions. These results show that good performance of the IFN-γ ELISPOT assay can be achieved under serum-free conditions. Optimization of the protocol for serum-free conditions should result in excellent detection rates and eliminate the requirement of serum batch and stability testing, allowing further harmonization of the assay.

Immunotherapy for neuroblastoma: turning promise into reality

Neuroblastoma is one of the commonest and most aggressive paediatric malignancies. The majority of children present with metastatic disease for which long-term survival remains poor despite intensive multi-modal therapies. Toxicity from current treatment regimes is already significant, and there is little room to further intensify therapy. Alternative treatment strategies are therefore needed in order to improve survival. Immunotherapy is an attractive therapeutic option for these children as it potentially offers a much more specific and less toxic treatment than conventional therapies. This review discusses the different immunotherapy strategies that may be useful in neuroblastoma, their advantages and disadvantages and the challenges that need to be overcome to successfully use them clinically.

"MIATA"-minimal information about T cell assays

Immunotherapy, especially therapeutic vaccination, has a great deal of potential in the treatment of cancer and certain infectious diseases such as HIV (Allison et al., 2006; Fauci et al., 2008; Feldmann and Steinman, 2005). Numerous vaccine candidates have been tested in patients with a variety of tumor types and chronic viral diseases. Often, the best way to assess the clinical potential of these vaccines is to monitor the induced T cell response, and yet there are currently no standards for reporting these results. This letter is an effort to address this problem.

Evaluation and recommendations on good clinical laboratory practice guidelines for phase I-III clinical trials

Marcella Sarzotti-Kelsoe and colleagues harmonize various approaches to Good Clinical Laboratory Practice for clinical trials into a single set of recommendations.

Fit for purpose? A case study: validation of immunological endpoint assays for the detection of cellular and humoral responses to anti-tumour DNA fusion vaccines

Clinical trials are governed by an increasingly stringent regulatory framework, which applies to all levels of trial conduct. Study critical immunological endpoints, which define success or failure in early phase clinical immunological trials, require formal pre-trial validation. In this case study, we describe the assay validation process, during which the sensitivity, and precision of immunological endpoint assays were defined. The purpose was the evaluation of two multicentre phase I/II clinical trials from our unit in Southampton, UK, which assess the effects of DNA fusion vaccines on immune responses in HLA-A2+ patients with carcinoembryonic antigen (CEA)-expressing malignancies and prostate cancer. Validated immunomonitoring is being performed using ELISA and IFNgamma ELISPOTs to assess humoral and cellular responses to the vaccines over time. The validated primary endpoint assay, a peptide-specific CD8+ IFNgamma ELISPOT, was tested in a pre-trial study and found to be suitable for the detection of low frequency naturally occurring CEA- and prostate-derived tumour-antigen-specific T cells in patients with CEA-expressing malignancies and prostate cancer.

Harmonization guidelines for HLA-peptide multimer assays derived from results of a large scale international proficiency panel of the Cancer Vaccine Consortium

Purpose

The Cancer Vaccine Consortium of the Cancer Research Institute (CVC-CRI) conducted a multicenter HLA-peptide multimer proficiency panel (MPP) with a group of 27 laboratories to assess the performance of the assay.

Experimental design

Participants used commercially available HLA-peptide multimers and a well characterized common source of peripheral blood mononuclear cells (PBMC). The frequency of CD8+ T cells specific for two HLA-A2-restricted model antigens was measured by flow cytometry.

The panel design allowed for participants to use their preferred staining reagents and locally established protocols for both cell labeling, data acquisition and analysis.

Results

We observed significant differences in both the performance characteristics of the assay and the reported frequencies of specific T cells across laboratories. These results emphasize the need to identify the critical variables important for the observed variability to allow for harmonization of the technique across institutions.

Conclusions

Three key recommendations emerged that would likely reduce assay variability and thus move toward harmonizing of this assay. (1) Use of more than two colors for the staining (2) collect at least 100,000 CD8 T cells, and (3) use of a background control sample to appropriately set the analytical gates. We also provide more insight into the limitations of the assay and identified additional protocol steps that potentially impact the quality of data generated and therefore should serve as primary targets for systematic analysis in future panels. Finally, we propose initial guidelines for harmonizing assay performance which include the introduction of standard operating protocols to allow for adequate training of technical staff and auditing of test analysis procedures.

Electronic supplementary material

The online version of this article (doi:10.1007/s00262-009-0681-z) contains supplementary material, which is available to authorized users.

Concordant proficiency in measurement of T-cell immunity in human immunodeficiency virus vaccine clinical trials by peripheral blood mononuclear cell and enzyme-linked immunospot assays in laboratories from three continents

The gamma interferon (IFN-gamma) enzyme-linked immunospot (ELISPOT) assay is used routinely to evaluate the potency of human immunodeficiency virus (HIV) vaccine candidates and other vaccine candidates. In order to compare candidates and pool data from multiple trial laboratories, validated standardized methods must be applied across laboratories. Proficiency panels are a key part of a comprehensive quality assurance program to monitor inter- and intralaboratory performance, as well as assay performance, over time. Seven International AIDS Vaccine Initiative-sponsored trial sites participated in the proficiency panels described in this study. At each laboratory, two operators independently processed identical sample sets consisting of frozen peripheral blood mononuclear cell (PBMC) samples from different donors by using four blind stimuli. PBMC recovery and viability after overnight resting and the IFN-gamma ELISPOT assay performance were assessed. All sites demonstrated good performance in PBMC thawing and resting, with a median recovery of 78% and median viability of 95%. The laboratories were able to detect similar antigen-specific T-cell responses, ranging from 50 to >3,000 spot-forming cells per million PBMC. An approximate range of a half log in results from operators within or across sites was seen in comparisons of antigen-specific responses. Consistently low background responses were seen in all laboratories. The results of these proficiency panels demonstrate the ability of seven laboratories, located across three continents, to process PBMC samples and to rank volunteers with differential magnitudes of IFN-gamma ELISPOT responses. These findings also illustrate the ability to standardize the IFN-gamma ELISPOT assay across multiple laboratories when common training methods, reagents such as fetal calf serum, and standard operating procedures are adopted. These results are encouraging for laboratories that are using cell-based immunology assays to test HIV vaccines and other vaccines.

Dendritic cell-based cancer vaccination: quo vadis?

Dendritic cells (DCs) play a central role in the initiation and regulation of primary immune responses. DCs loaded with tumor-associated antigens induce anti-tumoral cytotoxic T cells in vitro and in vivo. However, clinical trials using ex vivo-generated DCs have failed to demonstrate clinical efficacy. This review summarizes recent advances in concepts and techniques that are providing new impulses to DC-based cancer vaccination. Improvements in protocols for ex vivo-generation of DCs, innovations in immunomonitoring, strategies to overcome tumor-induced immunosuppression and insights into the mutual beneficial effects of vaccines and chemotherapy are all considered. Furthermore, we highlight novel developments in cell-free vaccines targeting DCs in vivo.

Whole blood assessment of antigen specific cellular immune response by real time quantitative PCR: a versatile monitoring and discovery tool

Background

Monitoring of cellular immune responses is indispensable in a number of clinical research areas, including microbiology, virology, oncology and autoimmunity. Purification and culture of peripheral blood mononuclear cells and rapid access to specialized equipment are usually required. We developed a whole blood (WB) technique monitoring antigen specific cellular immune response in vaccinated or naturally sensitized individuals.

Methods

WB (300 μl) was incubated at 37°C with specific antigens, in the form of peptides or commercial vaccines for 5–16 hours. Following RNAlater addition to stabilize RNA, the mixture could be stored over one week at room temperature or at 4°C. Total RNA was then extracted, reverse transcribed and amplified in quantitative real-time PCR (qRT-PCR) assays with primers and probes specific for cytokine and/or chemokine genes.

Results

Spiking experiments demonstrated that this technique could detect antigen specific cytokine gene expression from 50 cytotoxic T lymphocytes (CTL) diluted in 300 μl WB. Furthermore, the high sensitivity of this method could be confirmed ex-vivo by the successful detection of CD8+ T cell responses against HCMV, EBV and influenza virus derived HLA-A0201 restricted epitopes, which was significantly correlated with specific multimer staining. Importantly, a highly significant (p = 0.000009) correlation between hepatitis B surface antigen (HBsAg) stimulated IL-2 gene expression, as detectable in WB, and specific antibody titers was observed in donors vaccinated against hepatitis B virus (HBV) between six months and twenty years before the tests. To identify additional markers of potential clinical relevance, expression of chemokine genes was also evaluated. Indeed, HBsAg stimulated expression of MIP-1β (CCL4) gene was highly significantly (p = 0.0006) correlated with specific antibody titers. Moreover, a longitudinal study on response to influenza vaccine demonstrated a significant increase of antigen specific IFN-γ gene expression two weeks after immunization, declining thereafter, whereas increased IL-2 gene expression was still detectable four months after vaccination.

Conclusion

This method, easily amenable to automation, might qualify as technology of choice for high throughput screening of immune responses to large panels of antigens from cohorts of donors. Although analysis of cytokine gene expression requires adequate laboratory infrastructure, initial antigen stimulation and storage of test probes can be performed with minimal equipment and time requirements. This might prove important in "field" studies with difficult access to laboratory facilities.

Dendritic cell vaccination and immune monitoring

We exploited dendritic cells (DC) to vaccinate melanoma patients. We recently demonstrated a statistical significant correlation between favorable clinical outcome and the presence of vaccine-related tumor antigen-specific T cells in delayed type hypersensitivity (DTH) skin biopsies. However, favorable clinical outcome is only observed in a minority of the treated patients. Therefore, it is obvious that current DC-based protocols need to be improved. For this reason, we study in small proof of principle trials the fate, interactions and effectiveness of the injected DC.

Results and harmonization guidelines from two large-scale international Elispot proficiency panels conducted by the Cancer Vaccine Consortium (CVC/SVI)

The Cancer Vaccine Consortium of the Sabin Vaccine Institute (CVC/SVI) is conducting an ongoing large-scale immune monitoring harmonization program through its members and affiliated associations. This effort was brought to life as an external validation program by conducting an international Elispot proficiency panel with 36 laboratories in 2005, and was followed by a second panel with 29 participating laboratories in 2006 allowing for application of learnings from the first panel. Critical protocol choices, as well as standardization and validation practices among laboratories were assessed through detailed surveys. Although panel participants had to follow general guidelines in order to allow comparison of results, each laboratory was able to use its own protocols, materials and reagents. The second panel recorded an overall significantly improved performance, as measured by the ability to detect all predefined responses correctly. Protocol choices and laboratory practices, which can have a dramatic effect on the overall assay outcome, were identified and lead to the following recommendations: (A) Establish a laboratory SOP for Elispot testing procedures including (A1) a counting method for apoptotic cells for determining adequate cell dilution for plating, and (A2) overnight rest of cells prior to plating and incubation, (B) Use only pre-tested serum optimized for low background: high signal ratio, (C) Establish a laboratory SOP for plate reading including (C1) human auditing during the reading process and (C2) adequate adjustments for technical artifacts, and (D) Only allow trained personnel, which is certified per laboratory SOPs to conduct assays. Recommendations described under (A) were found to make a statistically significant difference in assay performance, while the remaining recommendations are based on practical experiences confirmed by the panel results, which could not be statistically tested. These results provide initial harmonization guidelines to optimize Elispot assay performance to the immunotherapy community. Further optimization is in process with ongoing panels.