Impact of analytical variability on clinical interpretation of multiplex pneumococcal serology assays

Application of vaccine response in the evaluation of patients with suspected B-cell immunodeficiency: Assessment of responses and challenges with interpretation

Diagnostic vaccination is an integral component in the evaluation of patients suspected to have a B cell or humoral deficiency. Evaluation of antibody production in response to both protein- and polysaccharide-based vaccines aids in distinguishing between specific categories of humoral deficiency. Although assessment of pneumococcal polysaccharide responses is widely available and included in diagnostic guidelines, significant variability still exists in the measurement and interpretation of these responses. Interpretation can also be complicated by age, vaccination history and treatment with immunoglobulin replacement therapy. Despite the challenges and limitations of evaluating pneumococcal polysaccharide vaccine responses, it can provide valuable diagnostic and prognostic information to guide therapeutic intervention. Future efforts are needed to further standardize measurement and interpretation of pneumococcal antibody responses to vaccination and to identify and establish other methods and/or vaccines as alternatives to pneumococcal vaccination to address the challenges in certain patient populations.

Pneumococcal IgG Antibody Responses to 23vPPV in Healthy Controls Using an Automated ELISA

Measurement of pre- and post-pneumococcal antibody levels after immunization with the 23-valent capsular polysaccharide pneumococcal vaccine (23vPPV) is indicative of a T-independent antibody response. The World Health Organisation ELISA is considered gold standard yet is labor-intensive and technically difficult to perform. Interpretation criteria defining an adequate response to 23vPPV remain controversial. The diagnostic Immunology Laboratory at The Royal Children's Hospital, Melbourne (RCH), performs an in-house multi-serotype automated ELISA. The primary objective of this study was to verify RCH interpretation criteria for the laboratory's automated ELISA. Forty pneumococcal conjugate vaccine (PCV)-naïve healthy adults aged 18 to 25 years and 22 PCV-primed healthy children aged 2 to 5 years were immunized with 23vPPV. A serum sample was collected immediately prior and 28 to 42 (± 7) days post immunization. Samples were analyzed on the Tecan Freedom Evo 200 ELISA with adequate response defined as post-immunization antibody level of 1.3 µg/mL or fourfold rise from baseline in ≥ 10/15 serotypes in adult participants and ≥ 4/8 serotypes in pediatric participants. Thirty-nine (97.5%) adults and 22 (100%) children achieved an adequate response to 23vPPV. In PCV-naïve adults, serotypes contained within the conjugate vaccines were less immunogenic, with 12 (30%) adults not achieving an adequate antibody response when only PCV serotypes were used for interpretation. Our diagnostic laboratory has verified the interpretation criteria used for an automated multi-serotype pneumococcal ELISA method. Clinical Trial Registration: ANZCTR registration number ACTRN12618000822280.

A Critical Review on the Standardization and Quality Assessment of Nonfunctional Laboratory Tests Frequently Used to Identify Inborn Errors of Immunity

Inborn errors of immunity (IEI), which were previously termed primary immunodeficiency diseases, represent a large and growing heterogeneous group of diseases that are mostly monogenic. In addition to increased susceptibility to infections, other clinical phenotypes have recently been associated with IEI, such as autoimmune disorders, severe allergies, autoinflammatory disorders, benign lymphoproliferative diseases, and malignant manifestations. The IUIS 2019 classification comprises 430 distinct defects that, although rare individually, represent a group affecting a significant number of patients, with an overall prevalence of 1:1,200-2,000 in the general population. Early IEI diagnosis is critical for appropriate therapy and genetic counseling, however, this process is deeply dependent on accurate laboratory tests. Despite the striking importance of laboratory data for clinical immunologists, several IEI-relevant immunoassays still lack standardization, including standardized protocols, reference materials, and external quality assessment programs. Moreover, well-established reference values mostly remain to be determined, especially for early ages, when the most severe conditions manifest and diagnosis is critical for patient survival. In this article, we intend to approach the issue of standardization and quality control of the nonfunctional diagnostic tests used for IEI, focusing on those frequently utilized in clinical practice. Herein, we will focus on discussing the issues of nonfunctional immunoassays (flow cytometry, enzyme-linked immunosorbent assays, and turbidimetry/nephelometry, among others), as defined by the pure quantification of proteins or cell subsets without cell activation or cell culture-based methods.

Peripheral CD4 T follicular cells induced by a conjugated pneumococcal vaccine correlate with enhanced opsonophagocytic antibody responses in younger individuals

BACKGROUND

PCV13 (conjugated polysaccharide) and PPSV23 (polysaccharide only) are two licensed vaccines targeting S. pneumoniae. The role of CD4 T-cell responses in pneumococcal vaccines among healthy participants and their impact on antibodies is not yet known.

METHODS

Ten adults (5 old and 5 young) received PCV13 (prime) and a year later PPSV23 (boost). Blood samples were collected prior to and multiple time points after vaccination. CD4 T cells responding to CRM₁₉₇, polysaccharide (PS), CRM₁₉₇ conjugated polysaccharide (CPS), PCV13 and PPSV23 vaccines were measured by flow cytometry. Serum antibodies were analyzed via multiplex opsonophagocytosis (MOPA) and pneumococcal IgG assays.

RESULTS

Vaccine-specific CD4 T cells were induced in all ten vaccinees post PCV13. Older vaccinees mounted higher peak responses and those specific for PCV13 and conjugated PS-1 were more polyfunctional compared to the younger group. Vaccine-elicited peripheral T follicular helper (Tfh) cells were only detected in the younger group who also exhibited a higher fold change in OPA titers post both vaccines. Importantly, Tfh cells following PCV13 correlated only with PCV13 serotype specific OPA titers after PPSV23 vaccination.

CONCLUSIONS

These findings demonstrate age related differences in immune response and the potential importance of Tfh in modulating functional antibody responses following pneumococcal vaccination.

Multilaboratory Comparison of Pneumococcal Multiplex Immunoassays Used in Immunosurveillance of Streptococcus pneumoniae across Europe

Serology of Streptococcus pneumoniae is challenging due to existence of multiple clinically relevant serotypes and the introduction of multivalent vaccines in national immunization programs. Multiplex immunoassays (MIAs) are applied as high-throughput cost-effective methods for serosurveillance, and yet laboratories use their own protocols. The aims of this study were to assess the agreement of results generated by MIAs in different laboratories within the EU Pneumo Multiplex Assay Consortium, to analyze factors contributing to differences in outcome, and to create a harmonized protocol. The study demonstrated good agreement of results of MIAs performed by laboratories using controlled assays for determination of levels of vaccine-induced pneumococcal antibodies. The EU Pneumo Multiplex Assay Consortium is open to everyone working in public health services, and it aims to facilitate efforts by participants to run and maintain a cost-effective, reproducible, high-quality MIA platform.

Surveillance studies are required to estimate the impact of pneumococcal vaccination in both children and the elderly across Europe. The World Health Organization (WHO) recommends use of enzyme immunoassays (EIAs) as standard methods for immune surveillance of pneumococcal antibodies. However, as levels of antibodies to multiple serotypes are monitored in thousands of samples, a need for a less laborious and more flexible method has evolved. Fluorescent-bead-based multiplex immunoassays (MIAs) are suitable for this purpose. An increasing number of public health and diagnostic laboratories use MIAs, although the method is not standardized and no international quality assessment scheme exists. The EU Pneumo Multiplex Assay Consortium was initiated in 2013 to advance harmonization of MIAs and to create an international quality assessment scheme. In a multilaboratory comparison organized by the consortium, agreement among nine laboratories that used their own optimized MIA was assessed on a panel of 15 reference sera for 13 pneumococcal serotypes with the new WHO standard 007sp. Agreement was assessed in terms of assay accuracy, reproducibility, repeatability, precision, and bias. The results indicate that the evaluated MIAs are robust and reproducible for measurement of vaccine-induced antibody responses. However, some serotype-specific variability in the results was observed in comparisons of polysaccharides from different sources and of different conjugation methods, especially for serotype 4. On the basis of the results, the consortium has contributed to the harmonization of MIA protocols to improve reliability of immune surveillance of Streptococcus pneumoniae.

IMPORTANCE Serology of Streptococcus pneumoniae is challenging due to existence of multiple clinically relevant serotypes and the introduction of multivalent vaccines in national immunization programs. Multiplex immunoassays (MIAs) are applied as high-throughput cost-effective methods for serosurveillance, and yet laboratories use their own protocols. The aims of this study were to assess the agreement of results generated by MIAs in different laboratories within the EU Pneumo Multiplex Assay Consortium, to analyze factors contributing to differences in outcome, and to create a harmonized protocol. The study demonstrated good agreement of results of MIAs performed by laboratories using controlled assays for determination of levels of vaccine-induced pneumococcal antibodies. The EU Pneumo Multiplex Assay Consortium is open to everyone working in public health services, and it aims to facilitate efforts by participants to run and maintain a cost-effective, reproducible, high-quality MIA platform.

Focusing on Good Responders to Pneumococcal Polysaccharide Vaccination in General Hospital Patients Suspected for Immunodeficiency. A Decision Tree Based on the 23-Valent Pneumococcal IgG Assay

Background and Aim: Recently, the 23-valent IgG-assay was suggested as screening assay to identify poor responders to pneumococcal polysaccharide (PnPS)-vaccination with the serotype-specific assay as a second-line test. However, in a low pre-test probability general hospital setting predicting good responders could be more valuable to reduce the number of samples needing serotyping. Methods: Serotype-specific PnPS antibody-assays were performed for suspected immunodeficiency in two Dutch general hospitals (Jeroen Bosch Hospital, 's-Hertogenbosch; Elisabeth Tweesteden Hospital, Tilburg). 23-Valent PnPS antibody-assays were subsequently performed in archived material. Data were analyzed using receiver operating characteristic curves (AUC) and agreement indices (ICC). Results: Sera of 284 patients (348 samples) were included; 23-valent IgG-titres and the corresponding sum of PnPS-serotype specific antibodies showed moderate correlation (ICC = 0.63). In 232 conjugated-pneumococcal-vaccine-naïve patients (270 samples), a random 23-valent IgG-titer could discriminate between samples with and without ≥7/11, ≥7/13, or ≥6/9 pneumococcal serotypes when both cut-off values 0.35 and 1.0 μg/ml were used (AUC 0.86 and 0.92, respectively). All patients with a pre-immunization-titer ≥38.2 μg/ml and/or post-immunization-titer ≥96.1 μg/ml and none with a post-immunization-titer ≤38.5 μg/ml exhibited a good response to PnPS vaccination. Using these breakpoints as screening test to predict good responders, only 24% of patients would require further serotyping, as opposed to 68% if breakpoints to predict poor responders would have been used. Conclusion: In a low pre-test probability setting, the 23-valent IgG-assay proved to be a reliable screening test for good responders in conjugated-pneumococcal-vaccine-naïve patients, reducing the overall number of patient samples needing further serotyping, thus reducing overall costs of pneumococcal vaccination response assessment.

Comparison of pneumococcal vaccination response in children with sickle cell disease: HbSS and HbSC

INTRODUCTION

Sickle cell disease (SCD) children are at increased risk of invasive pneumococcal disease and rely on penicillin prophylaxis and vaccination for infection prevention. Post-vaccination antibody levels in SCD may wane overtime. HbSC are believed to have better immunological response than HbSS.

OBJECTIVE

To compare antibody response to 23-valent pneumococcal polysaccharide vaccine (PPSV-23) between HbSS and HbSC.

METHODS

Patients with HbSS (n=33) and HbSC (n=11), aged 7-18 years, were prospectively recruited. Luminex pneumococcal antibody levels were measured for 23-serotypes, after two PPSV-23 doses.

RESULTS

Absolute median titer for 20 of the 23 serotypes was higher in HbSC than HbSS and significantly higher for serotypes 22 (3.9 vs. 1.6mcg/ml; p=0.039) and 43 (2.9 vs. 0.8mcg/ml; p=0.007). HbSC mounted a better immune anti-pneumococcal response compared to HbSS (≥1.3mcg/ml) for 18 of 23 serotypes, albeit not significant for any of the serotypes. More HbSC (64%) than HbSS (42%) were good vaccine responders (p=0.303). Two of 21 (10%) good vaccine responders and nine of 23 (39%) poor vaccine responders SCD participants subsequently developed acute chest syndrome or pneumonia (p=0.036). None of the HbSC patients developed ACS after receiving PPSV-23. HbSS poor vaccine responders were at increased future recurrence risk for ACS (p=0.003), pneumonia (p=0.036) or both (p=0.011), compared to good vaccine responders.

CONCLUSION

HbSC possess better pneumococcal vaccine response than HbSS. Poor vaccine response is concerning for future acute pulmonary events. Current vaccination strategy for SCD sub-types are lacking, therefore further study to evaluate utility of vaccine boosters is necessary.

Measuring quantity and function of pneumococcal antibodies in immunoglobulin products

BACKGROUND

Immunoglobulin replacement therapy is a cornerstone of the treatment of primary immunodeficiencies. Preparations used for replacement therapy are processed by purifying immunoglobulins from large pools of plasma, which were obtained from healthy donors. The constituent antibodies in these products depend on the immune history of the donor pool as well as manufacturing processes that differ among manufacturers. For these reasons various methods have been proposed to examine the levels and function of antibodies to organisms such as Streptococcus pneumoniae, which frequently causes infections in patients with immunodeficiencies. Pneumococcal antibody levels or antibody function can be measured with enzyme-linked immunosorbent assay (ELISA) or multiplexed opsonophagocytosis assay (MOPA). Although these assays were developed initially to assess the immunogenicity of pneumococcal vaccines, the techniques have been adapted to evaluate immunoglobulin products as well.

STUDY DESIGN AND METHODS

This article provides a concise review of the analytic techniques for measuring pneumococcal antibodies and prior studies of immunoglobulin products utilizing these methods.

RESULTS

Studies utilizing these assays have demonstrated that antibody levels of immunoglobulin products can vary with time, location, and manufacturer.

CONCLUSIONS

We highlight current issues and future considerations concerning measurement of pneumococcal antibodies in immunoglobulin products, and the assays used for this purpose.

Specific Antibody Deficiencies in Clinical Practice

Specific antibody deficiency (SAD) is defined as the inability to mount an antibody response to purified Streptococcus pneumoniae capsular polysaccharide antigens in the presence of normal immunoglobulin concentrations and normal antibody responses to protein antigens. In this review, we discuss the difficulties in using presently available testing methods to adequately define SAD. The fact that there are different forms of SADs to pneumococcal surface polysaccharides is detailed. The diagnostic and therapeutic implications of recognizing that, in addition to SAD, there are other forms of SAD in the response to S. pneumoniae polysaccharides are described in detail. The conclusion of this review is that assessment of immunity and therapeutic actions to deal with SADs need to be based on clinical evidence rather than solely on arbitrarily defined antibody responses.

Measuring immune responses to pneumococcal vaccines

Quantitative assays that measure immune response to pneumococcal vaccines are not only important for the evaluation of vaccine immunogenicity and efficacy, but are also utilized in the clinical diagnosis of immune deficiency syndromes. Analytical methods have progressed in order to meet changing demands in both of these areas, from early methods to ELISA, and most recently multiplex bead array assays and opsonophagocytosis assays (OPA). It is necessary to understand the evolution of such techniques and the criteria for their interpretation in order to better inform the application of currently available methods, and to guide future investigation into assay development.

Response to Tetanus and Pneumococcal Vaccination Following Administration of Ixekizumab in Healthy Participants

Background

Ixekizumab (IXE) is an interleukin (IL)-17A antagonist approved for the treatment of adults with moderate-to-severe psoriasis.

Objective

The objective of this study was to determine if the immune response to tetanus and pneumococcal vaccines in healthy subjects administered IXE was noninferior to control.

Methods

In a randomized, open-label, parallel-group study, adult subjects received vaccinations alone (N = 42, control) or in combination with 160 mg IXE subcutaneously 2 weeks prior to vaccination and 80 mg IXE on the day of vaccination (N = 41, IXE). Response to tetanus vaccination was defined as anti-tetanus antibodies ≥ 1.0 IU and a ≥ 1.5-fold increase if baseline was ≤ 1.0 IU or a ≥ 2.5-fold increase if baseline was > 1.0 IU. Response to pneumococcal vaccination was defined as a ≥ 2-fold increase from baseline in anti-pneumococcal antibodies against > 50% of the 23 serotypes. The primary outcomes were the percentages of patients with a response to the tetanus and pneumococcal vaccines 4 weeks after vaccination. A noninferiority analysis of IXE to control using a 40% margin was evaluated for the primary outcomes. Safety and pharmacokinetics were also assessed.

Results

IXE (38 completers) was noninferior to control (41 completers) based on the difference in the proportion of responders to tetanus [1.4%; 90% confidence interval (CI) − 16.6 to 19.2] and pneumococcal (− 0.8%; 90% CI − 12.9 to 11.0) vaccines. Twenty subjects (14 IXE, six control) reported 43 mild treatment-emergent adverse events.

Conclusion

IXE does not suppress the humoral immune response to non-live vaccines and was well tolerated in healthy subjects.

ClinicalTrial.gov identifier: NCT02543918.

Electronic supplementary material

The online version of this article (doi:10.1007/s40259-017-0249-y) contains supplementary material, which is available to authorized users.

Divergent humoral responses to 23-valent pneumococcal polysaccharide vaccine in critically-ill burn and neurosurgical patients

INTRODUCTION

Critically ill hospitalized patients are at increased risk of infection so we assessed the immunogenicity of 23-valent pneumococcal polysaccharide vaccine (PPSV23) administered within six days of injury.

METHODS

This prospective observational study compared the immunogenicity of PPSV23 among critically ill burn and neurosurgical patients at a tertiary, academic medical center. Patients received PPSV23 vaccination within six days of ICU admission per standard of care. Consent was obtained to measure concentrations of vaccine-specific IgG to 14 of 23 serotype capsule-specific IgG in serum prior to and 14-35 days following PPSV23. A successful immunologic response was defined as both a ≥2-fold rise in capsule-specific IgG from baseline and concentrations of >1 mcg/mL to 10 of 14 measured vaccine serotypes. Immunologic response was compared between burn and neurosurgical patients. Multiple variable regression methods were used to explore associations of clinical and laboratory parameters to immunologic responses.

RESULTS

Among the 16 burn and 27 neurosurgical patients enrolled, 87.5% and 40.7% generated a successful response to the vaccine, respectively (p = 0.004). Both median post-PPSV23 IgG concentrations (7.79 [4.56-18.1] versus 2.93 [1.49-8.01] mcg/mL; p = 0.006) and fold rises (10.66 [7.44-14.56] versus 3.48 [1.13-6.59]; p<0.001) were significantly greater in burn compared with neurosurgical patients. Presence of burn injury was directly and days from injury to immunization were inversely correlated with successful immunologic response (both p<0.03). Burn injury was associated with both increased median antibody levels post-PPSV23 and fold rise to 14 vaccine serotypes (p<0.03), whereas absolute lymphocyte count was inversely correlated with median antibody concentrations (p = 0.034).

CONCLUSION

Critically ill burn patients can generate successful responses to PPSV23 during acute injury whereas responses among neurosurgical patients is comparatively blunted. Further study is needed to elucidate the mechanisms of differential antigen responsiveness in these populations, including the role of acute stress responses, as well as the durability of these antibody responses.

Value of the Overall Pneumococcal Polysaccharide Response in the Diagnosis of Primary Humoral Immunodeficiencies

Background

An overall response assay [OVA, based on a 23-valent pneumococcal polysaccharide vaccine (PPV23)] is widely used to screen for anti-pneumococcal antibodies. Given the heterogeneity of response from one polysaccharide (PS) to another, a World Health Organization-standardized serotype-specific enzyme-linked immunosorbent assay (SSA) is considered to be the only reliable method for testing anti-PS antibody responses in individuals with suspected primary immunodeficiencies (PIDs).

Objective

To evaluate the OVA relative to the reference SSA.

Methods

Serum samples of adult patients referred for a suspected PID were collected before and then 4–8 weeks after immunization with PPV23. The anti-pneumococcal response was systematically assessed with an SSA (7–16 serotypes) and interpreted according to the American Academy of Asthma, Allergy and Immunology’s current guidelines. We used receiver operating characteristic curves and agreement indices to assess the OVA’s diagnostic value in a first cohort. In order to validate these findings, a second (validation) cohort was then prospectively included.

Results

Sixty-two adult patients were included, and 42 (67.7%) were defined as poor responders according to the SSA. Only the post-immunization titer in the OVA was able to correctly identify poor responders; a titer below 110 mg/L gave a positive predictive value of 100% [identifying 24 (57.1%) of the 42 poor responders], and similar levels of diagnostic performance were observed in the validation cohort. The pre-vaccination antibody titer, the post/pre-vaccination antibody titer ratio and a post-vaccination titer above 110 mg/L in the OVA were not predictive of the response in the SSA.

Conclusion

A post-vaccination antibody titer below 110 mg/L in the OVA was constantly associated with a poor PPV23 response using the SSA. In all other cases, SSA is the only reliable method for assessing diagnostic vaccination with PPV23.

Opportunities and Challenges of Multiplex Assays: A Machine Learning Perspective

Multiplex assays that allow the simultaneous measurement of multiple analytes in small sample quantities have developed into a widely used technology. Their implementation spans across multiple assay systems and can provide readouts of similar quality as the respective single-plex measures, albeit at far higher throughput. Multiplex assay systems are therefore an important element for biomarker discovery and development strategies but analysis of the derived data can face substantial challenges that may limit the possibility of identifying meaningful biological markers. This chapter gives an overview of opportunities and challenges of multiplexed biomarker analysis, in particular from the perspective of machine learning aimed at identification of predictive biological signatures.

Use and clinical interpretation of pneumococcal antibody measurements in the evaluation of humoral immune function

Pneumococcal vaccination is a commonly used technique for assessing the humoral immune status of a patient suspected of having immunodeficiency. Interpretation of what constitutes an adequate response, however, can be challenging. This is due to the complexity of the data generated from serotype-specific assays, historical variations in the assays used to measure pneumococcal antibodies, and varying recommendations on the relevant cut points that define response. In this review, we summarize the historical evolution of assays used for this purpose and discuss the analytical considerations that have influenced published data. We also examine current clinical recommendations for defining an adequate response to vaccination, with a particular focus on the interpretation of serotype-specific data generated by multiplex assays.

Multilaboratory assessment of threshold versus fold-change algorithms for minimizing analytical variability in multiplexed pneumococcal IgG measurements

Pneumococcal vaccination is frequently used to assess a patient's humoral immune function. The comparison of pre- and postvaccination levels of antipneumococcal antibodies is widely held to be the gold standard for documenting a response. However, many of the published criteria for defining an adequate response are based on assays that are no longer widely available. We compared the clinical classification of patient response by multiplex pneumococcal assays currently performed at three large reference laboratories using a variety of published criteria for defining responses in adults. The classification of responders agreed for 79% of the patients when using a threshold-based algorithm compared to 57 to 96% of the patients when using various fold-change-based algorithms. The highest rate of discordance was seen when the most stringent criteria for response were used (4-fold increase postvaccination in 70% of serotypes). The discordant samples tended to show similar patterns of response across all three assays, with small variations in the final number of serotypes converting postvaccination. We conclude that the use of published cut points for documenting response to pneumococcal vaccination can be affected by interlaboratory differences in pneumococcal assays, particularly for algorithms that require large fold changes for a response to be documented. However, the overall patterns of response were similar in virtually all samples, regardless of the assay used.