Evaluation of commercial SARS-CoV-2 serological assays in Canadian public health laboratories

Adaptive immune responses to two-dose COVID-19 vaccine series in healthy Canadian adults ≥ 50 years: a prospective, observational cohort study

To evaluate immune responses to COVID-19 vaccines in adults aged 50 years and older, spike protein (S)-specific antibody concentration, avidity, and function (via angiotensin-converting enzyme 2 (ACE2) inhibition surrogate neutralization and antibody dependent cellular phagocytosis (ADCP)), as well as S-specific T cells were quantified via activation induced marker (AIM) assay in response to two-dose series. Eighty-four adults were vaccinated with either: mRNA/mRNA (mRNA-1273 and/or BNT162b2); ChAdOx1-S/mRNA; or ChAdOx1-S/ChAdOx1-S. Anti-S IgG concentrations, ADCP scores and ACE2 inhibiting antibody concentrations were highest at one-month post-second dose and declined by four-months post-second dose for all groups. mRNA/mRNA and ChAdOx1-S/mRNA schedules had significantly higher antibody responses than ChAdOx1-S/ChAdOx1-S. CD8+ T-cell responses one-month post-second dose were associated with increased ACE2 surrogate neutralization. Antibody avidity (total relative avidity index) did not change between one-month and four-months post-second dose and did not significantly differ between groups by four-months post-second dose. In determining COVID-19 correlates of protection, a measure that considers both antibody concentration and avidity should be considered.

Riding high: seroprevalence of SARS-CoV-2 after 4 pandemic waves in Manitoba, Canada, April 2020-February 2022

BACKGROUND

Canada is emerging from the largest SARS-CoV-2 Omicron wave to date, with over 3.3 million confirmed cases. Unfortunately, PCR confirmed cases illuminate only a small portion of infections in the community and underestimate true disease burden. Population based seroprevalence studies, which measure antibody levels against a virus can more accurately estimate infection rates in the community and identify geographical and epidemiological trends to inform public health responses.

METHODS

The Manitoba COVID-19 Seroprevalence (MCS) study is a population-based cross-sectional study to assess the prevalence of SARS-CoV-2 antibodies across the province. Residual convenience specimens (n = 14,901) were tested for anti-SARS-CoV-2 nucleocapsid and spike IgG antibodies from April 1, 2020 to February 31, 2022. We estimated the monthly and cumulative prevalence using an exponential decay model, accounting for population demographics, sensitivity/specificity, and antibody waning. This approach generated estimates of natural infection as well as total antibody including vaccine-induced immunity within the community.

FINDINGS

After four waves of the pandemic, 60.1% (95%CI-56.6-63.7) of Manitobans have generated SARS-CoV-2 antibodies due to natural exposure independent of vaccination. Geographical analysis indicates a large portion of provincial prevalence stems from increased transmission in the Northern (92.3%) and Southern (71.8%) regional health authorities. Despite the high mortality rates reported by Manitoba, infection fatality ratios (IFR) peaked at 0.67% and declined to 0.20% following the Omicron wave, indicating parity with other national and international jurisdictions. Manitoba has achieved 93.4% (95%CI- 91.5-95.1) total antibody when including vaccination.

INTERPRETATION

Our data shows that more than 3 in 5 Manitobans have been infected by SARS-CoV-2 after four waves of the pandemic. This study also identifies key geographical and age specific prevalence rates that have contributed greatly to the overall severity of the pandemic in Manitoba and will inform jurisdictions considering reduction of public health measures.

Serology Assays Used in SARS-CoV-2 Seroprevalence Surveys Worldwide: A Systematic Review and Meta-Analysis of Assay Features, Testing Algorithms, and Performance

Background: Many serological assays to detect SARS-CoV-2 antibodies were developed during the COVID-19 pandemic. Differences in the detection mechanism of SARS-CoV-2 serological assays limited the comparability of seroprevalence estimates for populations being tested. Methods: We conducted a systematic review and meta-analysis of serological assays used in SARS-CoV-2 population seroprevalence surveys, searching for published articles, preprints, institutional sources, and grey literature between 1 January 2020, and 19 November 2021. We described features of all identified assays and mapped performance metrics by the manufacturers, third-party head-to-head, and independent group evaluations. We compared the reported assay performance by evaluation source with a mixed-effect beta regression model. A simulation was run to quantify how biased assay performance affects population seroprevalence estimates with test adjustment. Results: Among 1807 included serosurveys, 192 distinctive commercial assays and 380 self-developed assays were identified. According to manufacturers, 28.6% of all commercial assays met WHO criteria for emergency use (sensitivity [Sn.] >= 90.0%, specificity [Sp.] >= 97.0%). However, manufacturers overstated the absolute values of Sn. of commercial assays by 1.0% [0.1, 1.4%] and 3.3% [2.7, 3.4%], and Sp. by 0.9% [0.9, 0.9%] and 0.2% [−0.1, 0.4%] compared to third-party and independent evaluations, respectively. Reported performance data was not sufficient to support a similar analysis for self-developed assays. Simulations indicate that inaccurate Sn. and Sp. can bias seroprevalence estimates adjusted for assay performance; the error level changes with the background seroprevalence. Conclusions: The Sn. and Sp. of the serological assay are not fixed properties, but varying features depending on the testing population. To achieve precise population estimates and to ensure the comparability of seroprevalence, serosurveys should select assays with high performance validated not only by their manufacturers and adjust seroprevalence estimates based on assured performance data. More investigation should be directed to consolidating the performance of self-developed assays.

Characterizing Longitudinal Antibody Responses in Recovered Individuals Following COVID-19 Infection and Single-Dose Vaccination: A Prospective Cohort Study

BACKGROUND

Investigating antibody titers in individuals who have been both naturally infected with SARS-CoV-2 and vaccinated can provide insight into antibody dynamics and correlates of protection over time.

METHODS

Human coronavirus (HCoV) IgG antibodies were measured longitudinally in a prospective cohort of qPCR-confirmed, COVID-19 recovered individuals (k = 57) in British Columbia pre- and post-vaccination. SARS-CoV-2 and endemic HCoV antibodies were measured in serum collected between Nov. 2020 and Sept. 2021 (n = 341). Primary analysis used a linear mixed-effects model to understand the effect of single dose vaccination on antibody concentrations adjusting for biological sex, age, time from infection and vaccination. Secondary analysis investigated the cumulative incidence of high SARS-CoV-2 anti-spike IgG seroreactivity equal to or greater than 5.5 log10 AU/mL up to 105 days post-vaccination. No re-infections were detected in vaccinated participants, post-vaccination by qPCR performed on self-collected nasopharyngeal specimens.

RESULTS

Bivariate analysis (complete data for 42 participants, 270 samples over 472 days) found SARS-CoV-2 spike and RBD antibodies increased 14-56 days post-vaccination (p < 0.001) and vaccination prevented waning (regression coefficient, B = 1.66 [95%CI: 1.45-3.46]); while decline of nucleocapsid antibodies over time was observed (regression coefficient, B = -0.24 [95%CI: -1.2-(-0.12)]). A positive association was found between COVID-19 vaccination and endemic human β-coronavirus IgG titer 14-56 days post vaccination (OC43, p = 0.02 & HKU1, p = 0.02). On average, SARS-CoV-2 anti-spike IgG concentration increased in participants who received one vaccine dose by 2.06 log10 AU/mL (95%CI: 1.45-3.46) adjusting for age, biological sex, and time since infection. Cumulative incidence of high SARS-CoV-2 spike antibodies (>5.5 log10 AU/mL) was 83% greater in vaccinated compared to unvaccinated individuals.

CONCLUSIONS

Our study confirms that vaccination post-SARS-CoV-2 infection provides multiple benefits, such as increasing anti-spike IgG titers and preventing decay up to 85 days post-vaccination.

Evaluation of the performance of multiple immunoassay diagnostic platforms on the National Microbiology Laboratory SARS-CoV-2 National Serology Panel

BACKGROUND

Serological assays designed to detect SARS-CoV-2 antibodies are being used in serological surveys and other specialized applications. As a result, and to ensure that the outcomes of serological testing meet high quality standards, evaluations are required to assess the performance of these assays and the proficiency of laboratories performing them.

METHODS

A panel of 60 plasma/serum samples from blood donors who had reverse transcriptase-polymerase chain reaction (RT-PCR) confirmed SARS-CoV-2 infections and 21 SARS-CoV-2 negative samples were secured and distributed to interested laboratories within Canada (n = 30) and the United States (n = 1). Participating laboratories were asked to provide details on the diagnostic assays used, the platforms the assays were performed on, and the results obtained for each panel sample. Laboratories were blinded with respect to the expected outcomes.

RESULTS

The performance of the different assays evaluated was excellent, with the high-throughput platforms of Roche, Ortho, and Siemens demonstrating 100% sensitivity. Most other high-throughput platforms had sensitivities of >93%, with the exception of the IgG assay using the Abbott ARCHITECT which had an average sensitivity of only 87%. The majority of the high-throughput platforms also demonstrated very good specificities (>97%).

CONCLUSION

This proficiency study demonstrates that most of the SARS-CoV-2 serological assays utilized by provincial public health or hospital laboratories in Canada have acceptable sensitivity and excellent specificity.

A Qualitative Comparison of the Abbott SARS-CoV-2 IgG II Quant Assay against Commonly Used Canadian SARS-CoV-2 Enzyme Immunoassays in Blood Donor Retention Specimens, April 2020 to March 2021

Our group has previously used laboratory and commercially developed assays to understand the IgG responses to SARS-CoV-2 antigens, including nucleocapsid (N), spike (S), and receptor binding domain (RBD), in Canadian blood donors. In this current study, we analyzed 17,428 available and previously characterized retention samples collected from April 2020 to March 2021. The analysis compared the characteristics of the Abbott SARS-CoV-2 IgG II Quant assay (Abbott anti-spike [S], Abbott, Chicago, IL) against four other IgG assays. The Abbott anti-S assay has a qualitative threshold of 50 AU/mL. The four comparator assays were the Abbott anti-nucleocapsid (N) assay and three commonly used Canadian in-house IgG enzyme-linked immunosorbent assays (ELISAs) recognizing distinct recombinant viral antigens, full-length spike glycoprotein, glycoprotein RBD, and nucleocapsid. The strongest qualitative relationship was between Sinai RBD and the Abbott anti-S assay (kappa, 0.707; standard error [SE] of kappa, 0.018; 95% confidence interval, 0.671 to 0.743). We then scored each previously characterized specimen as positive when two anti-SARS-COV-2 assays identified anti-SARS-CoV-2 IgG in the specimen. Using this composite reference standard approach, the sensitivity of the Abbott anti-S assay was 95.96% (95% confidence interval [CI], 93.27 to 97.63%). The specificity of the Abbott anti-S assay was 99.35% (95% CI, 99.21 to 99.46%). Our study provides context on the use of commonly used SARS-CoV-2 serologies in Canada and identifies how these assays qualitatively compare to newer commercial assays. Our next steps are to assess how well the Abbott anti-S assays quantitatively detect wild-type and SARS-CoV-2 variants of concern. IMPORTANCE We describe the qualitative test characteristics of the Abbott SARS-CoV-2 IgG II Quant assay against four other anti-SARS-CoV-2 IgG assays commonly used in Canada. Although there is no gold standard for identifying anti-SARS-CoV-2 seropositivity, aggregate standards can be used to assess seropositivity. In this study, we used a specimen bank of previously well-characterized specimens collected between April 2020 and March 2021. The Abbott anti-S assay showed the strongest qualitative relationship with a widely used laboratory-developed IgG assay for the SARS-CoV-2 receptor binding domain. Using the composite reference standard approach, we also showed that the Abbott anti-S assay was highly sensitive and specific. As new anti-SARS-CoV-2 assays are developed, it is important to compare their test characteristics against other assays that have been extensively used in prior research.

Estimating SARS-CoV-2 Seroprevalence in Canadian Blood Donors, April 2020 to March 2021: Improving Accuracy with Multiple Assays

We have previously used composite reference standards and latent class analysis (LCA) to evaluate the performance of laboratory assays in the presence of tarnished gold standards. Here, we apply these techniques to repeated, cross-sectional study of Canadian blood donors, whose sera underwent parallel testing with four separate SARS-CoV-2 antibody assays. We designed a repeated cross-sectional design with random cross-sectional sampling of all available retention samples (n = 1500/month) for a 12 -month period from April 2020 until March 2021. Each sample was evaluated for SARS-CoV-2 IgG antibodies using four assays an Abbott Architect assay targeting the nucleocapsid antigen (Abbott-NP, Abbott, Chicago IL) and three in-house IgG ELISAs recognizing distinct recombinant viral antigens: full-length spike glycoprotein (Spike), spike glycoprotein receptor binding domain (RBD) and nucleocapsid (NP). We used two analytic approaches to estimate SAR-CoV-2 seroprevalence: a composite reference standard and LCA. Using LCA to estimate true seropositivity status based on the results of the four antibody tests, we estimated that seroprevalence increased from 0.8% (95% CI: 0.5-1.4%) in April 2020 to 6.3% (95% CI: 5.1-7.6%) in March 2021. Our study provides further support for the use of LCA in upcoming public health crises, epidemics, and pandemics when a gold standard assay may not be available or identifiable. IMPORTANCE Here, we describe an approach to estimating seroprevalence in a low prevalence setting when multiple assays are available and yet no known gold standard exists. Because serological studies identify cases through both diagnostic testing and surveillance, and otherwise silent, unrecognized infections, serological data can be used to estimate the true infection fatality ratio of a disease. However, seroprevalence studies rely on assays with imperfect sensitivity and specificity. Seroreversion (loss of antibody response) also occurs over time, and with the advent of vaccination, distinction of antibody response resulting from vaccination as opposed to antibody response due to infection has posed an additional challenge. Our approach indicates that seroprevalence on Canadian blood donors by the end of March 2021was less than 10%. Our study supports the use of latent class analysis in upcoming public health crises, epidemics, and pandemics when a gold standard assay may not be available or identifiable.

Comparative Evaluation of SARS-CoV-2 Rapid Immunochromatographic Test Assays with Chemiluminescent Immunoassay for the Diagnosis of COVID-19

Background To date, the molecular assay is the gold-standard method for COVID-19 diagnosis. However, they are expensive and complex. There is a pressing necessity for developing other effective diagnostics for SARS‐CoV‐2 patients. Therefore, serological detection of antibodies against SARS‐CoV‐2 might provide a good alternative. Aim We aimed to compare and evaluate seven rapid diagnostic tests with Mindray chemiluminescent automated immunoassay as a reference method for SARS-CoV-2 antibodies detection. Methods: This study included the serum of a total of 49 attendees to the Reference Laboratory of Egyptian university hospitals during the period from April 2021 to May 2021. Anti-Covid-19 antibodies detection in serum samples was performed by Mindray fully automated system as our reference method and seven rapid antibody tests; Wondfo, Vazyme, Dynamiker, Panbio, Artron Maccura and Roche. Results: The chemiluminescent assay revealed 30 (61.2%) positive samples and 19 (38.8%) negative samples for COVID-19 IgG. For COVID-19 IgM, 11 (22.4%) samples were positive and 38 (77.6%) samples were negative. Anti-SARS-CoV-2 antibodies were not detected in any of the PCR negative individuals. The best diagnostic performance was demonstrated by Roche IgG and IgM, and Vazyme IgG and IgM antibody tests followed by Panbio. For Roche, the sensitivity and specificity for IgG and IgM were (83.3%, 89.5%) and (72.7%, 81.6%) respectively. Vazyme showed sensitivity and specificity for IgG and IgM were (77.8%, 85.7%) and (75%, 91.7%) respectively. Regards Panbio, the sensitivity and specificity for IgG and IgM were (63.6%, 87.5%) and (50%, 86.7%) respectively. Cohen’s Kappa values revealed a substantial agreement for Roche IgG, Vazyme IgG and IgM of (0.7076, 0.6250, 0.6667) respectively. The worst agreement was reported for Maccura IgG, Wondfo, and Dynamiker IgM with Cohen’s Kappa values of (0.2508, 0.1893, 0.0313) respectively. Conclusions: Rapid tests in our study exhibited heterogeneous diagnostic performances. Roche, Vazyme, and Panbio antibody tests showed promising results in concordance with our reference method with the best-reported results. On the other hand, the other tests were inferior and failed in providing valid and reliable results. Further studies are necessary to determine the practicality of these tests in different settings and communities.