Validation of an automated, end-to-end metagenomic sequencing assay for agnostic detection of respiratory viruses

BACKGROUND

Current molecular diagnostics are limited in the number and type of detectable pathogens. Metagenomic next generation sequencing (mNGS) is an emerging, and increasingly feasible, pathogen-agnostic diagnostic approach. Translational barriers prohibit the widespread adoption of this technology in clinical laboratories. We validate an end-to-end mNGS assay for detection of respiratory viruses. Our assay is optimized to reduce turnaround time, lower cost-per-sample, increase throughput, and deploy secure and actionable bioinformatic results.

METHODS

We validated our assay using residual nasopharyngeal swab specimens from Vancouver General Hospital (n = 359), RT-PCR-positive, or negative for Influenza, SARS-CoV-2, and RSV. We quantified sample stability, assay precision, the effect of background nucleic acid levels, and analytical limits of detection. Diagnostic performance metrics were estimated.

RESULTS

We report that our mNGS assay is highly precise, semi-quantitative, with analytical limits of detection ranging from 103-104 copies/mL. Our assay is highly specific (100%) and sensitive (61.9% Overall: 86.8%; RT-PCR Ct < 30). Multiplexing capabilities enable processing of up to 55-specimens simultaneously on an Oxford Nanopore GridION device, with results reported within 12-hours.

CONCLUSIONS

This study outlines the diagnostic performance and feasibility of mNGS for respiratory viral diagnostics, infection control, and public health surveillance. We addressed translational barriers to widespread mNGS adoption.

Realizing the value in "non-standard" parts of the qPCR standard curve by integrating fundamentals of quantitative microbiology

The real-time polymerase chain reaction (PCR), commonly known as quantitative PCR (qPCR), is increasingly common in environmental microbiology applications. During the COVID-19 pandemic, qPCR combined with reverse transcription (RT-qPCR) has been used to detect and quantify SARS-CoV-2 in clinical diagnoses and wastewater monitoring of local trends. Estimation of concentrations using qPCR often features a log-linear standard curve model calibrating quantification cycle (Cq) values obtained from underlying fluorescence measurements to standard concentrations. This process works well at high concentrations within a linear dynamic range but has diminishing reliability at low concentrations because it cannot explain "non-standard" data such as Cq values reflecting increasing variability at low concentrations or non-detects that do not yield Cq values at all. Here, fundamental probabilistic modeling concepts from classical quantitative microbiology were integrated into standard curve modeling approaches by reflecting well-understood mechanisms for random error in microbial data. This work showed that data diverging from the log-linear regression model at low concentrations as well as non-detects can be seamlessly integrated into enhanced standard curve analysis. The newly developed model provides improved representation of standard curve data at low concentrations while converging asymptotically upon conventional log-linear regression at high concentrations and adding no fitting parameters. Such modeling facilitates exploration of the effects of various random error mechanisms in experiments generating standard curve data, enables quantification of uncertainty in standard curve parameters, and is an important step toward quantifying uncertainty in qPCR-based concentration estimates. Improving understanding of the random error in qPCR data and standard curve modeling is especially important when low concentrations are of particular interest and inappropriate analysis can unduly affect interpretation, conclusions regarding lab performance, reported concentration estimates, and associated decision-making.

Effector prediction and characterization in the oomycete pathogen Bremia lactucae reveal host-recognized WY domain proteins that lack the canonical RXLR motif

Pathogens that infect plants and animals use a diverse arsenal of effector proteins to suppress the host immune system and promote infection. Identification of effectors in pathogen genomes is foundational to understanding mechanisms of pathogenesis, for monitoring field pathogen populations, and for breeding disease resistance. We identified candidate effectors from the lettuce downy mildew pathogen Bremia lactucae by searching the predicted proteome for the WY domain, a structural fold found in effectors that has been implicated in immune suppression as well as effector recognition by host resistance proteins. We predicted 55 WY domain containing proteins in the genome of B. lactucae and found substantial variation in both sequence and domain architecture. These candidate effectors exhibit several characteristics of pathogen effectors, including an N-terminal signal peptide, lineage specificity, and expression during infection. Unexpectedly, only a minority of B. lactucae WY effectors contain the canonical N-terminal RXLR motif, which is a conserved feature in the majority of cytoplasmic effectors reported in Phytophthora spp. Functional analysis of 21 effectors containing WY domains revealed 11 that elicited cell death on wild accessions and domesticated lettuce lines containing resistance genes, indicative of recognition of these effectors by the host immune system. Only two of the 11 recognized effectors contained the canonical RXLR motif, suggesting that there has been an evolutionary divergence in sequence motifs between genera; this has major consequences for robust effector prediction in oomycete pathogens.

Mutual Information as a Performance Measure for Binary Predictors Characterized by Both ROC Curve and PROC Curve Analysis

The predictive receiver operating characteristic (PROC) curve differs from the more well-known receiver operating characteristic (ROC) curve in that it provides a basis for the evaluation of binary diagnostic tests using metrics defined conditionally on the outcome of the test rather than metrics defined conditionally on the actual disease status. Application of PROC curve analysis may be hindered by the complex graphical patterns that are sometimes generated. Here we present an information theoretic analysis that allows concurrent evaluation of PROC curves and ROC curves together in a simple graphical format. The analysis is based on the observation that mutual information may be viewed both as a function of ROC curve summary statistics (sensitivity and specificity) and prevalence, and as a function of predictive values and prevalence. Mutual information calculated from a 2 × 2 prediction-realization table for a specified risk score threshold on an ROC curve is the same as the mutual information calculated at the same risk score threshold on a corresponding PROC curve. Thus, for a given value of prevalence, the risk score threshold that maximizes mutual information is the same on both the ROC curve and the corresponding PROC curve. Phytopathologists and clinicians who have previously relied solely on ROC curve summary statistics when formulating risk thresholds for application in practical agricultural or clinical decision-making contexts are thus presented with a methodology that brings predictive values within the scope of that formulation.