Performance of Five Metagenomic Classifiers for Virus Pathogen Detection Using Respiratory Samples from a Clinical Cohort

Multicenter benchmarking of short and long read wet lab protocols for clinical viral metagenomics

Metagenomics is gradually being implemented for diagnosing infectious diseases. However, in-depth protocol comparisons for viral detection have been limited to individual sets of experimental workflows and laboratories. In this study, we present a benchmark of metagenomics protocols used in clinical diagnostic laboratories initiated by the European Society for Clinical Virology (ESCV) Network on NGS (ENNGS). A mock viral reference panel was designed to mimic low biomass clinical specimens. The panel was used to assess the performance of twelve metagenomic wet lab protocols currently in use in the diagnostic laboratories of participating ENNGS member institutions. Both Illumina and Nanopore, shotgun and targeted capture probe protocols were included. Performance metrics sensitivity, specificity, and quantitative potential were assessed using a central bioinformatics pipeline. Overall, viral pathogens with loads down to 104 copies/ml (corresponding to CT values of 31 in our PCR assays) were detected by all the evaluated metagenomic wet lab protocols. In contrast, lower abundant mixed viruses of CT values of 35 and higher were detected only by a minority of the protocols. Considering the reference panel as the gold standard, optimal thresholds to define a positive result were determined per protocol, based on the horizontal genome coverage. Implementing these thresholds, sensitivity and specificity of the protocols ranged from 67 to 100 % and 87 to 100 %, respectively. A variety of metagenomic protocols are currently in use in clinical diagnostic laboratories. Detection of low abundant viral pathogens and mixed infections remains a challenge, implying the need for standardization of metagenomic analysis for use in clinical settings.

Comparison of the performance of two targeted metagenomic virus capture probe-based methods using reference control materials and clinical samples

Viral enrichment by probe hybridization has been reported to significantly increase the sensitivity of viral metagenomics. This study compares the analytical performance of two targeted metagenomic virus capture probe-based methods: (i) SeqCap EZ HyperCap by Roche (ViroCap) and (ii) Twist Comprehensive Viral Research Panel workflow, for diagnostic use. Sensitivity, specificity, and limit of detection were analyzed using 25 synthetic viral sequences spiked in increasing proportions of human background DNA, eight clinical samples, and American Type Culture Collection (ATCC) Virome Virus Mix. Sensitivity and specificity were 95% and higher for both methods using the synthetic and reference controls as gold standard. Combining thresholds for viral sequence read counts and genome coverage [respectively 500 reads per million (RPM) and 10% coverage] resulted in optimal prediction of true positive results. Limits of detection were approximately 50-500 copies/mL for both methods as determined by ddPCR. Increasing proportions of spike-in cell-free human background sequences up to 99.999% (50 ng/mL) did not negatively affect viral detection, suggesting effective capture of viral sequences. These data show analytical performances in ranges applicable to clinical samples, for both probe hybridization metagenomic approaches. This study supports further steps toward more widespread use of viral metagenomics for pathogen detection, in clinical and surveillance settings using low biomass samples.

IMPORTANCE

Viral metagenomics has been gradually applied for broad-spectrum pathogen detection of infectious diseases, surveillance of emerging diseases, and pathogen discovery. Viral enrichment by probe hybridization methods has been reported to significantly increase the sensitivity of viral metagenomics. During the past years, a specific hybridization panel distributed by Roche has been adopted in a broad range of different clinical and zoonotic settings. Recently, Twist Bioscience has released a new hybridization panel targeting human and animal viruses. This is the first report comparing the performance of viral metagenomic hybridization panels.

Metagenomics in the fight against zoonotic viral infections: A focus on SARS-CoV-2 analogues

Zoonotic viral infections continue to pose significant threats to global public health, as highlighted by the COVID-19 pandemic caused by the SARS-CoV-2 virus. The emergence of SARS-CoV-2 served as a stark reminder of the potential for zoonotic transmission of viruses from animals to humans. Understanding the origins and dynamics of zoonotic viruses is critical for early detection, prevention, and effective management of future outbreaks. Metagenomics has emerged as a powerful tool for investigating the virome of diverse ecosystems, shedding light on the diversity of viral populations, their hosts, and potential zoonotic spillover events. We provide an in-depth examination of metagenomic approaches, including, NGS metagenomics, shotgun metagenomics, viral metagenomics, and single-virus metagenomics, highlighting their strengths and limitations in identifying and characterizing zoonotic viral pathogens. This review underscores the pivotal role of metagenomics in enhancing our ability to detect, monitor, and mitigate zoonotic viral infections, using SARS-CoV-2 analogues as a case study. We emphasize the need for continued interdisciplinary collaboration among virologists, ecologists, and bioinformaticians to harness the full potential of metagenomic approaches in safeguarding public health against emerging zoonotic threats.

Metagenomics characterization of respiratory viral RNA pathogens in children under five years with severe acute respiratory infection in the Free State, South Africa

Prompt detection of viral respiratory pathogens is crucial in managing respiratory infection including severe acute respiratory infection (SARI). Metagenomics next-generation sequencing (mNGS) and bioinformatics analyses remain reliable strategies for diagnostic and surveillance purposes. This study evaluated the diagnostic utility of mNGS using multiple analysis tools compared with multiplex real-time PCR for the detection of viral respiratory pathogens in children under 5 years with SARI. Nasopharyngeal swabs collected in viral transport media from 84 children admitted with SARI as per the World Health Organization definition between December 2020 and August 2021 in the Free State Province, South Africa, were used in this study. The obtained specimens were subjected to mNGS using the Illumina MiSeq system, and bioinformatics analysis was performed using three web-based analysis tools; Genome Detective, One Codex and Twist Respiratory Viral Research Panel. With average reads of 211323, mNGS detected viral pathogens in 82 (97.6%) of the 84 patients. Viral aetiologies were established in nine previously undetected/missed cases with an additional bacterial aetiology (Neisseria meningitidis) detected in one patient. Furthermore, mNGS enabled the much needed viral genotypic and subtype differentiation and provided significant information on bacterial co-infection despite enrichment for RNA viruses. Sequences of nonhuman viruses, bacteriophages, and endogenous retrovirus K113 (constituting the respiratory virome) were also uncovered. Notably, mNGS had lower detectability rate for severe acute respiratory syndrome coronavirus 2 (missing 18/32 cases). This study suggests that mNGS, combined with multiple/improved bioinformatics tools, is practically feasible for increased viral and bacterial pathogen detection in SARI, especially in cases where no aetiological agent could be identified by available traditional methods.

Development and Validation of a Bioinformatic Workflow for the Rapid Detection of Viruses in Biosecurity

The field of biosecurity has greatly benefited from the widespread adoption of high-throughput sequencing technologies, for its ability to deeply query plant and animal samples for pathogens for which no tests exist. However, the bioinformatics analysis tools designed for rapid analysis of these sequencing datasets are not developed with this application in mind, limiting the ability of diagnosticians to standardise their workflows using published tool kits. We sought to assess previously published bioinformatic tools for their ability to identify plant- and animal-infecting viruses while distinguishing from the host genetic material. We discovered that many of the current generation of virus-detection pipelines are not adequate for this task, being outperformed by more generic classification tools. We created synthetic MinION and HiSeq libraries simulating plant and animal infections of economically important viruses and assessed a series of tools for their suitability for rapid and accurate detection of infection, and further tested the top performing tools against the VIROMOCK Challenge dataset to ensure that our findings were reproducible when compared with international standards. Our work demonstrated that several methods provide sensitive and specific detection of agriculturally important viruses in a timely manner and provides a key piece of ground truthing for method development in this space.