Challenges for case-control studies with microbiome data

Variability and bias in microbiome metagenomic sequencing: an interlaboratory study comparing experimental protocols

Several studies have documented the significant impact of methodological choices in microbiome analyses. The myriad of methodological options available complicate the replication of results and generally limit the comparability of findings between independent studies that use differing techniques and measurement pipelines. Here we describe the Mosaic Standards Challenge (MSC), an international interlaboratory study designed to assess the impact of methodological variables on the results. The MSC did not prescribe methods but rather asked participating labs to analyze 7 shared reference samples (5 × human stool samples and 2 × mock communities) using their standard laboratory methods. To capture the array of methodological variables, each participating lab completed a metadata reporting sheet that included 100 different questions regarding the details of their protocol. The goal of this study was to survey the methodological landscape for microbiome metagenomic sequencing (MGS) analyses and the impact of methodological decisions on metagenomic sequencing results. A total of 44 labs participated in the MSC by submitting results (16S or WGS) along with accompanying metadata; thirty 16S rRNA gene amplicon datasets and 14 WGS datasets were collected. The inclusion of two types of reference materials (human stool and mock communities) enabled analysis of both MGS measurement variability between different protocols using the biologically-relevant stool samples, and MGS bias with respect to ground truth values using the DNA mixtures. Owing to the compositional nature of MGS measurements, analyses were conducted on the ratio of Firmicutes: Bacteroidetes allowing us to directly apply common statistical methods. The resulting analysis demonstrated that protocol choices have significant effects, including both bias of the MGS measurement associated with a particular methodological choices, as well as effects on measurement robustness as observed through the spread of results between labs making similar methodological choices. In the analysis of the DNA mock communities, MGS measurement bias was observed even when there was general consensus among the participating laboratories. This study was the result of a collaborative effort that included academic, commercial, and government labs. In addition to highlighting the impact of different methodological decisions on MGS result comparability, this work also provides insights for consideration in future microbiome measurement study design.

Challenges and opportunities in sharing microbiome data and analyses

Microbiome data, metadata and analytical workflows have become 'big' in terms of volume and complexity. Although the infrastructure and technologies to share data have been established, the interdisciplinary and multi-omic nature of the field can make resources difficult to identify and use. Following best practices for data deposition requires substantial effort, with sometimes little obvious reward. Gaps remain where microbiome-specific resources for data sharing or reproducibility do not yet exist. We outline available best practices, challenges to their adoption and opportunities in data sharing in microbiome research. We showcase examples of best practices and advocate for their enforcement and incentivization for data sharing. This includes recognition of data curation and sharing endeavours by individuals, institutions, journals and funders. Opportunities for progress include enabling microbiome-specific databases to incorporate future methods for data analysis, integration and reuse.

Impact of Experimental Bias on Compositional Analysis of Microbiome Data

Microbiome data are subject to experimental bias that is caused by DNA extraction and PCR amplification, among other sources, but this important feature is often ignored when developing statistical methods for analyzing microbiome data. McLaren, Willis, and Callahan (2019) proposed a model for how such biases affect the observed taxonomic profiles; this model assumes the main effects of bias without taxon-taxon interactions. Our newly developed method for testing the differential abundance of taxa, LOCOM, is the first method to account for experimental bias and is robust to the main effect biases. However, there is also evidence for taxon-taxon interactions. In this report, we formulated a model for interaction biases and used simulations based on this model to evaluate the impact of interaction biases on the performance of LOCOM as well as other available compositional analysis methods. Our simulation results indicate that LOCOM remained robust to a reasonable range of interaction biases. The other methods tend to have an inflated FDR even when there were only main effect biases. LOCOM maintained the highest sensitivity even when the other methods could not control the FDR. We thus conclude that LOCOM outperforms the other methods for compositional analysis of microbiome data considered here.

Top-down identification of keystone taxa in the microbiome

Keystone taxa in ecological communities are native taxa that play an especially important role in the stability of their ecosystem. However, we still lack an effective framework for identifying these taxa from the available high-throughput sequencing without the notoriously difficult step of reconstructing the detailed network of inter-specific interactions. In addition, while most microbial interaction models assume pair-wise relationships, it is yet unclear whether pair-wise interactions dominate the system, or whether higher-order interactions are relevant. Here we propose a top-down identification framework, which detects keystones by their total influence on the rest of the taxa. Our method does not assume a priori knowledge of pairwise interactions or any specific underlying dynamics and is appropriate to both perturbation experiments and metagenomic cross-sectional surveys. When applied to real high-throughput sequencing of the human gastrointestinal microbiome, we detect a set of candidate keystones and find that they are often part of a keystone module - multiple candidate keystone species with correlated occurrence. The keystone analysis of single-time-point cross-sectional data is also later verified by the evaluation of two-time-points longitudinal sampling. Our framework represents a necessary advancement towards the reliable identification of these key players of complex, real-world microbial communities.

LOCOM: A logistic regression model for testing differential abundance in compositional microbiome data with false discovery rate control

Compositional analysis is based on the premise that a relatively small proportion of taxa are differentially abundant, while the ratios of the relative abundances of the remaining taxa remain unchanged. Most existing methods use log-transformed data, but log-transformation of data with pervasive zero counts is problematic, and these methods cannot always control the false discovery rate (FDR). Further, high-throughput microbiome data such as 16S amplicon or metagenomic sequencing are subject to experimental biases that are introduced in every step of the experimental workflow. McLaren et al. [eLife 8, e46923 (2019)] have recently proposed a model for how these biases affect relative abundance data. Motivated by this model, we show that the odds ratios in a logistic regression comparing counts in two taxa are invariant to experimental biases. With this motivation, we propose logistic compositional analysis (LOCOM), a robust logistic regression approach to compositional analysis, that does not require pseudocounts. Inference is based on permutation to account for overdispersion and small sample sizes. Traits can be either binary or continuous, and adjustment for confounders is supported. Our simulations indicate that LOCOM always preserved FDR and had much improved sensitivity over existing methods. In contrast, analysis of composition of microbiomes (ANCOM) and ANCOM with bias correction (ANCOM-BC)/ANOVA-Like Differential Expression tool (ALDEx2) had inflated FDR when the effect sizes were small and large, respectively. Only LOCOM was robust to experimental biases in every situation. The flexibility of our method for a variety of microbiome studies is illustrated by the analysis of data from two microbiome studies. Our R package LOCOM is publicly available.

Lung microbiome alterations in NSCLC patients

Lung is colonized by a diverse array of microbes and the lung microbiota is profoundly involved in the development of respiratory diseases. There is little knowledge about the role of lung microbiota dysbiosis in lung cancer. In this study, we performed metagenomic sequencing on bronchoalveolar lavage (BAL) from two different sampling methods in non-small cell lung cancer (NSCLC) patients and non-cancer controls. We found the obvious variation between bronchoscopy samples and lobectomy samples. Oral taxa can be found in both bronchoscopy and lobectomy samples and higher abundance of oral taxa can be found in bronchoscopy samples. Although the NSCLC patients had similar microbial communities with non-cancer controls, rare species such as Lactobacillus rossiae, Bacteroides pyogenes, Paenibacillus odorifer, Pseudomonas entomophila, Magnetospirillum gryphiswaldense, fungus Chaetomium globosum et al. showed obvious difference between NSCLC patients and non-cancer controls. Age-, gender-, and smoking-specific species and EGFR expression-related species in NSCLC patients were detected. There results implicated that different lung segments have differential lung microbiome composition. The oral taxa are found in the lobectomy samples suggesting that oral microbiota are the true members of lung microbiota, rather than contamination during bronchoscopy. Lung cancer does not obviously alter the global microbial composition, while rare species are altered more than common species. Certain microbes may be associated with lung cancer progression.

How Do the Players Play? A Post-Genomic Analysis Paradigm to Understand Aquatic Ecosystem Processes

Culture-independent and meta-omics sequencing methods have shed considerable light on the so-called “microbial dark matter” of Earth’s environmental microbiome, improving our understanding of phylogeny, the tree of life, and the vast functional diversity of microorganisms. This influx of sequence data has led to refined and reimagined hypotheses about the role and importance of microbial biomass, that paradoxically, sequencing approaches alone are unable to effectively test. Post-genomic approaches such as metabolomics are providing more sensitive and insightful data to unravel the fundamental operations and intricacies of microbial communities within aquatic systems. We assert that the implementation of integrated post-genomic approaches, specifically metabolomics and metatranscriptomics, is the new frontier of environmental microbiology and ecology, expanding conventional assessments toward a holistic systems biology understanding. Progressing beyond siloed phylogenetic assessments and cataloging of metabolites, toward integrated analysis of expression (metatranscriptomics) and activity (metabolomics) is the most effective approach to provide true insight into microbial contributions toward local and global ecosystem functions. This data in turn creates opportunity for improved regulatory guidelines, biomarker discovery and better integration of modeling frameworks. To that end, critical aquatic environmental issues related to climate change, such as ocean warming and acidification, contamination mitigation, and macro-organism health have reasonable opportunity of being addressed through such an integrative approach. Lastly, we argue that the “post-genomics” paradigm is well served to proactively address the systemic technical issues experienced throughout the genomics revolution and focus on collaborative assessment of field-wide experimental standards of sampling, bioinformatics and statistical treatments.

CoMA - an intuitive and user-friendly pipeline for amplicon-sequencing data analysis

In recent years, there has been a veritable boost in next-generation sequencing (NGS) of gene amplicons in biological and medical studies. Huge amounts of data are produced and need to be analyzed adequately. Various online and offline analysis tools are available; however, most of them require extensive expertise in computer science or bioinformatics, and often a Linux-based operating system. Here, we introduce "CoMA-Comparative Microbiome Analysis" as a free and intuitive analysis pipeline for amplicon-sequencing data, compatible with any common operating system. Moreover, the tool offers various useful services including data pre-processing, quality checking, clustering to operational taxonomic units (OTUs), taxonomic assignment, data post-processing, data visualization, and statistical appraisal. The workflow results in highly esthetic and publication-ready graphics, as well as output files in standardized formats (e.g. tab-delimited OTU-table, BIOM, NEWICK tree) that can be used for more sophisticated analyses. The CoMA output was validated by a benchmark test, using three mock communities with different sample characteristics (primer set, amplicon length, diversity). The performance was compared with that of Mothur, QIIME and QIIME2-DADA2, popular packages for NGS data analysis. Furthermore, the functionality of CoMA is demonstrated on a practical example, investigating microbial communities from three different soils (grassland, forest, swamp). All tools performed well in the benchmark test and were able to reveal the majority of all genera in the mock communities. Also for the soil samples, the results of CoMA were congruent to those of the other pipelines, in particular when looking at the key microbial players.

Seasonal and diel patterns of abundance and activity of viruses in the Red Sea

Virus-microbe interactions have been studied in great molecular details for many years in cultured model systems, yielding a plethora of knowledge on how viruses use and manipulate host machinery. Since the advent of molecular techniques and high-throughput sequencing, methods such as cooccurrence, nucleotide composition, and other statistical frameworks have been widely used to infer virus-microbe interactions, overcoming the limitations of culturing methods. However, their accuracy and relevance is still debatable as cooccurrence does not necessarily mean interaction. Here we introduce an ecological perspective of marine viral communities and potential interaction with their hosts, using analyses that make no prior assumptions on specific virus-host pairs. By size fractionating water samples into free viruses and microbes (i.e., also viruses inside or attached to their hosts) and looking at how viral group abundance changes over time along both fractions, we show that the viral community is undergoing a change in rank abundance across seasons, suggesting a seasonal succession of viruses in the Red Sea. We use abundance patterns in the different size fractions to classify viral clusters, indicating potential diverse interactions with their hosts and potential differences in life history traits between major viral groups. Finally, we show hourly resolved variations of intracellular abundance of similar viral groups, which might indicate differences in their infection cycles or metabolic capacities.

The airway microbiota and exacerbations of COPD

Aim

The aim of this study was to investigate whether the compositionality of the lower airway microbiota predicts later exacerbation risk in persons with COPD in a cohort study.

Materials and methods

We collected lower airways microbiota samples by bronchoalveolar lavage and protected specimen brushes, and oral wash samples from 122 participants with COPD. Bacterial DNA was extracted from all samples, before we sequenced the V3-V4 region of the 16S RNA gene. The frequency of moderate and severe COPD exacerbations was surveyed in telephone interviews and in a follow-up visit. Compositional taxonomy and α and β diversity were compared between participants with and without later exacerbations.

Results

The four most abundant phyla were Firmicutes, Bacteroidetes, Proteobacteria and Fusobacteria in both groups, and the four most abundant genera were Streptococcus, Veillonella, Prevotella and Gemella. The relative abundances of different taxa showed a large variation between samples and individuals, and no statistically significant difference of either compositional taxonomy, or α or β diversity could be found between participants with and without COPD exacerbations within follow-up.

Conclusion

The findings from the current study indicate that individual differences in the lower airway microbiota in persons with COPD far outweigh group differences between frequent and nonfrequent COPD exacerbators, and that the compositionality of the microbiota is so complex as to present large challenges for use as a biomarker of later exacerbations.

Contrary to previous reports, in this study there were no significant associations between the lung microbiota in stable COPD and COPD exacerbation frequencyhttps://bit.ly/2ZVcNdG

Understanding and interpreting community sequencing measurements of the vaginal microbiome

Community-wide high-throughput sequencing has transformed the study of the vaginal microbiome, and clinical applications are on the horizon. Here we outline the three main community sequencing methods: (1) amplicon sequencing, (2) shotgun metagenomic sequencing, and (3) metatranscriptomic sequencing. We discuss the advantages and limitations of community sequencing generally, and the unique strengths and weaknesses of each method. We briefly review the contributions of community sequencing to vaginal microbiome research and practice. We develop suggestions for critically interpreting research results and potential clinical applications based on community sequencing of the vaginal microbiome. TWEETABLE ABSTRACT: We review the advantages and limitations of amplicon sequencing, metagenomics, and metatranscriptomics methods for the study of the vaginal microbiome.

Perspectives for Consideration in the Development of Microbial Cell Reference Materials

Microbiome measurement and analyses benefit greatly from incorporation of reference materials as controls. However, there are many points to consider in defining an ideal whole-cell reference material standard. Such a standard would embody all the diversity and measurement challenges present in real samples, would be completely characterized to provide "ground truth" data, and would be inexpensive and widely available. This ideal is, unfortunately, not readily attainable because of the diverse nature of different sequencing projects. Some applications may benefit most from highly complex reference materials, while others will value characterization or low expense more highly. The selection of appropriate microbial whole-cell reference materials to benchmark and validate microbial measurements should be considered carefully and may vary among specific applications. In this article, we describe a perspective on the development of whole-cell microbial reference materials for use in metagenomics analyses.

Consistent and correctable bias in metagenomic sequencing experiments

Marker-gene and metagenomic sequencing have profoundly expanded our ability to measure biological communities. But the measurements they provide differ from the truth, often dramatically, because these experiments are biased toward detecting some taxa over others. This experimental bias makes the taxon or gene abundances measured by different protocols quantitatively incomparable and can lead to spurious biological conclusions. We propose a mathematical model for how bias distorts community measurements based on the properties of real experiments. We validate this model with 16S rRNA gene and shotgun metagenomics data from defined bacterial communities. Our model better fits the experimental data despite being simpler than previous models. We illustrate how our model can be used to evaluate protocols, to understand the effect of bias on downstream statistical analyses, and to measure and correct bias given suitable calibration controls. These results illuminate new avenues toward truly quantitative and reproducible metagenomics measurements.

Consistent and correctable bias in metagenomic sequencing experiments

Marker-gene and metagenomic sequencing have profoundly expanded our ability to measure biological communities. But the measurements they provide differ from the truth, often dramatically, because these experiments are biased toward detecting some taxa over others. This experimental bias makes the taxon or gene abundances measured by different protocols quantitatively incomparable and can lead to spurious biological conclusions. We propose a mathematical model for how bias distorts community measurements based on the properties of real experiments. We validate this model with 16S rRNA gene and shotgun metagenomics data from defined bacterial communities. Our model better fits the experimental data despite being simpler than previous models. We illustrate how our model can be used to evaluate protocols, to understand the effect of bias on downstream statistical analyses, and to measure and correct bias given suitable calibration controls. These results illuminate new avenues toward truly quantitative and reproducible metagenomics measurements.

A latent allocation model for the analysis of microbial composition and disease

Background

Establishing the relationship between microbiota and specific diseases is important but requires appropriate statistical methodology. A specialized feature of microbiome count data is the presence of a large number of zeros, which makes it difficult to analyze in case-control studies. Most existing approaches either add a small number called a pseudo-count or use probability models such as the multinomial and Dirichlet-multinomial distributions to explain the excess zero counts, which may produce unnecessary biases and impose a correlation structure taht is unsuitable for microbiome data.

Results

The purpose of this article is to develop a new probabilistic model, called BERnoulli and MUltinomial Distribution-based latent Allocation (BERMUDA), to address these problems. BERMUDA enables us to describe the differences in bacteria composition and a certain disease among samples. We also provide a simple and efficient learning procedure for the proposed model using an annealing EM algorithm.

Conclusion

We illustrate the performance of the proposed method both through both the simulation and real data analysis. BERMUDA is implemented with R and is available from GitHub (https://github.com/abikoushi/Bermuda).

Impact of DNA extraction method and targeted 16S-rRNA hypervariable region on oral microbiota profiling

Amplification and sequencing of 16S amplicons are widely used for profiling the structure of oral microbiota. However, it remains not clear whether and to what degree DNA extraction and targeted 16S rRNA hypervariable regions influence the analysis. Based on a mock community consisting of five oral bacterial species in equal abundance, we compared the 16S amplicon sequencing results on the Illumina MiSeq platform from six frequently employed DNA extraction procedures and three pairs of widely used 16S rRNA hypervariable primers targeting different 16S rRNA regions. Technical reproducibility of selected 16S regions was also assessed. DNA extraction method exerted considerable influence on the observed bacterial diversity while hypervariable regions had a relatively minor effect. Protocols with beads added to the enzyme-mediated DNA extraction reaction produced more accurate bacterial community structure than those without either beads or enzymes. Hypervariable regions targeting V3-V4 and V4-V5 seemed to produce more reproducible results than V1-V3. Neither sequencing batch nor change of operator affected the reproducibility of bacterial diversity profiles. Therefore, DNA extraction strategy and 16S rDNA hypervariable regions both influenced the results of oral microbiota biodiversity profiling, thus should be carefully considered in study design and data interpretation.

Processing and Analyzing Human Microbiome Data

The human microbiome is associated with complex disorders such as diabetes, cancer, obesity and cardiovascular disorders. Recent technological developments have allowed researchers to fully quantify the composition of the microbiome using culture-independent approaches, resulting in a large amount of microbiome data, which provide invaluable opportunities to assess the important contributions of the microbiome to human health and disease. In this chapter, we discuss and evaluate multiple statistical approaches for processing, summarizing, and analyzing microbiome data. Specifically, we provide programming scripts for processing microbiome data using QIIME and calculating alpha and beta diversities, assessing the association between diversities and outcomes of interest using R programs, as well as interpretation of results. We illustrate the methods in the context of analyzing the foregut microbiome in esophageal adenocarcinoma.

Experimental design and quantitative analysis of microbial community multiomics

Studies of the microbiome have become increasingly sophisticated, and multiple sequence-based, molecular methods as well as culture-based methods exist for population-scale microbiome profiles. To link the resulting host and microbial data types to human health, several experimental design considerations, data analysis challenges, and statistical epidemiological approaches must be addressed. Here, we survey current best practices for experimental design in microbiome molecular epidemiology, including technologies for generating, analyzing, and integrating microbiome multiomics data. We highlight studies that have identified molecular bioactives that influence human health, and we suggest steps for scaling translational microbiome research to high-throughput target discovery across large populations.

Statistical analysis of co-occurrence patterns in microbial presence-absence datasets

Drawing on a long history in macroecology, correlation analysis of microbiome datasets is becoming a common practice for identifying relationships or shared ecological niches among bacterial taxa. However, many of the statistical issues that plague such analyses in macroscale communities remain unresolved for microbial communities. Here, we discuss problems in the analysis of microbial species correlations based on presence-absence data. We focus on presence-absence data because this information is more readily obtainable from sequencing studies, especially for whole-genome sequencing, where abundance estimation is still in its infancy. First, we show how Pearson's correlation coefficient (r) and Jaccard's index (J)-two of the most common metrics for correlation analysis of presence-absence data-can contradict each other when applied to a typical microbiome dataset. In our dataset, for example, 14% of species-pairs predicted to be significantly correlated by r were not predicted to be significantly correlated using J, while 37.4% of species-pairs predicted to be significantly correlated by J were not predicted to be significantly correlated using r. Mismatch was particularly common among species-pairs with at least one rare species (<10% prevalence), explaining why r and J might differ more strongly in microbiome datasets, where there are large numbers of rare taxa. Indeed 74% of all species-pairs in our study had at least one rare species. Next, we show how Pearson's correlation coefficient can result in artificial inflation of positive taxon relationships and how this is a particular problem for microbiome studies. We then illustrate how Jaccard's index of similarity (J) can yield improvements over Pearson's correlation coefficient. However, the standard null model for Jaccard's index is flawed, and thus introduces its own set of spurious conclusions. We thus identify a better null model based on a hypergeometric distribution, which appropriately corrects for species prevalence. This model is available from recent statistics literature, and can be used for evaluating the significance of any value of an empirically observed Jaccard's index. The resulting simple, yet effective method for handling correlation analysis of microbial presence-absence datasets provides a robust means of testing and finding relationships and/or shared environmental responses among microbial taxa.

Second Era of OMICS in Caries Research: Moving Past the Phase of Disillusionment

Novel approaches using OMICS techniques enable a collective assessment of multiple related biological units, including genes, gene expression, proteins, and metabolites. In the past decade, next-generation sequencing ( NGS) technologies were improved by longer sequence reads and the development of genome databases and user-friendly pipelines for data analysis, all accessible at lower cost. This has generated an outburst of high-throughput data. The application of OMICS has provided more depth to existing hypotheses as well as new insights in the etiology of dental caries. For example, the determination of complete bacterial microbiomes of oral samples rather than selected species, together with oral metatranscriptome and metabolome analyses, supports the viewpoint of dysbiosis of the supragingival biofilms. In addition, metabolome studies have been instrumental in disclosing the contributions of major pathways for central carbon and amino acid metabolisms to biofilm pH homeostasis. New, often noncultured, oral streptococci have been identified, and their phenotypic characterization has revealed candidates for probiotic therapy. Although findings from OMICS research have been greatly informative, problems related to study design, data quality, integration, and reproducibility still need to be addressed. Also, the emergence and continuous updates of these computationally demanding technologies require expertise in advanced bioinformatics for reliable interpretation of data. Despite the obstacles cited above, OMICS research is expected to encourage the discovery of novel caries biomarkers and the development of next-generation diagnostics and therapies for caries control. These observations apply equally to the study of other oral diseases.