Examining the practical limits of batch effect-correction algorithms: When should you care about batch effects?

Multi-omics data integration using ratio-based quantitative profiling with Quartet reference materials

Characterization and integration of the genome, epigenome, transcriptome, proteome and metabolome of different datasets is difficult owing to a lack of ground truth. Here we develop and characterize suites of publicly available multi-omics reference materials of matched DNA, RNA, protein and metabolites derived from immortalized cell lines from a family quartet of parents and monozygotic twin daughters. These references provide built-in truth defined by relationships among the family members and the information flow from DNA to RNA to protein. We demonstrate how using a ratio-based profiling approach that scales the absolute feature values of a study sample relative to those of a concurrently measured common reference sample produces reproducible and comparable data suitable for integration across batches, labs, platforms and omics types. Our study identifies reference-free 'absolute' feature quantification as the root cause of irreproducibility in multi-omics measurement and data integration and establishes the advantages of ratio-based multi-omics profiling with common reference materials.

MLXIPL associated with tumor-infiltrating CD8+ T cells is involved in poor prostate cancer prognosis

Introduction

Within tumor microenvironment, the presence of preexisting antitumor CD8+ T Q7 cells have been shown to be associated with a favorable prognosis in most solid cancers. However, in the case of prostate cancer (PCa), they have been linked to a negative impact on prognosis.

Methods

To gain a deeper understanding of the contribution of infiltrating CD8+ T cells to poor prognosis in PCa, the infiltration levelsof CD8+ T cells were estimated using the TCGA PRAD (The Cancer Genome Atlas Prostate Adenocarcinoma dataset) and MSKCC (Memorial Sloan Kettering Cancer Center) cohorts.

Results

Bioinformatic analyses revealed that CD8+ T cells likely influence PCa prognosis through increased expression of immune checkpoint molecules and enhanced recruitment of regulatory T cells. The MLXIPL was identified as the gene expressed in response to CD8+ T cell infiltration and was found to be associated with PCa prognosis. The prognostic role of MLXIPL was examined in two cohorts: TCGA PRAD (p = 2.3E-02) and the MSKCC cohort (p = 1.6E-02). Subsequently, MLXIPL was confirmed to be associated with an unfavorable prognosis in PCa, as evidenced by an independent cohort study (hazard ratio [HR] = 2.57, 95% CI: 1.42- 4.65, p = 1.76E-03).

Discussion

In summary, the findings suggested that MLXIPL related to tumor-infiltrating CD8+ T cells facilitated a poor prognosis in PCa.

Identification of Molecular Markers Associated with Prostate Cancer Subtypes: An Integrative Bioinformatics Approach

Prostate cancer (PCa) is characterised by androgen dependency. Unfortunately, under anti-androgen treatment pressure, castration-resistant prostate cancer (CRPC) emerges, characterised by heterogeneous cell populations that, over time, lead to the development of different androgen-dependent or -independent phenotypes. Despite important advances in therapeutic strategies, CRPC remains incurable. Context-specific essential genes represent valuable candidates for targeted anti-cancer therapies. Through the investigation of gene and protein annotations and the integration of published transcriptomic data, we identified two consensus lists to stratify PCa patients' risk and discriminate CRPC phenotypes based on androgen receptor activity. ROC and Kaplan-Meier survival analyses were used for gene set validation in independent datasets. We further evaluated these genes for their association with cancer dependency. The deregulated expression of the PCa-related genes was associated with overall and disease-specific survival, metastasis and/or high recurrence risk, while the CRPC-related genes clearly discriminated between adeno and neuroendocrine phenotypes. Some of the genes showed context-specific essentiality. We further identified candidate drugs through a computational repositioning approach for targeting these genes and treating lethal variants of PCa. This work provides a proof-of-concept for the use of an integrative approach to identify candidate biomarkers involved in PCa progression and CRPC pathogenesis within the goal of precision medicine.

Detection of neuron-derived cfDNA in blood plasma: a new diagnostic approach for neurodegenerative conditions

Neurodegenerative diseases, such as Alzheimer's disease (AD), pose significant challenges in early diagnosis, leading to irreversible brain damage and cognitive decline. In this study, we present a novel diagnostic approach that utilizes whole molecule analysis of neuron-derived cell-free DNA (cfDNA) as a biomarker for early detection of neurodegenerative diseases. By analyzing Differential Methylation Regions (DMRs) between purified cortical neurons and blood plasma samples, we identified robust biomarkers that accurately distinguish between neuronal and non-neuronal cfDNA. The use of cfDNA offers the advantage of convenient and minimally invasive sample collection compared to traditional cerebrospinal fluid or tissue biopsies, making this approach more accessible and patient friendly. Targeted sequencing at the identified DMR locus demonstrated that a conservative cutoff of 5% of neuron-derived cfDNA in blood plasma accurately identifies 100% of patients diagnosed with AD, showing promising potential for early disease detection. Additionally, this method effectively differentiated between patients with mild cognitive impairment (MCI) who later progressed to AD and those who did not, highlighting its prognostic capabilities. Importantly, the differentiation between patients with neurodegenerative diseases and healthy controls demonstrated the specificity of our approach. Furthermore, this cfDNA-based diagnostic strategy outperforms recently developed protein-based assays, which often lack accuracy and convenience. While our current approach focused on a limited set of loci, future research should explore the development of a more comprehensive model incorporating multiple loci to increase diagnostic accuracy further. Although certain limitations, such as technical variance associated with PCR amplification and bisulfite conversion, need to be addressed, this study emphasizes the potential of cfDNA analysis as a valuable tool for pre-symptomatic detection and monitoring of neurodegenerative diseases. With further development and validation, this innovative diagnostic strategy has the potential to significantly impact the field of neurodegenerative disease research and patient care, offering a promising avenue for early intervention and personalized therapeutic approaches.

Correcting batch effects in large-scale multiomics studies using a reference-material-based ratio method

BACKGROUND

Batch effects are notoriously common technical variations in multiomics data and may result in misleading outcomes if uncorrected or over-corrected. A plethora of batch-effect correction algorithms are proposed to facilitate data integration. However, their respective advantages and limitations are not adequately assessed in terms of omics types, the performance metrics, and the application scenarios.

RESULTS

As part of the Quartet Project for quality control and data integration of multiomics profiling, we comprehensively assess the performance of seven batch effect correction algorithms based on different performance metrics of clinical relevance, i.e., the accuracy of identifying differentially expressed features, the robustness of predictive models, and the ability of accurately clustering cross-batch samples into their own donors. The ratio-based method, i.e., by scaling absolute feature values of study samples relative to those of concurrently profiled reference material(s), is found to be much more effective and broadly applicable than others, especially when batch effects are completely confounded with biological factors of study interests. We further provide practical guidelines for implementing the ratio based approach in increasingly large-scale multiomics studies.

CONCLUSIONS

Multiomics measurements are prone to batch effects, which can be effectively corrected using ratio-based scaling of the multiomics data. Our study lays the foundation for eliminating batch effects at a ratio scale.

How missing value imputation is confounded with batch effects and what you can do about it

In data-processing pipelines, upstream steps can influence downstream processes because of their sequential nature. Among these data-processing steps, batch effect (BE) correction (BEC) and missing value imputation (MVI) are crucial for ensuring data suitability for advanced modeling and reducing the likelihood of false discoveries. Although BEC-MVI interactions are not well studied, they are ultimately interdependent. Batch sensitization can improve the quality of MVI. Conversely, accounting for missingness also improves proper BE estimation in BEC. Here, we discuss how BEC and MVI are interconnected and interdependent. We show how batch sensitization can improve any MVI and bring attention to the idea of BE-associated missing values (BEAMs). Finally, we discuss how batch-class imbalance problems can be mitigated by borrowing ideas from machine learning.

Batch-effect correction with sample remeasurement in highly confounded case-control studies

Batch effects are pervasive in biomedical studies. One approach to address the batch effects is repeatedly measuring a subset of samples in each batch. These remeasured samples are used to estimate and correct the batch effects. However, rigorous statistical methods for batch-effect correction with remeasured samples are severely underdeveloped. Here we developed a framework for batch-effect correction using remeasured samples in highly confounded case-control studies. We provided theoretical analyses of the proposed procedure, evaluated its power characteristics and provided a power calculation tool to aid in the study design. We found that the number of samples that need to be remeasured depends strongly on the between-batch correlation. When the correlation is high, remeasuring a small subset of samples is possible to rescue most of the power.

Design, execution, and interpretation of plant RNA-seq analyses

Genomics has transformed our understanding of the genetic architecture of traits and the genetic variation present in plants. Here, we present a review of how RNA-seq can be performed to tackle research challenges addressed by plant sciences. We discuss the importance of experimental design in RNA-seq, including considerations for sampling and replication, to avoid pitfalls and wasted resources. Approaches for processing RNA-seq data include quality control and counting features, and we describe common approaches and variations. Though differential gene expression analysis is the most common analysis of RNA-seq data, we review multiple methods for assessing gene expression, including detecting allele-specific gene expression and building co-expression networks. With the production of more RNA-seq data, strategies for integrating these data into genetic mapping pipelines is of increased interest. Finally, special considerations for RNA-seq analysis and interpretation in plants are needed, due to the high genome complexity common across plants. By incorporating informed decisions throughout an RNA-seq experiment, we can increase the knowledge gained.

MBECS: Microbiome Batch Effects Correction Suite

Despite the availability of batch effect correcting algorithms (BECA), no comprehensive tool that combines batch correction and evaluation of the results exists for microbiome datasets. This work outlines the Microbiome Batch Effects Correction Suite development that integrates several BECAs and evaluation metrics into a software package for the statistical computation framework R.

Concordance-Based Batch Effect Correction for Large-Scale Metabolomics

For a large-scale metabolomics study, sample collection, preparation, and analysis may last several days, months, or even (intermittently) over years. This may lead to apparent batch effects in the acquired metabolomics data due to variability in instrument status, environmental conditions, or experimental operators. Batch effects may confound the true biological relationships among metabolites and thus obscure real metabolic changes. At present, most of the commonly used batch effect correction (BEC) methods are based on quality control (QC) samples, which require sufficient and stable QC samples. However, the quality of the QC samples may deteriorate if the experiment lasts for a long time. Alternatively, isotope-labeled internal standards have been used, but they generally do not provide good coverage of the metabolome. On the other hand, BEC can also be conducted through a data-driven method, in which no QC sample is needed. Here, we propose a novel data-driven BEC method, namely, CordBat, to achieve concordance between each batch of samples. In the proposed CordBat method, a reference batch is first selected from all batches of data, and the remaining batches are referred to as "other batches." The reference batch serves as the baseline for the batch adjustment by providing a coordinate of correlation between metabolites. Next, a Gaussian graphical model is built on the combined dataset of reference and other batches, and finally, BEC is achieved by optimizing the correction coefficients in the other batches so that the correlation between metabolites of each batch and their combinations are in concordance with that of the reference batch. Three real-world metabolomics datasets are used to evaluate the performance of CordBat by comparing it with five commonly used BEC methods. The present experimental results showed the effectiveness of CordBat in batch effect removal and the concordance of correlation between metabolites after BEC. CordBat was found to be comparable to the QC-based methods and achieved better performance in the preservation of biological effects. The proposed CordBat method may serve as an alternative BEC method for large-scale metabolomics that lack proper QC samples.

The importance of batch sensitization in missing value imputation

Data analysis is complex due to a myriad of technical problems. Amongst these, missing values and batch effects are endemic. Although many methods have been developed for missing value imputation (MVI) and batch correction respectively, no study has directly considered the confounding impact of MVI on downstream batch correction. This is surprising as missing values are imputed during early pre-processing while batch effects are mitigated during late pre-processing, prior to functional analysis. Unless actively managed, MVI approaches generally ignore the batch covariate, with unknown consequences. We examine this problem by modelling three simple imputation strategies: global (M1), self-batch (M2) and cross-batch (M3) first via simulations, and then corroborated on real proteomics and genomics data. We report that explicit consideration of batch covariates (M2) is important for good outcomes, resulting in enhanced batch correction and lower statistical errors. However, M1 and M3 are error-generating: global and cross-batch averaging may result in batch-effect dilution, with concomitant and irreversible increase in intra-sample noise. This noise is unremovable via batch correction algorithms and produces false positives and negatives. Hence, careless imputation in the presence of non-negligible covariates such as batch effects should be avoided.

Holistic view of biological nitrogen fixation and phosphorus mobilization in Azotobacter chroococcum NCIMB 8003

Nitrogen (N) and phosphorus (P) deficiencies are two of the most agronomic problems that cause significant decrease in crop yield and quality. N and P chemical fertilizers are widely used in current agriculture, causing environmental problems and increasing production costs. Therefore, the development of alternative strategies to reduce the use of chemical fertilizers while maintaining N and P inputs are being investigated. Although dinitrogen is an abundant gas in the atmosphere, it requires biological nitrogen fixation (BNF) to be transformed into ammonium, a nitrogen source assimilable by living organisms. This process is bioenergetically expensive and, therefore, highly regulated. Factors like availability of other essential elements, as phosphorus, strongly influence BNF. However, the molecular mechanisms of these interactions are unclear. In this work, a physiological characterization of BNF and phosphorus mobilization (PM) from an insoluble form (Ca₃(PO₄)₂) in Azotobacter chroococcum NCIMB 8003 was carried out. These processes were analyzed by quantitative proteomics in order to detect their molecular requirements and interactions. BNF led to a metabolic change beyond the proteins strictly necessary to carry out the process, including the metabolism related to other elements, like phosphorus. Also, changes in cell mobility, heme group synthesis and oxidative stress responses were observed. This study also revealed two phosphatases that seem to have the main role in PM, an exopolyphosphatase and a non-specific alkaline phosphatase PhoX. When both BNF and PM processes take place simultaneously, the synthesis of nitrogenous bases and L-methionine were also affected. Thus, although the interdependence is still unknown, possible biotechnological applications of these processes should take into account the indicated factors.

Normalization of Large-Scale Transcriptome Data Using Heuristic Methods

In this study, we introduce an artificial intelligent method for addressing the batch effect of a transcriptome data. The method has several clear advantages in comparison with the alternative methods presently in use. Batch effect refers to the discrepancy in gene expression data series, measured under different conditions. While the data from the same batch (measurements performed under the same conditions) are compatible, combining various batches into 1 data set is problematic because of incompatible measurements. Therefore, it is necessary to perform correction of the combined data (normalization), before performing biological analysis. There are numerous methods attempting to correct data set for batch effect. These methods rely on various assumptions regarding the distribution of the measurements. Forcing the data elements into pre-supposed distribution can severely distort biological signals, thus leading to incorrect results and conclusions. As the discrepancy between the assumptions regarding the data distribution and the actual distribution is wider, the biases introduced by such “correction methods” are greater. We introduce a heuristic method to reduce batch effect. The method does not rely on any assumptions regarding the distribution and the behavior of data elements. Hence, it does not introduce any new biases in the process of correcting the batch effect. It strictly maintains the integrity of measurements within the original batches.

Dealing with missing values in proteomics data

Proteomics data are often plagued with missingness issues. These missing values (MVs) threaten the integrity of subsequent statistical analyses by reduction of statistical power, introduction of bias, and failure to represent the true sample. Over the years, several categories of missing value imputation (MVI) methods have been developed and adapted for proteomics data. These MVI methods perform their tasks based on different prior assumptions (e.g., data is normally or independently distributed) and operating principles (e.g., the algorithm is built to address random missingness only), resulting in varying levels of performance even when dealing with the same dataset. Thus, to achieve a satisfactory outcome, a suitable MVI method must be selected. To guide decision making on suitable MVI method, we provide a decision chart which facilitates strategic considerations on datasets presenting different characteristics. We also bring attention to other issues that can impact proper MVI such as the presence of confounders (e.g., batch effects) which can influence MVI performance. Thus, these too, should be considered during or before MVI.

Doppelgänger Spotting in Biomedical Gene Expression Data

Doppelgänger effects (DEs) occur when samples exhibit chance similarities such that, when split across training and validation sets, inflates the trained machine learning (ML) model performance. This inflationary effect causes misleading confidence on the deployability of the model. Thus, so far, there are no tools for doppelgänger identification or standard practices to manage their confounding implications. We present doppelgangerIdentifier, a software suite for doppelgänger identification and verification. Applying doppelgangerIdentifier across a multitude of diseases and data types, we show the pervasive nature of DEs in biomedical gene expression data. We also provide guidelines toward proper doppelgänger identification by exploring the ramifications of lingering batch effects from batch imbalances on the sensitivity of our doppelgänger identification algorithm. We suggest doppelgänger verification as a useful procedure to establish baselines for model evaluation that may inform on whether feature selection and ML on the data set may yield meaningful insights.

•

Doppelgänger effects inflate the machine learning performance

•

Doppelgänger effects exist in RNA-Seq and microarray gene expression data

•

Developed doppelgangerIdentifier, a software to identify and verify doppelgängers

•

Provide guidelines for proper doppelgänger identification

Perspectives for better batch effect correction in mass-spectrometry-based proteomics

Mass-spectrometry-based proteomics presents some unique challenges for batch effect correction. Batch effects are technical sources of variation, can confound analysis and usually non-biological in nature. As proteomic analysis involves several stages of data transformation from spectra to protein, the decision on when and what to apply batch correction on is often unclear. Here, we explore several relevant issues pertinent to batch effect correct considerations. The first involves applications of batch effect correction requiring prior knowledge on batch factors and exploring data to uncover new/unknown batch factors. The second considers recent literature that suggests there is no single best batch effect correction algorithm---i.e., instead of a best approach, one may instead ask, what is a suitable approach. The third section considers issues of batch effect detection. And finally, we look at potential developments for proteomic-specific batch effect correction methods and how to do better functional evaluations on batch corrected data.

Batch effect reduction of microarray data with dependent samples using an empirical Bayes approach (BRIDGE)

Batch-effects present challenges in the analysis of high-throughput molecular data and are particularly problematic in longitudinal studies when interest lies in identifying genes/features whose expression changes over time, but time is confounded with batch. While many methods to correct for batch-effects exist, most assume independence across samples; an assumption that is unlikely to hold in longitudinal microarray studies. We propose Batch effect Reduction of mIcroarray data with Dependent samples usinGEmpirical Bayes (BRIDGE), a three-step parametric empirical Bayes approach that leverages technical replicate samples profiled at multiple timepoints/batches, so-called "bridge samples", to inform batch-effect reduction/attenuation in longitudinal microarray studies. Extensive simulation studies and an analysis of a real biological data set were conducted to benchmark the performance of BRIDGE against both ComBat and longitudinalComBat. Our results demonstrate that while all methods perform well in facilitating accurate estimates of time effects, BRIDGE outperforms both ComBat and longitudinal ComBat in the removal of batch-effects in data sets with bridging samples, and perhaps as a result, was observed to have improved statistical power for detecting genes with a time effect. BRIDGE demonstrated competitive performance in batch effect reduction of confounded longitudinal microarray studies, both in simulated and a real data sets, and may serve as a useful preprocessing method for researchers conducting longitudinal microarray studies that include bridging samples.

Mathematical-based microbiome analytics for clinical translation

Traditionally, human microbiology has been strongly built on the laboratory focused culture of microbes isolated from human specimens in patients with acute or chronic infection. These approaches primarily view human disease through the lens of a single species and its relevant clinical setting however such approaches fail to account for the surrounding environment and wide microbial diversity that exists in vivo. Given the emergence of next generation sequencing technologies and advancing bioinformatic pipelines, researchers now have unprecedented capabilities to characterise the human microbiome in terms of its taxonomy, function, antibiotic resistance and even bacteriophages. Despite this, an analysis of microbial communities has largely been restricted to ordination, ecological measures, and discriminant taxa analysis. This is predominantly due to a lack of suitable computational tools to facilitate microbiome analytics. In this review, we first evaluate the key concerns related to the inherent structure of microbiome datasets which include its compositionality and batch effects. We describe the available and emerging analytical techniques including integrative analysis, machine learning, microbial association networks, topological data analysis (TDA) and mathematical modelling. We also present how these methods may translate to clinical settings including tools for implementation. Mathematical based analytics for microbiome analysis represents a promising avenue for clinical translation across a range of acute and chronic disease states.

The role of gene to gene interaction in the breast's genomic signature of pregnancy

Full-term pregnancy at an early age confers long-term protection against breast cancer. Published data shows a specific transcriptomic profile controlling chromatin remodeling that could play a relevant role in the pregnancy-induced protection. This process of chromatin remodeling, induced by the breast differentiation caused by the first full-term pregnancy, has mainly been measured by the expression level of genes individually considered. However, genes equally expressed during the process of chromatin remodeling may behave differently in their interaction with other genes. These changes at the gene cluster level could constitute an additional dimension of chromatin remodeling and therefore of the pregnancy-induced protection. In this research, we apply Information and Graph Theories, Differential Co-expression Network Analysis, and Multiple Regression Analysis, specially designed to examine structural and informational aspects of data sets, to analyze this question. Our findings demonstrate that, independently of the changes in the gene expression at the individual level, there are significant changes in gene-gene interactions and gene cluster behaviors. These changes indicate that the parous breast, through the process of early full-term pregnancy, generates more modules in the networks, with higher density, and a genomic structure performing additional and more complex functions than those found in the nulliparous breast.

Simulating ComBat: how batch correction can lead to the systematic introduction of false positive results in DNA methylation microarray studies

Background

Systematic technical effects—also called batch effects—are a considerable challenge when analyzing DNA methylation (DNAm) microarray data, because they can lead to false results when confounded with the variable of interest. Methods to correct these batch effects are error-prone, as previous findings have shown.

Results

Here, we demonstrate how using the R function ComBat to correct simulated Infinium HumanMethylation450 BeadChip (450 K) and Infinium MethylationEPIC BeadChip Kit (EPIC) DNAm data can lead to a large number of false positive results under certain conditions. We further provide a detailed assessment of the consequences for the highly relevant problem of p-value inflation with subsequent false positive findings after application of the frequently used ComBat method. Using ComBat to correct for batch effects in randomly generated samples produced alarming numbers of false discovery rate (FDR) and Bonferroni-corrected (BF) false positive results in unbalanced as well as in balanced sample distributions in terms of the relation between the outcome of interest variable and the technical position of the sample during the probe measurement. Both sample size and number of batch factors (e.g. number of chips) were systematically simulated to assess the probability of false positive findings. The effect of sample size was simulated using n = 48 up to n = 768 randomly generated samples. Increasing the number of corrected factors led to an exponential increase in the number of false positive signals. Increasing the number of samples reduced, but did not completely prevent, this effect.

Conclusions

Using the approach described, we demonstrate, that using ComBat for batch correction in DNAm data can lead to false positive results under certain conditions and sample distributions. Our results are thus contrary to previous publications, considering a balanced sample distribution as unproblematic when using ComBat. We do not claim completeness in terms of reporting all technical conditions and possible solutions of the occurring problems as we approach the problem from a clinician’s perspective and not from that of a computer scientist. With our approach of simulating data, we provide readers with a simple method to assess the probability of false positive findings in DNAm microarray data analysis pipelines.