A Bi-Objective RNN Model to Reconstruct Gene Regulatory Network: A Modified Multi-Objective Simulated Annealing Approach

BIC-LP: A Hybrid Higher-Order Dynamic Bayesian Network Score Function for Gene Regulatory Network Reconstruction

Reconstructing gene regulatory networks(GRNs) is an increasingly hot topic in bioinformatics. Dynamic Bayesian network(DBN) is a stochastic graph model commonly used as a vital model for GRN reconstruction. But probabilistic characteristics of biological networks and the existence of data noise bring great challenges to GRN reconstruction and always lead to many false positive/negative edges. ScoreLasso is a hybrid DBN score function combining DBN and linear regression with good performance. Its performance is, however, limited by first-order assumption and ignorance of the initial network of DBN. In this article, an integrated model based on higher-order DBN model, higher-order Lasso linear regression model and Pearson correlation model is proposed. Based on this, a hybrid higher-order DBN score function for GRN reconstruction is proposed, namely BIC-LP. BIC-LP score function is constructed by adding terms based on Lasso linear regression coefficients and Pearson correlation coefficients on classical BIC score function. Therefore, it could capture more information from dataset and curb information loss, compared with both many existing Bayesian family score functions and many state-of-the-art methods for GRN reconstruction. Experimental results show that BIC-LP can reasonably eliminate some false positive edges while retaining most true positive edges, so as to achieve better GRN reconstruction performance.

Inferring causal gene regulatory network via GreyNet: From dynamic grey association to causation

Gene regulatory network (GRN) provides abundant information on gene interactions, which contributes to demonstrating pathology, predicting clinical outcomes, and identifying drug targets. Existing high-throughput experiments provide rich time-series gene expression data to reconstruct the GRN to further gain insights into the mechanism of organisms responding to external stimuli. Numerous machine-learning methods have been proposed to infer gene regulatory networks. Nevertheless, machine learning, especially deep learning, is generally a “black box,” which lacks interpretability. The causality has not been well recognized in GRN inference procedures. In this article, we introduce grey theory integrated with the adaptive sliding window technique to flexibly capture instant gene–gene interactions in the uncertain regulatory system. Then, we incorporate generalized multivariate Granger causality regression methods to transform the dynamic grey association into causation to generate directional regulatory links. We evaluate our model on the DREAM4 in silico benchmark dataset and real-world hepatocellular carcinoma (HCC) time-series data. We achieved competitive results on the DREAM4 compared with other state-of-the-art algorithms and gained meaningful GRN structure on HCC data respectively.

Inferring Gene Regulatory Networks From Single-Cell Transcriptomic Data Using Bidirectional RNN

Accurate inference of gene regulatory rules is critical to understanding cellular processes. Existing computational methods usually decompose the inference of gene regulatory networks (GRNs) into multiple subproblems, rather than detecting potential causal relationships simultaneously, which limits the application to data with a small number of genes. Here, we propose BiRGRN, a novel computational algorithm for inferring GRNs from time-series single-cell RNA-seq (scRNA-seq) data. BiRGRN utilizes a bidirectional recurrent neural network to infer GRNs. The recurrent neural network is a complex deep neural network that can capture complex, non-linear, and dynamic relationships among variables. It maps neurons to genes, and maps the connections between neural network layers to the regulatory relationship between genes, providing an intuitive solution to model GRNs with biological closeness and mathematical flexibility. Based on the deep network, we transform the inference of GRNs into a regression problem, using the gene expression data at previous time points to predict the gene expression data at the later time point. Furthermore, we adopt two strategies to improve the accuracy and stability of the algorithm. Specifically, we utilize a bidirectional structure to integrate the forward and reverse inference results and exploit an incomplete set of prior knowledge to filter out some candidate inferences of low confidence. BiRGRN is applied to four simulated datasets and three real scRNA-seq datasets to verify the proposed method. We perform comprehensive comparisons between our proposed method with other state-of-the-art techniques. These experimental results indicate that BiRGRN is capable of inferring GRN simultaneously from time-series scRNA-seq data. Our method BiRGRN is implemented in Python using the TensorFlow machine-learning library, and it is freely available at https://gitee.com/DHUDBLab/bi-rgrn.

Multi-objective Simulated Annealing Variants to Infer Gene Regulatory Network: A Comparative Study

Gene Regulatory Network (GRN) is formed due to mutual transcriptional regulation within a set of protein coding genes in cellular context of an organism. Computational inference of GRN is important to understand the behavior of each gene in terms of change in its protein production rate (expression level). As Recurrent Neural Network (RNN) is efficient in GRN modeling, a bi-objective RNN formulation has been applied here. Based on Archived Multi Objective Simulated Annealing (AMOSA), four algorithms, namely, AMOSA Revised (AMOSAR), Modified Freezing based AMOSA (AMOFSA), Tabu based AMOSA (AMOTSA) and Modified Freezing and Tabu based AMOSA (AMOFTSA) have been proposed and applied to RNN (treated as GRN) for parameter learning taking four gene expression time series datasets. Comparative studies on the performance of the algorithms (based on each dataset) have been made in terms of the number of GRNs obtained in the final non-dominated front and the performance metrics, namely, recall, precision and f1 score. Two proposed variants, namely, AMOFSA and AMOTSA have been found competitive in performance. Experimental observations and statistical analysis show that, modified algorithms are better than AMOSAR and the state-of-the-art algorithms in respect of the above-mentioned metrics.

Gene Regulatory Network Construction Based on a Particle Swarm Optimization of a Long Short-term Memory Network

Background:

The Gene Regulatory Network (GRN) is a model for studying the function and behavior of genes by treating the genome as a whole, which can reveal the gene expression mechanism. However, due to the dynamics, nonlinearity, and complexity of gene expression data, it is a challenging task to construct a GRN precisely. And in the circulating cooling water system, the Slime-Forming Bacteria (SFB) is one of the bacteria that helps to form dirt. In order to explore the microbial fouling mechanism of SFB, constructing a GRN for the fouling-forming genes of SFB is significant.

Objective:

Propose an effective GRN construction method and construct a GRN for the foulingforming genes of SFB.

Methods:

In this paper, a combination method of Long Short-Term Memory Network (LSTM) and Mean Impact Value (MIV) was applied for GRN reconstruction. Firstly, LSTM was employed to establish a gene expression prediction model. To improve the performance of LSTM, a Particle Swarm Optimization (PSO) was introduced to optimize the weight and learning rate. Then, the MIV was used to infer the regulation among genes. In view of the fouling-forming problem of SFB, we have designed electromagnetic field experiments and transcriptome sequencing experiments to locate the fouling-forming genes and obtain gene expression data.

Results:

In order to test the proposed approach, the proposed method was applied to three datasets: a simulated dataset and two real biology datasets. By comparing with other methods, the experimental results indicate that the proposed method has higher modeling accuracy and it can be used to effectively construct a GRN. And at last, a GRN for fouling-forming genes of SFB was constructed using the proposed approach.

Conclusion:

The experiments indicated that the proposed approach can reconstruct a GRN precisely, and compared with other approaches, the proposed approach performs better in extracting the regulations among genes.