On reaction network implementations of neural networks

Mixtures Recomposition by Neural Nets: A Multidisciplinary Overview

Artificial Neural Networks (ANNs) are transforming how we understand chemical mixtures, providing an expressive view of the chemical space and multiscale processes. Their hybridization with physical knowledge can bridge the gap between predictivity and understanding of the underlying processes. This overview explores recent progress in ANNs, particularly their potential in the 'recomposition' of chemical mixtures. Graph-based representations reveal patterns among mixture components, and deep learning models excel in capturing complexity and symmetries when compared to traditional Quantitative Structure-Property Relationship models. Key components, such as Hamiltonian networks and convolution operations, play a central role in representing multiscale mixtures. The integration of ANNs with Chemical Reaction Networks and Physics-Informed Neural Networks for inverse chemical kinetic problems is also examined. The combination of sensors with ANNs shows promise in optical and biomimetic applications. A common ground is identified in the context of statistical physics, where ANN-based methods iteratively adapt their models by blending their initial states with training data. The concept of mixture recomposition unveils a reciprocal inspiration between ANNs and reactive mixtures, highlighting learning behaviors influenced by the training environment.

Biology-inspired graph neural network encodes reactome and reveals biochemical reactions of disease

Functional heterogeneity of healthy human tissues complicates interpretation of molecular studies, impeding precision therapeutic target identification and treatment. Considering this, we generated a graph neural network with Reactome-based architecture and trained it using 9,115 samples from Genotype-Tissue Expression (GTEx). Our graph neural network (GNN) achieves adjusted Rand index (ARI) = 0.7909, while a Resnet18 control model achieves ARI = 0.7781, on 370 held-out healthy human tissue samples from The Cancer Genome Atlas (TCGA), despite the Resnet18 using over 600 times the parameters. Our GNN also succeeds in separating 83 healthy skin samples from 95 lesional psoriasis samples, revealing that upregulation of 26S- and NUB1-mediated degradation of NEDD8, UBD, and their conjugates is central to the largest perturbed reaction network component in psoriasis. We show that our results are not discoverable using traditional differential expression and hypergeometric pathway enrichment analyses yet are supported by separate human multi-omics and small-molecule mouse studies, suggesting future molecular disease studies may benefit from similar GNN analytical approaches.

A survey on molecular-scale learning systems with relevance to DNA computing

DNA computing has emerged as a promising alternative to achieve programmable behaviors in chemistry by repurposing the nucleic acid molecules into chemical hardware upon which synthetic chemical programs can be executed. These chemical programs are capable of simulating diverse behaviors, including boolean logic computation, oscillations, and nanorobotics. Chemical environments such as the cell are marked by uncertainty and are prone to random fluctuations. For this reason, potential DNA-based molecular devices that aim to be deployed into such environments should be capable of adapting to the stochasticity inherent in them. In keeping with this goal, a new subfield has emerged within DNA computing, focusing on developing approaches that embed learning and inference into chemical reaction systems. If realized in biochemical contexts, such molecular machines can engender novel applications in fields such as biotechnology, synthetic biology, and medicine. Therefore, it would be beneficial to review how different ideas were conceived, how the progress has been so far, and what the emerging ideas are in this nascent field of 'molecular-scale learning'.

Programming and training rate-independent chemical reaction networks

To program complex behavior in environments incompatible with electronic controllers such as within bioreactors or engineered cells, we turn to chemical information processors. While chemical reactions can perform computation in the stoichiometric exchange of reactants for products (how many molecules of which reactants result in how many molecules of which products), the control of reaction rates is usually thought to allow more complex computation. Motivated by the fact that correct stoichiometry is easier to ensure than reaction rates, we provide a method for programming and training chemical computation by stoichiometry. We show that such computation can be straightforwardly programmed in a manner analogous to sequential programming, and demonstrate the execution of neural networks capable of complex machine learning tasks.

Embedding computation in biochemical environments incompatible with traditional electronics is expected to have a wide-ranging impact in synthetic biology, medicine, nanofabrication, and other fields. Natural biochemical systems are typically modeled by chemical reaction networks (CRNs) which can also be used as a specification language for synthetic chemical computation. In this paper, we identify a syntactically checkable class of CRNs called noncompetitive (NC) whose equilibria are absolutely robust to reaction rates and kinetic rate law, because their behavior is captured solely by their stoichiometric structure. In spite of the inherently parallel nature of chemistry, the robustness property allows for programming as if each reaction applies sequentially. We also present a technique to program NC-CRNs using well-founded deep learning methods, showing a translation procedure from rectified linear unit (ReLU) neural networks to NC-CRNs. In the case of binary weight ReLU networks, our translation procedure is surprisingly tight in the sense that a single bimolecular reaction corresponds to a single ReLU node and vice versa. This compactness argues that neural networks may be a fitting paradigm for programming rate-independent chemical computation. As proof of principle, we demonstrate our scheme with numerical simulations of CRNs translated from neural networks trained on traditional machine learning datasets, as well as tasks better aligned with potential biological applications including virus detection and spatial pattern formation.