The prediction of molecular toxicity based on BiGRU and GraphSAGE

Multimodal Representation Learning via Graph Isomorphism Network for Toxicity Multitask Learning

Toxicity is paramount for comprehending compound properties, particularly in the early stages of drug design. Due to the diversity and complexity of toxic effects, it became a challenge to compute compound toxicity tasks. To address this issue, we propose a multimodal representation learning model, termed multimodal graph isomorphism network (MMGIN), to address this challenge for compound toxicity multitask learning. Based on fingerprints and molecular graphs of compounds, our MMGIN model incorporates a multimodal representation learning model to acquire a comprehensive compound representation. This model adopts a two-channel structure to independently learn fingerprint representation and molecular graph representation. Subsequently, two feedforward neural networks utilize the learned multimodal compound representation to perform multitask learning, encompassing compound toxicity classification and multiple compound category classification simultaneously. To test the effectiveness of our model, we constructed a novel data set, termed the compound toxicity multitask learning (CTMTL) data set, derived from the TOXRIC data set. We compare our MMGIN model with other representative machine learning and deep learning models on the CTMTL and Tox21 data sets. The experimental results demonstrate significant advancements achieved by our MMGIN model. Furthermore, the ablation study underscores the effectiveness of the introduced fingerprints, molecular graphs, the multimodal representation learning model, and the multitask learning model, showcasing the model's superior predictive capability and robustness.

Advancing ecotoxicity assessment: Leveraging pre-trained model for bee toxicity and compound degradability prediction

The prediction of ecological toxicity plays an increasingly important role in modern society. However, the existing models often suffer from poor performance and limited predictive capabilities. In this study, we propose a novel approach for ecological toxicity assessment based on pre-trained models. By leveraging pre-training techniques and graph neural network models, we establish a highperformance predictive model. Furthermore, we incorporate a variational autoencoder to optimize the model, enabling simultaneous discrimination of toxicity to bees and molecular degradability. Additionally, despite the low similarity between the endogenous hormones in bees and the compounds in our dataset, our model confidently predicts that these hormones are non-toxic to bees, which further strengthens the credibility and accuracy of our model. We also discovered the negative correlation between the degradation and bee toxicity of compounds. In summary, this study presents an ecological toxicity assessment model with outstanding performance. The proposed model accurately predicts the toxicity of chemicals to bees and their degradability capabilities, offering valuable technical support to relevant fields.

MolLM: a unified language model for integrating biomedical text with 2D and 3D molecular representations

MOTIVATION

The current paradigm of deep learning models for the joint representation of molecules and text primarily relies on 1D or 2D molecular formats, neglecting significant 3D structural information that offers valuable physical insight. This narrow focus inhibits the models' versatility and adaptability across a wide range of modalities. Conversely, the limited research focusing on explicit 3D representation tends to overlook textual data within the biomedical domain.

RESULTS

We present a unified pre-trained language model, MolLM, that concurrently captures 2D and 3D molecular information alongside biomedical text. MolLM consists of a text Transformer encoder and a molecular Transformer encoder, designed to encode both 2D and 3D molecular structures. To support MolLM's self-supervised pre-training, we constructed 160K molecule-text pairings. Employing contrastive learning as a supervisory signal for learning, MolLM demonstrates robust molecular representation capabilities across four downstream tasks, including cross-modal molecule and text matching, property prediction, captioning, and text-prompted molecular editing. Through ablation, we demonstrate that the inclusion of explicit 3D representations improves performance in these downstream tasks.

AVAILABILITY AND IMPLEMENTATION

Our code, data, pre-trained model weights, and examples of using our model are all available at https://github.com/gersteinlab/MolLM. In particular, we provide Jupyter Notebooks offering step-by-step guidance on how to use MolLM to extract embeddings for both molecules and text.

Grouping strategies for assessing and managing persistent and mobile substances

Background

Persistent, mobile and toxic (PMT), or very persistent and very mobile (vPvM) substances are a wide class of chemicals that are recalcitrant to degradation, easily transported, and potentially harmful to humans and the environment. Due to their persistence and mobility, these substances are often widespread in the environment once emitted, particularly in water resources, causing increased challenges during water treatment processes. Some PMT/vPvM substances such as GenX and perfluorobutane sulfonic acid have been identified as substances of very high concern (SVHCs) under the European Registration, Evaluation, Authorisation and Restriction of Chemicals (REACH) regulation. With hundreds to thousands of potential PMT/vPvM substances yet to be assessed and managed, effective and efficient approaches that avoid a case-by-case assessment and prevent regrettable substitution are necessary to achieve the European Union's zero-pollution goal for a non-toxic environment by 2050.

Main

Substance grouping has helped global regulation of some highly hazardous chemicals, e.g., through the Montreal Protocol and the Stockholm Convention. This article explores the potential of grouping strategies for identifying, assessing and managing PMT/vPvM substances. The aim is to facilitate early identification of lesser-known or new substances that potentially meet PMT/vPvM criteria, prompt additional testing, avoid regrettable use or substitution, and integrate into existing risk management strategies. Thus, this article provides an overview of PMT/vPvM substances and reviews the definition of PMT/vPvM criteria and various lists of PMT/vPvM substances available. It covers the current definition of groups, compares the use of substance grouping for hazard assessment and regulation, and discusses the advantages and disadvantages of grouping substances for regulation. The article then explores strategies for grouping PMT/vPvM substances, including read-across, structural similarity and commonly retained moieties, as well as the potential application of these strategies using cheminformatics to predict P, M and T properties for selected examples.

Conclusions

Effective substance grouping can accelerate the assessment and management of PMT/vPvM substances, especially for substances that lack information. Advances to read-across methods and cheminformatics tools are needed to support efficient and effective chemical management, preventing broad entry of hazardous chemicals into the global market and favouring safer and more sustainable alternatives.

Prediction of Drug-Target Affinity Using Attention Neural Network

Studying drug-target interactions (DTIs) is the foundational and crucial phase in drug discovery. Biochemical experiments, while being the most reliable method for determining drug-target affinity (DTA), are time-consuming and costly, making it challenging to meet the current demands for swift and efficient drug development. Consequently, computational DTA prediction methods have emerged as indispensable tools for this research. In this article, we propose a novel deep learning algorithm named GRA-DTA, for DTA prediction. Specifically, we introduce Bidirectional Gated Recurrent Unit (BiGRU) combined with a soft attention mechanism to learn target representations. We employ Graph Sample and Aggregate (GraphSAGE) to learn drug representation, especially to distinguish the different features of drug and target representations and their dimensional contributions. We merge drug and target representations by an attention neural network (ANN) to learn drug-target pair representations, which are fed into fully connected layers to yield predictive DTA. The experimental results showed that GRA-DTA achieved mean squared error of 0.142 and 0.225 and concordance index reached 0.897 and 0.890 on the benchmark datasets KIBA and Davis, respectively, surpassing the most state-of-the-art DTA prediction algorithms.

MolFeSCue: enhancing molecular property prediction in data-limited and imbalanced contexts using few-shot and contrastive learning

MOTIVATION

Predicting molecular properties is a pivotal task in various scientific domains, including drug discovery, material science, and computational chemistry. This problem is often hindered by the lack of annotated data and imbalanced class distributions, which pose significant challenges in developing accurate and robust predictive models.

RESULTS

This study tackles these issues by employing pretrained molecular models within a few-shot learning framework. A novel dynamic contrastive loss function is utilized to further improve model performance in the situation of class imbalance. The proposed MolFeSCue framework not only facilitates rapid generalization from minimal samples, but also employs a contrastive loss function to extract meaningful molecular representations from imbalanced datasets. Extensive evaluations and comparisons of MolFeSCue and state-of-the-art algorithms have been conducted on multiple benchmark datasets, and the experimental data demonstrate our algorithm's effectiveness in molecular representations and its broad applicability across various pretrained models. Our findings underscore MolFeSCues potential to accelerate advancements in drug discovery.

AVAILABILITY AND IMPLEMENTATION

We have made all the source code utilized in this study publicly accessible via GitHub at http://www.healthinformaticslab.org/supp/ or https://github.com/zhangruochi/MolFeSCue. The code (MolFeSCue-v1-00) is also available as the supplementary file of this paper.

A deep learning framework for predicting molecular property based on multi-type features fusion

Extracting expressive molecular features is essential for molecular property prediction. Sequence-based representation is a common representation of molecules, which ignores the structure information of molecules. While molecular graph representation has a weak ability in expressing the 3D structure. In this article, we try to make use of the advantages of different type representations simultaneously for molecular property prediction. Thus, we propose a fusion model named DLF-MFF, which integrates the multi-type molecular features. Specifically, we first extract four different types of features from molecular fingerprints, 2D molecular graph, 3D molecular graph and molecular image. Then, in order to learn molecular features individually, we use four essential deep learning frameworks, which correspond to four distinct molecular representations. The final molecular representation is created by integrating the four feature vectors and feeding them into prediction layer to predict molecular property. We compare DLF-MFF with 7 state-of-the-art methods on 6 benchmark datasets consisting of multiple molecular properties, the experimental results show that DLF-MFF achieves state-of-the-art performance on 6 benchmark datasets. Moreover, DLF-MFF is applied to identify potential anti-SARS-CoV-2 inhibitor from 2500 drugs. We predict probability of each drug being inferred as a 3CL protease inhibitor and also calculate the binding affinity scores between each drug and 3CL protease. The results show that DLF-MFF product better performance in the identification of anti-SARS-CoV-2 inhibitor. This work is expected to offer novel research perspectives for accurate prediction of molecular properties and provide valuable insights into drug repurposing for COVID-19.

Molecular toxicity of nitrobenzene derivatives to tetrahymena pyriformis based on SMILES descriptors using Monte Carlo, docking, and MD simulations

It is challenging to model the toxicity of nitroaromatic compounds due to limited experimental data. Nitrobenzene derivatives are commonly used in industry and can lead to environmental contamination. Extensive research, including several QSPR studies, has been conducted to understand their toxicity. Predictive QSPR models can help improve chemical safety, but their limitations must be considered, and the molecular factors affecting toxicity should be carefully investigated. The latest QSPR methods, molecular modeling techniques, machine learning algorithms, and computational chemistry tools are essential for developing accurate and robust models. In this work, we used these methods to study a series of fifty compounds derived from nitrobenzene. The Monte Carlo approach was used for QSPR modeling by applying the SMILES molecular structure representation and optimal molecular descriptors. The correlation ideality index (CII) and correlation contradiction index (CCI) were further introduced as validation parameters to estimate the developed models' predictive ability. The statistical quality of the CII models was better than those without CII. The best QSPR model with the following statistical parameters (Split-3): (R2 = 0.968, CCC = 0.984, IIC = 0.861, CII = 0.979, Q2 = 0.954, QF12 = 0.946, QF22 = 0.938, QF32 = 0.947, Rm2 = 0.878, RMSE = 0.187, MAE = 0.151, FTraining = 390, FInvisible = 218, FCalibration = 240, RTest2 = 0.905) was selected to generate the studied promoters with increasing and decreasing activity.

BioGraph: Data Model for Linking and Querying Diverse Biological Metadata

Studying the association of gene function, diseases, and regulatory gene network reconstruction demands data compatibility. Data from different databases follow distinct schemas and are accessible in heterogenic ways. Although the experiments differ, data may still be related to the same biological entities. Some entities may not be strictly biological, such as geolocations of habitats or paper references, but they provide a broader context for other entities. The same entities from different datasets can share similar properties, which may or may not be found within other datasets. Joint, simultaneous data fetching from multiple data sources is complicated for the end-user or, in many cases, unsupported and inefficient due to differences in data structures and ways of accessing the data. We propose BioGraph-a new model that enables connecting and retrieving information from the linked biological data that originated from diverse datasets. We have tested the model on metadata collected from five diverse public datasets and successfully constructed a knowledge graph containing more than 17 million model objects, of which 2.5 million are individual biological entity objects. The model enables the selection of complex patterns and retrieval of matched results that can be discovered only by joining the data from multiple sources.

MSResG: Using GAE and Residual GCN to Predict Drug-Drug Interactions Based on Multi-source Drug Features

Drug-drug interaction refers to taking the two drugs may produce certain reaction which may be a threat to patients' health, or enhance the efficacy helpful for medical work. Therefore, it is necessary to study and predict it. In fact, traditional experimental methods can be used for drug-drug interaction prediction, but they are time-consuming and costly, so we prefer to use more accurate and convenient calculation methods to predict the unknown drug-drug interaction. In this paper, we proposed a deep learning framework called MSResG that considers multi-sources features of drugs and combines them with Graph Auto-Encoder to predicting. Firstly, the model obtains four feature representations of drugs from the database, namely, chemical substructure, target, pathway and enzyme, and then calculates the Jaccard similarity of the drugs. To balance different drug features, we perform similarity integration by finding the mean value. Then we will be comprehensive similarity network combined with drug interaction network, and encodes and decodes it using the graph auto-encoder based on residual graph convolution network. Encoding is to learn the potential feature vectors of drugs, which contain similar information and interaction information. Decoding is to reconstruct the network to predict unknown drug-drug interaction. The experimental results show that our model has advanced performance and is superior to other existing advanced methods. Case study also shows that MSResG has practical significance.