Quantitative Toxicity Prediction via Meta Ensembling of Multitask Deep Learning Models

Toxicity prediction and classification of Gunqile-7 with small sample based on transfer learning method

Drug-induced diseases are the most important component of iatrogenic disease. It is the duty of doctors to provide a reasonable and safe dose of medication. Gunqile-7 is a Mongolian medicine with analgesic and anti-inflammatory effects. As a foreign substance in the body, even with reasonable medication, it may produce varying degrees of adverse reactions or toxic side effects. Since the cost of collecting Gunqile-7 for pharmacological animal trials is high and the data sample is small, this paper employs transfer learning and data augmentation methods to study the toxicity of Gunqile-7. More specifically, to reduce the necessary number of training samples, the data augmentation approach is employed to extend the data set. Then, the transfer learning method and one-dimensional convolutional neural network are utilized to train the network. In addition, we use the support vector machine-recursive feature elimination method for feature selection to reduce features that have adverse effects on model predictions. Furthermore, due to the important role of the pre-trained model of transfer learning, we select a quantitative toxicity prediction model as the pre-trained model, which is consistent with the purpose of this paper. Lastly, the experimental results demonstrate the efficiency of the proposed method. Our method can improve accuracy by up to 9 percentage points compared to the method without transfer learning on a small sample set.

Benchmarking of Small Molecule Feature Representations for hERG, Nav1.5, and Cav1.2 Cardiotoxicity Prediction

In the field of drug discovery, there is a substantial challenge in seeking out chemical structures that possess desirable pharmacological, toxicological, and pharmacokinetic properties. Complications arise when drugs interfere with the functioning of cardiac ion channels, leading to serious cardiovascular consequences. The discontinuation and removal of numerous approved drugs from the market or at late development stages in the pipeline due to such inhibitory effects further highlight the urgency of addressing this issue. Consequently, the early prediction of potential blockers targeting cardiac ion channels during the drug discovery process is of paramount importance. This study introduces a deep learning framework that computationally determines the cardiotoxicity associated with the voltage-gated potassium channel (hERG), the voltage-gated calcium channel (Cav1.2), and the voltage-gated sodium channel (Nav1.5) for drug candidates. The predictive capabilities of three feature representations─molecular fingerprints, descriptors, and graph-based numerical representations─are rigorously benchmarked. Additionally, a novel training and evaluation data set framework is presented, enabling predictive model training of drug off-target cardiotoxicity using a comprehensive and large curated data set covering these three cardiac ion channels. To facilitate these predictions, a robust and comprehensive small molecule cardiotoxicity prediction tool named CToxPred has been developed. It is made available as open source under the permissive MIT license at https://github.com/issararab/CToxPred.

What is the ecotoxicity of a given chemical for a given aquatic species? Predicting interactions between species and chemicals using recommender system techniques

Ecotoxicological safety assessment of chemicals requires toxicity data on multiple species, despite the general desire of minimizing animal testing. Predictive models, specifically machine learning (ML) methods, are one of the tools capable of solving this apparent contradiction as they allow to generalize toxicity patterns across chemicals and species. However, despite the availability of large public toxicity datasets, the data is highly sparse, complicating model development. The aim of this study is to provide insights into how ML can predict toxicity using a large but sparse dataset. We developed models to predict LC50-values, based on experimental LC50-data covering 2431 organic chemicals and 1506 aquatic species from the ECOTOX-database. Several well-known ML techniques were evaluated and a new ML model was developed, inspired by recommender systems. This new model involves a simple linear model that learns low-rank interactions between species and chemicals using factorization machines. We evaluated the predictive performances of the developed models based on two validation settings: 1) predicting unseen chemical-species pairs, and 2) predicting unseen chemicals. The results of this study show that ML models can accurately predict LC50-values in both validation settings. Moreover, we show that the novel factorization machine approach can match well-tuned, complex, ML approaches.

Development of a Machine Learning Model to Estimate the Biotic Ligand Model-Based Predicted No-Effect Concentrations for Copper in Freshwater

The copper (Cu) biotic ligand model (BLM) has been used for ecological risk assessment by taking into account the bioavailability of Cu in freshwater. The Cu BLM requires data for many water chemistry variables, such as pH, major cations, and dissolved organic carbon, which can be difficult to obtain from water quality monitoring programs. To develop an optimized predicted no-effect concentration (PNEC) estimation model based on an available monitoring dataset, we proposed an initial model that considers all BLM variables, a second model that requires variables excluding alkalinity, and a third model using electrical conductivity as a surrogate for the major cations and alkalinity. Furthermore, deep neural network (DNN) models have been used to predict the nonlinear relationships between the PNEC (outcome variable) and the required input variables (explanatory variables). The predictive capacity of DNN models was compared with the results of other existing PNEC estimation tools using a look-up table and multiple linear and multivariate polynomial regression methods. Three DNN models, using different input variables, provided better predictions of the Cu PNECs compared with the existing tools for the following four test datasets: Korean, United States, Swedish, and Belgian freshwaters. Consequently, it is expected that Cu BLM-based risk assessment can be applied to various monitoring datasets, and that the most applicable model among the three different types of DNN models could be selected according to data availability for a given monitoring database. Environ Toxicol Chem 2023;42:2271-2283. © 2023 SETAC.

Artificial Intelligence in Drug Toxicity Prediction: Recent Advances, Challenges, and Future Perspectives

Toxicity prediction is a critical step in the drug discovery process that helps identify and prioritize compounds with the greatest potential for safe and effective use in humans, while also reducing the risk of costly late-stage failures. It is estimated that over 30% of drug candidates are discarded owing to toxicity. Recently, artificial intelligence (AI) has been used to improve drug toxicity prediction as it provides more accurate and efficient methods for identifying the potentially toxic effects of new compounds before they are tested in human clinical trials, thus saving time and money. In this review, we present an overview of recent advances in AI-based drug toxicity prediction, including the use of various machine learning algorithms and deep learning architectures, of six major toxicity properties and Tox21 assay end points. Additionally, we provide a list of public data sources and useful toxicity prediction tools for the research community and highlight the challenges that must be addressed to enhance model performance. Finally, we discuss future perspectives for AI-based drug toxicity prediction. This review can aid researchers in understanding toxicity prediction and pave the way for new methods of drug discovery.

Assessing chemical hazard and unraveling binding affinity of priority pollutants to lignin modifying enzymes for environmental remediation

Lignin-modifying enzymes (LMEs) are impactful biocatalysts in environmental remediation applications. However, LMEs-assisted experimental degradation neglects the molecular basis of pollutant degradation. Furthermore, throughout the remediation process, the inherent hazards of environmental pollutants remain untapped for in-depth toxicological endpoints. In this investigation, a predictive toxicological framework and a computational framework adopting LMEs were employed to assess the hazards of Priority Pollutants (PP) and its possible LMEs-assisted catalytic screening. The potential hazardous outcomes of PP were assessed using Quantitative structure-activity relationship (QSARs)-based techniques including Toxtree, ECOSAR, and T.E.S.T. tools. Toxicological findings revealed positive outcomes in a multitude of endpoints for all PP. The PP compound 2,3,7,8-TCDD (dioxin) was found to exhibit the lowest concentration of aquatic toxicity implementing aquatic model systems; LC₅₀ as 0.01, 0.01, 0.04 (mg L^-1) for Fish (96 H), Daphnid (48 H), Green algae (96 H) respectively. T.E.S.T. results revealed that chloroform, and 2-chlorophenol both seem to be developmental toxicants. Subsequently, LMEs-assisted docking procedure was employed in predictive mitigation of PP. The docking approach as predicted degradation revealed the far lowest docking energy score for Versatile peroxidase (VP)- 2,3,7,8-TCDD docked complex with a binding energy of -9.2 (kcal mol^-1), involved PHE-46, PRO-139, PRO-141, ILE-148, LEU-165, HIS-169, LEU-228, MET-262, and MET-265 as key interacting amino acid residues. Second most ranked but lesser than VP, Lignin peroxidase (LiP)- 2,3,7,8-TCDD docked complex exhibited a rather lower binding affinity score (-8.8 kcal mol^-1). Predictive degradation screening employing comparative docking revealed varying binding affinities, portraying that each LMEs member has independent feasibility to bind PP as substrate. Predictive findings endorsed the hazardous nature of associated PP in a multitude of endpoints, which could be attenuated by undertaking LMEs as a predictive approach to protect the environment and implement it in regulatory considerations.

Deep learning methods for molecular representation and property prediction

With advances in artificial intelligence (AI) methods, computer-aided drug design (CADD) has developed rapidly in recent years. Effective molecular representation and accurate property prediction are crucial tasks in CADD workflows. In this review, we summarize contemporary applications of deep learning (DL) methods for molecular representation and property prediction. We categorize DL methods according to the format of molecular data (1D, 2D, and 3D). In addition, we discuss some common DL models, such as ensemble learning and transfer learning, and analyze the interpretability methods for these models. We also highlight the challenges and opportunities of DL methods for molecular representation and property prediction.

Machine learning in the identification, prediction and exploration of environmental toxicology: Challenges and perspectives

Over the past few decades, data-driven machine learning (ML) has distinguished itself from hypothesis-driven studies and has recently received much attention in environmental toxicology. However, the use of ML in environmental toxicology remains in the early stages, with knowledge gaps, technical bottlenecks in data quality, high-dimensional/heterogeneous/small-sample data analysis and model interpretability, and a lack of an in-depth understanding of environmental toxicology. Given the above problems, we review the recent progress in the literature and highlight state-of-the-art toxicological studies using ML (such as learning and predicting toxicity in complicated biosystems and multiple-factor environmental scenarios of long-term and large-scale pollution). Beyond predicting simple biological endpoints by integrating untargeted omics and adverse outcome pathways, ML development should focus on revealing toxicological mechanisms. The integration of data-driven ML with other methods (e.g., omics analysis and adverse outcome pathway frameworks) endows ML with widely promising application in revealing toxicological mechanisms. High-quality databases and interpretable algorithms are urgently needed for toxicology and environmental science. Addressing the core issues and future challenges for ML in this review may narrow the knowledge gap between environmental toxicity and computational science and facilitate the control of environmental risk in the future.

Machine learning and artificial intelligence in toxicological sciences

Machine learning and artificial intelligence approaches have revolutionized multiple disciplines, including toxicology. This review summarizes representative recent applications of machine learning and artificial intelligence approaches in different areas of toxicology, including physiologically based pharmacokinetic (PBPK) modeling, quantitative structure-activity relationship modeling for toxicity prediction, adverse outcome pathway analysis, high-throughput screening, toxicogenomics, big data and toxicological databases. By leveraging machine learning and artificial intelligence approaches, now it is possible to develop PBPK models for hundreds of chemicals efficiently, to create in silico models to predict toxicity for a large number of chemicals with similar accuracies compared to in vivo animal experiments, and to analyze a large amount of different types of data (toxicogenomics, high-content image data, etc.) to generate new insights into toxicity mechanisms rapidly, which was impossible by manual approaches in the past. To continue advancing the field of toxicological sciences, several challenges should be considered: (1) not all machine learning models are equally useful for a particular type of toxicology data, and thus it is important to test different methods to determine the optimal approach; (2) current toxicity prediction is mainly on bioactivity classification (yes/no), so additional studies are needed to predict the intensity of effect or dose-response relationship; (3) as more data become available, it is crucial to perform rigorous data quality check and develop infrastructure to store, share, analyze, evaluate, and manage big data; and (4) it is important to convert machine learning models to user-friendly interfaces to facilitate their applications by both computational and bench scientists.

Prediction Models for Agonists and Antagonists of Molecular Initiation Events for Toxicity Pathways Using an Improved Deep-Learning-Based Quantitative Structure-Activity Relationship System

In silico approaches have been studied intensively to assess the toxicological risk of various chemical compounds as alternatives to traditional in vivo animal tests. Among these approaches, quantitative structure-activity relationship (QSAR) analysis has the advantages that it is able to construct models to predict the biological properties of chemicals based on structural information. Previously, we reported a deep learning (DL) algorithm-based QSAR approach called DeepSnap-DL for high-performance prediction modeling of the agonist and antagonist activity of key molecules in molecular initiating events in toxicological pathways using optimized hyperparameters. In the present study, to achieve high throughput in the DeepSnap-DL system-which consists of the preparation of three-dimensional molecular structures of chemical compounds, the generation of snapshot images from the three-dimensional chemical structures, DL, and statistical calculations-we propose an improved DeepSnap-DL approach. Using this improved system, we constructed 59 prediction models for the agonist and antagonist activity of key molecules in the Tox21 10K library. The results indicate that modeling of the agonist and antagonist activity with high prediction performance and high throughput can be achieved by optimizing suitable parameters in the improved DeepSnap-DL system.