Predicting effective drug combinations using gradient tree boosting based on features extracted from drug-protein heterogeneous network

Good machine learning practices: Learnings from the modern pharmaceutical discovery enterprise

Machine Learning (ML) and Artificial Intelligence (AI) have become an integral part of the drug discovery and development value chain. Many teams in the pharmaceutical industry nevertheless report the challenges associated with the timely, cost effective and meaningful delivery of ML and AI powered solutions for their scientists. We sought to better understand what these challenges were and how to overcome them by performing an industry wide assessment of the practices in AI and Machine Learning. Here we report results of the systematic business analysis of the personas in the modern pharmaceutical discovery enterprise in relation to their work with the AI and ML technologies. We identify 23 common business problems that individuals in these roles face when they encounter AI and ML technologies at work, and describe best practices (Good Machine Learning Practices) that address these issues.

AttenSyn: An Attention-Based Deep Graph Neural Network for Anticancer Synergistic Drug Combination Prediction

Identifying synergistic drug combinations is fundamentally important to treat a variety of complex diseases while avoiding severe adverse drug-drug interactions. Although several computational methods have been proposed, they highly rely on handcrafted feature engineering and cannot learn better interactive information between drug pairs, easily resulting in relatively low performance. Recently, deep-learning methods, especially graph neural networks, have been widely developed in this area and demonstrated their ability to address complex biological problems. In this study, we proposed AttenSyn, an attention-based deep graph neural network for accurately predicting synergistic drug combinations. In particular, we adopted a graph neural network module to extract high-latent features based on the molecular graphs only and exploited the attention-based pooling module to learn interactive information between drug pairs to strengthen the representations of drug pairs. Comparative results on the benchmark datasets demonstrated that our AttenSyn performs better than the state-of-the-art methods in the prediction of anticancer synergistic drug combinations. Additionally, to provide good interpretability of our model, we explored and visualized some crucial substructures in drugs through attention mechanisms. Furthermore, we also verified the effectiveness of our proposed AttenSyn on two cell lines by visualizing the features of drug combinations learnt from our model, exhibiting satisfactory generalization ability.

In silico protein function prediction: the rise of machine learning-based approaches

Proteins function as integral actors in essential life processes, rendering the realm of protein research a fundamental domain that possesses the potential to propel advancements in pharmaceuticals and disease investigation. Within the context of protein research, an imperious demand arises to uncover protein functionalities and untangle intricate mechanistic underpinnings. Due to the exorbitant costs and limited throughput inherent in experimental investigations, computational models offer a promising alternative to accelerate protein function annotation. In recent years, protein pre-training models have exhibited noteworthy advancement across multiple prediction tasks. This advancement highlights a notable prospect for effectively tackling the intricate downstream task associated with protein function prediction. In this review, we elucidate the historical evolution and research paradigms of computational methods for predicting protein function. Subsequently, we summarize the progress in protein and molecule representation as well as feature extraction techniques. Furthermore, we assess the performance of machine learning-based algorithms across various objectives in protein function prediction, thereby offering a comprehensive perspective on the progress within this field.

Predicting anticancer synergistic drug combinations based on multi-task learning

BACKGROUND

The discovery of anticancer drug combinations is a crucial work of anticancer treatment. In recent years, pre-screening drug combinations with synergistic effects in a large-scale search space adopting computational methods, especially deep learning methods, is increasingly popular with researchers. Although achievements have been made to predict anticancer synergistic drug combinations based on deep learning, the application of multi-task learning in this field is relatively rare. The successful practice of multi-task learning in various fields shows that it can effectively learn multiple tasks jointly and improve the performance of all the tasks.

METHODS

In this paper, we propose MTLSynergy which is based on multi-task learning and deep neural networks to predict synergistic anticancer drug combinations. It simultaneously learns two crucial prediction tasks in anticancer treatment, which are synergy prediction of drug combinations and sensitivity prediction of monotherapy. And MTLSynergy integrates the classification and regression of prediction tasks into the same model. Moreover, autoencoders are employed to reduce the dimensions of input features.

RESULTS

Compared with the previous methods listed in this paper, MTLSynergy achieves the lowest mean square error of 216.47 and the highest Pearson correlation coefficient of 0.76 on the drug synergy prediction task. On the corresponding classification task, the area under the receiver operator characteristics curve and the area under the precision-recall curve are 0.90 and 0.62, respectively, which are equivalent to the comparison methods. Through the ablation study, we verify that multi-task learning and autoencoder both have a positive effect on prediction performance. In addition, the prediction results of MTLSynergy in many cases are also consistent with previous studies.

CONCLUSION

Our study suggests that multi-task learning is significantly beneficial for both drug synergy prediction and monotherapy sensitivity prediction when combining these two tasks into one model. The ability of MTLSynergy to discover new anticancer synergistic drug combinations noteworthily outperforms other state-of-the-art methods. MTLSynergy promises to be a powerful tool to pre-screen anticancer synergistic drug combinations.

A model-agnostic framework to enhance knowledge graph-based drug combination prediction with drug-drug interaction data and supervised contrastive learning

Combination therapies have brought significant advancements to the treatment of various diseases in the medical field. However, searching for effective drug combinations remains a major challenge due to the vast number of possible combinations. Biomedical knowledge graph (KG)-based methods have shown potential in predicting effective combinations for wide spectrum of diseases, but the lack of credible negative samples has limited the prediction performance of machine learning models. To address this issue, we propose a novel model-agnostic framework that leverages existing drug-drug interaction (DDI) data as a reliable negative dataset and employs supervised contrastive learning (SCL) to transform drug embedding vectors to be more suitable for drug combination prediction. We conducted extensive experiments using various network embedding algorithms, including random walk and graph neural networks, on a biomedical KG. Our framework significantly improved performance metrics compared to the baseline framework. We also provide embedding space visualizations and case studies that demonstrate the effectiveness of our approach. This work highlights the potential of using DDI data and SCL in finding tighter decision boundaries for predicting effective drug combinations.

DeepTraSynergy: drug combinations using multimodal deep learning with transformers

MOTIVATION

Screening bioactive compounds in cancer cell lines receive more attention. Multidisciplinary drugs or drug combinations have a more effective role in treatments and selectively inhibit the growth of cancer cells.

RESULTS

Hence, we propose a new deep learning-based approach for drug combination synergy prediction called DeepTraSynergy. Our proposed approach utilizes multimodal input including drug-target interaction, protein-protein interaction, and cell-target interaction to predict drug combination synergy. To learn the feature representation of drugs, we have utilized transformers. It is worth noting that our approach is a multitask approach that predicts three outputs including the drug-target interaction, its toxic effect, and drug combination synergy. In our approach, drug combination synergy is the main task and the two other ones are the auxiliary tasks that help the approach to learn a better model. In the proposed approach three loss functions are defined: synergy loss, toxic loss, and drug-protein interaction loss. The last two loss functions are designed as auxiliary losses to help learn a better solution. DeepTraSynergy outperforms the classic and state-of-the-art models in predicting synergistic drug combinations on the two latest drug combination datasets. The DeepTraSynergy algorithm achieves accuracy values of 0.7715 and 0.8052 (an improvement over other approaches) on the DrugCombDB and Oncology-Screen datasets, respectively. Also, we evaluate the contribution of each component of DeepTraSynergy to show its effectiveness in the proposed method. The introduction of the relation between proteins (PPI networks) and drug-protein interaction significantly improves the prediction of synergistic drug combinations.

AVAILABILITY AND IMPLEMENTATION

The source code and data are available at https://github.com/fatemeh-rafiei/DeepTraSynergy.

Network pharmacology approaches for research of Traditional Chinese Medicines

Pharmacodynamics material basis and effective mechanisms are the two main issues to decipher the mechnisms of action of Traditional Chinese medicines (TCMs) for the treatment of diseases. TCMs, in "multi-component, multi-target, multi-pathway" paradigm, show satisfactory clinical results in complex diseases. New ideas and methods are urgently needed to explain the complex interactions between TCMs and diseases. Network pharmacology (NP) provides a novel paradigm to uncover and visualize the underlying interaction networks of TCMs against multifactorial diseases. The development and application of NP has promoted the safety, efficacy, and mechanism investigations of TCMs, which then reinforces the credibility and popularity of TCMs. The current organ-centricity of medicine and the "one disease-one target-one drug" dogma obstruct the understanding of complex diseases and the development of effective drugs. Therefore, more attentions should be paid to shift from "phenotype and symptom" to "endotype and cause" in understanding and redefining current diseases. In the past two decades, with the advent of advanced and intelligent technologies (such as metabolomics, proteomics, transcriptomics, single-cell omics, and artificial intelligence), NP has been improved and deeply implemented, and presented its great value and potential as the next drug-discovery paradigm. NP is developed to cure causal mechanisms instead of treating symptoms. This review briefly summarizes the recent research progress on NP application in TCMs for efficacy research, mechanism elucidation, target prediction, safety evaluation, drug repurposing, and drug design.

Network modeling helps to tackle the complexity of drug-disease systems

From the (patho)physiological point of view, diseases can be considered as emergent properties of living systems stemming from the complexity of these systems. Complex systems display some typical features, including the presence of emergent behavior and the organization in successive hierarchic levels. Drug treatments increase this complexity scenario, and from some years the use of network models has been introduced to describe drug-disease systems and to make predictions about them with regard to several aspects related to drug discovery. Here, we review some recent examples thereof with the aim to illustrate how network science tools can be very effective in addressing both tasks. We will examine the use of bipartite networks that lead to the important concept of "disease module", as well as the introduction of more articulated models, like multi-scale and multiplex networks, able to describe disease systems at increasing levels of organization. Examples of predictive models will then be discussed, considering both those that exploit approaches purely based on graph theory and those that integrate machine learning methods. A short account of both kinds of methodological applications will be provided. Finally, the point will be made on the present situation of modeling complex drug-disease systems highlighting some open issues. This article is categorized under: Neurological Diseases > Computational Models Infectious Diseases > Computational Models Cardiovascular Diseases > Computational Models.

Prediction of chemotherapy-related complications in pediatric oncology patients: artificial intelligence and machine learning implementations

Although the overall incidence of pediatric oncological diseases tends to increase over the years, it is among the rare diseases of the pediatric population. The diagnosis, treatment, and healthcare management of this group of diseases are important. Prevention of treatment-related complications is vital for patients, particularly in the pediatric population. Nowadays, the use of artificial intelligence and machine learning technologies in the management of oncological diseases is becoming increasingly important. With the advancement of software technologies, improvements have been made in the early diagnosis of risk groups in oncological diseases, in radiology, pathology, and imaging technologies, in cancer staging and management. In addition, these technologies can be used to predict the outcome in chemotherapy treatment of oncological diseases. In this context, this study identifies artificial intelligence and machine learning methods used in the prediction of complications due to chemotherapeutic agents used in childhood cancer treatment. For this purpose, the concepts of artificial intelligence and machine learning are explained in this review. A general framework for the use of machine learning in healthcare and pediatric oncology has been drawn and examples of studies conducted on this topic in pediatric oncology have been given. IMPACT: Artificial intelligence and machine learning are advanced tools that can be used to predict chemotherapy-related complications. Algorithms can assist clinicians' decision-making processes in the management of complications. Although studies are using these methods, there is a need to increase the number of studies on artificial intelligence applications in pediatric clinics.

In silico investigation of molecular networks linking gastrointestinal diseases, malnutrition, and sarcopenia

Malnutrition (MN) is a common primary or secondary complication in gastrointestinal diseases. The patient’s nutritional status also influences muscle mass and function, which can be impaired up to the degree of sarcopenia. The molecular interactions in diseases leading to sarcopenia are complex and multifaceted, affecting muscle physiology, the intestine (nutrition), and the liver at different levels. Although extensive knowledge of individual molecular factors is available, their regulatory interplay is not yet fully understood. A comprehensive overall picture of pathological mechanisms and resulting phenotypes is lacking. In silico approaches that convert existing knowledge into computationally readable formats can help unravel mechanisms, underlying such complex molecular processes. From public literature, we manually compiled experimental evidence for molecular interactions involved in the development of sarcopenia into a knowledge base, referred to as the Sarcopenia Map. We integrated two diseases, namely liver cirrhosis (LC), and intestinal dysfunction, by considering their effects on nutrition and blood secretome. We demonstrate the performance of our model by successfully simulating the impact of changing dietary frequency, glycogen storage capacity, and disease severity on the carbohydrate and muscle systems. We present the Sarcopenia Map as a publicly available, open-source, and interactive online resource, that links gastrointestinal diseases, MN, and sarcopenia. The map provides tools that allow users to explore the information on the map and perform in silico simulations.

DCE-DForest: A Deep Forest Model for the Prediction of Anticancer Drug Combination Effects

Drug combinations have recently been studied intensively due to their critical role in cancer treatment. Computational prediction of drug synergy has become a popular alternative strategy to experimental methods for anticancer drug synergy predictions. In this paper, a deep learning model called DCE-DForest is proposed to predict the synergistic effect of drug combinations. To sufficiently extract drug information, the paper leverages BERT (Bidirectional Encoder Representations from Transformers) to encode the drug and the deep forest to model the nonlinear relationship between the drugs and cell lines. The experimental results on the synergy datasets demonstrate that the proposed method consistently shows superior performance over the other machine learning models.

A scalable, open-source implementation of a large-scale mechanistic model for single cell proliferation and death signaling

Mechanistic models of how single cells respond to different perturbations can help integrate disparate big data sets or predict response to varied drug combinations. However, the construction and simulation of such models have proved challenging. Here, we developed a python-based model creation and simulation pipeline that converts a few structured text files into an SBML standard and is high-performance- and cloud-computing ready. We applied this pipeline to our large-scale, mechanistic pan-cancer signaling model (named SPARCED) and demonstrate it by adding an IFNγ pathway submodel. We then investigated whether a putative crosstalk mechanism could be consistent with experimental observations from the LINCS MCF10A Data Cube that IFNγ acts as an anti-proliferative factor. The analyses suggested this observation can be explained by IFNγ-induced SOCS1 sequestering activated EGF receptors. This work forms a foundational recipe for increased mechanistic model-based data integration on a single-cell level, an important building block for clinically-predictive mechanistic models.

Predicting combinations of drugs by exploiting graph embedding of heterogeneous networks

Background

Drug combination, offering an insight into the increased therapeutic efficacy and reduced toxicity, plays an essential role in the therapy of many complex diseases. Although significant efforts have been devoted to the identification of drugs, the identification of drug combination is still a challenge. The current algorithms assume that the independence of feature selection and drug prediction procedures, which may result in an undesirable performance.

Results

To address this issue, we develop a novel Semi-supervised Heterogeneous Network Embedding algorithm (called SeHNE) to predict the combination patterns of drugs by exploiting the graph embedding. Specifically, the ATC similarity of drugs, drug–target, and protein–protein interaction networks are integrated to construct the heterogeneous networks. Then, SeHNE jointly learns drug features by exploiting the topological structure of heterogeneous networks and predicting drug combination. One distinct advantage of SeHNE is that features of drugs are extracted under the guidance of classification, which improves the quality of features, thereby enhancing the performance of prediction of drugs. Experimental results demonstrate that the proposed algorithm is more accurate than state-of-the-art methods on various data, implying that the joint learning is promising for the identification of drug combination.

Conclusions

The proposed model and algorithm provide an effective strategy for the prediction of combinatorial patterns of drugs, implying that the graph-based drug prediction is promising for the discovery of drugs.

The Material Basis and Mechanism of Xuefu Zhuyu Decoction in Treating Stable Angina Pectoris and Unstable Angina Pectoris

METHODS

Firstly, we used a network proximity approach to calculate and compare the effectiveness of the formula with that of Western drugs for each type of angina, including all targets and intersecting targets, from a topological perspective. Secondly, we compared the mechanisms of action of the two angina pectoris at three levels and five aspects, including conventional and modular analysis approaches. Thirdly, based on the unique functions of each angina in the complex heterogeneous network, we designed a reverse process for finding the material basis using dynamic, static, and enriched items as well as a total item. Finally, the designed inverse process, material basis, and mechanism of action were validated.

RESULTS

The target network of Xuefu Zhuyu decoction is closer to the target network of each type of angina than that of Western drugs, and the intersection targets have a closer proximity. Comparison of the mechanisms of action showed that stable angina and unstable angina had 158 common targets, while the unique targets were 34 and 1, respectively. Modularity analysis showed that the GO similarity of target modules was highly correlated with KEGG similarity. We ended up with 67 compounds upregulated for stable angina and 47 compounds upregulated for unstable angina. Our results were validated by literature mining, high-volume molecular docking, and miRNA enrichment analysis.

CONCLUSIONS

For both types of angina pectoris, Xuefu Zhuyu decoction is superior to Western drugs. A comparison of various aspects led to the unique mechanisms of action, from which the material basis of each type of angina was deduced.

High-throughput screening for drug discovery targeting the cancer cell-microenvironment interactions in hematological cancers

INTRODUCTION

The interactions between leukemic blasts and cells within the bone marrow environment affect oncogenesis, cancer stem cell survival, as well as drug resistance in hematological cancers. The importance of this interaction is increasingly being recognized as a potentially important target for future drug discoveries and developments. Recent innovations in the high throughput drug screening-related technologies, novel ex-vivo disease-models, and freely available machine-learning algorithms are advancing the drug discovery process by targeting earlier undruggable proteins, complex pathways, as well as physical interactions (e.g. leukemic cell-bone microenvironment interaction).

AREA COVERED

In this review, the authors discuss the recent methodological advancements and existing challenges to target specialized hematopoietic niches within the bone marrow during leukemia and suggest how such methods can be used to identify drugs targeting leukemic cell-bone microenvironment interactions.

EXPERT OPINION

The recent development in cell-cell communication scoring technology and culture conditions can speed up the drug discovery by targeting the cell-microenvironment interaction. However, to accelerate this process, collecting clinical-relevant patient tissues, developing culture model systems, and implementing computational algorithms, especially trained to predict drugs and their combination targeting the cancer cell-bone microenvironment interaction are needed.

Machine learning approaches for drug combination therapies

Drug combination therapy is a promising strategy to treat complex diseases such as cancer and infectious diseases. However, current knowledge of drug combination therapies, especially in cancer patients, is limited because of adverse drug effects, toxicity and cell line heterogeneity. Screening new drug combinations requires substantial efforts since considering all possible combinations between drugs is infeasible and expensive. Therefore, building computational approaches, particularly machine learning methods, could provide an effective strategy to overcome drug resistance and improve therapeutic efficacy. In this review, we group the state-of-the-art machine learning approaches to analyze personalized drug combination therapies into three categories and discuss each method in each category. We also present a short description of relevant databases used as a benchmark in drug combination therapies and provide a list of well-known, publicly available interactive data analysis portals. We highlight the importance of data integration on the identification of drug combinations. Finally, we address the advantages of combining multiple data sources on drug combination analysis by showing an experimental comparison.

Recent omics-based computational methods for COVID-19 drug discovery and repurposing

The coronavirus disease 2019 (COVID-19) pandemic, caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), is the main reason for the increasing number of deaths worldwide. Although strict quarantine measures were followed in many countries, the disease situation is still intractable. Thus, it is needed to utilize all possible means to confront this pandemic. Therefore, researchers are in a race against the time to produce potential treatments to cure or reduce the increasing infections of COVID-19. Computational methods are widely proving rapid successes in biological related problems, including diagnosis and treatment of diseases. Many efforts in recent months utilized Artificial Intelligence (AI) techniques in the context of fighting the spread of COVID-19. Providing periodic reviews and discussions of recent efforts saves the time of researchers and helps to link their endeavors for a faster and efficient confrontation of the pandemic. In this review, we discuss the recent promising studies that used Omics-based data and utilized AI algorithms and other computational tools to achieve this goal. We review the established datasets and the developed methods that were basically directed to new or repurposed drugs, vaccinations and diagnosis. The tools and methods varied depending on the level of details in the available information such as structures, sequences or metabolic data.

DeepDDS: deep graph neural network with attention mechanism to predict synergistic drug combinations

MOTIVATION

Drug combination therapy has become an increasingly promising method in the treatment of cancer. However, the number of possible drug combinations is so huge that it is hard to screen synergistic drug combinations through wet-lab experiments. Therefore, computational screening has become an important way to prioritize drug combinations. Graph neural network has recently shown remarkable performance in the prediction of compound-protein interactions, but it has not been applied to the screening of drug combinations.

RESULTS

In this paper, we proposed a deep learning model based on graph neural network and attention mechanism to identify drug combinations that can effectively inhibit the viability of specific cancer cells. The feature embeddings of drug molecule structure and gene expression profiles were taken as input to multilayer feedforward neural network to identify the synergistic drug combinations. We compared DeepDDS (Deep Learning for Drug-Drug Synergy prediction) with classical machine learning methods and other deep learning-based methods on benchmark data set, and the leave-one-out experimental results showed that DeepDDS achieved better performance than competitive methods. Also, on an independent test set released by well-known pharmaceutical enterprise AstraZeneca, DeepDDS was superior to competitive methods by more than 16% predictive precision. Furthermore, we explored the interpretability of the graph attention network and found the correlation matrix of atomic features revealed important chemical substructures of drugs. We believed that DeepDDS is an effective tool that prioritized synergistic drug combinations for further wet-lab experiment validation.

AVAILABILITY AND IMPLEMENTATION

Source code and data are available at https://github.com/Sinwang404/DeepDDS/tree/master.

Machine learning methods, databases and tools for drug combination prediction

Combination therapy has shown an obvious efficacy on complex diseases and can greatly reduce the development of drug resistance. However, even with high-throughput screens, experimental methods are insufficient to explore novel drug combinations. In order to reduce the search space of drug combinations, there is an urgent need to develop more efficient computational methods to predict novel drug combinations. In recent decades, more and more machine learning (ML) algorithms have been applied to improve the predictive performance. The object of this study is to introduce and discuss the recent applications of ML methods and the widely used databases in drug combination prediction. In this study, we first describe the concept and controversy of synergism between drug combinations. Then, we investigate various publicly available data resources and tools for prediction tasks. Next, ML methods including classic ML and deep learning methods applied in drug combination prediction are introduced. Finally, we summarize the challenges to ML methods in prediction tasks and provide a discussion on future work.

An In Silico Method for Predicting Drug Synergy Based on Multitask Learning

To make better use of all kinds of knowledge to predict drug synergy, it is crucial to successfully establish a drug synergy prediction model and leverage the reconstruction of sparse known drug targets. Therefore, we present an in silico method that predicts the synergy scores of drug pairs based on multitask learning (DSML) that could fuse drug targets, protein-protein interactions, anatomical therapeutic chemical codes, a priori knowledge of drug combinations. To simultaneously reconstruct drug-target protein interactions and synergistic drug combinations, DSML benefits indirectly from the associations with relation through proteins. In cross-validation experiments, DSML improved the ability to predict drug synergy. Moreover, the reconstruction of drug-target interactions and the incorporation of multisource knowledge significantly improved drug combination predictions by a large margin. The potential drug combinations predicted by DSML demonstrate its ability to predict drug synergy.

Pathway-Guided Deep Neural Network toward Interpretable and Predictive Modeling of Drug Sensitivity

To efficiently save cost and reduce risk in drug research and development, there is a pressing demand to develop in silico methods to predict drug sensitivity to cancer cells. With the exponentially increasing number of multi-omics data derived from high-throughput techniques, machine learning-based methods have been applied to the prediction of drug sensitivities. However, these methods have drawbacks either in the interpretability of the mechanism of drug action or limited performance in modeling drug sensitivity. In this paper, we presented a pathway-guided deep neural network (DNN) model to predict the drug sensitivity in cancer cells. Biological pathways describe a group of molecules in a cell that collaborates to control various biological functions like cell proliferation and death, thereby abnormal function of pathways can result in disease. To take advantage of the excellent predictive ability of DNN and the biological knowledge of pathways, we reshaped the canonical DNN structure by incorporating a layer of pathway nodes and their connections to input gene nodes, which makes the DNN model more interpretable and predictive compared to canonical DNN. We have conducted extensive performance evaluations on multiple independent drug sensitivity data sets and demonstrated that our model significantly outperformed the canonical DNN model and eight other classical regression models. Most importantly, we observed a remarkable activity decrease in disease-related pathway nodes during forward propagation upon inputs of drug targets, which implicitly corresponds to the inhibition effect of disease-related pathways induced by drug treatment on cancer cells. Our empirical experiments showed that our method achieves pharmacological interpretability and predictive ability in modeling drug sensitivity in cancer cells. The web server, the processed data sets, and source codes for reproducing our work are available at http://pathdnn.denglab.org.