Knowledge graph prediction of unknown adverse drug reactions and validation in electronic health records

Bio-K-Transformer: A pre-trained transformer-based sequence-to-sequence model for adverse drug reactions prediction

BACKGROUND AND OBJECTIVE

Adverse drug reactions (ADRs) pose a serious threat to patient health, potentially resulting in severe consequences, including mortality. Accurate prediction of ADRs before drug market release is crucial for early prevention. Traditional ADR detection, relying on clinical trials and voluntary reporting, has inherent limitations. Clinical trials face challenges in capturing rare and long-term reactions due to scale and time constraints, while voluntary reporting tends to neglect mild and common reactions. Consequently, drugs on the market may carry unknown risks, leading to an increasing demand for more accurate predictions of ADRs before their commercial release. This study aims to develop a more accurate prediction model for ADRs prior to drug market release.

METHODS

We frame the ADR prediction task as a sequence-to-sequence problem and propose the Bio-K-Transformer, which integrates the transformer model with pre-trained models (i.e., Bio_ClinicalBERT and K-bert), to forecast potential ADRs. We enhance the attention mechanism of the Transformer encoder structure and adjust embedding layers to model diverse relationships between drug adverse reactions. Additionally, we employ a masking technique to handle target data. Experimental findings demonstrate a notable improvement in predicting potential adverse reactions, achieving a predictive accuracy of 90.08%. It significantly exceeds current state-of-the-art baseline models and even the fine-tuned Llama-3.1-8B and Llama3-Aloe-8B-Alpha model, while being cost-effective. The results highlight the model's efficacy in identifying potential adverse reactions with high precision, sensitivity, and specificity.

CONCLUSION

The Bio-K-Transformer significantly enhances the prediction of ADRs, offering a cost-effective method with strong potential for improving pre-market safety evaluations of pharmaceuticals.

Graph neural network-based subgraph analysis for predicting adverse drug events

PURPOSE

Adverse drug events (ADEs) are a significant global public health concern, and they have resulted in high rates of hospital admissions, morbidity, and mortality. Prior to the use of machine learning and deep learning methods, ADEs may not become well recognized until long after a drug has been approved and is widely used, which poses a significant challenge for ensuring patient safety. Consequently, there is a need to develop computational approaches for earlier identification of ADEs not detected during pre-registration clinical trials.

METHODS

This paper presents a state-of-the-art network-based approach that models patients as subgraphs composed of nodes of International Classification of Diseases (ICD) codes and directed edges illustrating disease progression. Four Graph Neural Network (GNN) variants were employed to make sub-graph level predictions that answer three Research Questions (RQ): 1) whether ADE(s) would occur given a patient's prior diagnoses history, 2) when an ADE would occur, and 3) which ADE would occur. The first and second RQs were addressed using a binary classification approach. The third RQ was addressed using a multi-label classification model.

RESULTS

The proposed network-based approach demonstrated superior performance in predicting ADEs, with the GraphSage model exhibiting the highest accuracy for both RQ 1 (0.8863) and RQ 3 (0.9367), while the Graph Attention Networks (GAT) model was found to perform best for RQ 2 (0.8769). Furthermore, an analysis segmented by ADE classification revealed that while RQs 1 and 3 exhibited minimal variance across different ADE categories, a distinct advantage was observed for categories B, C, and E in the context of RQ 2 when applying this sub-graph method.

CONCLUSION

The network-based approach demonstrates the potential of GNNs in supporting the early detection and prevention of ADEs. Accurately predicting ADEs could enable healthcare professionals to make informed clinical decisions, take preventive measures and adjust medication regimens before serious adverse events occur. The proposed prediction method could also lead to optimized usage of healthcare resources by preventing hospital admissions and reducing the overall burden of adverse drug events on the healthcare systems.

Research Progresses and Applications of Knowledge Graph Embedding Technique in Chemistry

A knowledge graph (KG) is a technique for modeling entities and their interrelations. Knowledge graph embedding (KGE) translates these entities and relationships into a continuous vector space to facilitate dense and efficient representations. In the domain of chemistry, applying KG and KGE techniques integrates heterogeneous chemical information into a coherent and user-friendly framework, enhances the representation of chemical data features, and is beneficial for downstream tasks, such as chemical property prediction. This paper begins with a comprehensive review of classical and contemporary KGE methodologies, including distance-based models, semantic matching models, and neural network-based approaches. We then catalogue the primary databases employed in chemistry and biochemistry that furnish the KGs with essential chemical data. Subsequently, we explore the latest applications of KG and KGE in chemistry, focusing on risk assessment, property prediction, and drug discovery. Finally, we discuss the current challenges to KG and KGE techniques and provide a perspective on their potential future developments.

The future of medicine: an outline attempt using state-of-the-art business and scientific trends

Introduction

Currently, there is a lot of discussion about the future of medicine. From research and development to regulatory approval and access to patients until the withdrawal of a medicinal product from the market, there have been many challenges and a lot of barriers to overcome. In parallel, the business environment changes rapidly. So, the big question is how the pharma ecosystem will evolve in the future.

Methods

The current literature about the latest business and scientific evolutions and trends was reviewed.

Results

In the business environment, vast changes have taken place via the development of the internet as well as the Internet of Things. A new approach to production has emerged in a frame called Creative Commons; producer and consumer may be gradually identified in the context of the same process. As technology rapidly evolves, it is dominated by Artificial Intelligence (AI), its subset, Machine Learning, and the use of Big Data and Real-World Data (RWD) to produce Real-World Evidence (RWE). Nanotechnology is an inter-science field that gives new opportunities for the manufacturing of devices and products that have dimensions of a billionth of a meter. Artificial Neural Networks and Deep Learning (DL) are mimicking the use of the human brain, combining computer science with new theoretical foundations for complex systems. The implementation of these evolutions has already been initiated in the medicinal products' lifecycle, including screening of drug candidates, clinical trials, pharmacovigilance (PV), marketing authorization, manufacturing, and the supply chain. This has emerged as a new ecosystem which features characteristics such as free online tools and free data available online. Personalized medicine is a breakthrough field where tailor-made therapeutic solutions can be provided customized to the genome of each patient.

Conclusion

Various interactions take place as the pharma ecosystem and technology rapidly evolve. This can lead to better, safer, and more effective treatments that are developed faster and with a more solid, data-driven and evidence-concrete approach, which will drive the benefit for the patient.

Knowledge Graphs in Pharmacovigilance: A Scoping Review

PURPOSE

To critically assess the role and added value of knowledge graphs in pharmacovigilance, focusing on their ability to predict adverse drug reactions.

METHODS

A systematic scoping review was conducted in which detailed information, including objectives, technology, data sources, methodology, and performance metrics, were extracted from a set of peer-reviewed publications reporting the use of knowledge graphs to support pharmacovigilance signal detection.

FINDINGS

The review, which included 47 peer-reviewed articles, found knowledge graphs were utilized for detecting/predicting single-drug adverse reactions and drug-drug interactions, with variable reported performance and sparse comparisons to legacy methods.

IMPLICATIONS

Research to date suggests that knowledge graphs have the potential to augment predictive signal detection in pharmacovigilance, but further research using more reliable reference sets of adverse drug reactions and comparison with legacy pharmacovigilance methods are needed to more clearly define best practices and to establish their place in holistic pharmacovigilance systems.

Artificial Intelligence for Drug Discovery: Are We There Yet?

Drug discovery is adapting to novel technologies such as data science, informatics, and artificial intelligence (AI) to accelerate effective treatment development while reducing costs and animal experiments. AI is transforming drug discovery, as indicated by increasing interest from investors, industrial and academic scientists, and legislators. Successful drug discovery requires optimizing properties related to pharmacodynamics, pharmacokinetics, and clinical outcomes. This review discusses the use of AI in the three pillars of drug discovery: diseases, targets, and therapeutic modalities, with a focus on small-molecule drugs. AI technologies, such as generative chemistry, machine learning, and multiproperty optimization, have enabled several compounds to enter clinical trials. The scientific community must carefully vet known information to address the reproducibility crisis. The full potential of AI in drug discovery can only be realized with sufficient ground truth and appropriate human intervention at later pipeline stages.

A patient safety knowledge graph supporting vaccine product development

BACKGROUND

Knowledge graphs are well-suited for modeling complex, unstructured, and multi-source data and facilitating their analysis. During the COVID-19 pandemic, adverse event data were integrated into a knowledge graph to support vaccine safety surveillance and nimbly respond to urgent health authority questions. Here, we provide details of this post-marketing safety system using public data sources. In addition to challenges with varied data representations, adverse event reporting on the COVID-19 vaccines generated an unprecedented volume of data; an order of magnitude larger than adverse events for all previous vaccines. The Patient Safety Knowledge Graph (PSKG) is a robust data store to accommodate the volume of adverse event data and harmonize primary surveillance data sources.

METHODS

We designed a semantic model to represent key safety concepts. We built an extract-transform-load (ETL) data pipeline to parse and import primary public data sources; align key elements such as vaccine names; integrated the Medical Dictionary for Regulatory Activities (MedDRA); and applied quality metrics. PSKG is deployed in a Neo4J graph database, and made available via a web interface and Application Programming Interfaces (APIs).

RESULTS

We import and align adverse event data and vaccine exposure data from 250 countries on a weekly basis, producing a graph with 4,340,980 nodes and 30,544,475 edges as of July 1, 2022. PSKG is used for ad-hoc analyses and periodic reporting for several widely available COVID-19 vaccines. Analysis code using the knowledge graph is 80% shorter than an equivalent implementation written entirely in Python, and runs over 200 times faster.

CONCLUSIONS

Organizing safety data into a concise model of nodes, properties, and edge relationships has greatly simplified analysis code by removing complex parsing and transformation algorithms from individual analyses and instead managing these centrally. The adoption of the knowledge graph transformed how the team answers key scientific and medical questions. Whereas previously an analysis would involve aggregating and transforming primary datasets from scratch to answer a specific question, the team can now iterate easily and respond as quickly as requests evolve (e.g., "Produce vaccine-X safety profile for adverse event-Y by country instead of age-range").

Mining literature and pathway data to explore the relations of ketamine with neurotransmitters and gut microbiota using a knowledge-graph

MOTIVATION

Up-to-date pathway knowledge is usually presented in scientific publications for human reading, making it difficult to utilize these resources for semantic integration and computational analysis of biological pathways. We here present an approach to mining knowledge graphs by combining manual curation with automated named entity recognition and automated relation extraction. This approach allows us to study pathway-related questions in detail, which we here show using the ketamine pathway, aiming to help improve understanding of the role of gut microbiota in the antidepressant effects of ketamine.

RESULTS

The thus devised ketamine pathway 'KetPath' knowledge graph comprises five parts: (i) manually curated pathway facts from images; (ii) recognized named entities in biomedical texts; (iii) identified relations between named entities; (iv) our previously constructed microbiota and pre-/probiotics knowledge bases; and (v) multiple community-accepted public databases. We first assessed the performance of automated extraction of relations between named entities using the specially designed state-of-the-art tool BioKetBERT. The query results show that we can retrieve drug actions, pathway relations, co-occurring entities, and their relations. These results uncover several biological findings, such as various gut microbes leading to increased expression of BDNF, which may contribute to the sustained antidepressant effects of ketamine. We envision that the methods and findings from this research will aid researchers who wish to integrate and query data and knowledge from multiple biomedical databases and literature simultaneously.

AVAILABILITY AND IMPLEMENTATION

Data and query protocols are available in the KetPath repository at https://dx.doi.org/10.5281/zenodo.8398941 and https://github.com/tingcosmos/KetPath.

Artificial intelligence in the field of pharmacy practice: A literature review

Artificial intelligence (AI) is a transformative technology used in various industrial sectors including healthcare. In pharmacy practice, AI has the potential to significantly improve medication management and patient care. This review explores various AI applications in the field of pharmacy practice. The incorporation of AI technologies provides pharmacists with tools and systems that help them make accurate and evidence-based clinical decisions. By using AI algorithms and Machine Learning, pharmacists can analyze a large volume of patient data, including medical records, laboratory results, and medication profiles, aiding them in identifying potential drug-drug interactions, assessing the safety and efficacy of medicines, and making informed recommendations tailored to individual patient requirements. Various AI models have been developed to predict and detect adverse drug events, assist clinical decision support systems with medication-related decisions, automate dispensing processes in community pharmacies, optimize medication dosages, detect drug-drug interactions, improve adherence through smart technologies, detect and prevent medication errors, provide medication therapy management services, and support telemedicine initiatives. By incorporating AI into clinical practice, health care professionals can augment their decision-making processes and provide patients with personalized care. AI allows for greater collaboration between different healthcare services provided to a single patient. For patients, AI may be a useful tool for providing guidance on how and when to take a medication, aiding in patient education, and promoting medication adherence and AI may be used to know how and where to obtain the most cost-effective healthcare and how best to communicate with healthcare professionals, optimize the health monitoring using wearables devices, provide everyday lifestyle and health guidance, and integrate diet and exercise.

[Overview of the application of knowledge graphs in the medical field]

With the booming development of medical information technology and computer science, the medical services industry is gradually transiting from information technology to intelligence. The medical knowledge graph plays an important role in intelligent medical applications such as knowledge questions and answers and intelligent diagnosis, and is a key technology for promoting wise medical care and the basis for intelligent management of medical information. In order to fully exploit the great potential of knowledge graphs in the medical field, this paper focuses on five aspects: inter-drug relationship discovery, assisted diagnosis, personalized recommendation, decision support and intelligent prediction. The latest research progress on medical knowledge graphs is introduced, and relevant suggestions are made in light of the current challenges and problems faced by medical knowledge graphs to provide reference for promoting the wide application of medical knowledge graphs.

A precision medicine approach to personalized prescribing using genetic and nongenetic factors for clinical decision-making

Screening potential drug-drug interactions, drug-gene interactions, contraindications, and other factors is crucial in clinical practice. However, implementing these screening concepts in real-world settings poses challenges. This work proposes an approach towards precision medicine that combines genetic and nongenetic factors to facilitate clinical decision-making. The approach focuses on raising the performance of four potential interaction screenings in the prescribing process, including drug-drug interactions, drug-gene interactions, drug-herb interactions, drug-social lifestyle interactions, and two potential considerations for patients with liver or renal impairment. The work describes the design of a curated knowledge-based model called the knowledge model for potential interaction and consideration screening, the screening logic for both the detection module and inference module, and the personalized prescribing report. Three case studies have demonstrated the proof-of-concept and effectiveness of this approach. The proposed approach aims to reduce decision-making processes for healthcare professionals, reduce medication-related harm, and enhance treatment effectiveness. Additionally, the recommendation with a semantic network is suggested to assist in risk-benefit analysis when health professionals plan therapeutic interventions with new medicines that have insufficient evidence to establish explicit recommendations. This approach offers a promising solution to implementing precision medicine in clinical practice.

Insight Extraction From E-Health Bookings by Means of Hypergraph and Machine Learning

New technologies are transforming medicine, and this revolution starts with data. Usually, health services within public healthcare systems are accessed through a booking centre managed by local health authorities and controlled by the regional government. In this perspective, structuring e-health data through a Knowledge Graph (KG) approach can provide a feasible method to quickly and simply organize data and/or retrieve new information. Starting from raw health bookings data from the public healthcare system in Italy, a KG method is presented to support e-health services through the extraction of medical knowledge and novel insights. By exploiting graph embedding which arranges the various attributes of the entities into the same vector space, we are able to apply Machine Learning (ML) techniques to the embedded vectors. The findings suggest that KGs could be used to assess patients' medical booking patterns, either from unsupervised or supervised ML. In particular, the former can determine possible presence of hidden groups of entities that is not immediately available through the original legacy dataset structure. The latter, although the performance of the used algorithms is not very high, shows encouraging results in predicting a patient's likelihood to undergo a particular medical visit within a year. However, many technological advances remain to be made, especially in graph database technologies and graph embedding algorithms.

MultiGML: Multimodal graph machine learning for prediction of adverse drug events

Adverse drug events constitute a major challenge for the success of clinical trials. Several computational strategies have been suggested to estimate the risk of adverse drug events in preclinical drug development. While these approaches have demonstrated high utility in practice, they are at the same time limited to specific information sources. Thus, many current computational approaches neglect a wealth of information which results from the integration of different data sources, such as biological protein function, gene expression, chemical compound structure, cell-based imaging and others. In this work we propose an integrative and explainable multi-modal Graph Machine Learning approach (MultiGML), which fuses knowledge graphs with multiple further data modalities to predict drug related adverse events and general drug target-phenotype associations. MultiGML demonstrates excellent prediction performance compared to alternative algorithms, including various traditional knowledge graph embedding techniques. MultiGML distinguishes itself from alternative techniques by providing in-depth explanations of model predictions, which point towards biological mechanisms associated with predictions of an adverse drug event. Hence, MultiGML could be a versatile tool to support decision making in preclinical drug development.

Rewiring Drug Research and Development through Human Data-Driven Discovery (HD3)

In an era of unparalleled technical advancement, the pharmaceutical industry is struggling to transform data into increased research and development efficiency, and, as a corollary, new drugs for patients. Here, we briefly review some of the commonly discussed issues around this counterintuitive innovation crisis. Looking at both industry- and science-related factors, we posit that traditional preclinical research is front-loading the development pipeline with data and drug candidates that are unlikely to succeed in patients. Applying a first principles analysis, we highlight the critical culprits and provide suggestions as to how these issues can be rectified through the pursuit of a Human Data-driven Discovery (HD3) paradigm. Consistent with other examples of disruptive innovation, we propose that new levels of success are not dependent on new inventions, but rather on the strategic integration of existing data and technology assets. In support of these suggestions, we highlight the power of HD3, through recently published proof-of-concept applications in the areas of drug safety analysis and prediction, drug repositioning, the rational design of combination therapies and the global response to the COVID-19 pandemic. We conclude that innovators must play a key role in expediting the path to a largely human-focused, systems-based approach to drug discovery and research.

Healthcare knowledge graph construction: A systematic review of the state-of-the-art, open issues, and opportunities

The incorporation of data analytics in the healthcare industry has made significant progress, driven by the demand for efficient and effective big data analytics solutions. Knowledge graphs (KGs) have proven utility in this arena and are rooted in a number of healthcare applications to furnish better data representation and knowledge inference. However, in conjunction with a lack of a representative KG construction taxonomy, several existing approaches in this designated domain are inadequate and inferior. This paper is the first to provide a comprehensive taxonomy and a bird's eye view of healthcare KG construction. Additionally, a thorough examination of the current state-of-the-art techniques drawn from academic works relevant to various healthcare contexts is carried out. These techniques are critically evaluated in terms of methods used for knowledge extraction, types of the knowledge base and sources, and the incorporated evaluation protocols. Finally, several research findings and existing issues in the literature are reported and discussed, opening horizons for future research in this vibrant area.

Evaluation of health care professionals' knowledge, attitudes, practices and barriers to pharmacovigilance and adverse drug reaction reporting: A cross-sectional multicentral study

BACKGROUND

Healthcare professionals' involvement and reporting of adverse drug reactions are essential for the success of a pharmacovigilance program. The aim of this study was to assess healthcare professionals (medical doctors, pharmacists, nurses, dentists, midwives, and paramedics) current knowledge, attitude, practices, and barriers regarding pharmacovigilance and adverse drug reactions reporting in multicentral healthcare settings.

METHODS

A cross-sectional face-to-face survey was conducted among currently working healthcare professionals in various hospitals in ten districts of Adana province, Türkiye from March to October 2022. A self-administered, pretested questionnaire (Cronbach's alpha = 0.894 for knowledge, attitudes and practices variables) was used for data collection. The questionnaire's final draft included five sections (sociodemographic/general information, knowledge, attitude, practices, and barriers) with 58 questions. The collected data was analyzed in SPSS (version 25) using descriptive statistics, the chi-square test, and logistic regression.

RESULTS

Of the total 435 distributed questionnaires, 412 completed the entire questionnaire, yielding a 94% response rate. The majority of healthcare professionals (60.4%; n = 249) had never received pharmacovigilance training. Among healthcare professionals 51.9% (n = 214), 71.1% (n = 293) and 92.5% (n = 381) had poor knowledge, positive attitudes and poor practices, respectively. Only 32.5% of healthcare professionals kept the record of an adverse drug reaction and only 13.1% reported adverse drug reactions. The profession (medical doctors, pharmacists, nurses, dentists, midwives, and paramedics) of healthcare professionals and a lack of training were predictors of poor adverse drug reaction reporting (p < 0.05). A statistically significant difference in healthcare professionals and knowledge, attitude and practices scores was also observed (p < 0.05). The main barriers which were supposed to discourage adverse drug reactions reporting by the healthcare professionals were higher workload (63.8%) followed by thinking that a single adverse drug reaction report makes no impact (63.6%) and lack of a professional atmosphere (51.9%).

CONCLUSION

In the current study, most healthcare professionals had poor knowledge and practice, but they had a positive attitude toward pharmacovigilance and adverse drug reactions reporting. Barriers to under-reporting of adverse drug reactions were also highlighted. Periodic training programs, educational interventions, systematic follow-up of healthcare professionals by local healthcare authorities, interprofessional links between all healthcare professionals, and the implementation of mandatory reporting policies are critical for improving healthcare professionals knowledge, practices, patient safety and pharmacovigilance activities.

Towards electronic health record-based medical knowledge graph construction, completion, and applications: A literature study

With the growth of data and intelligent technologies, the healthcare sector opened numerous technology that enabled services for patients, clinicians, and researchers. One major hurdle in achieving state-of-the-art results in health informatics is domain-specific terminologies and their semantic complexities. A knowledge graph crafted from medical concepts, events, and relationships acts as a medical semantic network to extract new links and hidden patterns from health data sources. Current medical knowledge graph construction studies are limited to generic techniques and opportunities and focus less on exploiting real-world data sources in knowledge graph construction. A knowledge graph constructed from Electronic Health Records (EHR) data obtains real-world data from healthcare records. It ensures better results in subsequent tasks like knowledge extraction and inference, knowledge graph completion, and medical knowledge graph applications such as diagnosis predictions, clinical recommendations, and clinical decision support. This review critically analyses existing works on medical knowledge graphs that used EHR data as the data source at (i) representation level, (ii) extraction level (iii) completion level. In this investigation, we found that EHR-based knowledge graph construction involves challenges such as high complexity and dimensionality of data, lack of knowledge fusion, and dynamic update of the knowledge graph. In addition, the study presents possible ways to tackle the challenges identified. Our findings conclude that future research should focus on knowledge graph integration and knowledge graph completion challenges.

From Data to Wisdom: Biomedical Knowledge Graphs for Real-World Data Insights

Graph data models are an emerging approach to structure clinical and biomedical information. These models offer intriguing opportunities for novel approaches in healthcare, such as disease phenotyping, risk prediction, and personalized precision care. The combination of data and information in a graph model to create knowledge graphs has rapidly expanded in biomedical research, but the integration of real-world data from the electronic health record has been limited. To broadly apply knowledge graphs to EHR and other real-world data, a deeper understanding of how to represent these data in a standardized graph model is needed. We provide an overview of the state-of-the-art research for clinical and biomedical data integration and summarize the potential to accelerate healthcare and precision medicine research through insight generation from integrated knowledge graphs.

Infant Low Birth Weight Prediction Using Graph Embedding Features

Low Birth weight (LBW) infants pose a serious public health concern worldwide in both the short and long term for infants and their mothers. Infant weight prediction prior to birth can help to identify risk factors and reduce the risk of infant morbidity and mortality. Although many Machine Learning (ML) algorithms have been proposed for LBW prediction using maternal features and produced considerable model performance, their performance needs to be improved so that they can be adapted in real-world clinical settings. Existing algorithms used for LBW classification often fail to capture structural information from the tabular dataset of patients with different complications. Therefore, to improve the LBW classification performance, we propose a solution by transforming the tabular data into a knowledge graph with the aim that patients from the same class (normal or LBW) exhibit similar patterns in the graphs. To achieve this, several features related to each node are extracted such as node embedding using node2vec algorithm, node degree, node similarity, nearest neighbors, etc. Our method is evaluated on a real-life dataset obtained from a large cohort study in the United Arab Emirates which contains data from 3453 patients. Multiple experiments were performed using the seven most commonly used ML models on the original dataset, graph features, and a combination of features, respectively. Experimental results show that our proposed method achieved the best performance with an area under the curve of 0.834 which is over 6% improvement compared to using the original risk factors without transforming them into knowledge graphs. Furthermore, we provide the clinical relevance of the proposed model that are important for the model to be adapted in clinical settings.

iADRGSE: A Graph-Embedding and Self-Attention Encoding for Identifying Adverse Drug Reaction in the Earlier Phase of Drug Development

Adverse drug reactions (ADRs) are a major issue to be addressed by the pharmaceutical industry. Early and accurate detection of potential ADRs contributes to enhancing drug safety and reducing financial expenses. The majority of the approaches that have been employed to identify ADRs are limited to determining whether a drug exhibits an ADR, rather than identifying the exact type of ADR. By introducing the "multi-level feature-fusion deep-learning model", a new predictor, called iADRGSE, has been developed, which can be used to identify adverse drug reactions at the early stage of drug discovery. iADRGSE integrates a self-attentive module and a graph-network module that can extract one-dimensional sub-structure sequence information and two-dimensional chemical-structure graph information of drug molecules. As a demonstration, cross-validation and independent testing were performed with iADRGSE on a dataset of ADRs classified into 27 categories, based on SOC (system organ classification). In addition, experiments comparing iADRGSE with approaches such as NPF were conducted on the OMOP dataset, using the jackknife test method. Experiments show that iADRGSE was superior to existing state-of-the-art predictors.

Towards a knowledge graph for pre-/probiotics and microbiota-gut-brain axis diseases

Scientific publications present biological relationships but are structured for human reading, making it difficult to use this resource for semantic integration and querying. Existing databases, on the other hand, are well structured for automated analysis, but do not contain comprehensive biological knowledge. We devised an approach for constructing comprehensive knowledge graphs from these two types of resources and applied it to investigate relationships between pre-/probiotics and microbiota-gut-brain axis diseases. To this end, we created (i) a knowledge base, dubbed ppstatement, containing manually curated detailed annotations, and (ii) a knowledge base, called ppconcept, containing automatically annotated concepts. The resulting Pre-/Probiotics Knowledge Graph (PPKG) combines these two knowledge bases with three other public databases (i.e. MeSH, UMLS and SNOMED CT). To validate the performance of PPKG and to demonstrate the added value of integrating two knowledge bases, we created four biological query cases. The query cases demonstrate that we can retrieve co-occurring concepts of interest, and also that combining the two knowledge bases leads to more comprehensive query results than utilizing them separately. The PPKG enables users to pose research queries such as "which pre-/probiotics combinations may benefit depression?", potentially leading to novel biological insights.

Evaluating molecular fingerprint-based models of drug side effects against a statistical control

There are many machine learning models that use molecular fingerprints of drugs to predict side effects. Characterizing their skill is necessary for understanding their usefulness in pharmaceutical development. Here, we analyze a statistical control of side effect prediction skill, develop a pipeline for benchmarking models, and evaluate how well existing models predict side effects identified in pharmaceutical documentation. We demonstrate that molecular fingerprints are useful for ranking drugs by their likelihood to cause a given side effect. However, the predictions for one or more drugs overall benefit only marginally from molecular fingerprints when ranking the likelihoods of many possible side effects, and display at most modest overall skill at identifying the side effects that do and do not occur.

Using logical constraints to validate statistical information about disease outbreaks in collaborative knowledge graphs: the case of COVID-19 epidemiology in Wikidata

Urgent global research demands real-time dissemination of precise data. Wikidata, a collaborative and openly licensed knowledge graph available in RDF format, provides an ideal forum for exchanging structured data that can be verified and consolidated using validation schemas and bot edits. In this research article, we catalog an automatable task set necessary to assess and validate the portion of Wikidata relating to the COVID-19 epidemiology. These tasks assess statistical data and are implemented in SPARQL, a query language for semantic databases. We demonstrate the efficiency of our methods for evaluating structured non-relational information on COVID-19 in Wikidata, and its applicability in collaborative ontologies and knowledge graphs more broadly. We show the advantages and limitations of our proposed approach by comparing it to the features of other methods for the validation of linked web data as revealed by previous research.

A Narrative Review of Adverse Event Detection, Monitoring, and Prevention in Indian Hospitals

An adverse event is any abnormal clinical finding associated with the use of a therapy. Adverse events are classified by reporting an event's seriousness, expectedness, and relatedness. Monitoring patient safety is of utmost importance as more and more data becomes available. In reality, very low numbers of adverse events are reported via the official path. Chart review, voluntary reporting, computerized surveillance, and direct observation can detect adverse drug events. Medication errors are commonly seen in hospitals and need provider and system-based interventions to prevent them. The need of the hour in India is to develop and implement medication safety best practices to avoid adverse events. The utility of artificial intelligence techniques in adverse event detection remains unexplored, and their accuracy and precision need to be studied in a controlled setting. There is a need to develop predictive models to assess the likelihood of adverse reactions while testing novel pharmaceutical drugs.

Measuring the impact of anonymization on real-world consolidated health datasets engineered for secondary research use: Experiments in the context of MODELHealth project

Introduction

Electronic Health Records (EHRs) are essential data structures, enabling the sharing of valuable medical care information for a diverse patient population and being reused as input to predictive models for clinical research. However, issues such as the heterogeneity of EHR data and the potential compromisation of patient privacy inhibit the secondary use of EHR data in clinical research.

Objectives

This study aims to present the main elements of the MODELHealth project implementation and the evaluation method that was followed to assess the efficiency of its mechanism.

Methods

The MODELHealth project was implemented as an Extract-Transform-Load system that collects data from the hospital databases, performs harmonization to the HL7 FHIR standard and anonymization using the k-anonymity method, before loading the transformed data to a central repository. The integrity of the anonymization process was validated by developing a database query tool. The information loss occurring due to the anonymization was estimated with the metrics of generalized information loss, discernibility and average equivalence class size for various values of k.

Results

The average values of generalized information loss, discernibility and average equivalence class size obtained across all tested datasets and k values were 0.008473 ± 0.006216252886, 115,145,464.3 ± 79,724,196.11 and 12.1346 ± 6.76096647, correspondingly. The values of those metrics appear correlated with factors such as the k value and the dataset characteristics, as expected.

Conclusion

The experimental results of the study demonstrate that it is feasible to perform effective harmonization and anonymization on EHR data while preserving essential patient information.

The Use of Artificial Intelligence in Pharmacovigilance: A Systematic Review of the Literature

INTRODUCTION

Artificial intelligence through machine learning uses algorithms and prior learnings to make predictions. Recently, there has been interest to include more artificial intelligence in pharmacovigilance of products already in the market and pharmaceuticals in development.

OBJECTIVE

The aim of this study was to identify and describe the uses of artificial intelligence in pharmacovigilance through a systematic literature review.

METHODS

Embase and MEDLINE database searches were conducted for articles published from January 1, 2015 to July 9, 2021 using search terms such as 'pharmacovigilance,' 'patient safety,' 'artificial intelligence,' and 'machine learning' in the title or abstract. Scientific articles that contained information on the use of artificial intelligence in all modalities of patient safety or pharmacovigilance were reviewed and synthesized using a pre-specified data extraction template. Articles with incomplete information and letters to editor, notes, and commentaries were excluded.

RESULTS

Sixty-six articles were identified for evaluation. Most relevant articles on artificial intelligence focused on machine learning, and it was used in patient safety in the identification of adverse drug events (ADEs) and adverse drug reactions (ADRs) (57.6%), processing safety reports (21.2%), extraction of drug-drug interactions (7.6%), identification of populations at high risk for drug toxicity or guidance for personalized care (7.6%), prediction of side effects (3.0%), simulation of clinical trials (1.5%), and integration of prediction uncertainties into diagnostic classifiers to increase patient safety (1.5%). Artificial intelligence has been used to identify safety signals through automated processes and training with machine learning models; however, the findings may not be generalizable given that there were different types of data included in each source.

CONCLUSION

Artificial intelligence allows for the processing and analysis of large amounts of data and can be applied to various disease states. The automation and machine learning models can optimize pharmacovigilance processes and provide a more efficient way to analyze information relevant to safety, although more research is needed to identify if this optimization has an impact on the quality of safety analyses. It is expected that its use will increase in the near future, particularly with its role in the prediction of side effects and ADRs.

Analyzing adverse drug reaction using statistical and machine learning methods: A systematic review

BACKGROUND

Adverse drug reactions (ADRs) are unintended negative drug-induced responses. Determining the association between drugs and ADRs is crucial, and several methods have been proposed to demonstrate this association. This systematic review aimed to examine the analytical tools by considering original articles that utilized statistical and machine learning methods for detecting ADRs.

METHODS

A systematic literature review was conducted based on articles published between 2015 and 2020. The keywords used were statistical, machine learning, and deep learning methods for detecting ADR signals. The study was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement (PRISMA) guidelines.

RESULTS

We reviewed 72 articles, of which 51 and 21 addressed statistical and machine learning methods, respectively. Electronic medical record (EMR) data were exclusively analyzed using the regression method. For FDA Adverse Event Reporting System (FAERS) data, components of the disproportionality method were preferable. DrugBank was the most used database for machine learning. Other methods accounted for the highest and supervised methods accounted for the second highest.

CONCLUSIONS

Using the 72 main articles, this review provides guidelines on which databases are frequently utilized and which analysis methods can be connected. For statistical analysis, >90% of the cases were analyzed by disproportionate or regression analysis with each spontaneous reporting system (SRS) data or electronic medical record (EMR) data; for machine learning research, however, there was a strong tendency to analyze various data combinations. Only half of the DrugBank database was occupied, and the k-nearest neighbor method accounted for the greatest proportion.

Comprehensive network medicine-based drug repositioning via integration of therapeutic efficacy and side effects

Despite advances in modern medicine that led to improvements in cardiovascular outcomes, cardiovascular disease (CVD) remains the leading cause of mortality and morbidity globally. Thus, there is an urgent need for new approaches to improve CVD drug treatments. As the development time and cost of drug discovery to clinical application are excessive, alternate strategies for drug development are warranted. Among these are included computational approaches based on omics data for drug repositioning, which have attracted increasing attention. In this work, we developed an adjusted similarity measure implemented by the algorithm SAveRUNNER to reposition drugs for cardiovascular diseases while, at the same time, considering the side effects of drug candidates. We analyzed nine cardiovascular disorders and two side effects. We formulated both disease disorders and side effects as network modules in the human interactome, and considered those drug candidates that are proximal to disease modules but far from side-effects modules as ideal. Our method provides a list of drug candidates for cardiovascular diseases that are unlikely to produce common, adverse side-effects. This approach incorporating side effects is applicable to other diseases, as well.

Interdisciplinary analysis of drugs: Structural features and clinical data

Background:

Chemical structure is a vital consideration early in the drug development process. Its role in analysis of safety and efficacy is relatively diminished after drugs are approved for clinical use. This interdisciplinary study explores a strategy by which readily available clinical data may be used along with structural features of drugs to identify associations with potential utility for both clinical decision-making and drug development.

Methods:

Chemical functional groups and structural groups (SGs) of 261 drugs were manually classified in tiers, and their incidence of gastrointestinal (GI) and central nervous system (CNS) adverse drug reactions (ADRs) were obtained from a clinical database. Drugs with an GI or CNS ADR incidence of at least 10% were analyzed for correlations with their functional and SGs.

Results:

Eight statistically significant associations were detected by preliminary analysis: piperazine and methylene groups were associated with higher rate of CNS ADRs; while amides, secondary alcohols, and di-substituted phenyl groups were associated with lower rates of GI or CNS ADRs or both.

Conclusions:

Although further study is necessary to understand these associations and build upon this strategy, this exploratory analysis establishes a methodology by which chemical properties of drugs may be used to aid in clinical decision-making when choosing between otherwise equivalent drug therapy options, as the presence of specific groups on drugs may be associated with increased or decreased risks of specific ADRs.

Data and Network Analytics for COVID-19 ICU Patients: A Case Study for a Spanish Hospital

The COVID-19 pandemic presents unprecedented challenges to the healthcare systems around the world. In 2020, Spain was among the countries with the highest Intensive Care Unit (ICU) hospitalization and mortality rates. This work analyzes data of COVID-19 patients admitted to a Spanish ICU during the first wave of the pandemic. The patients in our study either died (deceased patients) or were discharged from the ICU (non-deceased patients) and underwent the following landmarks: beginning of symptoms; arrival at the emergency department; beginning of the hospital stay; and ICU admission. Our goal is to create a graph-based data-science methodology to find associations among patients' comorbidities, previous medication, symptoms, and the COVID-19 treatment, and to analyze their evolution across landmarks. Towards that end, we first perform a hypothesis test based on bootstrap to identify discriminative features among deceased and non-deceased patients. Then, we leverage graph-based representations and network analytics to determine pairwise associations and complex relations among clinical features. The descriptive statistical analysis confirms that deceased patients exhibit multiple comorbidities with stronger levels of association and are treated with a wider range of drugs during the ICU stay. We also observe that the most common treatment was the simultaneous administration of lopinavir/ritonavir with hydroxychloroquine, regardless of the patients' outcome. Our results illustrate how graph tools and representations yield insights on the relations among comorbidities, drug treatments, and patients' evolution. All in all, the approach puts forth a new data-analysis tool for clinicians that can be applied to analyze (post-COVID) symptom/patient evolution.

Mining a stroke knowledge graph from literature

BACKGROUND

Stroke has an acute onset and a high mortality rate, making it one of the most fatal diseases worldwide. Its underlying biology and treatments have been widely studied both in the "Western" biomedicine and the Traditional Chinese Medicine (TCM). However, these two approaches are often studied and reported in insolation, both in the literature and associated databases.

RESULTS

To aid research in finding effective prevention methods and treatments, we integrated knowledge from the literature and a number of databases (e.g. CID, TCMID, ETCM). We employed a suite of biomedical text mining (i.e. named-entity) approaches to identify mentions of genes, diseases, drugs, chemicals, symptoms, Chinese herbs and patent medicines, etc. in a large set of stroke papers from both biomedical and TCM domains. Then, using a combination of a rule-based approach with a pre-trained BioBERT model, we extracted and classified links and relationships among stroke-related entities as expressed in the literature. We construct StrokeKG, a knowledge graph includes almost 46 k nodes of nine types, and 157 k links of 30 types, connecting diseases, genes, symptoms, drugs, pathways, herbs, chemical, ingredients and patent medicine.

CONCLUSIONS

Our Stroke-KG can provide practical and reliable stroke-related knowledge to help with stroke-related research like exploring new directions for stroke research and ideas for drug repurposing and discovery. We make StrokeKG freely available at http://114.115.208.144:7474/browser/ (Please click "Connect" directly) and the source structured data for stroke at https://github.com/yangxi1016/Stroke.

DGLinker: flexible knowledge-graph prediction of disease-gene associations

As a result of the advent of high-throughput technologies, there has been rapid progress in our understanding of the genetics underlying biological processes. However, despite such advances, the genetic landscape of human diseases has only marginally been disclosed. Exploiting the present availability of large amounts of biological and phenotypic data, we can use our current understanding of disease genetics to train machine learning models to predict novel genetic factors associated with the disease. To this end, we developed DGLinker, a webserver for the prediction of novel candidate genes for human diseases given a set of known disease genes. DGLinker has a user-friendly interface that allows non-expert users to exploit biomedical information from a wide range of biological and phenotypic databases, and/or to upload their own data, to generate a knowledge-graph and use machine learning to predict new disease-associated genes. The webserver includes tools to explore and interpret the results and generates publication-ready figures. DGLinker is available at https://dglinker.rosalind.kcl.ac.uk. The webserver is free and open to all users without the need for registration.

Investigating ADR mechanisms with Explainable AI: a feasibility study with knowledge graph mining

BACKGROUND

Adverse drug reactions (ADRs) are statistically characterized within randomized clinical trials and postmarketing pharmacovigilance, but their molecular mechanism remains unknown in most cases. This is true even for hepatic or skin toxicities, which are classically monitored during drug design. Aside from clinical trials, many elements of knowledge about drug ingredients are available in open-access knowledge graphs, such as their properties, interactions, or involvements in pathways. In addition, drug classifications that label drugs as either causative or not for several ADRs, have been established.

METHODS

We propose in this paper to mine knowledge graphs for identifying biomolecular features that may enable automatically reproducing expert classifications that distinguish drugs causative or not for a given type of ADR. In an Explainable AI perspective, we explore simple classification techniques such as Decision Trees and Classification Rules because they provide human-readable models, which explain the classification itself, but may also provide elements of explanation for molecular mechanisms behind ADRs. In summary, (1) we mine a knowledge graph for features; (2) we train classifiers at distinguishing, on the basis of extracted features, drugs associated or not with two commonly monitored ADRs: drug-induced liver injuries (DILI) and severe cutaneous adverse reactions (SCAR); (3) we isolate features that are both efficient in reproducing expert classifications and interpretable by experts (i.e., Gene Ontology terms, drug targets, or pathway names); and (4) we manually evaluate in a mini-study how they may be explanatory.

RESULTS

Extracted features reproduce with a good fidelity classifications of drugs causative or not for DILI and SCAR (Accuracy = 0.74 and 0.81, respectively). Experts fully agreed that 73% and 38% of the most discriminative features are possibly explanatory for DILI and SCAR, respectively; and partially agreed (2/3) for 90% and 77% of them.

CONCLUSION

Knowledge graphs provide sufficiently diverse features to enable simple and explainable models to distinguish between drugs that are causative or not for ADRs. In addition to explaining classifications, most discriminative features appear to be good candidates for investigating ADR mechanisms further.

An Ensembled SVM Based Approach for Predicting Adverse Drug Reactions

Background:

Preventing adverse drug reactions (ADRs) is imperative for the safety of the people. The problem of under-reporting the ADRs has been prevalent across the world, making it difficult to develop the prediction models, which are unbiased. As a result, most of the models are skewed to the negative samples leading to high accuracy but poor performance in other metrics such as precision, recall, F1 score, and AUROC score.

Objective:

In this work, we have proposed a novel way of predicting the ADRs by balancing the dataset.

Method:

The whole data set has been partitioned into balanced smaller data sets. SVMs with optimal kernel have been learned using each of the balanced data sets and the prediction of given ADR for the given drug has been obtained by voting from the ensembled optimal SVMs learned.

Results:

We have found that results are encouraging and comparable with the competing methods in the literature and obtained the average sensitivity of 0.97 for all the ADRs. The model has been interpreted and explained with SHAP values by various plots.

Conclusion:

A novel way of predicting ADRs by balancing the dataset has been proposed thereby reducing the effect of unbalanced datasets.

Towards the Modelling of Veillance based Citizen Profiling using Knowledge Graphs

In this work we have proposed a model for Citizen Profiling. It uses veillance (Surveillance and Sousveillance) for data acquisition. For representation of Citizen Profile Temporal Knowledge Graph has been used through which we can answer semantic queries. Previously, most of the work lacks representation of Citizen Profile and have used surveillance for data acquisition. Our contribution is towards enriching the data acquisition process by adding sousveillance mechanism and facilitating semantic queries through representation of Citizen Profiles using Temporal Knowledge Graphs. Our proposed solution is storage efficient as we have only stored data logs for Citizen Profiling instead of storing images, audio, and video for profiling purposes. Our proposed system can be extended to Smart City, Smart Traffic Management, Workplace profiling etc. Agent based mechanism can be used for data acquisition where each Citizen has its own agent. Another improvement can be to incorporate a decentralized version of database for maintaining Citizen profile.

Prediction of adverse drug reactions based on knowledge graph embedding

BACKGROUND

Adverse drug reactions (ADRs) are an important concern in the medication process and can pose a substantial economic burden for patients and hospitals. Because of the limitations of clinical trials, it is difficult to identify all possible ADRs of a drug before it is marketed. We developed a new model based on data mining technology to predict potential ADRs based on available drug data.

METHOD

Based on the Word2Vec model in Nature Language Processing, we propose a new knowledge graph embedding method that embeds drugs and ADRs into their respective vectors and builds a logistic regression classification model to predict whether a given drug will have ADRs.

RESULT

First, a new knowledge graph embedding method was proposed, and comparison with similar studies showed that our model not only had high prediction accuracy but also was simpler in model structure. In our experiments, the AUC of the classification model reached a maximum of 0.87, and the mean AUC was 0.863.

CONCLUSION

In this paper, we introduce a new method to embed knowledge graph to vectorize drugs and ADRs, then use a logistic regression classification model to predict whether there is a causal relationship between them. The experiment showed that the use of knowledge graph embedding can effectively encode drugs and ADRs. And the proposed ADRs prediction system is also very effective.

Prediction of adverse drug reactions using drug convolutional neural networks

Prediction of Adverse Drug Reactions (ADRs) has been an important aspect of Pharmacovigilance because of its impact in the pharma industry. The standard process of introduction of a new drug into a market involves a lot of clinical trials and tests. This is a tedious and time consuming process and also involves a lot of monetary resources. The faster approval of a drug helps the patients who are in need of the drug. The in silico prediction of Adverse Drug Reactions can help speed up the aforementioned process. The challenges involved are lack of negative data present and predicting ADR from just the chemical structure. Although many models are already available to predict ADR, most of the models use biological activities identifiers, chemical and physical properties in addition to chemical structures of the drugs. But for most of the new drugs to be tested, only chemical structures will be available. The performance of the existing models predicting ADR only using chemical structures is not efficient. Therefore, an efficient prediction of ADRs from just the chemical structure has been proposed in this paper. The proposed method involves a separate model for each ADR, making it a binary classification problem. This paper presents a novel CNN model called Drug Convolutional Neural Network (DCNN) to predict ADRs using chemical structures of the drugs. The performance is measured using the metrics such as Accuracy, Recall, Precision, Specificity, F1 score, AUROC and MCC. The results obtained by the proposed DCNN model outperform the competing models on the SIDER4.1 database in terms of all the metrics. A case study has been performed on a COVID-19 recommended drugs, where the proposed model predicted the ADRs that are well aligned with the observations made by medical professionals using conventional methods.

Adverse Drug Reaction Discovery Using a Tumor-Biomarker Knowledge Graph

Adverse drug reactions (ADRs) are a major public health concern, and early detection is crucial for drug development and patient safety. Together with the increasing availability of large-scale literature data, machine learning has the potential to predict unknown ADRs from current knowledge. By the machine learning methods, we constructed a Tumor-Biomarker Knowledge Graph (TBKG) which contains four types of node: Tumor, Biomarker, Drug, and ADR using biomedical literatures. Based on this knowledge graph, we not only discovered potential ADRs of antitumor drugs but also provided explanations. Experiments on real-world data show that our model can achieve 0.81 accuracy of three cross-validation and the ADRs discovery of Osimertinib was chosen for the clinical validation. Calculated ADRs of Osimertinib by our model consisted of the known ADRs which were in line with the official manual and some unreported rare ADRs in clinical cases. Results also showed that our model outperformed traditional co-occurrence methods. Moreover, each calculated ADRs were attached with the corresponding paths of “tumor-biomarker-drug” in the knowledge graph which could help to obtain in-depth insights into the underlying mechanisms. In conclusion, the tumor-biomarker knowledge-graph based approach is an explainable method for potential ADRs discovery based on biomarkers and might be valuable to the community working on the emerging field of biomedical literature mining and provide impetus for the mechanism research of ADRs.

What Can Machine Learning Approaches in Genomics Tell Us about the Molecular Basis of Amyotrophic Lateral Sclerosis?

Amyotrophic Lateral Sclerosis (ALS) is the most common late-onset motor neuron disorder, but our current knowledge of the molecular mechanisms and pathways underlying this disease remain elusive. This review (1) systematically identifies machine learning studies aimed at the understanding of the genetic architecture of ALS, (2) outlines the main challenges faced and compares the different approaches that have been used to confront them, and (3) compares the experimental designs and results produced by those approaches and describes their reproducibility in terms of biological results and the performances of the machine learning models. The majority of the collected studies incorporated prior knowledge of ALS into their feature selection approaches, and trained their machine learning models using genomic data combined with other types of mined knowledge including functional associations, protein-protein interactions, disease/tissue-specific information, epigenetic data, and known ALS phenotype-genotype associations. The importance of incorporating gene-gene interactions and cis-regulatory elements into the experimental design of future ALS machine learning studies is highlighted. Lastly, it is suggested that future advances in the genomic and machine learning fields will bring about a better understanding of ALS genetic architecture, and enable improved personalized approaches to this and other devastating and complex diseases.

Construction of a Digestive System Tumor Knowledge Graph Based on Chinese Electronic Medical Records: Development and Usability Study

BACKGROUND

With the increasing incidences and mortality of digestive system tumor diseases in China, ways to use clinical experience data in Chinese electronic medical records (CEMRs) to determine potentially effective relationships between diagnosis and treatment have become a priority. As an important part of artificial intelligence, a knowledge graph is a powerful tool for information processing and knowledge organization that provides an ideal means to solve this problem.

OBJECTIVE

This study aimed to construct a semantic-driven digestive system tumor knowledge graph (DSTKG) to represent the knowledge in CEMRs with fine granularity and semantics.

METHODS

This paper focuses on the knowledge graph schema and semantic relationships that were the main challenges for constructing a Chinese tumor knowledge graph. The DSTKG was developed through a multistep procedure. As an initial step, a complete DSTKG construction framework based on CEMRs was proposed. Then, this research built a knowledge graph schema containing 7 classes and 16 kinds of semantic relationships and accomplished the DSTKG by knowledge extraction, named entity linking, and drawing the knowledge graph. Finally, the quality of the DSTKG was evaluated from 3 aspects: data layer, schema layer, and application layer.

RESULTS

Experts agreed that the DSTKG was good overall (mean score 4.20). Especially for the aspects of "rationality of schema structure," "scalability," and "readability of results," the DSTKG performed well, with scores of 4.72, 4.67, and 4.69, respectively, which were much higher than the average. However, the small amount of data in the DSTKG negatively affected its "practicability" score. Compared with other Chinese tumor knowledge graphs, the DSTKG can represent more granular entities, properties, and semantic relationships. In addition, the DSTKG was flexible, allowing personalized customization to meet the designer's focus on specific interests in the digestive system tumor.

CONCLUSIONS

We constructed a granular semantic DSTKG. It could provide guidance for the construction of a tumor knowledge graph and provide a preliminary step for the intelligent application of knowledge graphs based on CEMRs. Additional data sources and stronger research on assertion classification are needed to gain insight into the DSTKG's potential.

Predicting the frequencies of drug side effects

A central issue in drug risk-benefit assessment is identifying frequencies of side effects in humans. Currently, frequencies are experimentally determined in randomised controlled clinical trials. We present a machine learning framework for computationally predicting frequencies of drug side effects. Our matrix decomposition algorithm learns latent signatures of drugs and side effects that are both reproducible and biologically interpretable. We show the usefulness of our approach on 759 structurally and therapeutically diverse drugs and 994 side effects from all human physiological systems. Our approach can be applied to any drug for which a small number of side effect frequencies have been identified, in order to predict the frequencies of further, yet unidentified, side effects. We show that our model is informative of the biology underlying drug activity: individual components of the drug signatures are related to the distinct anatomical categories of the drugs and to the specific drug routes of administration.

Currently, the frequencies of drug side effects are determined in randomised controlled clinical trials. Here the authors develop an interpretable machine learning approach to predict the frequencies of unknown side effects for drugs with a small number of determined side effect frequencies.

Development of a semi-structured, multifaceted, computer-aided questionnaire for outbreak investigation: e-Outbreak Platform

Aggressive tracing of contacts of confirmed cases is crucial to Taiwan's successful control of the early spread of COVID-19. As the pandemic lingers, an epidemiological investigation that can be conducted efficiently in a timely manner can help decrease the burden on the health personnel and increase the usefulness of such information in decision making. To develop a new tool that can improve the current practice of epidemiological investigation by incorporating new technologies in digital platform and knowledge graphs. To meet the various needs of the epidemiological investigation, we decided to develop an e-Outbreak Platform that provides a semi-structured, multifaceted, computer-aided questionnaire for outbreak investigation. There are three major parts of the platform: (1) a graphic portal that allows users to have an at-glance grasp of the functions provided by the platform and then choose the one they need; (2) disease-specific questionnaires that can accommodate different formats of the information, including text typing, button selection, and pull-down menu; and (3) functions to utilize the stored information, including report generation, statistical analyses, and knowledge graphs displaying contact tracing. When the number of outbreak investigation increases, the knowledge graphs can be extended to encompass other persons appearing in the same location at the same time, i.e., constituting a potential contact cluster. The information extracted can also be used to display the tracing on a map in animation. Overall, this system can provide a basis for further refinement that can be generalized to a variety of outbreak investigations.

Role of Artificial Intelligence in Patient Safety Outcomes: Systematic Literature Review

BACKGROUND

Artificial intelligence (AI) provides opportunities to identify the health risks of patients and thus influence patient safety outcomes.

OBJECTIVE

The purpose of this systematic literature review was to identify and analyze quantitative studies utilizing or integrating AI to address and report clinical-level patient safety outcomes.

METHODS

We restricted our search to the PubMed, PubMed Central, and Web of Science databases to retrieve research articles published in English between January 2009 and August 2019. We focused on quantitative studies that reported positive, negative, or intermediate changes in patient safety outcomes using AI apps, specifically those based on machine-learning algorithms and natural language processing. Quantitative studies reporting only AI performance but not its influence on patient safety outcomes were excluded from further review.

RESULTS

We identified 53 eligible studies, which were summarized concerning their patient safety subcategories, the most frequently used AI, and reported performance metrics. Recognized safety subcategories were clinical alarms (n=9; mainly based on decision tree models), clinical reports (n=21; based on support vector machine models), and drug safety (n=23; mainly based on decision tree models). Analysis of these 53 studies also identified two essential findings: (1) the lack of a standardized benchmark and (2) heterogeneity in AI reporting.

CONCLUSIONS

This systematic review indicates that AI-enabled decision support systems, when implemented correctly, can aid in enhancing patient safety by improving error detection, patient stratification, and drug management. Future work is still needed for robust validation of these systems in prospective and real-world clinical environments to understand how well AI can predict safety outcomes in health care settings.

A Knowledge-Based Machine Learning Approach to Gene Prioritisation in Amyotrophic Lateral Sclerosis

Amyotrophic lateral sclerosis is a neurodegenerative disease of the upper and lower motor neurons resulting in death from neuromuscular respiratory failure, typically within two to five years of first symptoms. Several rare disruptive gene variants have been associated with ALS and are responsible for about 15% of all cases. Although our knowledge of the genetic landscape of this disease is improving, it remains limited. Machine learning models trained on the available protein-protein interaction and phenotype-genotype association data can use our current knowledge of the disease genetics for the prediction of novel candidate genes. Here, we describe a knowledge-based machine learning method for this purpose. We trained our model on protein-protein interaction data from IntAct, gene function annotation from Gene Ontology, and known disease-gene associations from DisGeNet. Using several sets of known ALS genes from public databases and a manual review as input, we generated a list of new candidate genes for each input set. We investigated the relevance of the predicted genes in ALS by using the available summary statistics from the largest ALS genome-wide association study and by performing functional and phenotype enrichment analysis. The predicted sets were enriched for genes associated with other neurodegenerative diseases known to overlap with ALS genetically and phenotypically, as well as for biological processes associated with the disease. Moreover, using ALS genes from ClinVar and our manual review as input, the predicted sets were enriched for ALS-associated genes (ClinVar p = 0.038 and manual review p = 0.060) when used for gene prioritisation in a genome-wide association study.

Pharmacoepidemiology research: delivering evidence about drug safety and effectiveness in mental health

Research that provides an evidence base for the pharmacotherapy of people with mental disorders is needed. The abundance of digital data has facilitated pharmacoepidemiology and, in particular, observational research on the effectiveness of real-world medication. Advantages of pharmacoepidemiological research are the availability of large patient samples, and coverage of under-researched subpopulations in their naturalistic conditions. Such research is also cheaper and quicker to do than randomised controlled trials, meaning that issues regarding generic medication, stopping medication (deprescribing), and long-term outcomes are more likely to be addressed. Pharmacoepidemiological methods can also be extended to pharmacovigilance and to aid the development of new purposes for existing drugs. Drawbacks of observational pharmacoepidemiological studies come from the non-randomised nature of treatment selection, leading to confounding by indication. Potential methods for managing this drawback include active comparison groups, within-individual designs, and propensity scoring. Many of the more rigorous pharmacoepidemiology studies have been strengthened through multiple analytical approaches triangulated to improve confidence in inferred causal relationships. With developments in data resources and analytical techniques, it is encouraging that guidelines are beginning to include evidence from robust observational pharmacoepidemiological studies alongside randomised controlled trials. Collaboration between guideline writers and researchers involved in pharmacoepidemiology could help researchers to answer the questions that are important to policy makers and ensure that results are integrated into the evidence base. Further development of statistical and data science techniques, alongside public engagement and capacity building (data resources and researcher base), will be necessary to take full advantage of future opportunities.

Trends and Features of the Applications of Natural Language Processing Techniques for Clinical Trials Text Analysis

Natural language processing (NLP) is an effective tool for generating structured information from unstructured data, the one that is commonly found in clinical trial texts. Such interdisciplinary research has gradually grown into a flourishing research field with accumulated scientific outputs available. In this study, bibliographical data collected from Web of Science, PubMed, and Scopus databases from 2001 to 2018 had been investigated with the use of three prominent methods, including performance analysis, science mapping, and, particularly, an automatic text analysis approach named structural topic modeling. Topical trend visualization and test analysis were further employed to quantify the effects of the year of publication on topic proportions. Topical diverse distributions across prolific countries/regions and institutions were also visualized and compared. In addition, scientific collaborations between countries/regions, institutions, and authors were also explored using social network analysis. The findings obtained were essential for facilitating the development of the NLP-enhanced clinical trial texts processing, boosting scientific and technological NLP-enhanced clinical trial research, and facilitating inter-country/region and inter-institution collaborations.

Graph-Representation of Patient Data: a Systematic Literature Review

Graph theory is a well-established theory with many methods used in mathematics to study graph structures. In the field of medicine, electronic health records (EHR) are commonly used to store and analyze patient data. Consequently, it seems straight-forward to perform research on modeling EHR data as graphs. This systematic literature review aims to investigate the frontiers of the current research in the field of graphs representing and processing patient data. We want to show, which areas of research in this context need further investigation. The databases MEDLINE, Web of Science, IEEE Xplore and ACM digital library were queried by using the search terms health record, graph and related terms. Based on the "Preferred Reporting Items for Systematic Reviews and Meta-Analysis" (PRISMA) statement guidelines the articles were screened and evaluated using full-text analysis. Eleven out of 383 articles found in systematic literature review were finally included for analysis in this literature review. Most of them use graphs to represent temporal relations, often representing the connection among laboratory data points. Only two papers report that the graph data were further processed by comparing the patient graphs using similarity measurements. Graphs representing individual patients are hardly used in research context, only eleven papers considered such kind of graphs in their investigations. The potential of graph theoretical algorithms, which are already well established, could help increasing this research field, but currently there are too few papers to estimate how this area of research will develop. Altogether, the use of such patient graphs could be a promising technique to develop decision support systems for diagnosis, medication or therapy of patients using similarity measurements or different kinds of analysis.

Computational Advances in Drug Safety: Systematic and Mapping Review of Knowledge Engineering Based Approaches

Drug Safety (DS) is a domain with significant public health and social impact. Knowledge Engineering (KE) is the Computer Science discipline elaborating on methods and tools for developing “knowledge-intensive” systems, depending on a conceptual “knowledge” schema and some kind of “reasoning” process. The present systematic and mapping review aims to investigate KE-based approaches employed for DS and highlight the introduced added value as well as trends and possible gaps in the domain. Journal articles published between 2006 and 2017 were retrieved from PubMed/MEDLINE and Web of Science® (873 in total) and filtered based on a comprehensive set of inclusion/exclusion criteria. The 80 finally selected articles were reviewed on full-text, while the mapping process relied on a set of concrete criteria (concerning specific KE and DS core activities, special DS topics, employed data sources, reference ontologies/terminologies, and computational methods, etc.). The analysis results are publicly available as online interactive analytics graphs. The review clearly depicted increased use of KE approaches for DS. The collected data illustrate the use of KE for various DS aspects, such as Adverse Drug Event (ADE) information collection, detection, and assessment. Moreover, the quantified analysis of using KE for the respective DS core activities highlighted room for intensifying research on KE for ADE monitoring, prevention and reporting. Finally, the assessed use of the various data sources for DS special topics demonstrated extensive use of dominant data sources for DS surveillance, i.e., Spontaneous Reporting Systems, but also increasing interest in the use of emerging data sources, e.g., observational healthcare databases, biochemical/genetic databases, and social media. Various exemplar applications were identified with promising results, e.g., improvement in Adverse Drug Reaction (ADR) prediction, detection of drug interactions, and novel ADE profiles related with specific mechanisms of action, etc. Nevertheless, since the reviewed studies mostly concerned proof-of-concept implementations, more intense research is required to increase the maturity level that is necessary for KE approaches to reach routine DS practice. In conclusion, we argue that efficiently addressing DS data analytics and management challenges requires the introduction of high-throughput KE-based methods for effective knowledge discovery and management, resulting ultimately, in the establishment of a continuous learning DS system.