A quantitative weight-of-evidence method for confidence assessment of adverse outcome pathway networks: A case study on chemical-induced liver steatosis

The field of chemical toxicity testing is undergoing a transition to overcome the limitations of in vivo experiments. This evolution involves implementing innovative non-animal approaches to improve predictability and provide a more precise understanding of toxicity mechanisms. Adverse outcome pathway (AOP) networks are pivotal in organizing existing mechanistic knowledge related to toxicological processes. However, these AOP networks are dynamic and require regular updates to incorporate the latest data. Regulatory challenges also persist due to concerns about the reliability of the information they offer. This study introduces a generic Weight-of-Evidence (WoE) scoring method, aligned with the tailored Bradford-Hill criteria, to quantitatively assess the confidence levels in key event relationships (KERs) within AOP networks. We use the previously published AOP network on chemical-induced liver steatosis, a prevalent form of human liver injury, as a case study. Initially, the existing AOP network is optimized with the latest scientific information extracted from PubMed using the free SysRev platform for artificial intelligence (AI)-based abstract inclusion and standardized data collection. The resulting optimized AOP network, constructed using Cytoscape, visually represents confidence levels through node size (key event, KE) and edge thickness (KERs). Additionally, a Shiny application is developed to facilitate user interaction with the dataset, promoting future updates. Our analysis of 173 research papers yielded 100 unique KEs and 221 KERs among which 72 KEs and 170 KERs, respectively, have not been previously documented in the prior AOP network or AOP-wiki. Notably, modifications in de novo lipogenesis, fatty acid uptake and mitochondrial beta-oxidation, leading to lipid accumulation and liver steatosis, garnered the highest KER confidence scores. In conclusion, our study delivers a generic methodology for developing and assessing AOP networks. The quantitative WoE scoring method facilitates in determining the level of support for KERs within the optimized AOP network, offering valuable insights into its utility in both scientific research and regulatory contexts. KERs supported by robust evidence represent promising candidates for inclusion in an in vitro test battery for reliably predicting chemical-induced liver steatosis within regulatory frameworks.

Unraveling the mechanisms underlying drug-induced cholestatic liver injury: identifying key genes using machine learning techniques on human in vitro data sets

Drug-induced intrahepatic cholestasis (DIC) is a main type of hepatic toxicity that is challenging to predict in early drug development stages. Preclinical animal studies often fail to detect DIC in humans. In vitro toxicogenomics assays using human liver cells have become a practical approach to predict human-relevant DIC. The present study was set up to identify transcriptomic signatures of DIC by applying machine learning algorithms to the Open TG-GATEs database. A total of nine DIC compounds and nine non-DIC compounds were selected, and supervised classification algorithms were applied to develop prediction models using differentially expressed features. Feature selection techniques identified 13 genes that achieved optimal prediction performance using logistic regression combined with a sequential backward selection method. The internal validation of the best-performing model showed accuracy of 0.958, sensitivity of 0.941, specificity of 0.978, and F1-score of 0.956. Applying the model to an external validation set resulted in an average prediction accuracy of 0.71. The identified genes were mechanistically linked to the adverse outcome pathway network of DIC, providing insights into cellular and molecular processes during response to chemical toxicity. Our findings provide valuable insights into toxicological responses and enhance the predictive accuracy of DIC prediction, thereby advancing the application of transcriptome profiling in designing new approach methodologies for hazard identification.

Optimization of an adverse outcome pathway network on chemical-induced cholestasis using an artificial intelligence-assisted data collection and confidence level quantification approach

BACKGROUND

Adverse outcome pathway (AOP) networks are versatile tools in toxicology and risk assessment that capture and visualize mechanisms driving toxicity originating from various data sources. They share a common structure consisting of a set of molecular initiating events and key events, connected by key event relationships, leading to the actual adverse outcome. AOP networks are to be considered living documents that should be frequently updated by feeding in new data. Such iterative optimization exercises are typically done manually, which not only is a time-consuming effort, but also bears the risk of overlooking critical data. The present study introduces a novel approach for AOP network optimization of a previously published AOP network on chemical-induced cholestasis using artificial intelligence to facilitate automated data collection followed by subsequent quantitative confidence assessment of molecular initiating events, key events, and key event relationships.

METHODS

Artificial intelligence-assisted data collection was performed by means of the free web platform Sysrev. Confidence levels of the tailored Bradford-Hill criteria were quantified for the purpose of weight-of-evidence assessment of the optimized AOP network. Scores were calculated for biological plausibility, empirical evidence, and essentiality, and were integrated into a total key event relationship confidence value. The optimized AOP network was visualized using Cytoscape with the node size representing the incidence of the key event and the edge size indicating the total confidence in the key event relationship.

RESULTS

This resulted in the identification of 38 and 135 unique key events and key event relationships, respectively. Transporter changes was the key event with the highest incidence, and formed the most confident key event relationship with the adverse outcome, cholestasis. Other important key events present in the AOP network include: nuclear receptor changes, intracellular bile acid accumulation, bile acid synthesis changes, oxidative stress, inflammation and apoptosis.

CONCLUSIONS

This process led to the creation of an extensively informative AOP network focused on chemical-induced cholestasis. This optimized AOP network may serve as a mechanistic compass for the development of a battery of in vitro assays to reliably predict chemical-induced cholestatic injury.