Development of a network of carcinogenicity adverse outcome pathways and its employment as an evidence framework for safety assessment

The traditional paradigm for safety assessment of chemicals for their carcinogenic potential to humans relies heavily on a battery of well-established genotoxicity tests, usually followed up by long-term, high-dose rodent studies. There are a variety of problems with this approach, not least that the rodent may not always be the best model to predict toxicity in humans. Consequently, new approach methodologies (NAMs) are being developed to replace or enhance predictions coming from the existing assays. However, a combination of the data arising from NAMs is likely to be required to improve upon the current paradigm, and consequently a framework is needed to combine evidence in a meaningful way. Adverse outcome pathways (AOPs) represent an ideal construct on which to organize this evidence. In this work, a data structure outlined previously was used to capture AOPs and evidence relating to carcinogenicity. Knowledge held within the predictive system Derek Nexus was extracted, built upon, and arranged into a coherent network containing 37 AOPs. 60 assays and 351 in silico alerts were then associated with KEs in this network, and it was brought to life by associating data and contextualizing evidence and predictions for over 13,400 compounds. Initial investigations into using the network to view knowledge and reason between evidence in different ways were made. Organizing knowledge and evidence in this way provides a flexible framework on which to carry out more consistent and meaningful carcinogenicity safety assessments in many different contexts.

Beyond adverse outcome pathways: making toxicity predictions from event networks, SAR models, data and knowledge

Adverse outcome pathways have shown themselves to be useful ways of understanding and expressing knowledge about sequences of events that lead to adverse outcomes (AOs) such as toxicity. In this paper we use the building blocks of adverse outcome pathways-namely key events (KEs) and key event relationships-to construct networks which can be used to make predictions of the likelihood of AOs. The networks of KEs are augmented by data from and knowledge about assays as well as by structure activity relationship predictions linking chemical classes to the observation of KEs. These inputs are combined within a reasoning framework to produce an information-rich display of the relevant knowledge and data and predictions of AOs both in the abstract case and for individual chemicals. Illustrative examples are given for skin sensitization, reprotoxicity and non-genotoxic carcinogenicity.

Prediction of the effect of formulation on the toxicity of chemicals

Two approaches for the prediction of which of two vehicles will result in lower toxicity for anticancer agents are presented. Machine-learning models are developed using decision tree, random forest and partial least squares methodologies and statistical evidence is presented to demonstrate that they represent valid models. Separately, a clustering method is presented that allows the ordering of vehicles by the toxicity they show for chemically-related compounds.

Evaluation of a statistics-based Ames mutagenicity QSAR model and interpretation of the results obtained

The relative wealth of bacterial mutagenicity data available in the public literature means that in silico quantitative/qualitative structure activity relationship (QSAR) systems can readily be built for this endpoint. A good means of evaluating the performance of such systems is to use private unpublished data sets, which generally represent a more distinct chemical space than publicly available test sets and, as a result, provide a greater challenge to the model. However, raw performance metrics should not be the only factor considered when judging this type of software since expert interpretation of the results obtained may allow for further improvements in predictivity. Enough information should be provided by a QSAR to allow the user to make general, scientifically-based arguments in order to assess and overrule predictions when necessary. With all this in mind, we sought to validate the performance of the statistics-based in vitro bacterial mutagenicity prediction system Sarah Nexus (version 1.1) against private test data sets supplied by nine different pharmaceutical companies. The results of these evaluations were then analysed in order to identify findings presented by the model which would be useful for the user to take into consideration when interpreting the results and making their final decision about the mutagenic potential of a given compound.

New structural alerts for Ames mutagenicity discovered using emerging pattern mining techniques

The discovered patterns are used to develop new structural alerts for mutagenicity in the Derek Nexus expert system.

Self organising hypothesis networks: a new approach for representing and structuring SAR knowledge

Background

Combining different sources of knowledge to build improved structure activity relationship models is not easy owing to the variety of knowledge formats and the absence of a common framework to interoperate between learning techniques. Most of the current approaches address this problem by using consensus models that operate at the prediction level. We explore the possibility to directly combine these sources at the knowledge level, with the aim to harvest potentially increased synergy at an earlier stage. Our goal is to design a general methodology to facilitate knowledge discovery and produce accurate and interpretable models.

Results

To combine models at the knowledge level, we propose to decouple the learning phase from the knowledge application phase using a pivot representation (lingua franca) based on the concept of hypothesis. A hypothesis is a simple and interpretable knowledge unit. Regardless of its origin, knowledge is broken down into a collection of hypotheses. These hypotheses are subsequently organised into hierarchical network. This unification permits to combine different sources of knowledge into a common formalised framework. The approach allows us to create a synergistic system between different forms of knowledge and new algorithms can be applied to leverage this unified model. This first article focuses on the general principle of the Self Organising Hypothesis Network (SOHN) approach in the context of binary classification problems along with an illustrative application to the prediction of mutagenicity.

Conclusion

It is possible to represent knowledge in the unified form of a hypothesis network allowing interpretable predictions with performances comparable to mainstream machine learning techniques. This new approach offers the potential to combine knowledge from different sources into a common framework in which high level reasoning and meta-learning can be applied; these latter perspectives will be explored in future work.

Feature combination networks for the interpretation of statistical machine learning models: application to Ames mutagenicity

Background

A new algorithm has been developed to enable the interpretation of black box models. The developed algorithm is agnostic to learning algorithm and open to all structural based descriptors such as fragments, keys and hashed fingerprints. The algorithm has provided meaningful interpretation of Ames mutagenicity predictions from both random forest and support vector machine models built on a variety of structural fingerprints.

A fragmentation algorithm is utilised to investigate the model’s behaviour on specific substructures present in the query. An output is formulated summarising causes of activation and deactivation. The algorithm is able to identify multiple causes of activation or deactivation in addition to identifying localised deactivations where the prediction for the query is active overall. No loss in performance is seen as there is no change in the prediction; the interpretation is produced directly on the model’s behaviour for the specific query.

Results

Models have been built using multiple learning algorithms including support vector machine and random forest. The models were built on public Ames mutagenicity data and a variety of fingerprint descriptors were used. These models produced a good performance in both internal and external validation with accuracies around 82%. The models were used to evaluate the interpretation algorithm. Interpretation was revealed that links closely with understood mechanisms for Ames mutagenicity.

Conclusion

This methodology allows for a greater utilisation of the predictions made by black box models and can expedite further study based on the output for a (quantitative) structure activity model. Additionally the algorithm could be utilised for chemical dataset investigation and knowledge extraction/human SAR development.

Towards the creation of an international toxicology information centre

A pilot toxicology database system has been created which is accessible on-line via the world-wide web or in-house via an intranet. It is intended to be suitable as a source of toxicological information and to support structure-activity relationship studies, and it can be searched on chemical structural and substructural as well as toxicological and physico-chemical data. Successful completion of the pilot has led to an ongoing project to develop and expand the system.

Using absolute and relative reasoning in the prediction of the potential metabolism of xenobiotics

To be useful, a system which predicts the metabolic fate of a chemical should predict the more likely metabolites rather than every possibility. Reasoning can be used to prioritize biotransformations, but a real biochemical domain is complex and cannot be fully defined in terms of the likelihood of events. This paper describes the combined use of two models for reasoning under uncertainty in a working system, METEOR-one model deals with absolute reasoning and the second with relative reasoning.

Using Argumentation for Absolute Reasoning about the Potential Toxicity of Chemicals

The application of a new argumentation model is illustrated by reference to DEREK for Windows, a knowledge-based expert system for the prediction of the toxicity of chemicals. Examples demonstrate various aspects of the model such as the undercutting of arguments, the resolution of multiple arguments about the same proposition, and the propagation of arguments along a chain of reasoning.

A Comprehensive Approach to Argumentation

A reasoning model, based on the logic of argumentation, is described. The model represents argumentation as a directed graph in which nodes and arcs can be colored using an ordinal set of weightings and in which the attributes of both nodes and arcs can be modified. It is thus able to deal with the undercutting or augmenting of arguments. Weightings can be propagated through the graph to generate unique weightings for any node or arc. The model is able to deal with contradiction. It can incorporate numerical methods and is able to handle qualitative and quantitative reasoning.