1
|
Achar J, Firman JW, Cronin MTD, Öberg G. A framework for categorizing sources of uncertainty in in silico toxicology methods: Considerations for chemical toxicity predictions. Regul Toxicol Pharmacol 2024; 154:105737. [PMID: 39547503 DOI: 10.1016/j.yrtph.2024.105737] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2024] [Revised: 10/26/2024] [Accepted: 11/11/2024] [Indexed: 11/17/2024]
Abstract
Improving regulatory confidence and acceptance of in silico toxicology methods for chemical risk assessment requires assessment of associated uncertainties. Therefore, there is a need to identify and systematically categorize sources of uncertainty relevant to the methods and their predictions. In the present study, we analyzed studies that have characterized sources of uncertainty across commonly applied in silico toxicology methods. Our study reveals variations in the kind and number of uncertainty sources these studies cover. Additionally, the studies use different terminologies to describe similar sources of uncertainty; consequently, a majority of the sources considerably overlap. Building on an existing framework, we developed a new uncertainty categorization framework that systematically consolidates and categorizes the different uncertainty sources described in the analyzed studies. We then illustrate the importance of the developed framework through a case study involving QSAR prediction of the toxicity of five compounds, as well as compare it with the QSAR Assessment Framework (QAF). The framework can provide a structured (and potentially more transparent) understanding of where the uncertainties reside within in silico toxicology models and model predictions, thus promoting critical reflection on appropriate strategies to address the uncertainties.
Collapse
Affiliation(s)
- Jerry Achar
- Institute for Resources Environment, and Sustainability, The University of British Columbia, 2202 Main Mall, BC, V6T 1Z4, Vancouver, Canada.
| | - James W Firman
- School of Pharmacy and Biomolecular Sciences, Liverpool John Moores University, Byrom Street, L3 3AF, Liverpool, UK
| | - Mark T D Cronin
- School of Pharmacy and Biomolecular Sciences, Liverpool John Moores University, Byrom Street, L3 3AF, Liverpool, UK
| | - Gunilla Öberg
- Institute for Resources Environment, and Sustainability, The University of British Columbia, 2202 Main Mall, BC, V6T 1Z4, Vancouver, Canada
| |
Collapse
|
2
|
Singh AV, Bhardwaj P, Laux P, Pradeep P, Busse M, Luch A, Hirose A, Osgood CJ, Stacey MW. AI and ML-based risk assessment of chemicals: predicting carcinogenic risk from chemical-induced genomic instability. FRONTIERS IN TOXICOLOGY 2024; 6:1461587. [PMID: 39659701 PMCID: PMC11628524 DOI: 10.3389/ftox.2024.1461587] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2024] [Accepted: 11/11/2024] [Indexed: 12/12/2024] Open
Abstract
Chemical risk assessment plays a pivotal role in safeguarding public health and environmental safety by evaluating the potential hazards and risks associated with chemical exposures. In recent years, the convergence of artificial intelligence (AI), machine learning (ML), and omics technologies has revolutionized the field of chemical risk assessment, offering new insights into toxicity mechanisms, predictive modeling, and risk management strategies. This perspective review explores the synergistic potential of AI/ML and omics in deciphering clastogen-induced genomic instability for carcinogenic risk prediction. We provide an overview of key findings, challenges, and opportunities in integrating AI/ML and omics technologies for chemical risk assessment, highlighting successful applications and case studies across diverse sectors. From predicting genotoxicity and mutagenicity to elucidating molecular pathways underlying carcinogenesis, integrative approaches offer a comprehensive framework for understanding chemical exposures and mitigating associated health risks. Future perspectives for advancing chemical risk assessment and cancer prevention through data integration, advanced machine learning techniques, translational research, and policy implementation are discussed. By implementing the predictive capabilities of AI/ML and omics technologies, researchers and policymakers can enhance public health protection, inform regulatory decisions, and promote sustainable development for a healthier future.
Collapse
Affiliation(s)
- Ajay Vikram Singh
- Department of Chemical and Product Safety, German Federal Institute for Risk Assessment (BfR), Berlin, Germany
| | - Preeti Bhardwaj
- Department of Chemical and Product Safety, German Federal Institute for Risk Assessment (BfR), Berlin, Germany
| | - Peter Laux
- Department of Chemical and Product Safety, German Federal Institute for Risk Assessment (BfR), Berlin, Germany
| | - Prachi Pradeep
- Department of Chemical and Product Safety, German Federal Institute for Risk Assessment (BfR), Berlin, Germany
| | - Madleen Busse
- Department of Biological Safety, German Federal Institute for Risk Assessment (BfR), Berlin, Germany
| | - Andreas Luch
- Department of Chemical and Product Safety, German Federal Institute for Risk Assessment (BfR), Berlin, Germany
| | - Akihiko Hirose
- Chemicals Evaluation and Research Institute, Tokyo, Japan
| | - Christopher J. Osgood
- Department of Biological Sciences, Old Dominion University, Norfolk, VA, United States
| | - Michael W. Stacey
- Frank Reidy Research Center for Bioelectrics, Old Dominion University, Norfolk, VA, United States
| |
Collapse
|
3
|
Banerjee A, Kar S, Roy K, Patlewicz G, Charest N, Benfenati E, Cronin MTD. Molecular similarity in chemical informatics and predictive toxicity modeling: from quantitative read-across (q-RA) to quantitative read-across structure-activity relationship (q-RASAR) with the application of machine learning. Crit Rev Toxicol 2024; 54:659-684. [PMID: 39225123 DOI: 10.1080/10408444.2024.2386260] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2024] [Revised: 07/25/2024] [Accepted: 07/25/2024] [Indexed: 09/04/2024]
Abstract
This article aims to provide a comprehensive critical, yet readable, review of general interest to the chemistry community on molecular similarity as applied to chemical informatics and predictive modeling with a special focus on read-across (RA) and read-across structure-activity relationships (RASAR). Molecular similarity-based computational tools, such as quantitative structure-activity relationships (QSARs) and RA, are routinely used to fill the data gaps for a wide range of properties including toxicity endpoints for regulatory purposes. This review will explore the background of RA starting from how structural information has been used through to how other similarity contexts such as physicochemical, absorption, distribution, metabolism, and elimination (ADME) properties, and biological aspects are being characterized. More recent developments of RA's integration with QSAR have resulted in the emergence of novel models such as ToxRead, generalized read-across (GenRA), and quantitative RASAR (q-RASAR). Conventional QSAR techniques have been excluded from this review except where necessary for context.
Collapse
Affiliation(s)
- Arkaprava Banerjee
- Department of Pharmaceutical Technology, Drug Theoretics and Cheminformatics (DTC) Laboratory, Jadavpur University, Kolkata, India
| | - Supratik Kar
- Department of Chemistry and Physics, Chemometrics & Molecular Modeling Laboratory, Kean University, Union, NJ, USA
| | - Kunal Roy
- Department of Pharmaceutical Technology, Drug Theoretics and Cheminformatics (DTC) Laboratory, Jadavpur University, Kolkata, India
| | - Grace Patlewicz
- Center for Computational Toxicology and Exposure, US Environmental Protection Agency, Research Triangle Park, NC, USA
| | - Nathaniel Charest
- Center for Computational Toxicology and Exposure, US Environmental Protection Agency, Research Triangle Park, NC, USA
| | - Emilio Benfenati
- Department of Environmental Health Sciences, Istituto di Ricerche Farmacologiche Mario Negri IRCCS, Milan, Italy
| | - Mark T D Cronin
- School of Pharmacy and Biomolecular Sciences, Liverpool John Moores University, Liverpool, UK
| |
Collapse
|
4
|
Serafini MM, Sepehri S, Midali M, Stinckens M, Biesiekierska M, Wolniakowska A, Gatzios A, Rundén-Pran E, Reszka E, Marinovich M, Vanhaecke T, Roszak J, Viviani B, SenGupta T. Recent advances and current challenges of new approach methodologies in developmental and adult neurotoxicity testing. Arch Toxicol 2024; 98:1271-1295. [PMID: 38480536 PMCID: PMC10965660 DOI: 10.1007/s00204-024-03703-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2023] [Accepted: 02/06/2024] [Indexed: 03/27/2024]
Abstract
Adult neurotoxicity (ANT) and developmental neurotoxicity (DNT) assessments aim to understand the adverse effects and underlying mechanisms of toxicants on the human nervous system. In recent years, there has been an increasing focus on the so-called new approach methodologies (NAMs). The Organization for Economic Co-operation and Development (OECD), together with European and American regulatory agencies, promote the use of validated alternative test systems, but to date, guidelines for regulatory DNT and ANT assessment rely primarily on classical animal testing. Alternative methods include both non-animal approaches and test systems on non-vertebrates (e.g., nematodes) or non-mammals (e.g., fish). Therefore, this review summarizes the recent advances of NAMs focusing on ANT and DNT and highlights the potential and current critical issues for the full implementation of these methods in the future. The status of the DNT in vitro battery (DNT IVB) is also reviewed as a first step of NAMs for the assessment of neurotoxicity in the regulatory context. Critical issues such as (i) the need for test batteries and method integration (from in silico and in vitro to in vivo alternatives, e.g., zebrafish, C. elegans) requiring interdisciplinarity to manage complexity, (ii) interlaboratory transferability, and (iii) the urgent need for method validation are discussed.
Collapse
Affiliation(s)
- Melania Maria Serafini
- Department of Pharmacological and Biomolecular Sciences, "Rodolfo Paoletti", Università degli Studi di Milano, Milan, Italy.
| | - Sara Sepehri
- Department of In Vitro Toxicology and Dermato-Cosmetology (IVTD), Vrije Universiteit Brussels, Brussels, Belgium
| | - Miriam Midali
- Department of Pharmacological and Biomolecular Sciences, "Rodolfo Paoletti", Università degli Studi di Milano, Milan, Italy
| | - Marth Stinckens
- Department of In Vitro Toxicology and Dermato-Cosmetology (IVTD), Vrije Universiteit Brussels, Brussels, Belgium
| | - Marta Biesiekierska
- Department of Translational Research, Nofer Institute of Occupational Medicine, Lodz, Poland
| | - Anna Wolniakowska
- Department of Translational Research, Nofer Institute of Occupational Medicine, Lodz, Poland
| | - Alexandra Gatzios
- Department of In Vitro Toxicology and Dermato-Cosmetology (IVTD), Vrije Universiteit Brussels, Brussels, Belgium
| | - Elise Rundén-Pran
- The Climate and Environmental Research Institute NILU, Kjeller, Norway
| | - Edyta Reszka
- Department of Translational Research, Nofer Institute of Occupational Medicine, Lodz, Poland
| | - Marina Marinovich
- Department of Pharmacological and Biomolecular Sciences, "Rodolfo Paoletti", Università degli Studi di Milano, Milan, Italy
- Center of Research on New Approach Methodologies (NAMs) in chemical risk assessment (SAFE-MI), Università degli Studi di Milano, Milan, Italy
| | - Tamara Vanhaecke
- Department of In Vitro Toxicology and Dermato-Cosmetology (IVTD), Vrije Universiteit Brussels, Brussels, Belgium
| | - Joanna Roszak
- Department of Translational Research, Nofer Institute of Occupational Medicine, Lodz, Poland
| | - Barbara Viviani
- Department of Pharmacological and Biomolecular Sciences, "Rodolfo Paoletti", Università degli Studi di Milano, Milan, Italy
- Center of Research on New Approach Methodologies (NAMs) in chemical risk assessment (SAFE-MI), Università degli Studi di Milano, Milan, Italy
| | - Tanima SenGupta
- The Climate and Environmental Research Institute NILU, Kjeller, Norway
| |
Collapse
|
5
|
Balaji S. Metabophore-mediated retro-metabolic ('MeMeReMe') approach in drug design. Drug Discov Today 2023; 28:103736. [PMID: 37586644 DOI: 10.1016/j.drudis.2023.103736] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2023] [Revised: 06/13/2023] [Accepted: 08/09/2023] [Indexed: 08/18/2023]
Abstract
Preclinical toxicity assessments of new drugs require the use of in silico prediction techniques as ethics, cost, time, and complexity limit in vitro and in vivo methods. This review discusses the fundamental concepts of biophores especially toxicophores and their detection methodologies, tools and techniques, as well as ongoing challenges, and methods for overcoming them. This will guide the design community in manipulating lead compounds via a pre-determined pathway based on the MeMeReMe approach. The ideas discussed will be useful both for predicting toxicity and for de-risking leads through optimization.
Collapse
Affiliation(s)
- Seetharaman Balaji
- Department of Biotechnology, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, Karnataka 57614, India.
| |
Collapse
|
6
|
Chakravarti S. Augmenting Expert Knowledge-Based Toxicity Alerts by Statistically Mined Molecular Fragments. Chem Res Toxicol 2023. [PMID: 37207298 DOI: 10.1021/acs.chemrestox.2c00368] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/21/2023]
Abstract
Structural alerts are molecular substructures assumed to be associated with molecular initiating events in various toxic effects and an integral part of in silico toxicology. However, alerts derived using the knowledge of human experts often suffer from a lack of predictivity, specificity, and satisfactory coverage. In this work, we present a method to build hybrid QSAR models by combining expert knowledge-based alerts and statistically mined molecular fragments. Our objective was to find out if the combination is better than the individual systems. Lasso regularization-based variable selection was applied on combined sets of knowledge-based alerts and molecular fragments, but the variable elimination was only allowed to happen on the molecular fragments. We tested the concept on three toxicity end points, i.e., skin sensitization, acute Daphnia toxicity, and Ames mutagenicity, which covered both classification and regression problems. Results showed the predictive performance of such hybrid models is, indeed, better than the models based solely on expert alerts or statistically mined fragments alone. The method also enables the discovery of activating and mitigating/deactivating features for toxicity alerts and the identification of new alerts, thereby reducing false positive and false negative outcomes commonly associated with generic alerts and alerts with poor coverage, respectively.
Collapse
Affiliation(s)
- Suman Chakravarti
- MultiCASE Inc., 23811 Chagrin Blvd, Suite 305, Beachwood, Ohio 44122, United States
| |
Collapse
|
7
|
Cronin MTD, Belfield SJ, Briggs KA, Enoch SJ, Firman JW, Frericks M, Garrard C, Maccallum PH, Madden JC, Pastor M, Sanz F, Soininen I, Sousoni D. Making in silico predictive models for toxicology FAIR. Regul Toxicol Pharmacol 2023; 140:105385. [PMID: 37037390 DOI: 10.1016/j.yrtph.2023.105385] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2023] [Revised: 02/18/2023] [Accepted: 04/07/2023] [Indexed: 04/12/2023]
Abstract
In silico predictive models for toxicology include quantitative structure-activity relationship (QSAR) and physiologically based kinetic (PBK) approaches to predict physico-chemical and ADME properties, toxicological effects and internal exposure. Such models are used to fill data gaps as part of chemical risk assessment. There is a growing need to ensure in silico predictive models for toxicology are available for use and reproducible. This paper describes how the FAIR (Findable, Accessible, Interoperable, Reusable) principles, developed for data sharing, have been applied to in silico predictive models. In particular, this investigation has focussed on how the FAIR principles could be applied to improved regulatory acceptance of predictions from such models. Eighteen principles have been developed that cover all aspects of FAIR. It is intended that FAIRification of in silico predictive models for toxicology will increase their use and acceptance.
Collapse
Affiliation(s)
- Mark T D Cronin
- School of Pharmacy and Biomolecular Sciences, Liverpool John Moores University, Byrom Street, Liverpool, L3 3AF, UK.
| | - Samuel J Belfield
- School of Pharmacy and Biomolecular Sciences, Liverpool John Moores University, Byrom Street, Liverpool, L3 3AF, UK
| | - Katharine A Briggs
- Lhasa Limited, Granary Wharf House, 2 Canal Wharf, Holbeck, Leeds, LS11 5PS, UK
| | - Steven J Enoch
- School of Pharmacy and Biomolecular Sciences, Liverpool John Moores University, Byrom Street, Liverpool, L3 3AF, UK
| | - James W Firman
- School of Pharmacy and Biomolecular Sciences, Liverpool John Moores University, Byrom Street, Liverpool, L3 3AF, UK
| | - Markus Frericks
- BASF SE, APD/ET - Li 444, Speyerer St 2, 67117, Limburgerhof, Germany
| | - Clare Garrard
- ELIXIR, Wellcome Genome Campus, Hinxton, Cambridgeshire, CB10 1SD, UK
| | - Peter H Maccallum
- ELIXIR, Wellcome Genome Campus, Hinxton, Cambridgeshire, CB10 1SD, UK
| | - Judith C Madden
- School of Pharmacy and Biomolecular Sciences, Liverpool John Moores University, Byrom Street, Liverpool, L3 3AF, UK
| | - Manuel Pastor
- Research Programme on Biomedical Informatics (GRIB), Hospital del Mar Medical Research Institute (IMIM), Dept. of Medicine and Life Sciences (MELIS), Universitat Pompeu Fabra, Carrer Dr. Aiguader 88, 08003, Barcelona, Spain
| | - Ferran Sanz
- Research Programme on Biomedical Informatics (GRIB), Hospital del Mar Medical Research Institute (IMIM), Dept. of Medicine and Life Sciences (MELIS), Universitat Pompeu Fabra, Carrer Dr. Aiguader 88, 08003, Barcelona, Spain
| | - Inari Soininen
- Synapse Research Management Partners SL, Calle Velazquez 94, planta 1, 28006, Madrid, Spain
| | - Despoina Sousoni
- ELIXIR, Wellcome Genome Campus, Hinxton, Cambridgeshire, CB10 1SD, UK
| |
Collapse
|
8
|
Firman JW, Ebbrell DJ, Bauer FJ, Sapounidou M, Hodges G, Campos B, Roberts J, Gutsell S, Thomas PC, Bonnell M, Cronin MTD. Construction of an In Silico Structural Profiling Tool Facilitating Mechanistically Grounded Classification of Aquatic Toxicants. ENVIRONMENTAL SCIENCE & TECHNOLOGY 2022; 56:17805-17814. [PMID: 36445296 PMCID: PMC9775196 DOI: 10.1021/acs.est.2c03736] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/21/2022] [Revised: 11/14/2022] [Accepted: 11/16/2022] [Indexed: 06/16/2023]
Abstract
The performance of chemical safety assessment within the domain of environmental toxicology is often impeded by a shortfall of appropriate experimental data describing potential hazards across the many compounds in regular industrial use. In silico schemes for assigning aquatic-relevant modes or mechanisms of toxic action to substances, based solely on consideration of chemical structure, have seen widespread employment─including those of Verhaar, Russom, and later Bauer (MechoA). Recently, development of a further system was reported by Sapounidou, which, in common with MechoA, seeks to ground its classifications in understanding and appreciation of molecular initiating events. Until now, this Sapounidou scheme has not seen implementation as a tool for practical screening use. Accordingly, the primary purpose of this study was to create such a resource─in the form of a computational workflow. This exercise was facilitated through the formulation of 183 structural alerts/rules describing molecular features associated with narcosis, chemical reactivity, and specific mechanisms of action. Output was subsequently compared relative to that of the three aforementioned alternative systems to identify strengths and shortcomings as regards coverage of chemical space.
Collapse
Affiliation(s)
- James W. Firman
- School
of Pharmacy and Biomolecular Sciences, Liverpool
John Moores University, Byrom Street, Liverpool L3 3AF, U.K.
| | - David J. Ebbrell
- School
of Pharmacy and Biomolecular Sciences, Liverpool
John Moores University, Byrom Street, Liverpool L3 3AF, U.K.
| | - Franklin J. Bauer
- KREATiS
SAS, 23 rue du Creuzat, ZAC de St-Hubert 38080, L′Isle d′Abeau, France
| | - Maria Sapounidou
- School
of Pharmacy and Biomolecular Sciences, Liverpool
John Moores University, Byrom Street, Liverpool L3 3AF, U.K.
| | - Geoff Hodges
- Safety
and Environmental Assurance Centre, Unilever, Colworth Science Park, Sharnbrook, Bedford MK44 1LQ, Bedfordshire, U.K.
| | - Bruno Campos
- Safety
and Environmental Assurance Centre, Unilever, Colworth Science Park, Sharnbrook, Bedford MK44 1LQ, Bedfordshire, U.K.
| | - Jayne Roberts
- Safety
and Environmental Assurance Centre, Unilever, Colworth Science Park, Sharnbrook, Bedford MK44 1LQ, Bedfordshire, U.K.
| | - Steve Gutsell
- Safety
and Environmental Assurance Centre, Unilever, Colworth Science Park, Sharnbrook, Bedford MK44 1LQ, Bedfordshire, U.K.
| | - Paul C. Thomas
- KREATiS
SAS, 23 rue du Creuzat, ZAC de St-Hubert 38080, L′Isle d′Abeau, France
| | - Mark Bonnell
- Science
and Risk Assessment Directorate, Environment
& Climate Change Canada, 351 St. Joseph Blvd, Gatineau, Quebec K1A 0H3, Canada
| | - Mark T. D. Cronin
- School
of Pharmacy and Biomolecular Sciences, Liverpool
John Moores University, Byrom Street, Liverpool L3 3AF, U.K.
| |
Collapse
|
9
|
Burgoon LD, Kluxen FM, Frericks M. Understanding and overcoming the technical challenges in using in silico predictions in regulatory decisions of complex toxicological endpoints - A pesticide perspective for regulatory toxicologists with a focus on machine learning models. Regul Toxicol Pharmacol 2022; 137:105311. [PMID: 36494002 DOI: 10.1016/j.yrtph.2022.105311] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2022] [Revised: 11/28/2022] [Accepted: 11/30/2022] [Indexed: 12/12/2022]
Abstract
There are many challenges that must be overcome before in silico toxicity predictions are ripe for regulatory decision-making. Today, mandates in the United States of America and the European Union to avoid animal usage in toxicity testing is driving the need to consider alternative technologies, including Quantitative Structure Activity Relationship (QSAR) models, and read across approaches. However, when adopting new methods, it is critical that both new approach developers as well as regulatory users understand the strengths and challenges with these new approaches. In this paper, we identify potential sources of bias in machine learning methods specific to toxicity predictions, that may impact the overall performance of in silico models. We also discuss ways to mitigate these biases. Based on our experiences, the most prevalent sources of bias include class imbalance (differing numbers of "toxic" vs "nontoxic" compounds), limited numbers of chemicals within a particular chemistry, and biases within the studies that make up the database used for model building, as well as model evaluation biases. While this is already complex for repeated dose toxicity, in reproduction and developmental toxicity a further level of complexity is introduced by the need to evaluate effects on individual animal and litter basis (e.g., a hierarchal structure). We also discuss key considerations developers and regulators need to make when they use machine learning models to predict chemical safety. Our objective is for our paper to serve as a desk reference for model developers and regulators as they evaluate machine learning models and as they make decisions using these models.
Collapse
|