1
|
Carfagna MA, Ahmed CS, Butler S, Fukushima T, Houser W, Jensen N, Paisley B, Leuenroth-Quinn S, Snyder K, Vispute S, Wang W, Ali MY. Cross study analyses of SEND data: toxicity profile classification. Toxicol Sci 2024; 200:277-286. [PMID: 38851876 DOI: 10.1093/toxsci/kfae072] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/10/2024] Open
Abstract
A SEND toxicology data transformation, harmonization, and analysis platform were created to improve the identification of unique findings related to the intended target, species, and duration of dosing using data from multiple studies. The lack of a standardized digital format for data analysis had impeded large-scale analysis of in vivo toxicology studies. The CDISC SEND standard enables the analysis of data from multiple studies performed by different laboratories. This work describes methods to analyze data and automate cross-study analysis of toxicology studies. Cross-study analysis can be used to understand a single compound's toxicity profile across all studies performed and/or to evaluate on-target versus off-target toxicity for multiple compounds intended for the same pharmacological target. This work involved development of data harmonization/transformation strategies to enable cross-study analysis of both numerical and categorical SEND data. Four de-identified SEND datasets from the BioCelerate database were used for the analyses. Toxicity profiles for key organ systems were developed for liver, kidney, male reproductive tract, endocrine system, and hematopoietic system using SEND domains. A cross-study analysis dashboard with a built-in user-defined scoring system was created for custom analyses, including visualizations to evaluate data at the organ system level and drill down into individual animal data. This data analysis provides the tools for scientists to compare toxicity profiles across multiple studies using SEND. A cross-study analysis of 2 different compounds intended for the same pharmacological target is described and the analyses indicate potential on-target effects to liver, kidney, and hematopoietic systems.
Collapse
Affiliation(s)
| | - Cm Sabbir Ahmed
- US Food & Drug Administration, Silver Spring, MD 20901, United States
- Oak Ridge Institute for Science and Education, Oak Ridge, TN 37830, United States
| | - Susan Butler
- US Food & Drug Administration, Silver Spring, MD 20901, United States
- Oak Ridge Institute for Science and Education, Oak Ridge, TN 37830, United States
| | | | - William Houser
- Bristol Myers Squibb, New Brunswick, NJ 08901, United States
| | | | | | | | - Kevin Snyder
- US Food & Drug Administration, Silver Spring, MD 20901, United States
| | | | - Wenxian Wang
- Bristol Myers Squibb, New Brunswick, NJ 08901, United States
| | - Md Yousuf Ali
- US Food & Drug Administration, Silver Spring, MD 20901, United States
- Oak Ridge Institute for Science and Education, Oak Ridge, TN 37830, United States
| |
Collapse
|
2
|
Palazzi X, Anger LT, Boulineau T, Grevot A, Guffroy M, Henson K, Hoepp N, Jacobsen M, Kale VP, Kreeger J, Lane JH, Li D, Muster W, Paisley B, Ramaiah L, Robertson N, Shultz V, Steger Hartmann T, Westhouse R. Points to consider regarding the use and implementation of virtual controls in nonclinical general toxicology studies. Regul Toxicol Pharmacol 2024; 150:105632. [PMID: 38679316 DOI: 10.1016/j.yrtph.2024.105632] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2024] [Revised: 04/17/2024] [Accepted: 04/22/2024] [Indexed: 05/01/2024]
Abstract
The replacement of a proportion of concurrent controls by virtual controls in nonclinical safety studies has gained traction over the last few years. This is supported by foundational work, encouraged by regulators, and aligned with societal expectations regarding the use of animals in research. This paper provides an overview of the points to consider for any institution on the verge of implementing this concept, with emphasis given on database creation, risks, and discipline-specific perspectives.
Collapse
Affiliation(s)
- Xavier Palazzi
- Drug Safety Research and Development, Pfizer Inc, 445, Eastern Point Road, Groton CT, USA.
| | - Lennart T Anger
- Safety Assessment, Genentech, Inc., 1 DNA Way, South San Francisco, CA, 94080, USA
| | - Theresa Boulineau
- Nonclinical Drug Safety, Boehringer Ingelheim, 900 Ridgebury Road, Ridgefield, CT, 06877, USA
| | - Armelle Grevot
- Preclinical Safety, Novartis AG, Fabrikstrasse, Basel, Switzerland
| | - Magali Guffroy
- Preclinical Safety, AbbVie, 1 North Waukegan Road, R46G/AP13A-3, North Chicago, IL, 60064, USA
| | - Kristin Henson
- Preclinical Safety, Novartis Pharmaceuticals Corporation, One Health Plaza, East Hanover, NJ, 07936, USA
| | - Natalie Hoepp
- Nonclinical Drug Safety, Merck and Co., Inc., Rahway, NJ, USA
| | - Matt Jacobsen
- Clinical Pharmacology and Safety Sciences, AstraZeneca, Biomedical Campus, 1 Francis Crick Ave, Cambridge, UK
| | - Vijay P Kale
- Nonclinical Safety, Bristol Myers Squibb, 1 Squibb Dr, New Brunswick, NJ, 08901, USA
| | - John Kreeger
- Non-Clinical Safety, GSK, 1250 S. Collegeville Rd, Collegeville, PA, USA
| | - Joan H Lane
- Translational Safety & Bioanalytical Sciences, Amgen, Inc., 1 Amgen Center Dr, Thousand Oaks, CA, 91320, USA
| | - Dingzhou Li
- Global Biometrics & Data Management, Pfizer Inc, 445, Eastern Point Road, Groton CT, USA
| | - Wolfgang Muster
- Pharmaceutical Sciences, F. Hoffmann-La Roche Ltd., Grenzacherstrasse 124, CH-4070, Basel, Switzerland
| | - Brianna Paisley
- iBAR ADMET, Eli Lilly and Company, 893 Delaware St, Indianapolis, IN, USA
| | - Lila Ramaiah
- Preclinical Sciences and Translational Safety, Johnson & Johnson, 1400 McKean Road, PO Box 776, Spring House, PA, 19477, USA
| | - Nicola Robertson
- Non-Clinical Safety, GSK, Gunnels Wood Road, Stevenage, SG1 2NY, UK
| | - Valerie Shultz
- Nonclinical Development, Organon, 4000 Chemical Rd, Suite 500, Plymouth Meeting, PA, 19462, USA
| | - Thomas Steger Hartmann
- Investigational Toxicology, BAYER AG, Pharmaceuticals, Muellerstrasse 178, 13342, Berlin, Germany
| | - Richard Westhouse
- Toxicology and Pathology, Agios Pharmaceuticals, 88 Sidney Street, Cambridge, MA, USA
| |
Collapse
|
3
|
Gurjanov A, Vieira-Vieira C, Vienenkoetter J, Vaas LAI, Steger-Hartmann T. Replacing concurrent controls with virtual control groups in rat toxicity studies. Regul Toxicol Pharmacol 2024; 148:105592. [PMID: 38401762 DOI: 10.1016/j.yrtph.2024.105592] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2023] [Revised: 02/15/2024] [Accepted: 02/21/2024] [Indexed: 02/26/2024]
Abstract
Virtual control groups (VCGs) in nonclinical toxicity represent the concept of using appropriate historical control data for replacing concurrent control group animals. Historical control data collected from standardized studies can serve as base for constructing VCGs and legacy study reports can be used as a benchmark to evaluate the VCG performance. Replacing concurrent controls of legacy studies with VCGs should ideally reproduce the results of these studies. Based on three four-week rat oral toxicity legacy studies with varying degrees of toxicity findings we developed a concept to evaluate VCG performance on different levels: the ability of VCGs to (i) reproduce statistically significant deviations from the concurrent control, (ii) reproduce test substance-related effects, and (iii) reproduce the conclusion of the toxicity study in terms of threshold dose, target organs, toxicological biomarkers (clinical pathology) and reversibility. Although VCGs have shown a low to moderate ability to reproduce statistical results, the general study conclusions remained unchanged. Our results provide a first indication that carefully selected historical control data can be used to replace concurrent control without impairing the general study conclusion. Additionally, the developed procedures and workflows lay the foundation for the future validation of virtual controls for a use in regulatory toxicology.
Collapse
Affiliation(s)
- Alexander Gurjanov
- Bayer Research & Development, Pharmaceuticals, Investigative Toxicology, Berlin, Germany.
| | - Carlos Vieira-Vieira
- Bayer Research & Development, Pharmaceuticals, Investigative Toxicology, Berlin, Germany
| | - Julia Vienenkoetter
- Bayer Research & Development, Pharmaceuticals, Pathology and Clinical Pathology, Wuppertal, Germany
| | - Lea A I Vaas
- Bayer Research & Development, Pharmaceuticals, Research & Pre-Clinical Statistics Group, Berlin, Germany
| | - Thomas Steger-Hartmann
- Bayer Research & Development, Pharmaceuticals, Investigative Toxicology, Berlin, Germany
| |
Collapse
|
4
|
Rudmann DG, Bertrand L, Zuraw A, Deiters J, Staup M, Rivenson Y, Kuklyte J. Building a nonclinical pathology laboratory of the future for pharmaceutical research excellence. Drug Discov Today 2023; 28:103747. [PMID: 37598916 DOI: 10.1016/j.drudis.2023.103747] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2023] [Revised: 08/02/2023] [Accepted: 08/14/2023] [Indexed: 08/22/2023]
Abstract
We describe a roadmap for a fully digital artificial intelligence (AI)-augmented nonclinical pathology laboratory across three continents. Underpinning the design are Good Laboratory Practice (GLP)-validated laboratory information management systems (LIMS), whole slide-scanners (WSS), image management systems (IMS), and a digital microscope intended for use by the nonclinical pathologist. Digital diagnostics are supported by tools that include AI-based virtual staining and deep learning-based decision support. Implemented during the COVID-19 pandemic, the initial digitized workflow largely mitigated disruption of pivotal nonclinical studies required to support pharmaceutical clinical testing. We believe that this digital transformation of our nonclinical pathology laboratories will promote efficiency and innovation in the future and enhance the quality and speed of drug development decision making.
Collapse
Affiliation(s)
- D G Rudmann
- Charles River Laboratories, Digital Toxicologic Pathology, Discovery and Safety Assessment, Wilmington, DE, USA.
| | - L Bertrand
- Charles River Laboratories, Digital Toxicologic Pathology, Discovery and Safety Assessment, Wilmington, DE, USA
| | - A Zuraw
- Charles River Laboratories, Digital Toxicologic Pathology, Discovery and Safety Assessment, Wilmington, DE, USA
| | - J Deiters
- Charles River Laboratories, Digital Toxicologic Pathology, Discovery and Safety Assessment, Wilmington, DE, USA
| | - M Staup
- Charles River Laboratories, Digital Toxicologic Pathology, Discovery and Safety Assessment, Wilmington, DE, USA
| | | | | |
Collapse
|
5
|
Steger-Hartmann T, Clark M. Can Historical Control Group Data Be Used to Replace Concurrent Controls in Animal Studies? Toxicol Pathol 2023; 51:361-362. [PMID: 37905979 DOI: 10.1177/01926233231208987] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2023]
Abstract
The availability of large amounts of high-quality control data from tightly controlled regulated animal safety data has created the idea to re-use these data beyond its classical applications of quality control, identification of treatment-related effects and assessing effect-size relevance for building virtual control groups (VCGs). While the ethical and cost-saving aspects of such a concept are immediately evident, the potential challenges need to be carefully considered to avoid any effect which could lower the sensitivity of an animal study to detect adverse events, safety thresholds, target organs, or biomarkers. In our brief communication, we summarize the current discussion regarding VCGs and propose a path forward how the replacement of concurrent control with VCGs resulting from historical data could be systematically assessed and to come to conclusions regarding the scientific value of the concept.
Collapse
|