1
|
Dorst M, Zeevenhooven N, Wilding R, Mende D, Brandt BW, Zaura E, Hoekstra A, Sheraton VM. FAIR compliant database development for human microbiome data samples. Front Cell Infect Microbiol 2024; 14:1384809. [PMID: 38774631 PMCID: PMC11106358 DOI: 10.3389/fcimb.2024.1384809] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2024] [Accepted: 04/17/2024] [Indexed: 05/24/2024] Open
Abstract
Introduction Sharing microbiome data among researchers fosters new innovations and reduces cost for research. Practically, this means that the (meta)data will have to be standardized, transparent and readily available for researchers. The microbiome data and associated metadata will then be described with regards to composition and origin, in order to maximize the possibilities for application in various contexts of research. Here, we propose a set of tools and protocols to develop a real-time FAIR (Findable. Accessible, Interoperable and Reusable) compliant database for the handling and storage of human microbiome and host-associated data. Methods The conflicts arising from privacy laws with respect to metadata, possible human genome sequences in the metagenome shotgun data and FAIR implementations are discussed. Alternate pathways for achieving compliance in such conflicts are analyzed. Sample traceable and sensitive microbiome data, such as DNA sequences or geolocalized metadata are identified, and the role of the GDPR (General Data Protection Regulation) data regulations are considered. For the construction of the database, procedures have been realized to make data FAIR compliant, while preserving privacy of the participants providing the data. Results and discussion An open-source development platform, Supabase, was used to implement the microbiome database. Researchers can deploy this real-time database to access, upload, download and interact with human microbiome data in a FAIR complaint manner. In addition, a large language model (LLM) powered by ChatGPT is developed and deployed to enable knowledge dissemination and non-expert usage of the database.
Collapse
Affiliation(s)
- Mathieu Dorst
- Informatics Institute, University of Amsterdam, Amsterdam, Netherlands
| | | | - Rory Wilding
- Supabase Limited Liability Company (LLC), San Francisco, CA, United States
| | - Daniel Mende
- Amsterdam Institute of Infection and Immunity, Amsterdam University Medical Center, Amsterdam, Netherlands
| | - Bernd W. Brandt
- Department of Preventive Dentistry, Academic Centre for Dentistry Amsterdam, Vrije Universiteit Amsterdam and University of Amsterdam, Amsterdam, Netherlands
| | - Egija Zaura
- Department of Preventive Dentistry, Academic Centre for Dentistry Amsterdam, Vrije Universiteit Amsterdam and University of Amsterdam, Amsterdam, Netherlands
| | - Alfons Hoekstra
- Computational Science Lab, Informatics Institute, University of Amsterdam, Amsterdam, Netherlands
| | - Vivek M. Sheraton
- Computational Science Lab, Informatics Institute, University of Amsterdam, Amsterdam, Netherlands
| |
Collapse
|
2
|
Inau ET, Sack J, Waltemath D, Zeleke AA. Initiatives, Concepts, and Implementation Practices of the Findable, Accessible, Interoperable, and Reusable Data Principles in Health Data Stewardship: Scoping Review. J Med Internet Res 2023; 25:e45013. [PMID: 37639292 PMCID: PMC10495848 DOI: 10.2196/45013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2022] [Revised: 03/25/2023] [Accepted: 04/14/2023] [Indexed: 08/29/2023] Open
Abstract
BACKGROUND Thorough data stewardship is a key enabler of comprehensive health research. Processes such as data collection, storage, access, sharing, and analytics require researchers to follow elaborate data management strategies properly and consistently. Studies have shown that findable, accessible, interoperable, and reusable (FAIR) data leads to improved data sharing in different scientific domains. OBJECTIVE This scoping review identifies and discusses concepts, approaches, implementation experiences, and lessons learned in FAIR initiatives in health research data. METHODS The Arksey and O'Malley stage-based methodological framework for scoping reviews was applied. PubMed, Web of Science, and Google Scholar were searched to access relevant publications. Articles written in English, published between 2014 and 2020, and addressing FAIR concepts or practices in the health domain were included. The 3 data sources were deduplicated using a reference management software. In total, 2 independent authors reviewed the eligibility of each article based on defined inclusion and exclusion criteria. A charting tool was used to extract information from the full-text papers. The results were reported using the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines. RESULTS A total of 2.18% (34/1561) of the screened articles were included in the final review. The authors reported FAIRification approaches, which include interpolation, inclusion of comprehensive data dictionaries, repository design, semantic interoperability, ontologies, data quality, linked data, and requirement gathering for FAIRification tools. Challenges and mitigation strategies associated with FAIRification, such as high setup costs, data politics, technical and administrative issues, privacy concerns, and difficulties encountered in sharing health data despite its sensitive nature were also reported. We found various workflows, tools, and infrastructures designed by different groups worldwide to facilitate the FAIRification of health research data. We also uncovered a wide range of problems and questions that researchers are trying to address by using the different workflows, tools, and infrastructures. Although the concept of FAIR data stewardship in the health research domain is relatively new, almost all continents have been reached by at least one network trying to achieve health data FAIRness. Documented outcomes of FAIRification efforts include peer-reviewed publications, improved data sharing, facilitated data reuse, return on investment, and new treatments. Successful FAIRification of data has informed the management and prognosis of various diseases such as cancer, cardiovascular diseases, and neurological diseases. Efforts to FAIRify data on a wider variety of diseases have been ongoing since the COVID-19 pandemic. CONCLUSIONS This work summarises projects, tools, and workflows for the FAIRification of health research data. The comprehensive review shows that implementing the FAIR concept in health data stewardship carries the promise of improved research data management and transparency in the era of big data and open research publishing. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) RR2-10.2196/22505.
Collapse
Affiliation(s)
- Esther Thea Inau
- Department of Medical Informatics, Institute for Community Medicine, University Medicine Greifswald, Greifswald, Germany
| | - Jean Sack
- International Health Department, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, United States
| | - Dagmar Waltemath
- Department of Medical Informatics, Institute for Community Medicine, University Medicine Greifswald, Greifswald, Germany
| | - Atinkut Alamirrew Zeleke
- Department of Medical Informatics, Institute for Community Medicine, University Medicine Greifswald, Greifswald, Germany
| |
Collapse
|
3
|
Hardy K, Heyse S. FAIR data policies can benefit biotech startups. Nat Biotechnol 2023; 41:1060-1061. [PMID: 37568019 DOI: 10.1038/s41587-023-01892-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/13/2023]
|
4
|
Rocca-Serra P, Gu W, Ioannidis V, Abbassi-Daloii T, Capella-Gutierrez S, Chandramouliswaran I, Splendiani A, Burdett T, Giessmann RT, Henderson D, Batista D, Emam I, Gadiya Y, Giovanni L, Willighagen E, Evelo C, Gray AJG, Gribbon P, Juty N, Welter D, Quast K, Peeters P, Plasterer T, Wood C, van der Horst E, Reilly D, van Vlijmen H, Scollen S, Lister A, Thurston M, Granell R, Sansone SA. The FAIR Cookbook - the essential resource for and by FAIR doers. Sci Data 2023; 10:292. [PMID: 37208467 PMCID: PMC10198982 DOI: 10.1038/s41597-023-02166-3] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2022] [Accepted: 04/19/2023] [Indexed: 05/21/2023] Open
Abstract
The notion that data should be Findable, Accessible, Interoperable and Reusable, according to the FAIR Principles, has become a global norm for good data stewardship and a prerequisite for reproducibility. Nowadays, FAIR guides data policy actions and professional practices in the public and private sectors. Despite such global endorsements, however, the FAIR Principles are aspirational, remaining elusive at best, and intimidating at worst. To address the lack of practical guidance, and help with capability gaps, we developed the FAIR Cookbook, an open, online resource of hands-on recipes for "FAIR doers" in the Life Sciences. Created by researchers and data managers professionals in academia, (bio)pharmaceutical companies and information service industries, the FAIR Cookbook covers the key steps in a FAIRification journey, the levels and indicators of FAIRness, the maturity model, the technologies, the tools and the standards available, as well as the skills required, and the challenges to achieve and improve data FAIRness. Part of the ELIXIR ecosystem, and recommended by funders, the FAIR Cookbook is open to contributions of new recipes.
Collapse
Affiliation(s)
- Philippe Rocca-Serra
- Oxford e-Research Centre, Department of Engineering Science, University of Oxford, 7 Keble Road, OX13QG, Oxford, UK.
- AstraZeneca, Data Office, Data Science & AI unit R&D, 136 Hills Rd, Cambridge, UK.
| | - Wei Gu
- Luxembourg Centre for Systems Biomedicine, ELIXIR Luxembourg, University of Luxembourg, L-4367, Belval, Luxembourg
- Luxembourg National Data Service, 6 Avenue des Hauts-Fourneaux, Esch-sur-Alzette, Luxembourg, L-4362, Esch-sur-Alzette, Luxembourg
| | - Vassilios Ioannidis
- Vital-IT Group, SIB Swiss Institute of Bioinformatics, 1015, Lausanne, Switzerland
| | - Tooba Abbassi-Daloii
- Department of Bioinformatics (BiGCaT), NUTRIM, FHML, Maastricht University, Maastricht, the Netherlands
| | | | - Ishwar Chandramouliswaran
- Office of Data Science Strategy, National Institutes of Health, 9000 Rockville Pike, Bethesda, Maryland, 20892, USA
| | | | - Tony Burdett
- European Molecular Biology Laboratory, European Bioinformatics Institute (EMBL-EBI), Hinxton, CB10 1SD, UK
| | - Robert T Giessmann
- Bayer AG, Business Development & Licensing & OI, Pharmaceuticals, 13342, Berlin, Germany
- Institute for Globally Distributed Open Research and Education (IGDORE), Berlin, Germany
| | - David Henderson
- Bayer AG, Business Development & Licensing & OI, Pharmaceuticals, 13342, Berlin, Germany
| | - Dominique Batista
- Oxford e-Research Centre, Department of Engineering Science, University of Oxford, 7 Keble Road, OX13QG, Oxford, UK
| | - Ibrahim Emam
- Data Science Institute, Imperial College London, William Penney Laboratory, South Kensington Campus, London, SW7 2AZ, UK
| | - Yojana Gadiya
- Fraunhofer Institute for Translational Medicine and Pharmacology and Fraunhofer Cluster of Excellence for Immune Mediated Diseases, Schnackenburgallee 114, 22525 Hamburg, and Theodor Stern Kai 7, 60590, Frankfurt, Germany
| | - Lucas Giovanni
- Department of Bioinformatics (BiGCaT), NUTRIM, FHML, Maastricht University, Maastricht, the Netherlands
| | - Egon Willighagen
- Department of Bioinformatics (BiGCaT), NUTRIM, FHML, Maastricht University, Maastricht, the Netherlands
| | - Chris Evelo
- Department of Bioinformatics (BiGCaT), NUTRIM, FHML, Maastricht University, Maastricht, the Netherlands
| | - Alasdair J G Gray
- Department of Computer Science, Heriot-Watt University, Edinburgh, EH14 4AS, Scotland, UK
| | - Philip Gribbon
- Fraunhofer Institute for Translational Medicine and Pharmacology and Fraunhofer Cluster of Excellence for Immune Mediated Diseases, Schnackenburgallee 114, 22525 Hamburg, and Theodor Stern Kai 7, 60590, Frankfurt, Germany
| | - Nick Juty
- The University of Manchester, Department of Computer Science, The University of Manchester, Manchester, M13 9PL, UK
| | - Danielle Welter
- Luxembourg Centre for Systems Biomedicine, ELIXIR Luxembourg, University of Luxembourg, L-4367, Belval, Luxembourg
- Luxembourg National Data Service, 6 Avenue des Hauts-Fourneaux, Esch-sur-Alzette, Luxembourg, L-4362, Esch-sur-Alzette, Luxembourg
| | - Karsten Quast
- Boehringer Ingelheim Pharma GmbH & Co. KG, Birkendorfer Straße 65, 88397, Biberach an der Riss, Germany
| | - Paul Peeters
- Janssen, Turnhoutseweg 30, B-2340, Beerse, Belgium
| | - Tom Plasterer
- AstraZeneca Pharmaceuticals, 36 Gatehouse Drive, Waltham, MA, 02451, USA
| | - Colin Wood
- AstraZeneca, da Vinci Building, Melbourn Science Park, Cambridge Road, Royston, SG8 6HM, UK
| | - Eelke van der Horst
- The Hyve BV, Arthur van Schendelstraat 650, 3511 MJ, Utrecht, The Netherlands
| | - Dorothy Reilly
- Novartis Institutes for BioMedical Research, Novartis Pharma AG, Basel, Switzerland
| | | | - Serena Scollen
- ELIXIR Hub, Wellcome Genome Campus, Hinxton, Cambridge, CB10 1SD, UK
| | - Allyson Lister
- Oxford e-Research Centre, Department of Engineering Science, University of Oxford, 7 Keble Road, OX13QG, Oxford, UK
| | - Milo Thurston
- Oxford e-Research Centre, Department of Engineering Science, University of Oxford, 7 Keble Road, OX13QG, Oxford, UK
| | - Ramon Granell
- Oxford e-Research Centre, Department of Engineering Science, University of Oxford, 7 Keble Road, OX13QG, Oxford, UK
| | - Susanna-Assunta Sansone
- Oxford e-Research Centre, Department of Engineering Science, University of Oxford, 7 Keble Road, OX13QG, Oxford, UK.
| |
Collapse
|
5
|
Zeng C, Lee YS, Szatrowski A, Mero D, Khomtchouk BB. Computational integration and meta-analysis of abandoned cardio-(vascular/renal/metabolic) therapeutics discontinued during clinical trials from 2011 to 2022. Front Cardiovasc Med 2023; 10:1033832. [PMID: 36815023 PMCID: PMC9940660 DOI: 10.3389/fcvm.2023.1033832] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2022] [Accepted: 01/17/2023] [Indexed: 02/09/2023] Open
Abstract
Cardiovascular/renal/metabolic (CVRM) diseases collectively comprise the leading cause of death worldwide and disproportionally affect older demographics and historically underrepresented minority populations. Despite these critical unmet needs, pharmaceutical research and development (R&D) efforts have historically struggled with high drug failure rates, low approval rates, and other challenges. Drug repurposing is one approach to recovering R&D costs and meeting unmet demands in therapeutic markets. While there are multiple approaches to conducting drug repurposing, we recognize the importance of bringing together and consolidating discontinued drug information to help identify prospective repurposing candidates. In this study, we have harmonized and integrated information on all relevant CVRM drug assets from U.S. Securities and Exchange Commission (SEC) filings, clinical trial records, PharmGKB, Open Targets, and other platforms. A list of existing therapeutics discontinued or shelved by pharmaceutical/biotechnology companies in 2011-2022 were manually curated and interpreted for insights using information on each drug's genetic target, mechanism of action (MOA), clinical indication, and R&D information including highest phase of clinical development, year of discontinuation, previous repurposing attempts (if any), and other actionable metadata. This study also summarizes the profiles of CVRM drugs discontinued within the past decade and identifies the limitations of publicly available information on discontinued drug assets. The constructed database could serve as a tool for identifying candidates for drug repurposing and developing query methods for collecting R&D information.
Collapse
Affiliation(s)
- Carisa Zeng
- The College of the University of Chicago, Chicago, IL, United States
| | - Yoon Seo Lee
- The College of the University of Chicago, Chicago, IL, United States
| | - Austin Szatrowski
- The College of the University of Chicago, Chicago, IL, United States
| | - Deniel Mero
- Dock Therapeutics, Inc., Lewes, DE, United States
| | - Bohdan B. Khomtchouk
- Department of BioHealth Informatics, Luddy School of Informatics, Computing, and Engineering, Indiana University, Indianapolis, IN, United States,Krannert Cardiovascular Research Center, Indiana University School of Medicine, Indianapolis, IN, United States,Center for Computational Biology and Bioinformatics, Indiana University School of Medicine, Indianapolis, IN, United States,*Correspondence: Bohdan B. Khomtchouk,
| |
Collapse
|
6
|
Alharbi E, Skeva R, Juty N, Jay C, Goble C. A FAIR-Decide framework for pharmaceutical R&D: FAIR data cost-benefit assessment. Drug Discov Today 2023; 28:103510. [PMID: 36716952 DOI: 10.1016/j.drudis.2023.103510] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2022] [Revised: 01/24/2023] [Accepted: 01/24/2023] [Indexed: 01/29/2023]
Abstract
The FAIR (findable, accessible, interoperable and reusable) principles are data management and stewardship guidelines aimed at increasing the effective use of scientific research data. Adherence to these principles in managing data assets in pharmaceutical research and development (R&D) offers pharmaceutical companies the potential to maximise the value of such assets, but the endeavour is costly and challenging. We describe the 'FAIR-Decide' framework, which aims to guide decision-making on the retrospective FAIRification of existing datasets by using business analysis techniques to estimate costs and expected benefits. This framework supports decision-making on FAIRification in the pharmaceutical R&D industry and can be integrated into a company's data management strategy.
Collapse
Affiliation(s)
- Ebtisam Alharbi
- College of Computer and Information Systems, Umm Al-Qura University, Mecca, Saudi Arabia.
| | - Rigina Skeva
- Department of Computer Science, University of Manchester, Manchester, UK
| | - Nick Juty
- Department of Computer Science, University of Manchester, Manchester, UK
| | - Caroline Jay
- Department of Computer Science, University of Manchester, Manchester, UK.
| | - Carole Goble
- Department of Computer Science, University of Manchester, Manchester, UK.
| |
Collapse
|
7
|
Alharbi E, Gadiya Y, Henderson D, Zaliani A, Delfin-Rossaro A, Cambon-Thomsen A, Kohler M, Witt G, Welter D, Juty N, Jay C, Engkvist O, Goble C, Reilly DS, Satagopam V, Ioannidis V, Gu W, Gribbon P. Selection of data sets for FAIRification in drug discovery and development: Which, why, and how? Drug Discov Today 2022; 27:2080-2085. [PMID: 35595012 PMCID: PMC9236643 DOI: 10.1016/j.drudis.2022.05.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2022] [Revised: 04/28/2022] [Accepted: 05/10/2022] [Indexed: 11/30/2022]
Abstract
Research organisations are focussed on quantifying the costs and benefits of implementing FAIR. Criteria used for the selection of data for FAIRification can be opaque and inconsistent. FAIRification effort depends on individual skills, competencies, resources, and time available. FAIRification should satisfy reuse scenarios, and lead to scientific and economic impacts. Organisational challenges include providing training to individuals and developing a FAIR organisation culture.
Despite the intuitive value of adopting the Findable, Accessible, Interoperable, and Reusable (FAIR) principles in both academic and industrial sectors, challenges exist in resourcing, balancing long- versus short-term priorities, and achieving technical implementation. This situation is exacerbated by the unclear mechanisms by which costs and benefits can be assessed when decisions on FAIR are made. Scientific and research and development (R&D) leadership need reliable evidence of the potential benefits and information on effective implementation mechanisms and remediating strategies. In this article, we describe procedures for cost–benefit evaluation, and identify best-practice approaches to support the decision-making process involved in FAIR implementation.
Collapse
Affiliation(s)
- Ebtisam Alharbi
- Department of Computer Science, The University of Manchester, Oxford Road, Manchester, UK
| | - Yojana Gadiya
- Fraunhofer Institute for Translational Medicine and Pharmacology (ITMP), Schnackenburgallee 114, 22525 Hamburg, and Theodor Stern Kai 7, 60590 Frankfurt, Germany; Fraunhofer Cluster of Excellence for Immune Mediated Diseases (CIMD), Theodor Stern Kai 7, 60590 Frankfurt, Germany
| | - David Henderson
- Bayer AG, Research & Development, Pharmaceuticals, Müllerstrasse 178, 13353 Berlin, Germany
| | - Andrea Zaliani
- Fraunhofer Institute for Translational Medicine and Pharmacology (ITMP), Schnackenburgallee 114, 22525 Hamburg, and Theodor Stern Kai 7, 60590 Frankfurt, Germany; Fraunhofer Cluster of Excellence for Immune Mediated Diseases (CIMD), Theodor Stern Kai 7, 60590 Frankfurt, Germany
| | | | | | - Manfred Kohler
- Fraunhofer Institute for Translational Medicine and Pharmacology (ITMP), Schnackenburgallee 114, 22525 Hamburg, and Theodor Stern Kai 7, 60590 Frankfurt, Germany; Fraunhofer Cluster of Excellence for Immune Mediated Diseases (CIMD), Theodor Stern Kai 7, 60590 Frankfurt, Germany
| | - Gesa Witt
- Fraunhofer Institute for Translational Medicine and Pharmacology (ITMP), Schnackenburgallee 114, 22525 Hamburg, and Theodor Stern Kai 7, 60590 Frankfurt, Germany; Fraunhofer Cluster of Excellence for Immune Mediated Diseases (CIMD), Theodor Stern Kai 7, 60590 Frankfurt, Germany
| | - Danielle Welter
- Luxembourg Centre for Systems Biomedicine, ELIXIR Luxembourg, University of Luxembourg, L-4367 Belval, Luxembourg
| | - Nick Juty
- Department of Computer Science, The University of Manchester, Oxford Road, Manchester, UK
| | - Caroline Jay
- Department of Computer Science, The University of Manchester, Oxford Road, Manchester, UK
| | - Ola Engkvist
- Discovery Sciences, R&D, AstraZeneca, SE-43183 Mölndal, Sweden
| | - Carole Goble
- Department of Computer Science, The University of Manchester, Oxford Road, Manchester, UK
| | - Dorothy S Reilly
- Novartis Institutes for BioMedical Research, Novartis Pharma AG, Basel, Switzerland
| | - Venkata Satagopam
- Luxembourg Centre for Systems Biomedicine, ELIXIR Luxembourg, University of Luxembourg, L-4367 Belval, Luxembourg
| | - Vassilios Ioannidis
- SIB Swiss Institute of Bioinformatics, Quartier Sorge - Batiment Amphipole, 1015 Lausanne, Switzerland.
| | - Wei Gu
- Novartis Institutes for BioMedical Research, Novartis Pharma AG, Basel, Switzerland.
| | - Philip Gribbon
- Fraunhofer Institute for Translational Medicine and Pharmacology (ITMP), Schnackenburgallee 114, 22525 Hamburg, and Theodor Stern Kai 7, 60590 Frankfurt, Germany; Fraunhofer Cluster of Excellence for Immune Mediated Diseases (CIMD), Theodor Stern Kai 7, 60590 Frankfurt, Germany.
| |
Collapse
|
8
|
Maximizing data value for biopharma through FAIR and quality implementation: FAIR plus Q. Drug Discov Today 2022; 27:1441-1447. [DOI: 10.1016/j.drudis.2022.01.006] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2021] [Revised: 01/10/2022] [Accepted: 01/17/2022] [Indexed: 12/15/2022]
|