1
|
Serafini MM, Sepehri S, Midali M, Stinckens M, Biesiekierska M, Wolniakowska A, Gatzios A, Rundén-Pran E, Reszka E, Marinovich M, Vanhaecke T, Roszak J, Viviani B, SenGupta T. Recent advances and current challenges of new approach methodologies in developmental and adult neurotoxicity testing. Arch Toxicol 2024; 98:1271-1295. [PMID: 38480536 DOI: 10.1007/s00204-024-03703-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2023] [Accepted: 02/06/2024] [Indexed: 03/27/2024]
Abstract
Adult neurotoxicity (ANT) and developmental neurotoxicity (DNT) assessments aim to understand the adverse effects and underlying mechanisms of toxicants on the human nervous system. In recent years, there has been an increasing focus on the so-called new approach methodologies (NAMs). The Organization for Economic Co-operation and Development (OECD), together with European and American regulatory agencies, promote the use of validated alternative test systems, but to date, guidelines for regulatory DNT and ANT assessment rely primarily on classical animal testing. Alternative methods include both non-animal approaches and test systems on non-vertebrates (e.g., nematodes) or non-mammals (e.g., fish). Therefore, this review summarizes the recent advances of NAMs focusing on ANT and DNT and highlights the potential and current critical issues for the full implementation of these methods in the future. The status of the DNT in vitro battery (DNT IVB) is also reviewed as a first step of NAMs for the assessment of neurotoxicity in the regulatory context. Critical issues such as (i) the need for test batteries and method integration (from in silico and in vitro to in vivo alternatives, e.g., zebrafish, C. elegans) requiring interdisciplinarity to manage complexity, (ii) interlaboratory transferability, and (iii) the urgent need for method validation are discussed.
Collapse
Affiliation(s)
- Melania Maria Serafini
- Department of Pharmacological and Biomolecular Sciences, "Rodolfo Paoletti", Università degli Studi di Milano, Milan, Italy.
| | - Sara Sepehri
- Department of In Vitro Toxicology and Dermato-Cosmetology (IVTD), Vrije Universiteit Brussels, Brussels, Belgium
| | - Miriam Midali
- Department of Pharmacological and Biomolecular Sciences, "Rodolfo Paoletti", Università degli Studi di Milano, Milan, Italy
| | - Marth Stinckens
- Department of In Vitro Toxicology and Dermato-Cosmetology (IVTD), Vrije Universiteit Brussels, Brussels, Belgium
| | - Marta Biesiekierska
- Department of Translational Research, Nofer Institute of Occupational Medicine, Lodz, Poland
| | - Anna Wolniakowska
- Department of Translational Research, Nofer Institute of Occupational Medicine, Lodz, Poland
| | - Alexandra Gatzios
- Department of In Vitro Toxicology and Dermato-Cosmetology (IVTD), Vrije Universiteit Brussels, Brussels, Belgium
| | - Elise Rundén-Pran
- The Climate and Environmental Research Institute NILU, Kjeller, Norway
| | - Edyta Reszka
- Department of Translational Research, Nofer Institute of Occupational Medicine, Lodz, Poland
| | - Marina Marinovich
- Department of Pharmacological and Biomolecular Sciences, "Rodolfo Paoletti", Università degli Studi di Milano, Milan, Italy
- Center of Research on New Approach Methodologies (NAMs) in chemical risk assessment (SAFE-MI), Università degli Studi di Milano, Milan, Italy
| | - Tamara Vanhaecke
- Department of In Vitro Toxicology and Dermato-Cosmetology (IVTD), Vrije Universiteit Brussels, Brussels, Belgium
| | - Joanna Roszak
- Department of Translational Research, Nofer Institute of Occupational Medicine, Lodz, Poland
| | - Barbara Viviani
- Department of Pharmacological and Biomolecular Sciences, "Rodolfo Paoletti", Università degli Studi di Milano, Milan, Italy
- Center of Research on New Approach Methodologies (NAMs) in chemical risk assessment (SAFE-MI), Università degli Studi di Milano, Milan, Italy
| | - Tanima SenGupta
- The Climate and Environmental Research Institute NILU, Kjeller, Norway
| |
Collapse
|
2
|
Tal T, Myhre O, Fritsche E, Rüegg J, Craenen K, Aiello-Holden K, Agrillo C, Babin PJ, Escher BI, Dirven H, Hellsten K, Dolva K, Hessel E, Heusinkveld HJ, Hadzhiev Y, Hurem S, Jagiello K, Judzinska B, Klüver N, Knoll-Gellida A, Kühne BA, Leist M, Lislien M, Lyche JL, Müller F, Colbourne JK, Neuhaus W, Pallocca G, Seeger B, Scharkin I, Scholz S, Spjuth O, Torres-Ruiz M, Bartmann K. New approach methods to assess developmental and adult neurotoxicity for regulatory use: a PARC work package 5 project. FRONTIERS IN TOXICOLOGY 2024; 6:1359507. [PMID: 38742231 PMCID: PMC11089904 DOI: 10.3389/ftox.2024.1359507] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2023] [Accepted: 03/18/2024] [Indexed: 05/16/2024] Open
Abstract
In the European regulatory context, rodent in vivo studies are the predominant source of neurotoxicity information. Although they form a cornerstone of neurotoxicological assessments, they are costly and the topic of ethical debate. While the public expects chemicals and products to be safe for the developing and mature nervous systems, considerable numbers of chemicals in commerce have not, or only to a limited extent, been assessed for their potential to cause neurotoxicity. As such, there is a societal push toward the replacement of animal models with in vitro or alternative methods. New approach methods (NAMs) can contribute to the regulatory knowledge base, increase chemical safety, and modernize chemical hazard and risk assessment. Provided they reach an acceptable level of regulatory relevance and reliability, NAMs may be considered as replacements for specific in vivo studies. The European Partnership for the Assessment of Risks from Chemicals (PARC) addresses challenges to the development and implementation of NAMs in chemical risk assessment. In collaboration with regulatory agencies, Project 5.2.1e (Neurotoxicity) aims to develop and evaluate NAMs for developmental neurotoxicity (DNT) and adult neurotoxicity (ANT) and to understand the applicability domain of specific NAMs for the detection of endocrine disruption and epigenetic perturbation. To speed up assay time and reduce costs, we identify early indicators of later-onset effects. Ultimately, we will assemble second-generation developmental neurotoxicity and first-generation adult neurotoxicity test batteries, both of which aim to provide regulatory hazard and risk assessors and industry stakeholders with robust, speedy, lower-cost, and informative next-generation hazard and risk assessment tools.
Collapse
Affiliation(s)
- Tamara Tal
- Helmholtz Centre for Environmental Research – UFZ, Chemicals in the Environment Research Section, Leipzig, Germany
- University of Leipzig, Medical Faculty, Leipzig, Germany
| | - Oddvar Myhre
- Norwegian Institute of Public Health – NIPH, Department of Chemical Toxicology, Oslo, Norway
| | - Ellen Fritsche
- IUF – Leibniz Research Institute for Environmental Medicine, Düsseldorf, Germany
- DNTOX GmbH, Düsseldorf, Germany
- Swiss Centre for Applied Human Toxicology, University of Basel, Basel, Switzerland
| | - Joëlle Rüegg
- Uppsala University, Department of Organismal Biology, Uppsala, Sweden
| | - Kai Craenen
- European Chemicals Agency (ECHA), Helsinki, Finland
| | | | - Caroline Agrillo
- Uppsala University, Department of Organismal Biology, Uppsala, Sweden
| | - Patrick J. Babin
- Université de Bordeaux, Institut National de la Santé et de la Recherche Médicale (INSERM), Maladies Rares: Génétique et Métabolisme (MRGM), Pessac, France
| | - Beate I. Escher
- Helmholtz Centre for Environmental Research – UFZ, Chemicals in the Environment Research Section, Leipzig, Germany
| | - Hubert Dirven
- Norwegian Institute of Public Health – NIPH, Department of Chemical Toxicology, Oslo, Norway
| | | | - Kristine Dolva
- University of Oslo, Section for Pharmacology and Pharmaceutical Biosciences, Department of Pharmacy, Olso, Norway
| | - Ellen Hessel
- Dutch Nation Institute for Public Health and the Environment (RIVM), Centre for Health Protection, Bilthoven, Netherlands
| | - Harm J. Heusinkveld
- Dutch Nation Institute for Public Health and the Environment (RIVM), Centre for Health Protection, Bilthoven, Netherlands
| | - Yavor Hadzhiev
- University of Birmingham, Centre for Environmental Research and Justice, Birmingham, UK
| | - Selma Hurem
- Norwegian University of Life Sciences (NMBU), Faculty of Veterinary Medicine, Ås, Norway
| | - Karolina Jagiello
- University of Gdansk, Laboratory of Environmental Chemoinformatics, Gdansk, Poland
| | - Beata Judzinska
- University of Gdansk, Laboratory of Environmental Chemoinformatics, Gdansk, Poland
| | - Nils Klüver
- Helmholtz Centre for Environmental Research – UFZ, Chemicals in the Environment Research Section, Leipzig, Germany
| | - Anja Knoll-Gellida
- Université de Bordeaux, Institut National de la Santé et de la Recherche Médicale (INSERM), Maladies Rares: Génétique et Métabolisme (MRGM), Pessac, France
| | - Britta A. Kühne
- University of Veterinary Medicine Hannover, Foundation, Institute for Food Quality and Food Safety, Hannover, Germany
| | - Marcel Leist
- University of Konstanz, In Vitro Toxicology and Biomedicine/CAAT-Europe, Konstanz, Germany
| | - Malene Lislien
- Norwegian Institute of Public Health – NIPH, Department of Chemical Toxicology, Oslo, Norway
| | - Jan L. Lyche
- Norwegian University of Life Sciences (NMBU), Faculty of Veterinary Medicine, Ås, Norway
| | - Ferenc Müller
- University of Birmingham, Centre for Environmental Research and Justice, Birmingham, UK
| | - John K. Colbourne
- University of Birmingham, Centre for Environmental Research and Justice, Birmingham, UK
| | - Winfried Neuhaus
- AIT Austrian Institute of Technology GmbH, Competence Unit Molecular Diagnostics, Center Health and Bioresources, Vienna, Austria
- Danube Private University, Faculty of Dentistry and Medicine, Department of Medicine, Krems, Austria
| | - Giorgia Pallocca
- University of Konstanz, In Vitro Toxicology and Biomedicine/CAAT-Europe, Konstanz, Germany
| | - Bettina Seeger
- University of Veterinary Medicine Hannover, Foundation, Institute for Food Quality and Food Safety, Hannover, Germany
| | - Ilka Scharkin
- IUF – Leibniz Research Institute for Environmental Medicine, Düsseldorf, Germany
| | - Stefan Scholz
- Helmholtz Centre for Environmental Research – UFZ, Chemicals in the Environment Research Section, Leipzig, Germany
| | - Ola Spjuth
- Uppsala University and Science for Life Laboratory, Department of Pharmaceutical Biosciences, Uppsala, Sweden
| | - Monica Torres-Ruiz
- Instituto de Salud Carlos III (ISCIII), Centro Nacional de Sanidad Ambiental (CNSA), Environmental Toxicology Unit, Majadahonda, Spain
| | - Kristina Bartmann
- IUF – Leibniz Research Institute for Environmental Medicine, Düsseldorf, Germany
- DNTOX GmbH, Düsseldorf, Germany
| |
Collapse
|
3
|
Ito S, Mukherjee S, Erami K, Muratani S, Mori A, Ichikawa S, White W, Yoshino K, Fallacara D. Proof of concept for quantitative adverse outcome pathway modeling of chronic toxicity in repeated exposure. Sci Rep 2024; 14:4741. [PMID: 38413641 PMCID: PMC10899215 DOI: 10.1038/s41598-024-55220-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Accepted: 02/21/2024] [Indexed: 02/29/2024] Open
Abstract
Adverse Outcome Pathway (AOP) is a useful tool to glean mode of action (MOE) of a chemical. However, in order to use it for the purpose of risk assessment, an AOP needs to be quantified using in vitro or in vivo data. Majority of quantitative AOPs developed so far, were for single exposure to progressively higher doses. Limited attempts were made to include time in the modeling. Here as a proof-of concept, we developed a hypothetical AOP, and quantified it using a virtual dataset for six repeated exposures using a Bayesian Network Analysis (BN) framework. The virtual data was generated using realistic assumptions. Effects of each exposure were analyzed separately using a static BN model and analyzed in combination using a dynamic BN (DBN) model. Our work shows that the DBN model can be used to calculate the probability of adverse outcome when other upstream KEs were observed earlier. These probabilities can help in identification of early indicators of AO. In addition, we also developed a data driven AOP pruning technique using a lasso-based subset selection, and show that the causal structure of AOP is itself dynamic and changes over time. This proof-of-concept study revealed the possibility for expanding the applicability of the AOP framework to incorporate biological dynamism in toxicity appearance by repeated insults.
Collapse
Affiliation(s)
- Shigeaki Ito
- Scientific Product Assessment Center, Japan Tobacco Inc., 6-2, Umegaoka, Aoba-ku, Yokohama, Kanagawa, 227-8512, Japan.
| | | | - Kazuo Erami
- Scientific Product Assessment Center, Japan Tobacco Inc., 6-2, Umegaoka, Aoba-ku, Yokohama, Kanagawa, 227-8512, Japan
| | - Shugo Muratani
- Scientific Product Assessment Center, Japan Tobacco Inc., 6-2, Umegaoka, Aoba-ku, Yokohama, Kanagawa, 227-8512, Japan
| | - Akina Mori
- Scientific Product Assessment Center, Japan Tobacco Inc., 6-2, Umegaoka, Aoba-ku, Yokohama, Kanagawa, 227-8512, Japan
| | - Sakuya Ichikawa
- Scientific Product Assessment Center, Japan Tobacco Inc., 6-2, Umegaoka, Aoba-ku, Yokohama, Kanagawa, 227-8512, Japan
| | | | - Kei Yoshino
- Scientific Product Assessment Center, Japan Tobacco Inc., 6-2, Umegaoka, Aoba-ku, Yokohama, Kanagawa, 227-8512, Japan
| | | |
Collapse
|
4
|
Zhang L, Li M, Zhang D, Zhang S, Zhang L, Wang X, Qian Z. Developmental neurotoxicity (DNT) QSAR combination prediction model establishment and structural characteristics interpretation. Toxicol Res (Camb) 2024; 13:tfad116. [PMID: 38178999 PMCID: PMC10762666 DOI: 10.1093/toxres/tfad116] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2023] [Revised: 09/14/2023] [Accepted: 11/08/2023] [Indexed: 01/06/2024] Open
Abstract
With the incidence of neurodevelopmental disorders on the rise, it is imperative to screen and evaluate developmental neurotoxicity (DNT) compounds from a large number of environmental chemicals and understand their mechanisms. In this study, DNT qualitative structure-activity relationship (QSAR) study was carried out for the first time based on DNT data of mammals and structural characterization of DNT compounds was preliminarily illustrated. Five different classification algorithms and two feature selection methods were used to construct prediction models. The best model had good predictive ability on the external test set, but a small application domain (AD). Through combining of three different models, both MCC and AD values were improved. Furthermore, electronical properties, van der Waals volume-related properties and S, Cl or P containing substructure were found to be associated with DNT through modeling descriptors analysis and structure alerts (SAs) identification. This study lays a foundation for further DNT prediction of environmental exposures in human and contributes to the understanding of DNT mechanism.
Collapse
Affiliation(s)
- Lu Zhang
- Department of Toxicology, Tianjin Centers for Disease Control and Prevention, Tianjin 300011, China
| | - Min Li
- Department of Toxicology, Tianjin Centers for Disease Control and Prevention, Tianjin 300011, China
| | - Dalong Zhang
- Department of Toxicology, Tianjin Centers for Disease Control and Prevention, Tianjin 300011, China
| | - Shujing Zhang
- Department of Toxicology, Tianjin Centers for Disease Control and Prevention, Tianjin 300011, China
| | - Li Zhang
- Department of Toxicology, Tianjin Centers for Disease Control and Prevention, Tianjin 300011, China
| | - Xiaojun Wang
- Department of Toxicology, Tianjin Centers for Disease Control and Prevention, Tianjin 300011, China
| | - Zhiyong Qian
- Department of Toxicology, Tianjin Centers for Disease Control and Prevention, Tianjin 300011, China
| |
Collapse
|
5
|
Gao J, Zhao J, Chen X, Wang J. A review on in silico prediction of the environmental risks posed by pharmaceutical emerging contaminants. ENVIRONMENTAL MONITORING AND ASSESSMENT 2023; 195:1535. [PMID: 38008816 DOI: 10.1007/s10661-023-12159-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/11/2023] [Accepted: 11/18/2023] [Indexed: 11/28/2023]
Abstract
Computer-aided (in silico) prediction has shown good potential to support the environmental risk assessment (ERA) of pharmaceutical emerging contaminants (PECs), allowing low-cost, animal-free, high-throughput screening of multiple potential risks posed by a wide variety of pharmaceuticals in the environment based on insufficient toxicity data. This review provided recent insights regarding the application of in silico approaches in prediction for environmental risks of PECs. Based on the review of 20 included articles from 8 countries published since 2018, we found that the researchers' interest and concern in this research topic were sharply aroused since 2021. Recently, in silico approaches have been widely used for the prediction of bioaccumulation and biodegradability, lethal endpoints, developmental toxicity, mutagenicity, other eco-toxicological effects such as ototoxicity and hematological toxicity, and human health hazards of exposure to PECs. Particular attention has been given to the simultaneous discernment of multiple environmental risks and health effects of PECs based on mechanistic data of pharmaceuticals using advanced bioinformatic methods such as transcriptomic analysis and network pharmacology prediction. In silico software platforms and databases used in the included studies were diversified, and there is currently no standardized and accepted in silico model for ERA of PECs. Date suggested that in silico prediction of the environmental risks posed by PECs is still in its infancy. Considerable critical challenges need to be addressed, including consideration of environmental exposure concentration for PECs, interactions among mixtures of PECs and other contaminants coexisting in environments, and development of in silico models specific to ERA of PECs.
Collapse
Affiliation(s)
- Jian Gao
- Institute of Pharmaceutical Innovation, Hubei Province Key Laboratory of Occupational Hazard Identification and Control, School of Medicine, Wuhan University of Science and Technology, Wuhan, 430065, China
| | - Jinru Zhao
- Institute of Pharmaceutical Innovation, Hubei Province Key Laboratory of Occupational Hazard Identification and Control, School of Medicine, Wuhan University of Science and Technology, Wuhan, 430065, China
| | - Xintong Chen
- Institute of Pharmaceutical Innovation, Hubei Province Key Laboratory of Occupational Hazard Identification and Control, School of Medicine, Wuhan University of Science and Technology, Wuhan, 430065, China
| | - Jun Wang
- Institute of Pharmaceutical Innovation, Hubei Province Key Laboratory of Occupational Hazard Identification and Control, School of Medicine, Wuhan University of Science and Technology, Wuhan, 430065, China.
| |
Collapse
|
6
|
Grillberger K, Cöllen E, Trivisani CI, Blum J, Leist M, Ecker GF. Structural Insights into Neonicotinoids and N-Unsubstituted Metabolites on Human nAChRs by Molecular Docking, Dynamics Simulations, and Calcium Imaging. Int J Mol Sci 2023; 24:13170. [PMID: 37685977 PMCID: PMC10487998 DOI: 10.3390/ijms241713170] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2023] [Revised: 08/10/2023] [Accepted: 08/12/2023] [Indexed: 09/10/2023] Open
Abstract
Neonicotinoid pesticides were initially designed in order to achieve species selectivity on insect nicotinic acetylcholine receptors (nAChRs). However, concerns arose when agonistic effects were also detected in human cells expressing nAChRs. In the context of next-generation risk assessments (NGRAs), new approach methods (NAMs) should replace animal testing where appropriate. Herein, we present a combination of in silico and in vitro methodologies that are used to investigate the potentially toxic effects of neonicotinoids and nicotinoid metabolites on human neurons. First, an ensemble docking study was conducted on the nAChR isoforms α7 and α3β4 to assess potential crucial molecular initiating event (MIE) interactions. Representative docking poses were further refined using molecular dynamics (MD) simulations and binding energy calculations using implicit solvent models. Finally, calcium imaging on LUHMES neurons confirmed a key event (KE) downstream of the MIE. This method was also used to confirm the predicted agonistic effect of the metabolite descyano-thiacloprid (DCNT).
Collapse
Affiliation(s)
- Karin Grillberger
- Department of Pharmaceutical Sciences, University of Vienna, 1090 Vienna, Austria
| | - Eike Cöllen
- In Vitro Toxicology and Biomedicine, University of Konstanz, 78457 Konstanz, Germany
| | | | - Jonathan Blum
- In Vitro Toxicology and Biomedicine, University of Konstanz, 78457 Konstanz, Germany
| | - Marcel Leist
- In Vitro Toxicology and Biomedicine, University of Konstanz, 78457 Konstanz, Germany
| | - Gerhard F. Ecker
- Department of Pharmaceutical Sciences, University of Vienna, 1090 Vienna, Austria
| |
Collapse
|
7
|
Suciu I, Pamies D, Peruzzo R, Wirtz PH, Smirnova L, Pallocca G, Hauck C, Cronin MTD, Hengstler JG, Brunner T, Hartung T, Amelio I, Leist M. G × E interactions as a basis for toxicological uncertainty. Arch Toxicol 2023; 97:2035-2049. [PMID: 37258688 PMCID: PMC10256652 DOI: 10.1007/s00204-023-03500-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2023] [Accepted: 04/17/2023] [Indexed: 06/02/2023]
Abstract
To transfer toxicological findings from model systems, e.g. animals, to humans, standardized safety factors are applied to account for intra-species and inter-species variabilities. An alternative approach would be to measure and model the actual compound-specific uncertainties. This biological concept assumes that all observed toxicities depend not only on the exposure situation (environment = E), but also on the genetic (G) background of the model (G × E). As a quantitative discipline, toxicology needs to move beyond merely qualitative G × E concepts. Research programs are required that determine the major biological variabilities affecting toxicity and categorize their relative weights and contributions. In a complementary approach, detailed case studies need to explore the role of genetic backgrounds in the adverse effects of defined chemicals. In addition, current understanding of the selection and propagation of adverse outcome pathways (AOP) in different biological environments is very limited. To improve understanding, a particular focus is required on modulatory and counter-regulatory steps. For quantitative approaches to address uncertainties, the concept of "genetic" influence needs a more precise definition. What is usually meant by this term in the context of G × E are the protein functions encoded by the genes. Besides the gene sequence, the regulation of the gene expression and function should also be accounted for. The widened concept of past and present "gene expression" influences is summarized here as Ge. Also, the concept of "environment" needs some re-consideration in situations where exposure timing (Et) is pivotal: prolonged or repeated exposure to the insult (chemical, physical, life style) affects Ge. This implies that it changes the model system. The interaction of Ge with Et might be denoted as Ge × Et. We provide here general explanations and specific examples for this concept and show how it could be applied in the context of New Approach Methodologies (NAM).
Collapse
Affiliation(s)
- Ilinca Suciu
- In Vitro Toxicology and Biomedicine, Department Inaugurated By the Doerenkamp-Zbinden Foundation, University of Konstanz, Universitaetsstr. 10, 78457, Constance, Germany
| | - David Pamies
- Department of Biological Sciences, University of Lausanne, 1005, Lausanne, Switzerland
| | - Roberta Peruzzo
- Department of Molecular and Cell Biology, University of California, Berkeley, CA, 94720, USA
| | - Petra H Wirtz
- Centre for the Advanced Study of Collective Behaviour, University of Konstanz, 78457, Constance, Germany
- Biological Work and Health Psychology, Department of Psychology, University of Konstanz, 78457, Constance, Germany
| | - Lena Smirnova
- Center for Alternatives to Animal Testing (CAAT), Johns Hopkins University, Bloomberg School of Public Health, Baltimore, MD, 21205, USA
| | | | - Christof Hauck
- Department of Cell Biology, University of Konstanz, 78457, Constance, Germany
| | - Mark T D Cronin
- School of Pharmacy and Biomolecular Sciences, Liverpool John Moores University, Byrom Street, Liverpool, L3 3AF, UK
| | - Jan G Hengstler
- Leibniz Research Centre for Working Environment and Human Factors, Technical University Dortmund, 44139, Dortmund, Germany
| | - Thomas Brunner
- Biochemical Pharmacology, Department of Biology, University of Konstanz, 78457, Constance, Germany
| | - Thomas Hartung
- Center for Alternatives to Animal Testing (CAAT), Johns Hopkins University, Bloomberg School of Public Health, Baltimore, MD, 21205, USA
- CAAT Europe, University of Konstanz, 78457, Constance, Germany
| | - Ivano Amelio
- Division for Systems Toxicology, Department of Biology, University of Konstanz, 78457, Constance, Germany
| | - Marcel Leist
- In Vitro Toxicology and Biomedicine, Department Inaugurated By the Doerenkamp-Zbinden Foundation, University of Konstanz, Universitaetsstr. 10, 78457, Constance, Germany.
- CAAT Europe, University of Konstanz, 78457, Constance, Germany.
| |
Collapse
|
8
|
Hinojosa MG, Johansson Y, Cediel-Ulloa A, Ivanova E, Gabring N, Gliga A, Forsby A. Evaluation of mRNA markers in differentiating human SH-SY5Y cells for estimation of developmental neurotoxicity. Neurotoxicology 2023; 97:65-77. [PMID: 37210002 DOI: 10.1016/j.neuro.2023.05.011] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Revised: 05/05/2023] [Accepted: 05/17/2023] [Indexed: 05/22/2023]
Abstract
Current guidelines for developmental neurotoxicity (DNT) evaluation are based on animal models. These have limitations so more relevant, efficient and robust approaches for DNT assessment are needed. We have used the human SH-SY5Y neuroblastoma cell model to evaluate a panel of 93 mRNA markers that are frequent in Neuronal diseases and functional annotations and also differentially expressed during retinoic acid-induced differentiation in the cell model. Rotenone, valproic acid (VPA), acrylamide (ACR) and methylmercury chloride (MeHg) were used as DNT positive compounds. Tolbutamide, D-mannitol and clofibrate were used as DNT negative compounds. To determine concentrations for exposure for gene expression analysis, we developed a pipeline for neurite outgrowth assessment by live-cell imaging. In addition, cell viability was measured by the resazurin assay. Gene expression was analyzed by RT-qPCR after 6 days of exposure during differentiation to concentrations of the DNT positive compounds that affected neurite outgrowth, but with no or minimal effect on cell viability. Methylmercury affected cell viability at lower concentrations than neurite outgrowth, hence the cells were exposed with the highest non-cytotoxic concentration. Rotenone (7.3nM) induced 32 differentially expressed genes (DEGs), ACR (70µM) 8 DEGs, and VPA (75µM) 16 DEGs. No individual genes were significantly dysregulated by all 3 DNT positive compounds (p<0.05), but 9 genes were differentially expressed by 2 of them. Methylmercury (0.8nM) was used to validate the 9 DEGs. The expression of SEMA5A (encoding semaphorin 5A) and CHRNA7 (encoding nicotinic acetylcholine receptor subunit α7) was downregulated by all 4 DNT positive compounds. None of the DNT negative compounds dysregulated any of the 9 DEGs in common for the DNT positive compounds. We suggest that SEMA5A or CHRNA7 should be further evaluated as biomarkers for DNT studies in vitro since they also are involved in neurodevelopmental adverse outcomes in humans.
Collapse
Affiliation(s)
- M G Hinojosa
- Department of Biochemistry and Biophysics, Stockholm University, 106 91, Stockholm, Sweden
| | - Y Johansson
- Department of Biochemistry and Biophysics, Stockholm University, 106 91, Stockholm, Sweden
| | - A Cediel-Ulloa
- Department of Organismal Biology, Environmental Toxicology, Uppsala University, 752 36, Uppsala, Sweden
| | - E Ivanova
- Department of Biochemistry and Biophysics, Stockholm University, 106 91, Stockholm, Sweden
| | - N Gabring
- Department of Biochemistry and Biophysics, Stockholm University, 106 91, Stockholm, Sweden
| | - A Gliga
- Institute of Environmental Medicine, Karolinska Institute, Stockholm, 171 77, Sweden
| | - A Forsby
- Department of Biochemistry and Biophysics, Stockholm University, 106 91, Stockholm, Sweden
| |
Collapse
|
9
|
Fucic A, Mantovani A, Vena J, Bloom MS, Sincic N, Vazquez M, Aguado-Sierra J. Impact of endocrine disruptors from mother's diet on immuno-hormonal orchestration of brain development and introduction of the virtual human twin tool. Reprod Toxicol 2023; 117:108357. [PMID: 36863570 DOI: 10.1016/j.reprotox.2023.108357] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Revised: 02/19/2023] [Accepted: 02/22/2023] [Indexed: 03/04/2023]
Abstract
Diet has long been known to modify physiology during development and adulthood. However, due to a growing number of manufactured contaminants and additives over the last few decades, diet has increasingly become a source of exposure to chemicals that has been associated with adverse health risks. Sources of food contaminants include the environment, crops treated with agrochemicals, inappropriate storage (e.g., mycotoxins) and migration of xenobiotics from food packaging and food production equipment. Hence, consumers are exposed to a mixture of xenobiotics, some of which are endocrine disruptors (EDs). The complex interactions between immune function and brain development and their orchestration by steroid hormones are insufficiently understood in human populations, and little is known about the impact on immune-brain interactions by transplacental fetal exposure to EDs via maternal diet. To help to identify the key data gaps, this paper aims to present (a) how transplacental EDs modify immune system and brain development, and (b) how these mechanisms may correlate with diseases such as autism and disturbances of lateral brain development. Attention is given to disturbances of the subplate, a transient structure of crucial significance in brain development. Additionally, we describe cutting edge approaches to investigate the developmental neurotoxicity of EDs, such as the application of artificial intelligence and comprehensive modelling. In the future, highly complex investigations will be performed using virtual brain models constructed using sophisticated multi-physics/multi-scale modelling strategies based on patient and synthetic data, which will enable a greater understanding of healthy or disturbed brain development.
Collapse
Affiliation(s)
- A Fucic
- Institute for Medical Research and Occupational Health, Ksaverska C 2, Zagreb, Croatia.
| | - A Mantovani
- Istituto Superiore di Sanità, Department of Food Safety, Nutrition and Veterinary Public Health, Rome, Italy
| | - J Vena
- Public Health Sciences, Medical University of South Carolina, Charleston, SC, USA
| | - M S Bloom
- Global and Community Health, George Mason University, 4400 University Dr., Fairfax, VA, USA
| | - N Sincic
- Medical School, University of Zagreb, Salata 3, Croatia
| | - M Vazquez
- Barcelona Supercomputing Center, Plaça Eusebi Güell, 1-3, Barcelona 08034, Spain
| | - J Aguado-Sierra
- Barcelona Supercomputing Center, Plaça Eusebi Güell, 1-3, Barcelona 08034, Spain
| |
Collapse
|
10
|
Bajard L, Adamovsky O, Audouze K, Baken K, Barouki R, Beltman JB, Beronius A, Bonefeld-Jørgensen EC, Cano-Sancho G, de Baat ML, Di Tillio F, Fernández MF, FitzGerald RE, Gundacker C, Hernández AF, Hilscherova K, Karakitsios S, Kuchovska E, Long M, Luijten M, Majid S, Marx-Stoelting P, Mustieles V, Negi CK, Sarigiannis D, Scholz S, Sovadinova I, Stierum R, Tanabe S, Tollefsen KE, van den Brand AD, Vogs C, Wielsøe M, Wittwehr C, Blaha L. Application of AOPs to assist regulatory assessment of chemical risks - Case studies, needs and recommendations. ENVIRONMENTAL RESEARCH 2023; 217:114650. [PMID: 36309218 PMCID: PMC9850416 DOI: 10.1016/j.envres.2022.114650] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/02/2022] [Revised: 10/18/2022] [Accepted: 10/21/2022] [Indexed: 05/06/2023]
Abstract
While human regulatory risk assessment (RA) still largely relies on animal studies, new approach methodologies (NAMs) based on in vitro, in silico or non-mammalian alternative models are increasingly used to evaluate chemical hazards. Moreover, human epidemiological studies with biomarkers of effect (BoE) also play an invaluable role in identifying health effects associated with chemical exposures. To move towards the next generation risk assessment (NGRA), it is therefore crucial to establish bridges between NAMs and standard approaches, and to establish processes for increasing mechanistically-based biological plausibility in human studies. The Adverse Outcome Pathway (AOP) framework constitutes an important tool to address these needs but, despite a significant increase in knowledge and awareness, the use of AOPs in chemical RA remains limited. The objective of this paper is to address issues related to using AOPs in a regulatory context from various perspectives as it was discussed in a workshop organized within the European Union partnerships HBM4EU and PARC in spring 2022. The paper presents examples where the AOP framework has been proven useful for the human RA process, particularly in hazard prioritization and characterization, in integrated approaches to testing and assessment (IATA), and in the identification and validation of BoE in epidemiological studies. Nevertheless, several limitations were identified that hinder the optimal usability and acceptance of AOPs by the regulatory community including the lack of quantitative information on response-response relationships and of efficient ways to map chemical data (exposure and toxicity) onto AOPs. The paper summarizes suggestions, ongoing initiatives and third-party tools that may help to overcome these obstacles and thus assure better implementation of AOPs in the NGRA.
Collapse
Affiliation(s)
- Lola Bajard
- RECETOX, Faculty of Science, Masaryk University, Kotlarska 2, 611 37 Brno, Czech Republic
| | - Ondrej Adamovsky
- RECETOX, Faculty of Science, Masaryk University, Kotlarska 2, 611 37 Brno, Czech Republic
| | - Karine Audouze
- Université Paris Cité, T3S, Inserm UMR S-1124, F-75006 Paris, France
| | - Kirsten Baken
- Unit Health, Flemish Institute for Technological Research (VITO NV), Boeretang 200, 2400 Mol, Belgium
| | - Robert Barouki
- Université Paris Cité, T3S, Inserm UMR S-1124, F-75006 Paris, France
| | - Joost B Beltman
- Division of Drug Discovery and Safety, Leiden Academic Centre for Drug Research, Leiden University, Leiden, Netherlands
| | - Anna Beronius
- Institute of Environmental Medicine, Karolinska Institutet, Nobels väg 13, Solna, Sweden
| | - Eva Cecilie Bonefeld-Jørgensen
- Centre for Arctic Health & Molecular Epidemiology, Department of Public Health, Aarhus University, Bartholins Allé 2, 8000 Aarhus, Denmark; Greenland Centre for Health Research, University of Greenland, Manutooq 1, 3905 Nuussuaq, Greenland
| | | | - Milo L de Baat
- KWR Water Research Institute, Groningenhaven 7, 3433 PE Nieuwegein, the Netherlands
| | - Filippo Di Tillio
- Division of Drug Discovery and Safety, Leiden Academic Centre for Drug Research, Leiden University, Leiden, Netherlands
| | - Mariana F Fernández
- Center for Biomedical Research (CIBM) & School of Medicine, University of Granada, 18016 Granada, Spain; Instituto de Investigación Biosanitaria (ibs. GRANADA), 18012, Granada, Spain; Consortium for Biomedical Research in Epidemiology and Public Health (CIBERESP), 28029 Madrid, Spain
| | - Rex E FitzGerald
- Swiss Centre for Applied Human Toxicology SCAHT, University of Basel, Missionsstrasse 64, CH-4055 Basel, Switzerland
| | - Claudia Gundacker
- Institute of Medical Genetics, Center for Pathobiochemistry and Genetics, Medical University of Vienna, 1090 Vienna, Austria
| | - Antonio F Hernández
- Instituto de Investigación Biosanitaria (ibs. GRANADA), 18012, Granada, Spain; Department of Legal Medicine and Toxicology, University of Granada School of Medicine, Avda. de la Investigación, 11, 18016, Granada, Spain; Consortium for Biomedical Research in Epidemiology & Public Health, CIBERESP, Madrid, Spain
| | - Klara Hilscherova
- RECETOX, Faculty of Science, Masaryk University, Kotlarska 2, 611 37 Brno, Czech Republic
| | - Spyros Karakitsios
- Environmental Engineering Laboratory, Department of Chemical Engineering, Aristotle University of Thessaloniki, Thessaloniki, Greece; HERACLES Research Centre on the Exposome and Health, Center for Interdisciplinary Research and Innovation, Thessaloniki, Greece
| | - Eliska Kuchovska
- IUF-Leibniz Research Institute for Environmental Medicine, Auf'm Hennekamp 50, 40225, Duesseldorf, Germany
| | - Manhai Long
- Centre for Arctic Health & Molecular Epidemiology, Department of Public Health, Aarhus University, Bartholins Allé 2, 8000 Aarhus, Denmark
| | - Mirjam Luijten
- National Institute for Public Health and the Environment (RIVM), Centre for Health Protection, Bilthoven, the Netherlands
| | - Sanah Majid
- KWR Water Research Institute, Groningenhaven 7, 3433 PE Nieuwegein, the Netherlands
| | - Philip Marx-Stoelting
- German Federal Institute for Risk Assessment, Dept. Pesticides Safety, Berlin, Germany
| | - Vicente Mustieles
- Center for Biomedical Research (CIBM) & School of Medicine, University of Granada, 18016 Granada, Spain; Instituto de Investigación Biosanitaria (ibs. GRANADA), 18012, Granada, Spain; Consortium for Biomedical Research in Epidemiology and Public Health (CIBERESP), 28029 Madrid, Spain
| | - Chander K Negi
- RECETOX, Faculty of Science, Masaryk University, Kotlarska 2, 611 37 Brno, Czech Republic
| | - Dimosthenis Sarigiannis
- Environmental Engineering Laboratory, Department of Chemical Engineering, Aristotle University of Thessaloniki, Thessaloniki, Greece; HERACLES Research Centre on the Exposome and Health, Center for Interdisciplinary Research and Innovation, Thessaloniki, Greece
| | - Stefan Scholz
- UFZ Helmholtz Center for Environmental Research, Dept Bioanalyt Ecotoxicol, D-04318 Leipzig, Germany
| | - Iva Sovadinova
- RECETOX, Faculty of Science, Masaryk University, Kotlarska 2, 611 37 Brno, Czech Republic
| | - Rob Stierum
- Netherlands Organisation for Applied Scientific Research, Risk Analysis for Products in Development, Utrecht, the Netherlands
| | - Shihori Tanabe
- Division of Risk Assessment, Center for Biological Safety and Research, National Institute of Health Sciences, Kawasaki, Japan
| | - Knut Erik Tollefsen
- Norwegian Institute for Water Research (NIVA), Section of Ecotoxicology and Risk Assessment, Gaustadalléen, Oslo, Norway; Norwegian University of Life Sciences (NMBU), Faculty of Environmental Sciences and Natural Resource Management (MINA), Norway
| | - Annick D van den Brand
- Institute for Public Health and the Environment (RIVM), Centre for Nutrition, Prevention and Health Services, 3720 BA Bilthoven, the Netherlands
| | - Carolina Vogs
- Institute of Environmental Medicine, Karolinska Institutet, Nobels väg 13, Solna, Sweden; Department of Biomedical Sciences and Veterinary Public Health, Swedish University of Agricultural Sciences, SE-75007 Uppsala, Sweden
| | - Maria Wielsøe
- Centre for Arctic Health & Molecular Epidemiology, Department of Public Health, Aarhus University, Bartholins Allé 2, 8000 Aarhus, Denmark
| | | | - Ludek Blaha
- RECETOX, Faculty of Science, Masaryk University, Kotlarska 2, 611 37 Brno, Czech Republic.
| |
Collapse
|
11
|
Saarimäki LA, Morikka J, Pavel A, Korpilähde S, del Giudice G, Federico A, Fratello M, Serra A, Greco D. Toxicogenomics Data for Chemical Safety Assessment and Development of New Approach Methodologies: An Adverse Outcome Pathway-Based Approach. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2023; 10:e2203984. [PMID: 36479815 PMCID: PMC9839874 DOI: 10.1002/advs.202203984] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/11/2022] [Revised: 11/09/2022] [Indexed: 05/25/2023]
Abstract
Mechanistic toxicology provides a powerful approach to inform on the safety of chemicals and the development of safe-by-design compounds. Although toxicogenomics supports mechanistic evaluation of chemical exposures, its implementation into the regulatory framework is hindered by uncertainties in the analysis and interpretation of such data. The use of mechanistic evidence through the adverse outcome pathway (AOP) concept is promoted for the development of new approach methodologies (NAMs) that can reduce animal experimentation. However, to unleash the full potential of AOPs and build confidence into toxicogenomics, robust associations between AOPs and patterns of molecular alteration need to be established. Systematic curation of molecular events to AOPs will create the much-needed link between toxicogenomics and systemic mechanisms depicted by the AOPs. This, in turn, will introduce novel ways of benefitting from the AOPs, including predictive models and targeted assays, while also reducing the need for multiple testing strategies. Hence, a multi-step strategy to annotate AOPs is developed, and the resulting associations are applied to successfully highlight relevant adverse outcomes for chemical exposures with strong in vitro and in vivo convergence, supporting chemical grouping and other data-driven approaches. Finally, a panel of AOP-derived in vitro biomarkers for pulmonary fibrosis (PF) is identified and experimentally validated.
Collapse
Affiliation(s)
- Laura Aliisa Saarimäki
- Finnish Hub for Development and Validation of Integrated Approaches (FHAIVE)Faculty of Medicine and Health TechnologyTampere UniversityArvo Ylpön katu 34Tampere33520Finland
| | - Jack Morikka
- Finnish Hub for Development and Validation of Integrated Approaches (FHAIVE)Faculty of Medicine and Health TechnologyTampere UniversityArvo Ylpön katu 34Tampere33520Finland
| | - Alisa Pavel
- Finnish Hub for Development and Validation of Integrated Approaches (FHAIVE)Faculty of Medicine and Health TechnologyTampere UniversityArvo Ylpön katu 34Tampere33520Finland
| | - Seela Korpilähde
- Finnish Hub for Development and Validation of Integrated Approaches (FHAIVE)Faculty of Medicine and Health TechnologyTampere UniversityArvo Ylpön katu 34Tampere33520Finland
| | - Giusy del Giudice
- Finnish Hub for Development and Validation of Integrated Approaches (FHAIVE)Faculty of Medicine and Health TechnologyTampere UniversityArvo Ylpön katu 34Tampere33520Finland
| | - Antonio Federico
- Finnish Hub for Development and Validation of Integrated Approaches (FHAIVE)Faculty of Medicine and Health TechnologyTampere UniversityArvo Ylpön katu 34Tampere33520Finland
| | - Michele Fratello
- Finnish Hub for Development and Validation of Integrated Approaches (FHAIVE)Faculty of Medicine and Health TechnologyTampere UniversityArvo Ylpön katu 34Tampere33520Finland
| | - Angela Serra
- Finnish Hub for Development and Validation of Integrated Approaches (FHAIVE)Faculty of Medicine and Health TechnologyTampere UniversityArvo Ylpön katu 34Tampere33520Finland
- Tampere Institute for Advanced StudyTampere UniversityKalevantie 4Tampere33100Finland
| | - Dario Greco
- Finnish Hub for Development and Validation of Integrated Approaches (FHAIVE)Faculty of Medicine and Health TechnologyTampere UniversityArvo Ylpön katu 34Tampere33520Finland
- Institute of BiotechnologyUniversity of HelsinkiP.O.Box 56HelsinkiUusimaa00014Finland
| |
Collapse
|
12
|
de Leeuw VC, van Oostrom CTM, Wackers PFK, Pennings JLA, Hodemaekers HM, Piersma AH, Hessel EVS. Neuronal differentiation pathways and compound-induced developmental neurotoxicity in the human neural progenitor cell test (hNPT) revealed by RNA-seq. CHEMOSPHERE 2022; 304:135298. [PMID: 35700809 PMCID: PMC9247748 DOI: 10.1016/j.chemosphere.2022.135298] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/18/2022] [Revised: 05/30/2022] [Accepted: 06/08/2022] [Indexed: 05/27/2023]
Abstract
There is an increased awareness that the use of animals for compound-induced developmental neurotoxicity (DNT) testing has limitations. Animal-free innovations, especially the ones based on human stem cell-based models are pivotal in studying DNT since they can mimic processes relevant to human brain development. Here we present the human neural progenitor test (hNPT), a 10-day protocol in which neural progenitor cells differentiate into a neuron-astrocyte co-culture. The study aimed to characterise differentiation over time and to find neurodevelopmental processes sensitive to compound exposure using transcriptomics. 3992 genes regulated in unexposed control cultures (p ≤ 0.001, log2FC ≥ 1) showed Gene Ontology (GO-) term enrichment for neuronal and glial differentiation, neurite extension, synaptogenesis, and synaptic transmission. Exposure to known or suspected DNT compounds (acrylamide, chlorpyrifos, fluoxetine, methyl mercury, or valproic acid) at concentrations resulting in 95% cell viability each regulated unique combinations of GO-terms relating to neural progenitor proliferation, neuronal and glial differentiation, axon development, synaptogenesis, synaptic transmission, and apoptosis. Investigation of the GO-terms 'neuron apoptotic process' and 'axon development' revealed common genes that were responsive across compounds, and might be used as biomarkers for DNT. The GO-term 'synaptic signalling', on the contrary, whilst also responsive to all compounds tested, showed little overlap in gene expression regulation patterns between the conditions. This GO-term may articulate compound-specific effects that may be relevant for revealing differences in mechanism of toxicity. Given its focus on neural progenitor cell to mature multilineage neuronal cell maturation and its detailed molecular readout based on gene expression analysis, hNPT might have added value as a tool for neurodevelopmental toxicity testing in vitro. Further assessment of DNT-specific biomarkers that represent these processes needs further studies.
Collapse
Affiliation(s)
- Victoria C de Leeuw
- Centre for Health Protection, National Institute for Public Health and the Environment (RIVM), Bilthoven, the Netherlands; Institute for Risk Assessment Sciences (IRAS), Utrecht University, Utrecht, the Netherlands.
| | - Conny T M van Oostrom
- Centre for Health Protection, National Institute for Public Health and the Environment (RIVM), Bilthoven, the Netherlands
| | - Paul F K Wackers
- Centre for Health Protection, National Institute for Public Health and the Environment (RIVM), Bilthoven, the Netherlands
| | - Jeroen L A Pennings
- Centre for Health Protection, National Institute for Public Health and the Environment (RIVM), Bilthoven, the Netherlands
| | - Hennie M Hodemaekers
- Centre for Health Protection, National Institute for Public Health and the Environment (RIVM), Bilthoven, the Netherlands
| | - Aldert H Piersma
- Centre for Health Protection, National Institute for Public Health and the Environment (RIVM), Bilthoven, the Netherlands; Institute for Risk Assessment Sciences (IRAS), Utrecht University, Utrecht, the Netherlands
| | - Ellen V S Hessel
- Centre for Health Protection, National Institute for Public Health and the Environment (RIVM), Bilthoven, the Netherlands
| |
Collapse
|