1
|
Fu G, Savic D, Butler D. Making Waves: Towards data-centric water engineering. WATER RESEARCH 2024; 256:121585. [PMID: 38598949 DOI: 10.1016/j.watres.2024.121585] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/08/2023] [Revised: 02/14/2024] [Accepted: 04/07/2024] [Indexed: 04/12/2024]
Abstract
Artificial intelligence (AI) is expected to transform many scientific disciplines, with the potential to significantly accelerate scientific discovery. This perspective calls for the development of data-centric water engineering to tackle water challenges in a changing world. Building on the historical evolution of water engineering from empirical and theoretical paradigms to the current computational paradigm, we argue that a fourth paradigm, i.e., data-centric water engineering, is emerging driven by recent AI advances. Here we define a new framework for data-centric water engineering in which data are transformed into knowledge and insight through a data pipeline powered by AI technologies. It is proposed that data-centric water engineering embraces three principles - data-first, integration and decision making. We envision that the development of data-centric water engineering needs an interdisciplinary research community, a shift in mindset and culture in the academia and water industry, and an ethical and risk framework to guide the development and application of AI. We hope this paper could inspire research and development that will accelerate the paradigm shift towards data-centric water engineering in the water sector and fundamentally transform the planning and management of water infrastructure.
Collapse
Affiliation(s)
- Guangtao Fu
- Centre for Water Systems, University of Exeter, Exeter EX4 4QF, United Kingdom.
| | - Dragan Savic
- Centre for Water Systems, University of Exeter, Exeter EX4 4QF, United Kingdom; KWR Water Research Institute, Niuwegein 3430 BB, the Netherlands
| | - David Butler
- Centre for Water Systems, University of Exeter, Exeter EX4 4QF, United Kingdom
| |
Collapse
|
2
|
Wang X, Fu G, Ren NQ. Artificial intelligence is transforming the research paradigm of environmental science and engineering. ENVIRONMENTAL SCIENCE AND ECOTECHNOLOGY 2024; 19:100346. [PMID: 38058954 PMCID: PMC10696158 DOI: 10.1016/j.ese.2023.100346] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/08/2023]
Affiliation(s)
- Xu Wang
- State Key Laboratory of Urban Water Resource and Environment, School of Civil and Environmental Engineering, Harbin Institute of Technology, Shenzhen, Shenzhen, 518055, China
| | - Guangtao Fu
- Centre for Water Systems, College of Engineering, Mathematics and Physical Sciences, University of Exeter, Exeter, EX4 4QF, United Kingdom
| | - Nan-Qi Ren
- State Key Laboratory of Urban Water Resource and Environment, School of Civil and Environmental Engineering, Harbin Institute of Technology, Shenzhen, Shenzhen, 518055, China
| |
Collapse
|
3
|
Xu B, Yu H, Shi Z, Liu J, Wei Y, Zhang Z, Huangfu Y, Xu H, Li Y, Zhang L, Feng Y, Shi G. Knowledge-guided machine learning reveals pivotal drivers for gas-to-particle conversion of atmospheric nitrate. ENVIRONMENTAL SCIENCE AND ECOTECHNOLOGY 2024; 19:100333. [PMID: 38021366 PMCID: PMC10661687 DOI: 10.1016/j.ese.2023.100333] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/07/2023] [Revised: 10/09/2023] [Accepted: 10/12/2023] [Indexed: 12/01/2023]
Abstract
Particulate nitrate, a key component of fine particles, forms through the intricate gas-to-particle conversion process. This process is regulated by the gas-to-particle conversion coefficient of nitrate (ε(NO3-)). The mechanism between ε(NO3-) and its drivers is highly complex and nonlinear, and can be characterized by machine learning methods. However, conventional machine learning often yields results that lack clear physical meaning and may even contradict established physical/chemical mechanisms due to the influence of ambient factors. It urgently needs an alternative approach that possesses transparent physical interpretations and provides deeper insights into the impact of ε(NO3-). Here we introduce a supervised machine learning approach-the multilevel nested random forest guided by theory approaches. Our approach robustly identifies NH4+, SO42-, and temperature as pivotal drivers for ε(NO3-). Notably, substantial disparities exist between the outcomes of traditional random forest analysis and the anticipated actual results. Furthermore, our approach underscores the significance of NH4+ during both daytime (30%) and nighttime (40%) periods, while appropriately downplaying the influence of some less relevant drivers in comparison to conventional random forest analysis. This research underscores the transformative potential of integrating domain knowledge with machine learning in atmospheric studies.
Collapse
Affiliation(s)
- Bo Xu
- State Environmental Protection Key Laboratory of Urban Ambient Air Particulate Matter Pollution Prevention and Control, Tianjin Key Laboratory of Urban Transport Emission Research, College of Environmental Science and Engineering, Nankai University, Tianjin, 300350, China
- CMA-NKU Cooperative Laboratory for Atmospheric Environment-Health Research (CLAER), College of Environmental Science and Engineering, Nankai University, Tianjin, 300350, China
| | - Haofei Yu
- Department of Civil, Environmental, and Construction Engineering, University of Central Florida, Orlando, FL, USA
| | - Zongbo Shi
- School of Geography Earth and Environment Sciences, University of Birmingham, Birmingham, B15 2TT, UK
| | - Jinxing Liu
- State Key Laboratory of Precision Measuring Technology and Instruments, Tianjin Key Laboratory of air Pollutants Monitoring Technology, School of Precision Instrument and Opto-electronics Engineering, Tianjin University, Tianjin, 300072, China
- Gigantic Technology (Tianjin) Co., Ltd, Tianjin, 300072, China
| | - Yuting Wei
- State Environmental Protection Key Laboratory of Urban Ambient Air Particulate Matter Pollution Prevention and Control, Tianjin Key Laboratory of Urban Transport Emission Research, College of Environmental Science and Engineering, Nankai University, Tianjin, 300350, China
- CMA-NKU Cooperative Laboratory for Atmospheric Environment-Health Research (CLAER), College of Environmental Science and Engineering, Nankai University, Tianjin, 300350, China
| | - Zhongcheng Zhang
- State Environmental Protection Key Laboratory of Urban Ambient Air Particulate Matter Pollution Prevention and Control, Tianjin Key Laboratory of Urban Transport Emission Research, College of Environmental Science and Engineering, Nankai University, Tianjin, 300350, China
- CMA-NKU Cooperative Laboratory for Atmospheric Environment-Health Research (CLAER), College of Environmental Science and Engineering, Nankai University, Tianjin, 300350, China
| | - Yanqi Huangfu
- State Environmental Protection Key Laboratory of Urban Ambient Air Particulate Matter Pollution Prevention and Control, Tianjin Key Laboratory of Urban Transport Emission Research, College of Environmental Science and Engineering, Nankai University, Tianjin, 300350, China
- CMA-NKU Cooperative Laboratory for Atmospheric Environment-Health Research (CLAER), College of Environmental Science and Engineering, Nankai University, Tianjin, 300350, China
| | - Han Xu
- State Environmental Protection Key Laboratory of Urban Ambient Air Particulate Matter Pollution Prevention and Control, Tianjin Key Laboratory of Urban Transport Emission Research, College of Environmental Science and Engineering, Nankai University, Tianjin, 300350, China
- CMA-NKU Cooperative Laboratory for Atmospheric Environment-Health Research (CLAER), College of Environmental Science and Engineering, Nankai University, Tianjin, 300350, China
| | - Yue Li
- College of Computer Science, Nankai University, Tianjin, 300350, China
| | - Linlin Zhang
- China National Environmental Monitoring Centre, Beijing, 100012, China
| | - Yinchang Feng
- State Environmental Protection Key Laboratory of Urban Ambient Air Particulate Matter Pollution Prevention and Control, Tianjin Key Laboratory of Urban Transport Emission Research, College of Environmental Science and Engineering, Nankai University, Tianjin, 300350, China
- CMA-NKU Cooperative Laboratory for Atmospheric Environment-Health Research (CLAER), College of Environmental Science and Engineering, Nankai University, Tianjin, 300350, China
| | - Guoliang Shi
- State Environmental Protection Key Laboratory of Urban Ambient Air Particulate Matter Pollution Prevention and Control, Tianjin Key Laboratory of Urban Transport Emission Research, College of Environmental Science and Engineering, Nankai University, Tianjin, 300350, China
- CMA-NKU Cooperative Laboratory for Atmospheric Environment-Health Research (CLAER), College of Environmental Science and Engineering, Nankai University, Tianjin, 300350, China
| |
Collapse
|
4
|
Zhi W, Appling AP, Golden HE, Podgorski J, Li L. Deep learning for water quality. NATURE WATER 2024; 2:228-241. [PMID: 38846520 PMCID: PMC11151732 DOI: 10.1038/s44221-024-00202-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/13/2023] [Accepted: 01/10/2024] [Indexed: 06/09/2024]
Abstract
Understanding and predicting the quality of inland waters are challenging, particularly in the context of intensifying climate extremes expected in the future. These challenges arise partly due to complex processes that regulate water quality, and arduous and expensive data collection that exacerbate the issue of data scarcity. Traditional process-based and statistical models often fall short in predicting water quality. In this Review, we posit that deep learning represents an underutilized yet promising approach that can unravel intricate structures and relationships in high-dimensional data. We demonstrate that deep learning methods can help address data scarcity by filling temporal and spatial gaps and aid in formulating and testing hypotheses via identifying influential drivers of water quality. This Review highlights the strengths and limitations of deep learning methods relative to traditional approaches, and underscores its potential as an emerging and indispensable approach in overcoming challenges and discovering new knowledge in water-quality sciences.
Collapse
Affiliation(s)
- Wei Zhi
- The National Key Laboratory of Water Disaster Prevention, Yangtze Institute for Conservation and Development, Key Laboratory of Hydrologic-Cycle and Hydrodynamic-System of Ministry of Water Resources, Hohai University, Nanjing, China
- Department of Civil and Environmental Engineering, The Pennsylvania State University, University Park, PA, USA
| | | | - Heather E Golden
- Office of Research and Development, US Environmental Protection Agency, Cincinnati, OH, USA
| | - Joel Podgorski
- Department of Water Resources and Drinking Water, Swiss Federal Institute of Aquatic Science and Technology (EAWAG), Dübendorf, Switzerland
| | - Li Li
- Department of Civil and Environmental Engineering, The Pennsylvania State University, University Park, PA, USA
| |
Collapse
|
5
|
Li Z, Liu H, Zhang C, Fu G. Real-time water quality prediction in water distribution networks using graph neural networks with sparse monitoring data. WATER RESEARCH 2024; 250:121018. [PMID: 38113592 DOI: 10.1016/j.watres.2023.121018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/07/2023] [Revised: 11/07/2023] [Accepted: 12/12/2023] [Indexed: 12/21/2023]
Abstract
Ensuring the safety and reliability of drinking water supply requires accurate prediction of water quality in water distribution networks (WDNs). However, existing hydraulic model-based approaches for system state prediction face challenges in model calibration with limited sensor data and intensive computing requirements, while current machine learning models are lack of capacity to predict the system states at sites that are not monitored or included in model training. To address these gaps, this study proposes a novel gated graph neural network (GGNN) model for real-time water quality prediction in WDNs. The GGNN model integrates hydraulic flow directions and water quality data to represent the topology and system dynamics, and employs a masking operation for training to enhance prediction accuracy. Evaluation results from a real-world WDN demonstrate that the GGNN model is capable to achieve accurate water quality prediction across the entire WDN. Despite being trained with water quality data from a limited number of sensor sites, the model can achieve high predictive accuracies (Mean Absolute Error = 0.07 mg L-1 and Mean Absolute Percentage Error = 10.0 %) across the entire network including those unmonitored sites. Furthermore, water quality-based sensor placement significantly improves predictive accuracy, emphasizing the importance of careful sensor location selection. This research advances water quality prediction in WDNs by offering a practical and effective machine learning solution to address challenges related to limited sensor data and network complexity. This study provides a first step towards developing machine learning models to replace hydraulic models in WDN modelling.
Collapse
Affiliation(s)
- Zilin Li
- Department of Hydraulic Engineering, Dalian University of Technology, Dalian, Liaoning 116024, China; Centre for Water Systems, University of Exeter, Exeter EX4 4QF, United Kingdom
| | - Haixing Liu
- Department of Hydraulic Engineering, Dalian University of Technology, Dalian, Liaoning 116024, China.
| | - Chi Zhang
- Department of Hydraulic Engineering, Dalian University of Technology, Dalian, Liaoning 116024, China
| | - Guangtao Fu
- Centre for Water Systems, University of Exeter, Exeter EX4 4QF, United Kingdom.
| |
Collapse
|
6
|
Li Z, Liu H, Zhang C, Fu G. Gated graph neural networks for identifying contamination sources in water distribution systems. JOURNAL OF ENVIRONMENTAL MANAGEMENT 2024; 351:119806. [PMID: 38118345 DOI: 10.1016/j.jenvman.2023.119806] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Revised: 11/20/2023] [Accepted: 12/06/2023] [Indexed: 12/22/2023]
Abstract
Contamination events in water distribution networks (WDN) pose significant threats to water supply and public health. Rapid and accurate contamination source identification (CSI) can facilitate the development of remedial measures to reduce impacts. Though many machine learning (ML) methods have been proposed for fast detection, there is a critical need for approaches capturing complex spatial dynamics in WDNs to enhance prediction accuracy. This study proposes a gated graph neural network (GGNN) for CSI in the WDN, incorporating both spatiotemporal water quality data and flow directionality between network nodes. Evaluated across various contamination scenarios, the GGNN demonstrates high prediction accuracy even with limited sensor coverage. Notably, directional connections significantly enhance the GGNN CSI accuracy, underscoring the importance of network topology and flow dynamics in ML-based WDN CSI approaches. Specifically, the method achieves a 92.27% accuracy in narrowing the contamination source to 5 points using just 2 h of sensor data. The GGNN showcases resilience under model and measurement uncertainties, reaffirming its potential for real-time implementation in practice. Moreover, our findings highlight the impact of sensor sampling frequency and measurement accuracy on CSI accuracy, offering practical insights for ML methods in water network applications.
Collapse
Affiliation(s)
- Zilin Li
- Department of Hydraulic Engineering, Dalian University of Technology, Dalian, Liaoning, 116024, China
| | - Haixing Liu
- Department of Hydraulic Engineering, Dalian University of Technology, Dalian, Liaoning, 116024, China.
| | - Chi Zhang
- Department of Hydraulic Engineering, Dalian University of Technology, Dalian, Liaoning, 116024, China
| | - Guangtao Fu
- Centre for Water Systems, University of Exeter, Exeter, EX4 4QF, UK
| |
Collapse
|