1
|
Bixler TS, Collins MR, Mo W. Risk-based public health impact assessment for drinking water contamination emergencies. THE SCIENCE OF THE TOTAL ENVIRONMENT 2024; 931:172966. [PMID: 38705288 DOI: 10.1016/j.scitotenv.2024.172966] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/17/2024] [Revised: 05/01/2024] [Accepted: 05/01/2024] [Indexed: 05/07/2024]
Abstract
Chemical spills in surface waters pose a significant threat to public health and the environment. This study investigates the public health impacts associated with organic chemical spill emergencies and explores timely countermeasures deployable by drinking water facilities. Using a dynamic model of a typical multi-sourced New England drinking water treatment facility and its distribution network, this study assesses the impacts of various countermeasure deployment scenarios, including source switching, enhanced coagulation via poly‑aluminum chloride (PACl), addition of powdered activated carbon (PAC), and temporary system shutdown. This study reveals that the deployment of multiple countermeasures yields the most significant reduction in total public health impacts, regardless of the demand and supply availability. With the combination PAC deployed first with other countermeasures proving to be the most effective strategies, followed by the combination of facility shutdowns. By understanding the potential public health impacts and evaluating the effectiveness of countermeasures, authorities can develop proactive plans, secure additional funding, and enhance their capacity to mitigate the consequences of such events. These insights contribute to safeguarding public health and improving the resilience of drinking water systems in the face of the ever-growing threat of chemical spills.
Collapse
Affiliation(s)
- Taler S Bixler
- Department of Civil and Environmental Engineering, University of New Hampshire, Durham, NH 03824, United States
| | - M Robin Collins
- Department of Civil and Environmental Engineering, University of New Hampshire, Durham, NH 03824, United States
| | - Weiwei Mo
- Department of Civil and Environmental Engineering, University of New Hampshire, Durham, NH 03824, United States.
| |
Collapse
|
2
|
Liao Z, Zhang M, Chen Y, Zhang Z, Wang H. A "Prediction - Detection - Judgment" framework for sudden water contamination event detection with online monitoring. JOURNAL OF ENVIRONMENTAL MANAGEMENT 2024; 355:120496. [PMID: 38437742 DOI: 10.1016/j.jenvman.2024.120496] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/16/2023] [Revised: 02/16/2024] [Accepted: 02/22/2024] [Indexed: 03/06/2024]
Abstract
The contamination detection technology helps in water quality management and protection in surface water. It is important to detect sudden contamination events timely from dynamic variations due to various interference factors in online water quality monitoring data. In this study, a framework named "Prediction - Detection - Judgment" is proposed with a method framework of "Time series increment - Hierarchical clustering - Bayes' theorem model". Time to detection is used as an evaluation index of contamination detection methods, along with the probability of detection and false alarm rate. The proposed method is tested with available public data and further applied in a monitoring site of a river. Results showed that the method could detect the contamination events with a 100% probability of detection, a 17% false alarm rate and a time to detection close to 4 monitoring intervals. The proposed index time to detection evaluates the timeliness of the method, and timely detection ensures that contamination events can be responded to and dealt with in time. The site application also demonstrates the feasibility and practicability of the framework proposed in this study and its potential for extensive implementation.
Collapse
Affiliation(s)
- Zhenliang Liao
- College of Civil Engineering and Architecture, Xinjiang University, Urumqi 830046, PR China; College of Environmental Science and Engineering, Tongji University, Shanghai 200092, PR China.
| | - Minhao Zhang
- College of Environmental Science and Engineering, Tongji University, Shanghai 200092, PR China
| | - Yun Chen
- College of Environmental Science and Engineering, Tongji University, Shanghai 200092, PR China; Water Conservancy Development Research Center, Taihu Basin Authority, PR China
| | - Zhiyu Zhang
- College of Environmental Science and Engineering, Tongji University, Shanghai 200092, PR China.
| | - Huijuan Wang
- College of Civil Engineering and Architecture, Xinjiang University, Urumqi 830046, PR China
| |
Collapse
|
3
|
Li Z, Liu H, Zhang C, Fu G. Generative adversarial networks for detecting contamination events in water distribution systems using multi-parameter, multi-site water quality monitoring. ENVIRONMENTAL SCIENCE AND ECOTECHNOLOGY 2023; 14:100231. [PMID: 36578363 PMCID: PMC9791317 DOI: 10.1016/j.ese.2022.100231] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/13/2022] [Revised: 12/06/2022] [Accepted: 12/06/2022] [Indexed: 06/17/2023]
Abstract
Contamination events in water distribution networks (WDNs) can have a huge impact on water supply and public health; increasingly, online water quality sensors are deployed for real-time detection of contamination events. Machine learning has been used to integrate multivariate time series water quality data at multiple stations for contamination detection; however, accurate extraction of spatial features in water quality signals remains challenging. This study proposed a contamination detection method based on generative adversarial networks (GANs). The GAN model was constructed to simultaneously consider the spatial correlation between sensor locations and temporal information of water quality indicators. The model consists of two networks-a generator and a discriminator-the outputs of which are used to measure the degree of abnormality of water quality data at each time step, referred to as the anomaly score. Bayesian sequential analysis is used to update the likelihood of event occurrence based on the anomaly scores. Alarms are then generated from the fusion of single-site and multi-site models. The proposed method was tested on a WDN for various contamination events with different characteristics. Results showed high detection performance by the proposed GAN method compared with the minimum volume ellipsoid benchmark method for various contamination amplitudes. Additionally, the GAN method achieved high accuracy for various contamination events with different amplitudes and numbers of anomalous water quality parameters, and water quality data from different sensor stations, highlighting its robustness and potential for practical application to real-time contamination events.
Collapse
Affiliation(s)
- Zilin Li
- School of Hydraulic Engineering, Dalian University of Technology, Dalian, Liaoning, 116024, China
- Centre for Water Systems, University of Exeter, Exeter, EX4 4QF, UK
| | - Haixing Liu
- School of Hydraulic Engineering, Dalian University of Technology, Dalian, Liaoning, 116024, China
| | - Chi Zhang
- School of Hydraulic Engineering, Dalian University of Technology, Dalian, Liaoning, 116024, China
| | - Guangtao Fu
- Centre for Water Systems, University of Exeter, Exeter, EX4 4QF, UK
| |
Collapse
|
4
|
Ward FA. Integrating water science, economics, and policy for future climate adaptation. JOURNAL OF ENVIRONMENTAL MANAGEMENT 2023; 325:116574. [PMID: 36419309 DOI: 10.1016/j.jenvman.2022.116574] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/23/2022] [Revised: 10/09/2022] [Accepted: 10/17/2022] [Indexed: 06/16/2023]
Abstract
Water science, water economics, and water policy issues continue to rise in importance internationally as elevated population, income growth, and climate change magnify scarcity, shortages, and injustices in water access. Based on the unique physical, institutional, and economic characteristics of water, this work's first contribution is to characterize a road forward for research innovations that enable better integration of water science, water economics, and water policy. Meeting water's sustainable development and justice goals calls for several research innovations that humanity awaits. The advances called for in this work include deep uncertainty management, red team reviews, innovative water rights design, accelerating SDG achievement, valuing water infrastructure, valuing natural water retention, incentivizing water conservation, improving financial performance of rural water systems, water network modularization, non-price scarcity signals, optimization model calibration, remote sensing, transboundary benefit sharing, optimal growth, and water valuation. The work's second contribution is to present a prototype scalable basin scale hydroeconomic analysis (HEA) as a framework for integrating these above innovations when they occur. Results of the HEA show that losses from a 50% shortage in the basin's surface water supply can continue to protect 93% of total economic benefits across economic sectors if an efficient water trading system is established to move water from lower to higher valued uses when shortages occur. The work concludes by noting that great advances remain needed for better and longer lives.
Collapse
Affiliation(s)
- Frank A Ward
- Department of Agricultural Economics and Agricultural Business, Water Science and Management Program, New Mexico State University, Las Cruces, NM, 88011, USA.
| |
Collapse
|
5
|
Shao Z, Xu L, Chai H, Yost SA, Zheng Z, Wu Z, He Q. A Bayesian-SWMM coupled stochastic model developed to reconstruct the complete profile of an unknown discharging incidence in sewer networks. JOURNAL OF ENVIRONMENTAL MANAGEMENT 2021; 297:113211. [PMID: 34284327 DOI: 10.1016/j.jenvman.2021.113211] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/07/2020] [Revised: 05/25/2021] [Accepted: 06/30/2021] [Indexed: 06/13/2023]
Abstract
Unknown illicit discharges from manufactories often contain toxic chemical matters that are detrimental to the receiving waterbody by deteriorating the performance of wastewater treatment plants. Numerical models that identify these sources and reconstruct the discharging profiles are highly desired for environment management purpose. In this study, a stochastic source identification model that couples Bayesian inference with SWMM is developed to reconstruct the profile of an instantaneous dumpling incidence in sewer networks. The unknown source parameters include location, dumping rate and time of the dumping incidence. Key factors that impact the convergence and performance of the model including walking step size, numbers of unknown source parameters and numbers of monitoring sites are investigated. Results show that the Bayesian-SWMM coupled model is effective and accurate in identifying the unknown sources parameters in an instantaneous dumping event. It is also found that walking step size is crucial for the results to converge to true solutions. Furthermore, it shows that the identified results are highly dependent on the numbers of unknown source parameters. More unknowns result to unsatisfying results. However, the study shows that this limitation could be significantly reduced by using more monitoring site data. One contribution of the study is that errors from measurements and numerical simulation are considered in the identification while results are presented in probabilities with all possible values revealed. This feature is highly practical and efficient when it comes to assist further field screening efforts to pinpoint the true sources.
Collapse
Affiliation(s)
- Zhiyu Shao
- Key Laboratory of Ecological Environment of Ministry of Education of Three Gorges Reservoir Area, Chongqing University, Chongqing, 400030, China; College of Environment and Ecology, Chongqing University, Chongqing, 400030, China.
| | - Lei Xu
- Key Laboratory of Ecological Environment of Ministry of Education of Three Gorges Reservoir Area, Chongqing University, Chongqing, 400030, China; College of Environment and Ecology, Chongqing University, Chongqing, 400030, China
| | - Hongxiang Chai
- Key Laboratory of Ecological Environment of Ministry of Education of Three Gorges Reservoir Area, Chongqing University, Chongqing, 400030, China; College of Environment and Ecology, Chongqing University, Chongqing, 400030, China
| | - Scott A Yost
- Department of Civil Engineering, University of Kentucky, Lexington, 40506, USA
| | - Zuole Zheng
- Key Laboratory of Ecological Environment of Ministry of Education of Three Gorges Reservoir Area, Chongqing University, Chongqing, 400030, China; College of Environment and Ecology, Chongqing University, Chongqing, 400030, China
| | - Zhengsong Wu
- Key Laboratory of Ecological Environment of Ministry of Education of Three Gorges Reservoir Area, Chongqing University, Chongqing, 400030, China; College of Environment and Ecology, Chongqing University, Chongqing, 400030, China
| | - Qiang He
- Key Laboratory of Ecological Environment of Ministry of Education of Three Gorges Reservoir Area, Chongqing University, Chongqing, 400030, China; College of Environment and Ecology, Chongqing University, Chongqing, 400030, China
| |
Collapse
|
6
|
Niu JQ, Zhao Q, Xin X, Zhang YQ, Hu N, Ma YY, Han ZG. Krebs-type polyoxometalate-based crystalline materials: synthesis, characterization and catalytic performance. J COORD CHEM 2020. [DOI: 10.1080/00958972.2020.1802650] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
Affiliation(s)
- Jia-Qi Niu
- Hebei Key Laboratory of Organic Functional Molecules, National Demonstration Center for Experimental Chemistry Education, College of Chemistry and Material Science, Hebei Normal University, Shijiazhuang, Hebei, P. R. China
| | - Qing Zhao
- Hebei Key Laboratory of Organic Functional Molecules, National Demonstration Center for Experimental Chemistry Education, College of Chemistry and Material Science, Hebei Normal University, Shijiazhuang, Hebei, P. R. China
| | - Xing Xin
- Hebei Key Laboratory of Organic Functional Molecules, National Demonstration Center for Experimental Chemistry Education, College of Chemistry and Material Science, Hebei Normal University, Shijiazhuang, Hebei, P. R. China
| | - Ya-Qi Zhang
- Hebei Key Laboratory of Organic Functional Molecules, National Demonstration Center for Experimental Chemistry Education, College of Chemistry and Material Science, Hebei Normal University, Shijiazhuang, Hebei, P. R. China
| | - Na Hu
- Hebei Key Laboratory of Organic Functional Molecules, National Demonstration Center for Experimental Chemistry Education, College of Chemistry and Material Science, Hebei Normal University, Shijiazhuang, Hebei, P. R. China
| | - Yuan-Yuan Ma
- Hebei Key Laboratory of Organic Functional Molecules, National Demonstration Center for Experimental Chemistry Education, College of Chemistry and Material Science, Hebei Normal University, Shijiazhuang, Hebei, P. R. China
| | - Zhan-Gang Han
- Hebei Key Laboratory of Organic Functional Molecules, National Demonstration Center for Experimental Chemistry Education, College of Chemistry and Material Science, Hebei Normal University, Shijiazhuang, Hebei, P. R. China
| |
Collapse
|
7
|
Yaroshenko I, Kirsanov D, Marjanovic M, Lieberzeit PA, Korostynska O, Mason A, Frau I, Legin A. Real-Time Water Quality Monitoring with Chemical Sensors. SENSORS 2020; 20:s20123432. [PMID: 32560552 PMCID: PMC7349867 DOI: 10.3390/s20123432] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/25/2020] [Revised: 06/12/2020] [Accepted: 06/14/2020] [Indexed: 02/07/2023]
Abstract
Water quality is one of the most critical indicators of environmental pollution and it affects all of us. Water contamination can be accidental or intentional and the consequences are drastic unless the appropriate measures are adopted on the spot. This review provides a critical assessment of the applicability of various technologies for real-time water quality monitoring, focusing on those that have been reportedly tested in real-life scenarios. Specifically, the performance of sensors based on molecularly imprinted polymers is evaluated in detail, also giving insights into their principle of operation, stability in real on-site applications and mass production options. Such characteristics as sensing range and limit of detection are given for the most promising systems, that were verified outside of laboratory conditions. Then, novel trends of using microwave spectroscopy and chemical materials integration for achieving a higher sensitivity to and selectivity of pollutants in water are described.
Collapse
Affiliation(s)
- Irina Yaroshenko
- Institute of Chemistry, St. Petersburg State University, Mendeleev Center, Universitetskaya nab. 7/9, 199034 St. Petersburg, Russia; (I.Y.); (A.L.)
| | - Dmitry Kirsanov
- Institute of Chemistry, St. Petersburg State University, Mendeleev Center, Universitetskaya nab. 7/9, 199034 St. Petersburg, Russia; (I.Y.); (A.L.)
- Correspondence: ; Tel.: +7-921-333-1246
| | - Monika Marjanovic
- Faculty for Chemistry, Department of Physical Chemistry, University of Vienna, Waehringer Strasse 42, 1090 Vienna, Austria; (M.M.); (P.A.L.)
| | - Peter A. Lieberzeit
- Faculty for Chemistry, Department of Physical Chemistry, University of Vienna, Waehringer Strasse 42, 1090 Vienna, Austria; (M.M.); (P.A.L.)
| | - Olga Korostynska
- Faculty of Technology, Art and Design, Department of Mechanical, Electronic and Chemical Engineering, Oslo Metropolitan University, 0166 Oslo, Norway;
- Faculty of Science and Technology, Norwegian University of Life Sciences, 1432 Ås, Norway;
| | - Alex Mason
- Faculty of Science and Technology, Norwegian University of Life Sciences, 1432 Ås, Norway;
- Animalia AS, Norwegian Meat and Poultry Research Centre, P.O. Box 396, 0513 Økern, Oslo, Norway
- Faculty of Engineering and Technology, Liverpool John Moores University, Liverpool L3 3AF, UK;
| | - Ilaria Frau
- Faculty of Engineering and Technology, Liverpool John Moores University, Liverpool L3 3AF, UK;
| | - Andrey Legin
- Institute of Chemistry, St. Petersburg State University, Mendeleev Center, Universitetskaya nab. 7/9, 199034 St. Petersburg, Russia; (I.Y.); (A.L.)
| |
Collapse
|
8
|
An Online Contaminant Classification Method Based on MF-DCCA Using Conventional Water Quality Indicators. Processes (Basel) 2020. [DOI: 10.3390/pr8020178] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022] Open
Abstract
Emergent contamination warning systems are critical to ensure drinking water supply security. After detecting the existence of contaminants, identifying the types of contaminants is conducive to taking remediation measures. An online classification method for contaminants, which explored abnormal fluctuation information and the correlation between 12 water quality indicators adequately, is proposed to realize comprehensive and accurate discrimination of contaminants. Firstly, the paper utilized multi-fractal detrended fluctuation analysis (MF-DFA) to select indicators with abnormal fluctuation, used multi-fractal detrended cross-correlation analysis (MF-DCCA) to measure the cross-correlation between indicators. Subsequently, the algorithm fused the abnormal probability of each indicator and constructed the abnormal probability matrix to further judge the abnormal fluctuation of indicators using D–S evidence theory. Finally, the singularity index of the cross-correlation function and the selected indicators were used to classification by cosine distance. Experiments of five chemical contaminants at three concentration levels were implemented, and analysis results show the method can weaken disturbance of water quality background noise and other interfering factors. It effectively improved the classification accuracy at low concentrations compared with another three methods, including methods using triple standard deviation threshold and single indicator fluctuation analysis-only methods without fluctuation analysis. This can be applied to water quality emergency monitoring systems to reduce contaminant misclassification.
Collapse
|
9
|
Sun L, Yan H, Xin K, Tao T. Contamination source identification in water distribution networks using convolutional neural network. ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH INTERNATIONAL 2019; 26:36786-36797. [PMID: 31745764 DOI: 10.1007/s11356-019-06755-x] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/18/2019] [Accepted: 10/14/2019] [Indexed: 06/10/2023]
Abstract
Contamination source identification (CSI) is significant for water quality security and social stability when a contamination intrusion event occurs in water distribution systems (WDSs). However, in research, this is an extremely challenging task for many reasons, such as limited number of water quality sensors and their limitations in detecting contaminants. Hence, some researchers have introduced consumers' complaint information as an alternative of sensors for CSI. But the problem with this approach is that the uncertainty of complaint delay time has a great impact on the identification accuracy. To address this issue, this study constructed complaint matrices to present the spatiotemporal characteristics of consumer complaints in an intrusion event and proposed a new methodology employing convolution neural network (CNN)-a deep learning algorithm-for the purpose of pattern recognition. CNN aimed to explore the inherent characteristics of complaint patterns corresponding to different contaminant intrusion nodes and to improve the performance of identifying the contamination source based on consumer complaint information. Two case studies illustrated methodology effectiveness in WDSs of various scales, even with the high uncertainties of complaint delay time. The comparison between CNN and a back-propagation artificial neural network algorithm demonstrates that the former framework possesses stronger robustness and higher accuracy for CSI.
Collapse
Affiliation(s)
- Lian Sun
- College of Environmental Science and Engineering, Tongji University, Shanghai, China
| | - Hexiang Yan
- College of Environmental Science and Engineering, Tongji University, Shanghai, China
| | - Kunlun Xin
- College of Environmental Science and Engineering, Tongji University, Shanghai, China.
- Institute of Pollution Control and Ecological Security, Shanghai, China.
| | - Tao Tao
- College of Environmental Science and Engineering, Tongji University, Shanghai, China
- Institute of Pollution Control and Ecological Security, Shanghai, China
| |
Collapse
|
10
|
Osmani SA, Banik BK, Ali H. Integrating fuzzy logic with Pearson correlation to optimize contaminant detection in water distribution system with uncertainty analyses. ENVIRONMENTAL MONITORING AND ASSESSMENT 2019; 191:441. [PMID: 31203453 DOI: 10.1007/s10661-019-7533-x] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/13/2018] [Accepted: 05/10/2019] [Indexed: 06/09/2023]
Abstract
An effective detection algorithm, supervising an online water system, is expected to monitor changes in water quality due to any contamination. However, contemporary event detection methods are often criticized for their high false detection rates as well as for their low true detection rates. This study proposes two new event detection methods for contamination that use multi-objective optimization by investigating the correlation between multiple types of conventional water quality sensors. While the first method incorporates non-dominated sorting genetic algorithm II (NSGA-II) with the Pearson correlation Euclidean distance (PE) method in order to maximize the probability of detection (PD) and to minimize the false alarm rate (FAR), the second method introduces fuzzy logic in order to establish a degree of correlations ranking that replaces the correlation relationship indicator threshold. Optimization is performed by using NSGA-II in the second method. The results of this study show that the incorporation of fuzzy logic with NSGA-II in event detection method have produced better results in event detection. The results also show that both methods detect all true events without producing any false alarm rates. Moreover, an uncertainty analysis on input sensor signals is performed to test the robustness of the fuzzy logic-based event detection method by employing the widely used Monte Carlo simulation (MCS) technique. Four different scenarios of uncertainty are analyzed, in particular, and the findings suggest that the proposed method is very effective in minimizing false alarm rates and maximizing true events detection, and hence, it can be regarded as one of the novel approaches to demonstrate its application in the development of an event detection algorithm.
Collapse
Affiliation(s)
- Shabbir Ahmed Osmani
- Department of Civil Engineering, Leading University, Ragib Nagar, South Surma, Sylhet, Bangladesh
| | - Bijit Kumar Banik
- Department of Civil and Environmental Engineering, Shahjalal University of Science and Technology, Sylhet, Bangladesh.
| | - Hazrat Ali
- Department of Civil Engineering, Chittagong University of Engineering & Technology, Chattogram, 4349, Bangladesh
| |
Collapse
|
11
|
Xu X, Liu Y, Liu S, Li J, Guo G, Smith K. Real-time detection of potable-reclaimed water pipe cross-connection events by conventional water quality sensors using machine learning methods. JOURNAL OF ENVIRONMENTAL MANAGEMENT 2019; 238:201-209. [PMID: 30851559 DOI: 10.1016/j.jenvman.2019.02.110] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/15/2018] [Revised: 02/05/2019] [Accepted: 02/23/2019] [Indexed: 06/09/2023]
Abstract
Risk of cross-connection is becoming higher due to greater construction of potable-reclaimed water dual distribution systems. Cross-connection events can result in serious health concerns and reduce public confidence in reclaimed water. Thus, reliable, cost-effective and real-time online detection methods for early warning are required. The current study carried out pilot-scale experiments to simulate potable-reclaimed water pipe cross-connection events for different mixing ratios (from 30% to 1%) using machine learning methods based on multiple conventional water quality parameters. The parameters included residual chlorine, pH, turbidity, temperature, conductivity, oxidation-reduction potential and chemical oxygen demand. The results showed that correlated variation occurred among water quality parameters at the time of the cross-connection event. A single parameter-based method can be effective at high mixing ratios, but not at low mixing ratios. The direct supporting vector machine (SVM)-based method managed to overcome this drawback, but coped poorly with abnormal readings of water parameter sensors. In that respect, a Pearson correlation coefficient (PCC)-SVM-based method was developed. It provided not only high detection performance under normal conditions, but also remained reliable when abnormal readings occurred. The detection accuracy and true positive rate of this method was still over 88%, and the false positive rate was below 12%, given a sudden variation of an individual water quality parameter. The receiver operating characteristic curves further confirmed the promising practical applicability of this PCC-SVM-based method for early detection of cross-connection events.
Collapse
Affiliation(s)
- Xiyan Xu
- School of Environment, Tsinghua University, 100084, Beijing, China
| | - Ying Liu
- School of Environment, Tsinghua University, 100084, Beijing, China
| | - Shuming Liu
- School of Environment, Tsinghua University, 100084, Beijing, China.
| | - Junyu Li
- School of Environment, Tsinghua University, 100084, Beijing, China
| | - Guancheng Guo
- School of Environment, Tsinghua University, 100084, Beijing, China
| | - Kate Smith
- School of Environment, Tsinghua University, 100084, Beijing, China
| |
Collapse
|
12
|
Towards Development of an Optimization Model to Identify Contamination Source in a Water Distribution Network. WATER 2018. [DOI: 10.3390/w10050579] [Citation(s) in RCA: 27] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
13
|
Application of Least-Squares Support Vector Machines for Quantitative Evaluation of Known Contaminant in Water Distribution System Using Online Water Quality Parameters. SENSORS 2018; 18:s18040938. [PMID: 29565295 PMCID: PMC5948656 DOI: 10.3390/s18040938] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/27/2018] [Revised: 03/15/2018] [Accepted: 03/19/2018] [Indexed: 11/16/2022]
Abstract
In water-quality, early warning systems and qualitative detection of contaminants are always challenging. There are a number of parameters that need to be measured which are not entirely linearly related to pollutant concentrations. Besides the complex correlations between variable water parameters that need to be analyzed also impairs the accuracy of quantitative detection. In aspects of these problems, the application of least-squares support vector machines (LS-SVM) is used to evaluate the water contamination and various conventional water quality sensors quantitatively. The various contaminations may cause different correlative responses of sensors, and also the degree of response is related to the concentration of the injected contaminant. Therefore to enhance the reliability and accuracy of water contamination detection a new method is proposed. In this method, a new relative response parameter is introduced to calculate the differences between water quality parameters and their baselines. A variety of regression models has been examined, as result of its high performance, the regression model based on genetic algorithm (GA) is combined with LS-SVM. In this paper, the practical application of the proposed method is considered, controlled experiments are designed, and data is collected from the experimental setup. The measured data is applied to analyze the water contamination concentration. The evaluation of results validated that the LS-SVM model can adapt to the local nonlinear variations between water quality parameters and contamination concentration with the excellent generalization ability and accuracy. The validity of the proposed approach in concentration evaluation for potassium ferricyanide is proven to be more than 0.5 mg/L in water distribution systems.
Collapse
|
14
|
Zulkifli SN, Rahim HA, Lau WJ. Detection of contaminants in water supply: A review on state-of-the-art monitoring technologies and their applications. SENSORS AND ACTUATORS. B, CHEMICAL 2018; 255:2657-2689. [PMID: 32288249 PMCID: PMC7126548 DOI: 10.1016/j.snb.2017.09.078] [Citation(s) in RCA: 71] [Impact Index Per Article: 11.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/14/2016] [Revised: 08/22/2017] [Accepted: 09/13/2017] [Indexed: 05/12/2023]
Abstract
Water monitoring technologies are widely used for contaminants detection in wide variety of water ecology applications such as water treatment plant and water distribution system. A tremendous amount of research has been conducted over the past decades to develop robust and efficient techniques of contaminants detection with minimum operating cost and energy. Recent developments in spectroscopic techniques and biosensor approach have improved the detection sensitivities, quantitatively and qualitatively. The availability of in-situ measurements and multiple detection analyses has expanded the water monitoring applications in various advanced techniques including successful establishment in hand-held sensing devices which improves portability in real-time basis for the detection of contaminant, such as microorganisms, pesticides, heavy metal ions, inorganic and organic components. This paper intends to review the developments in water quality monitoring technologies for the detection of biological and chemical contaminants in accordance with instrumental limitations. Particularly, this review focuses on the most recently developed techniques for water contaminant detection applications. Several recommendations and prospective views on the developments in water quality assessments will also be included.
Collapse
Affiliation(s)
| | - Herlina Abdul Rahim
- Faculty of Electrical Engineering, Universiti Teknologi Malaysia, 81310 Skudai, Johor, Malaysia
| | - Woei-Jye Lau
- Advanced Membrane Technology Research Centre (AMTEC), Faculty of Chemical and Energy Engineering, Universiti Teknologi Malaysia, 81310 Skudai, Johor, Malaysia
| |
Collapse
|
15
|
Shi B, Wang P, Jiang J, Liu R. Applying high-frequency surrogate measurements and a wavelet-ANN model to provide early warnings of rapid surface water quality anomalies. THE SCIENCE OF THE TOTAL ENVIRONMENT 2018; 610-611:1390-1399. [PMID: 28854482 DOI: 10.1016/j.scitotenv.2017.08.232] [Citation(s) in RCA: 30] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/09/2017] [Revised: 08/16/2017] [Accepted: 08/23/2017] [Indexed: 06/07/2023]
Abstract
It is critical for surface water management systems to provide early warnings of abrupt, large variations in water quality, which likely indicate the occurrence of spill incidents. In this study, a combined approach integrating a wavelet artificial neural network (wavelet-ANN) model and high-frequency surrogate measurements is proposed as a method of water quality anomaly detection and warning provision. High-frequency time series of major water quality indexes (TN, TP, COD, etc.) were produced via a regression-based surrogate model. After wavelet decomposition and denoising, a low-frequency signal was imported into a back-propagation neural network for one-step prediction to identify the major features of water quality variations. The precisely trained site-specific wavelet-ANN outputs the time series of residual errors. A warning is triggered when the actual residual error exceeds a given threshold, i.e., baseline pattern, estimated based on long-term water quality variations. A case study based on the monitoring program applied to the Potomac River Basin in Virginia, USA, was conducted. The integrated approach successfully identified two anomaly events of TP variations at a 15-minute scale from high-frequency online sensors. A storm event and point source inputs likely accounted for these events. The results show that the wavelet-ANN model is slightly more accurate than the ANN for high-frequency surface water quality prediction, and it meets the requirements of anomaly detection. Analyses of the performance at different stations and over different periods illustrated the stability of the proposed method. By combining monitoring instruments and surrogate measures, the presented approach can support timely anomaly identification and be applied to urban aquatic environments for watershed management.
Collapse
Affiliation(s)
- Bin Shi
- School of Environment, Harbin Institute of Technology, Harbin 150090, China
| | - Peng Wang
- School of Environment, Harbin Institute of Technology, Harbin 150090, China; State Key Laboratory of Urban Water Resource and Environment, Harbin Institute of Technology, Harbin 150090, China
| | - Jiping Jiang
- School of Environment, Harbin Institute of Technology, Harbin 150090, China; School of Environmental Science and Engineering, Southern University of Science and Technology, Shenzhen 518055, China.
| | - Rentao Liu
- School of Environment, Harbin Institute of Technology, Harbin 150090, China
| |
Collapse
|
16
|
Contamination Event Detection with Multivariate Time-Series Data in Agricultural Water Monitoring. SENSORS 2017; 17:s17122806. [PMID: 29207535 PMCID: PMC5751451 DOI: 10.3390/s17122806] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/17/2017] [Revised: 11/24/2017] [Accepted: 11/30/2017] [Indexed: 11/17/2022]
Abstract
Time series data of multiple water quality parameters are obtained from the water sensor networks deployed in the agricultural water supply network. The accurate and efficient detection and warning of contamination events to prevent pollution from spreading is one of the most important issues when pollution occurs. In order to comprehensively reduce the event detection deviation, a spatial–temporal-based event detection approach with multivariate time-series data for water quality monitoring (M-STED) was proposed. The M-STED approach includes three parts. The first part is that M-STED adopts a Rule K algorithm to select backbone nodes as the nodes in the CDS, and forward the sensed data of multiple water parameters. The second part is to determine the state of each backbone node with back propagation neural network models and the sequential Bayesian analysis in the current timestamp. The third part is to establish a spatial model with Bayesian networks to estimate the state of the backbones in the next timestamp and trace the “outlier” node to its neighborhoods to detect a contamination event. The experimental results indicate that the average detection rate is more than 80% with M-STED and the false detection rate is lower than 9%, respectively. The M-STED approach can improve the rate of detection by about 40% and reduce the false alarm rate by about 45%, compared with the event detection with a single water parameter algorithm, S-STED. Moreover, the proposed M-STED can exhibit better performance in terms of detection delay and scalability.
Collapse
|
17
|
Zodrow KR, Li Q, Buono RM, Chen W, Daigger G, Dueñas-Osorio L, Elimelech M, Huang X, Jiang G, Kim JH, Logan BE, Sedlak DL, Westerhoff P, Alvarez PJJ. Advanced Materials, Technologies, and Complex Systems Analyses: Emerging Opportunities to Enhance Urban Water Security. ENVIRONMENTAL SCIENCE & TECHNOLOGY 2017; 51:10274-10281. [PMID: 28742338 DOI: 10.1021/acs.est.7b01679] [Citation(s) in RCA: 62] [Impact Index Per Article: 8.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/22/2023]
Abstract
Innovation in urban water systems is required to address the increasing demand for clean water due to population growth and aggravated water stress caused by water pollution, aging infrastructure, and climate change. Advances in materials science, modular water treatment technologies, and complex systems analyses, coupled with the drive to minimize the energy and environmental footprints of cities, provide new opportunities to ensure a resilient and safe water supply. We present a vision for enhancing efficiency and resiliency of urban water systems and discuss approaches and research needs for overcoming associated implementation challenges.
Collapse
Affiliation(s)
- Katherine R Zodrow
- Department of Civil and Environmental Engineering, Rice University , Houston, Texas 77005, United States
- Baker Institute for Public Policy, Center for Energy Studies, Rice University , Houston, Texas 77005, United States
- Nanosystems Engineering Research Center for Nanotechnology Enabled Water Treatment (NEWT), Rice University , Houston, Texas 77005, United States
| | - Qilin Li
- Department of Civil and Environmental Engineering, Rice University , Houston, Texas 77005, United States
- Nanosystems Engineering Research Center for Nanotechnology Enabled Water Treatment (NEWT), Rice University , Houston, Texas 77005, United States
| | - Regina M Buono
- Baker Institute for Public Policy, Center for Energy Studies, Rice University , Houston, Texas 77005, United States
| | - Wei Chen
- College of Environmental Science and Engineering, Nankai University , Tianjin, China 300071
| | - Glen Daigger
- Department of Civil and Environmental Engineering, University of Michigan , Ann Arbor, Michigan 48109, United States
| | - Leonardo Dueñas-Osorio
- Department of Civil and Environmental Engineering, Rice University , Houston, Texas 77005, United States
| | - Menachem Elimelech
- Nanosystems Engineering Research Center for Nanotechnology Enabled Water Treatment (NEWT), Rice University , Houston, Texas 77005, United States
- Department of Chemical and Environmental Engineering, Yale University , New Haven, Connecticut 06511, United States
| | - Xia Huang
- School of Environment, Tsinghua University , Beijing, China 100084
| | - Guibin Jiang
- State Key Laboratory of Environmental Chemistry and Ecotoxicology, Chinese Academy of Sciences , Beijing, China 100085
| | - Jae-Hong Kim
- Nanosystems Engineering Research Center for Nanotechnology Enabled Water Treatment (NEWT), Rice University , Houston, Texas 77005, United States
- Department of Chemical and Environmental Engineering, Yale University , New Haven, Connecticut 06511, United States
| | - Bruce E Logan
- Department of Civil and Environmental Engineering, Penn State University , State College, Pennsylvania 16801, United States
| | - David L Sedlak
- Department of Civil and Environmental Engineering, UC Berkeley , Berkeley, California 94720, United States
| | - Paul Westerhoff
- Nanosystems Engineering Research Center for Nanotechnology Enabled Water Treatment (NEWT), Rice University , Houston, Texas 77005, United States
- School of Sustainable Engineering and The Built Environment, Arizona State University , Box 3005, Tempe, Arizona 85287-3005, United States
| | - Pedro J J Alvarez
- Department of Civil and Environmental Engineering, Rice University , Houston, Texas 77005, United States
- Baker Institute for Public Policy, Center for Energy Studies, Rice University , Houston, Texas 77005, United States
- Nanosystems Engineering Research Center for Nanotechnology Enabled Water Treatment (NEWT), Rice University , Houston, Texas 77005, United States
| |
Collapse
|
18
|
Huang P, Wang K, Hou D, Zhang J, Yu J, Zhang G. In situ detection of water quality contamination events based on signal complexity analysis using online ultraviolet-visible spectral sensor. APPLIED OPTICS 2017; 56:6317-6323. [PMID: 29047830 DOI: 10.1364/ao.56.006317] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/26/2017] [Accepted: 07/08/2017] [Indexed: 06/07/2023]
Abstract
The contaminant detection in water distribution systems is essential to protect public health from potentially harmful compounds resulting from accidental spills or intentional releases. As a noninvasive optical technique, ultraviolet-visible (UV-Vis) spectroscopy is investigated for detecting contamination events. However, current methods for event detection exhibit the shortcomings of noise susceptibility. In this paper, a new method that has less sensitivity to noise was proposed to detect water quality contamination events by analyzing the complexity of the UV-Vis spectrum series. The proposed method applied approximate entropy (ApEn) to measure spectrum signals' complexity, which made a distinction between normal and abnormal signals. The impact of noise was attenuated with the help of ApEn's insensitivity to signal disturbance. This method was tested on a real water distribution system data set with various concentration simulation events. Results from the experiment and analysis show that the proposed method has a good performance on noise tolerance and provides a better detection result compared with the autoregressive model and sequential probability ratio test.
Collapse
|
19
|
Lin WC, Brondum K, Monroe CW, Burns MA. Multifunctional Water Sensors for pH, ORP, and Conductivity Using Only Microfabricated Platinum Electrodes. SENSORS 2017; 17:s17071655. [PMID: 28753913 PMCID: PMC5539692 DOI: 10.3390/s17071655] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/04/2017] [Revised: 06/23/2017] [Accepted: 06/28/2017] [Indexed: 11/30/2022]
Abstract
Monitoring of the pH, oxidation-reduction-potential (ORP), and conductivity of aqueous samples is typically performed using multiple sensors. To minimize the size and cost of these sensors for practical applications, we have investigated the use of a single sensor constructed with only bare platinum electrodes deposited on a glass substrate. The sensor can measure pH from 4 to 10 while simultaneously measuring ORP from 150 to 800 mV. The device can also measure conductivity up to 8000 μS/cm in the range of 10 °C to 50 °C, and all these measurements can be made even if the water samples contain common ions found in residential water. The sensor is inexpensive (i.e., ~$0.10/unit) and has a sensing area below 1 mm2, suggesting that the unit is cost-efficient, robust, and widely applicable, including in microfluidic systems.
Collapse
Affiliation(s)
- Wen-Chi Lin
- Department of Chemical Engineering, University of Michigan, Ann Arbor, MI 48109, USA.
| | | | - Charles W Monroe
- Department of Engineering Science, University of Oxford, Oxford OX1 3PJ, UK.
| | - Mark A Burns
- Department of Chemical Engineering, University of Michigan, Ann Arbor, MI 48109, USA.
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, USA.
| |
Collapse
|
20
|
Zhang J, Hou D, Wang K, Huang P, Zhang G, Loáiciga H. Real-time detection of organic contamination events in water distribution systems by principal components analysis of ultraviolet spectral data. ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH INTERNATIONAL 2017; 24:12882-12898. [PMID: 28365843 DOI: 10.1007/s11356-017-8907-7] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/03/2016] [Accepted: 03/21/2017] [Indexed: 06/07/2023]
Abstract
The detection of organic contaminants in water distribution systems is essential to protect public health from potential harmful compounds resulting from accidental spills or intentional releases. Existing methods for detecting organic contaminants are based on quantitative analyses such as chemical testing and gas/liquid chromatography, which are time- and reagent-consuming and involve costly maintenance. This study proposes a novel procedure based on discrete wavelet transform and principal component analysis for detecting organic contamination events from ultraviolet spectral data. Firstly, the spectrum of each observation is transformed using discrete wavelet with a coiflet mother wavelet to capture the abrupt change along the wavelength. Principal component analysis is then employed to approximate the spectra based on capture and fusion features. The significant value of Hotelling's T2 statistics is calculated and used to detect outliers. An alarm of contamination event is triggered by sequential Bayesian analysis when the outliers appear continuously in several observations. The effectiveness of the proposed procedure is tested on-line using a pilot-scale setup and experimental data.
Collapse
Affiliation(s)
- Jian Zhang
- State Key Laboratory of Industrial Control Technology, College of Control Science and Engineering, Zhejiang University, Hangzhou, 310027, China
| | - Dibo Hou
- State Key Laboratory of Industrial Control Technology, College of Control Science and Engineering, Zhejiang University, Hangzhou, 310027, China.
| | - Ke Wang
- State Key Laboratory of Industrial Control Technology, College of Control Science and Engineering, Zhejiang University, Hangzhou, 310027, China
| | - Pingjie Huang
- State Key Laboratory of Industrial Control Technology, College of Control Science and Engineering, Zhejiang University, Hangzhou, 310027, China
| | - Guangxin Zhang
- State Key Laboratory of Industrial Control Technology, College of Control Science and Engineering, Zhejiang University, Hangzhou, 310027, China
| | - Hugo Loáiciga
- Department of Geography/UCSB, Santa Barbara, CA, 93106, USA
| |
Collapse
|
21
|
Online Classification of Contaminants Based on Multi-Classification Support Vector Machine Using Conventional Water Quality Sensors. SENSORS 2017; 17:s17030581. [PMID: 28335400 PMCID: PMC5375867 DOI: 10.3390/s17030581] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/09/2016] [Revised: 02/14/2017] [Accepted: 03/09/2017] [Indexed: 11/19/2022]
Abstract
Water quality early warning system is mainly used to detect deliberate or accidental water pollution events in water distribution systems. Identifying the types of pollutants is necessary after detecting the presence of pollutants to provide warning information about pollutant characteristics and emergency solutions. Thus, a real-time contaminant classification methodology, which uses the multi-classification support vector machine (SVM), is proposed in this study to obtain the probability for contaminants belonging to a category. The SVM-based model selected samples with indistinct feature, which were mostly low-concentration samples as the support vectors, thereby reducing the influence of the concentration of contaminants in the building process of a pattern library. The new sample points were classified into corresponding regions after constructing the classification boundaries with the support vector. Experimental results show that the multi-classification SVM-based approach is less affected by the concentration of contaminants when establishing a pattern library compared with the cosine distance classification method. Moreover, the proposed approach avoids making a single decision when classification features are unclear in the initial phase of injecting contaminants.
Collapse
|
22
|
Oliker N, Ostfeld A. Network hydraulics inclusion in water quality event detection using multiple sensor stations data. WATER RESEARCH 2015; 80:47-58. [PMID: 25996752 DOI: 10.1016/j.watres.2015.04.036] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/31/2014] [Revised: 03/05/2015] [Accepted: 04/20/2015] [Indexed: 06/04/2023]
Abstract
Event detection is one of the current most challenging topics in water distribution systems analysis: how regular on-line hydraulic (e.g., pressure, flow) and water quality (e.g., pH, residual chlorine, turbidity) measurements at different network locations can be efficiently utilized to detect water quality contamination events. This study describes an integrated event detection model which combines multiple sensor stations data with network hydraulics. To date event detection modelling is likely limited to single sensor station location and dataset. Single sensor station models are detached from network hydraulics insights and as a result might be significantly exposed to false positive alarms. This work is aimed at decreasing this limitation through integrating local and spatial hydraulic data understanding into an event detection model. The spatial analysis complements the local event detection effort through discovering events with lower signatures by exploring the sensors mutual hydraulic influences. The unique contribution of this study is in incorporating hydraulic simulation information into the overall event detection process of spatially distributed sensors. The methodology is demonstrated on two example applications using base runs and sensitivity analyses. Results show a clear advantage of the suggested model over single-sensor event detection schemes.
Collapse
Affiliation(s)
- Nurit Oliker
- Faculty of Civil and Environmental Engineering, Technion - Israel Institute of Technology, Haifa 32000, Israel
| | - Avi Ostfeld
- Faculty of Civil and Environmental Engineering, Technion - Israel Institute of Technology, Haifa 32000, Israel.
| |
Collapse
|
23
|
Liu S, Smith K, Che H. A multivariate based event detection method and performance comparison with two baseline methods. WATER RESEARCH 2015; 80:109-118. [PMID: 25996758 DOI: 10.1016/j.watres.2015.05.013] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/27/2015] [Revised: 04/30/2015] [Accepted: 05/05/2015] [Indexed: 06/04/2023]
Abstract
Early warning systems have been widely deployed to protect water systems from accidental and intentional contamination events. Conventional detection algorithms are often criticized for having high false positive rates and low true positive rates. This mainly stems from the inability of these methods to determine whether variation in sensor measurements is caused by equipment noise or the presence of contamination. This paper presents a new detection method that identifies the existence of contamination by comparing Euclidean distances of correlation indicators, which are derived from the correlation coefficients of multiple water quality sensors. The performance of the proposed method was evaluated using data from a contaminant injection experiment and compared with two baseline detection methods. The results show that the proposed method can differentiate between fluctuations caused by equipment noise and those due to the presence of contamination. It yielded higher possibility of detection and a lower false alarm rate than the two baseline methods. With optimized parameter values, the proposed method can correctly detect 95% of all contamination events with a 2% false alarm rate.
Collapse
Affiliation(s)
- Shuming Liu
- School of Environment, Tsinghua University, Beijing 100084, China.
| | - Kate Smith
- School of Environment, Tsinghua University, Beijing 100084, China
| | - Han Che
- School of Environment, Tsinghua University, Beijing 100084, China
| |
Collapse
|
24
|
Hou D, Zhang J, Yang Z, Liu S, Huang P, Zhang G. Distribution water quality anomaly detection from UV optical sensor monitoring data by integrating principal component analysis with chi-square distribution. OPTICS EXPRESS 2015; 23:17487-17510. [PMID: 26191757 DOI: 10.1364/oe.23.017487] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
The issue of distribution water quality security ensuring is recently attracting global attention due to the potential threat from harmful contaminants. The real-time monitoring based on ultraviolet optical sensors is a promising technique. This method is of reagent-free, low maintenance cost, rapid analysis and wide cover range. However, the ultraviolet absorption spectra are of large size and easily interfered. While within the on-site application, there is almost no prior knowledge like spectral characteristics of potential contaminants before determined. Meanwhile, the concept of normal water quality is also varying due to the operating condition. In this paper, a procedure based on multivariate statistical analysis is proposed to detect distribution water quality anomaly based on ultraviolet optical sensors. Firstly, the principal component analysis is employed to capture the main variety features from the spectral matrix and reduce the dimensionality. A new statistical variable is then constructed and used for evaluating the local outlying degree according to the chi-square distribution in the principal component subspace. The possibility of anomaly of the latest observation is calculated by the accumulation of the outlying degrees from the adjacent previous observations. To develop a more reliable anomaly detection procedure, several key parameters are discussed. By utilizing the proposed methods, the distribution water quality anomalies and the optical abnormal changes can be detected. The contaminants intrusion experiment is conducted in a pilot-scale distribution system by injecting phenol solution. The effectiveness of the proposed procedure is finally testified using the experimental spectral data.
Collapse
|
25
|
Housh M, Ostfeld A. An integrated logit model for contamination event detection in water distribution systems. WATER RESEARCH 2015; 75:210-223. [PMID: 25770443 DOI: 10.1016/j.watres.2015.02.016] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/28/2014] [Revised: 01/18/2015] [Accepted: 02/06/2015] [Indexed: 06/04/2023]
Abstract
The problem of contamination event detection in water distribution systems has become one of the most challenging research topics in water distribution systems analysis. Current attempts for event detection utilize a variety of approaches including statistical, heuristics, machine learning, and optimization methods. Several existing event detection systems share a common feature in which alarms are obtained separately for each of the water quality indicators. Unifying those single alarms from different indicators is usually performed by means of simple heuristics. A salient feature of the current developed approach is using a statistically oriented model for discrete choice prediction which is estimated using the maximum likelihood method for integrating the single alarms. The discrete choice model is jointly calibrated with other components of the event detection system framework in a training data set using genetic algorithms. The fusing process of each indicator probabilities, which is left out of focus in many existing event detection system models, is confirmed to be a crucial part of the system which could be modelled by exploiting a discrete choice model for improving its performance. The developed methodology is tested on real water quality data, showing improved performances in decreasing the number of false positive alarms and in its ability to detect events with higher probabilities, compared to previous studies.
Collapse
Affiliation(s)
- Mashor Housh
- Department of Natural Resources and Environmental Management, University of Haifa, 3498838, Israel
| | - Avi Ostfeld
- Faculty of Civil and Environmental Engineering, Technion - Israel Institute of Technology, Haifa 32000, Israel.
| |
Collapse
|
26
|
Performance Evaluation for a Contamination Detection Method Using Multiple Water Quality Sensors in an Early Warning System. WATER 2015. [DOI: 10.3390/w7041422] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
27
|
Liu S, Che H, Smith K, Chang T. Contaminant classification using cosine distances based on multiple conventional sensors. ENVIRONMENTAL SCIENCE. PROCESSES & IMPACTS 2015; 17:343-350. [PMID: 25529552 DOI: 10.1039/c4em00580e] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
Emergent contamination events have a significant impact on water systems. After contamination detection, it is important to classify the type of contaminant quickly to provide support for remediation attempts. Conventional methods generally either rely on laboratory-based analysis, which requires a long analysis time, or on multivariable-based geometry analysis and sequence analysis, which is prone to being affected by the contaminant concentration. This paper proposes a new contaminant classification method, which discriminates contaminants in a real time manner independent of the contaminant concentration. The proposed method quantifies the similarities or dissimilarities between sensors' responses to different types of contaminants. The performance of the proposed method was evaluated using data from contaminant injection experiments in a laboratory and compared with a Euclidean distance-based method. The robustness of the proposed method was evaluated using an uncertainty analysis. The results show that the proposed method performed better in identifying the type of contaminant than the Euclidean distance based method and that it could classify the type of contaminant in minutes without significantly compromising the correct classification rate (CCR).
Collapse
Affiliation(s)
- Shuming Liu
- School of Environment, Tsinghua University, Beijing, 100084, China.
| | | | | | | |
Collapse
|
28
|
Liu S, Che H, Smith K, Chen C. A method of detecting contamination events using multiple conventional water quality sensors. ENVIRONMENTAL MONITORING AND ASSESSMENT 2015; 187:4189. [PMID: 25467418 DOI: 10.1007/s10661-014-4189-4] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/25/2014] [Accepted: 11/19/2014] [Indexed: 06/04/2023]
Abstract
Early warning systems are often used for detecting contamination accidents. Traditional event detection methods suffer from high false negative and false positive errors. This paper proposes a detection method using multiple conventional water quality sensors and introduces a method to determine the values of parameters, which was configured as a multiple optimization problem and solved using a non-dominated sorting genetic algorithm (NSGA-II). The capability of the proposed method to detect contamination events caused by cadmium nitrate is demonstrated in this paper. The performance of the proposed method to detect events caused by different concentrations was also investigated. Results show that, after calibration, the proposed method can detect a contamination event 1 min after addition of cadmium nitrate at the concentration of 0.008 mg/l and has low false negative and positive rates.
Collapse
Affiliation(s)
- Shuming Liu
- School of Environment, Tsinghua University, Beijing, 100084, China,
| | | | | | | |
Collapse
|
29
|
Eliades DG, Stavrou D, Vrachimis SG, Panayiotou CG, Polycarpou MM. Contamination Event Detection Using Multi-level Thresholds. ACTA ACUST UNITED AC 2015. [DOI: 10.1016/j.proeng.2015.08.1003] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
30
|
Liu S, Che H, Smith K, Chen L. Contamination event detection using multiple types of conventional water quality sensors in source water. ENVIRONMENTAL SCIENCE. PROCESSES & IMPACTS 2014; 16:2028-2038. [PMID: 24953418 DOI: 10.1039/c4em00188e] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
Early warning systems are often used to detect deliberate and accidental contamination events in a water system. Conventional methods normally detect a contamination event by comparing the predicted and observed water quality values from one sensor. This paper proposes a new method for event detection by exploring the correlative relationships between multiple types of conventional water quality sensors. The performance of the proposed method was evaluated using data from contaminant injection experiments in a laboratory. Results from these experiments demonstrated the correlative responses of multiple types of sensors. It was observed that the proposed method could detect a contamination event 9 minutes after the introduction of lead nitrate solution with a concentration of 0.01 mg L(-1). The proposed method employs three parameters. Their impact on the detection performance was also analyzed. The initial analysis showed that the correlative response is contaminant-specific, which implies that it can be utilized not only for contamination detection, but also for contaminant identification.
Collapse
Affiliation(s)
- Shuming Liu
- School of Environment, Tsinghua University, Beijing 100084, China.
| | | | | | | |
Collapse
|
31
|
Eliades D, Lambrou T, Panayiotou C, Polycarpou M. Contamination Event Detection in Water Distribution Systems Using a Model-based Approach. ACTA ACUST UNITED AC 2014. [DOI: 10.1016/j.proeng.2014.11.229] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
32
|
Contaminant Detection Using Multiple Conventional Water Quality Sensors in an Early Warning System. ACTA ACUST UNITED AC 2014. [DOI: 10.1016/j.proeng.2014.11.239] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|
33
|
Arad J, Housh M, Perelman L, Ostfeld A. A dynamic thresholds scheme for contaminant event detection in water distribution systems. WATER RESEARCH 2013; 47:1899-1908. [PMID: 23384516 DOI: 10.1016/j.watres.2013.01.017] [Citation(s) in RCA: 35] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/04/2012] [Revised: 11/22/2012] [Accepted: 01/08/2013] [Indexed: 06/01/2023]
Abstract
In this study, a dynamic thresholds scheme is developed and demonstrated for contamination event detection in water distribution systems. The developed methodology is based on a recently published article of the authors (Perelman et al., 2012). Event detection in water supply systems is aimed at disclosing abnormal hydraulic or water quality events by exploring the time series behavior of routine hydraulic (e.g., flow, pressure) and water quality measurements (e.g., residual chlorine, pH, turbidity). While event detection raises alerts to the possibility of an event occurrence, it does not relate to origins, thus an event may be hydraulically-driven, as a consequence of problems like sudden leakages or pump/pipe malfunctions. Most events, however, are related to deliberate, accidental, or natural contamination intrusions. The developed methodology herein is based on off-line and on-line stages. During the off-line stage, a genetic algorithm (GA) is utilized for tuning five decision variables: positive and negative filters, positive and negative dynamic thresholds, and window size. During the on-line stage, a recursively Bayes' rule is invoked, employing the five decision variables, for real time on-line event detection. Using the same database, the proposed methodology is compared to Perelman et al. (2012), showing considerably improved detection ability. Metadata and the computer code are provided as Supplementary material.
Collapse
Affiliation(s)
- Jonathan Arad
- Faculty of Civil and Environmental Engineering, Technion - IIT, Haifa 32000, Israel
| | | | | | | |
Collapse
|
34
|
Kang O, Lee S, Wasewar K, Kim M, Liu H, Oh T, Janghorban E, Yoo C. Determination of key sensor locations for non-point pollutant sources management in sewer network. KOREAN J CHEM ENG 2013. [DOI: 10.1007/s11814-012-0108-y] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
|
35
|
Aisopou A, Stoianov I, Graham NJD. In-pipe water quality monitoring in water supply systems under steady and unsteady state flow conditions: a quantitative assessment. WATER RESEARCH 2012; 46:235-246. [PMID: 22094001 DOI: 10.1016/j.watres.2011.10.058] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/16/2011] [Revised: 10/27/2011] [Accepted: 10/31/2011] [Indexed: 05/31/2023]
Abstract
Monitoring the quality of drinking water from the treatment plant to the consumers tap is critical to ensure compliance with national standards and/or WHO guideline levels. There are a number of processes and factors affecting the water quality during transmission and distribution which are little understood. A significant obstacle for gaining a detailed knowledge of various physical and chemical processes and the effect of the hydraulic conditions on the water quality deterioration within water supply systems is the lack of reliable and low-cost (both capital and O & M) water quality sensors for continuous monitoring. This paper has two objectives. The first one is to present a detailed evaluation of the performance of a novel in-pipe multi-parameter sensor probe for reagent- and membrane-free continuous water quality monitoring in water supply systems. The second objective is to describe the results from experimental research which was conducted to acquire continuous water quality and high-frequency hydraulic data for the quantitative assessment of the water quality changes occurring under steady and unsteady-state flow conditions. The laboratory and field evaluation of the multi-parameter sensor probe showed that the sensors have a rapid dynamic response, average repeatability and unreliable accuracy. The uncertainties in the sensor data present significant challenges for the analysis and interpretation of the acquired data and their use for water quality modelling, decision support and control in operational systems. Notwithstanding these uncertainties, the unique data sets acquired from transmission and distribution systems demonstrated the deleterious effect of unsteady state flow conditions on various water quality parameters. These studies demonstrate: (i) the significant impact of the unsteady-state hydraulic conditions on the disinfectant residual, turbidity and colour caused by the re-suspension of sediments, scouring of biofilms and tubercles from the pipe and increased mixing, and the need for further experimental research to investigate these interactions; (ii) important advances in sensor technologies which provide unique opportunities to study both the dynamic hydraulic conditions and water quality changes in operational systems. The research in these two areas is critical to better understand and manage the water quality deterioration in ageing water transmission and distribution systems.
Collapse
Affiliation(s)
- Angeliki Aisopou
- Department of Civil and Environmental Engineering, Imperial College London, South Kensington, London SW7 2AZ, UK.
| | | | | |
Collapse
|
36
|
Roig B, Delpla I, Baurès E, Jung A, Thomas O. Analytical issues in monitoring drinking-water contamination related to short-term, heavy rainfall events. Trends Analyt Chem 2011. [DOI: 10.1016/j.trac.2011.04.008] [Citation(s) in RCA: 30] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|