1
|
Croll HC, Ikuma K, Ong SK, Sarkar S. Unified control of diverse actions in a wastewater treatment activated sludge system using reinforcement learning for multi-objective optimization. WATER RESEARCH 2024; 263:122179. [PMID: 39096812 DOI: 10.1016/j.watres.2024.122179] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/02/2023] [Revised: 07/10/2024] [Accepted: 07/28/2024] [Indexed: 08/05/2024]
Abstract
The operation of modern wastewater treatment facilities is a balancing act in which a multitude of variables are controlled to achieve a wide range of objectives, many of which are conflicting. This is especially true within secondary activated sludge systems, where significant research and industry effort has been devoted to advance control optimization strategies, both domain-driven and data-driven. Among data-driven control strategies, reinforcement learning (RL) stands out for its ability to achieve better than human performance in complex environments. While RL has been applied to activated sludge process optimization in existing literature, these applications are typically limited in scope, and never for the control of more than three actions. Expanding the scope of RL control has the potential to increase the optimization potential while concurrently reducing the number of control systems that must be tuned and maintained by operations staff. This study examined several facets of the implementation of multi-action, multi-objective RL agents, namely how many actions a single agent could successfully control and what extent of environment data was necessary to train such agents. This study observed improved control optimization with increasing action scope, though control of waste activated sludge remains a challenge. Furthermore, agents were able to maintain a high level of performance under decreased observation scope, up to a point. When compared to baseline control of the Benchmark Simulation Model No. 1 (BSM1), an RL agent controlling seven individual actions improved the average BSM1 performance metric by 8.3 %, equivalent to an annual cost savings of $40,200 after accounting for the cost of additional sensors.
Collapse
Affiliation(s)
- Henry C Croll
- Department of Civil, Construction, and Environmental Engineering, Iowa State University, Ames, IA, 50011, USA.
| | - Kaoru Ikuma
- Department of Civil, Construction, and Environmental Engineering, Iowa State University, Ames, IA, 50011, USA
| | - Say Kee Ong
- Department of Civil, Construction, and Environmental Engineering, Iowa State University, Ames, IA, 50011, USA
| | - Soumik Sarkar
- Department of Mechanical Engineering, Iowa State University, Ames, IA, 50011, USA
| |
Collapse
|
2
|
Nagpal M, Siddique MA, Sharma K, Sharma N, Mittal A. Optimizing wastewater treatment through artificial intelligence: recent advances and future prospects. WATER SCIENCE AND TECHNOLOGY : A JOURNAL OF THE INTERNATIONAL ASSOCIATION ON WATER POLLUTION RESEARCH 2024; 90:731-757. [PMID: 39141032 DOI: 10.2166/wst.2024.259] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Accepted: 07/17/2024] [Indexed: 08/15/2024]
Abstract
Artificial intelligence (AI) is increasingly being applied to wastewater treatment to enhance efficiency, improve processes, and optimize resource utilization. This review focuses on objectives, advantages, outputs, and major findings of various AI models in the three key aspects: the prediction of removal efficiency for both organic and inorganic pollutants, real-time monitoring of essential water quality parameters (such as pH, COD, BOD, turbidity, TDS, and conductivity), and fault detection in the processes and equipment integral to wastewater treatment. The prediction accuracy (R2 value) of AI technologies for pollutant removal has been reported to vary between 0.64 and 1.00. A critical aspect explored in this review is the cost-effectiveness of implementing AI systems in wastewater treatment. Numerous countries and municipalities are actively engaging in pilot projects and demonstrations to assess the feasibility and effectiveness of AI applications in wastewater treatment. Notably, the review highlights successful outcomes from these initiatives across diverse geographical contexts, showcasing the adaptability and positive impact of AI in revolutionizing wastewater treatment on a global scale. Further, insights on the ethical considerations and potential future directions for the use of AI in wastewater treatment plants have also been provided.
Collapse
Affiliation(s)
- Mudita Nagpal
- Department of Applied Sciences, Vivekananda Institute of Professional Studies-Technical Campus, Delhi 110034, India E-mail:
| | - Miran Ahmad Siddique
- Department of Applied Sciences, Vivekananda Institute of Professional Studies-Technical Campus, Delhi 110034, India
| | - Khushi Sharma
- Department of Applied Sciences, Vivekananda Institute of Professional Studies-Technical Campus, Delhi 110034, India
| | - Nidhi Sharma
- Department of Applied Sciences, Vivekananda Institute of Professional Studies-Technical Campus, Delhi 110034, India
| | - Ankit Mittal
- Department of Chemistry, Shyam Lal College, University of Delhi, Delhi 110032, India
| |
Collapse
|
3
|
Pei S, Hoang L, Fu G, Butler D. Real-time control of urban drainage systems using neuro-evolution. JOURNAL OF ENVIRONMENTAL MANAGEMENT 2024; 360:121133. [PMID: 38763119 DOI: 10.1016/j.jenvman.2024.121133] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/28/2024] [Revised: 05/08/2024] [Accepted: 05/09/2024] [Indexed: 05/21/2024]
Abstract
With climate change and urbanization, existing urban drainage systems are being stressed beyond their design capacity in many parts of the world. Real-time control (RTC) can improve the performance of these systems and reduce the need for system upgrades. However, developing optimal control policies for RTC is a challenging research area due to computational demands, high uncertainties and system dynamics. This study presents a new RTC method using neuro-evolution for controlling combined sewer overflow (CSO) in urban drainage systems. Neuro-evolution is an approach to neural network research by evolutionary algorithms. Neuro-evolution realizes RTC by training the control policy in advance, thus avoiding the online optimization process in the application period. The simulation results of the benchmark Astlingen network indicate that the trained control policy outperforms the equal filling degree strategy in terms of CSO volume reduction and robustness in the face of tank level uncertainty. The performance analysis of the typical CSO events shows that the control policy mainly makes positive contributions during 'small' CSO events rather than 'large' ones. In particular, the effectiveness of the control policy in 'small' CSO events is more prominent in the initial phase of the events compared with the final phase. This work stands to support a foundation for future studies in the control of urban water systems based on neuro-evolution.
Collapse
Affiliation(s)
- Shengwei Pei
- Centre for Water Systems, Department of Engineering, University of Exeter, EX4 4QF, United Kingdom.
| | - Lan Hoang
- IBM Research Europe UKI, Daresbury, Warrington, United Kingdom
| | - Guangtao Fu
- Centre for Water Systems, Department of Engineering, University of Exeter, EX4 4QF, United Kingdom
| | - David Butler
- Centre for Water Systems, Department of Engineering, University of Exeter, EX4 4QF, United Kingdom
| |
Collapse
|
4
|
Negm A, Ma X, Aggidis G. Deep reinforcement learning challenges and opportunities for urban water systems. WATER RESEARCH 2024; 253:121145. [PMID: 38330870 DOI: 10.1016/j.watres.2024.121145] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/20/2023] [Revised: 01/09/2024] [Accepted: 01/14/2024] [Indexed: 02/10/2024]
Abstract
The efficient and sustainable supply and transport of water is a key component to any functioning civilisation making the role of urban water systems (UWS) inherently crucial to the wellbeing of its customers. However, managing water is not a simple task. Whether it is ageing infrastructure, transient flows, air cavities or low pressures; water can be lost as a result of many issues that face UWSs. The complexity of those networks grows with the high urbanisation trends and climate change making water companies and regulatory bodies in need of new solutions. So, it comes as no surprise that many researchers are invested in innovating within the water industry to ensure that the future of our water is safe. Deep reinforcement learning (DRL) has the potential to tackle complexities that used to be very challenging as it relies on deep neural networks for function approximation and representation. This technology has conquered many fields due to its impressive results and can effectively revolutionise UWS. In this article, we explain the background of DRL and the milestones of this field using a novel taxonomy of the DRL algorithms. This will be followed by with a novel review of DRL applications in the UWS which focus on water distribution networks and stormwater systems. The review will be concluded with critical insights on how DRL can benefit different aspects of urban water systems.
Collapse
Affiliation(s)
- Ahmed Negm
- Lancaster University Energy Group, School of Engineering, Lancaster LA1 4YW, UK
| | - Xiandong Ma
- Lancaster University Energy Group, School of Engineering, Lancaster LA1 4YW, UK
| | - George Aggidis
- Lancaster University Energy Group, School of Engineering, Lancaster LA1 4YW, UK.
| |
Collapse
|
5
|
Barros Ó, Parpot P, Neves IC, Tavares T. Exploring Optimization of Zeolites as Adsorbents for Rare Earth Elements in Continuous Flow by Machine Learning Techniques. Molecules 2023; 28:7964. [PMID: 38138454 PMCID: PMC10746106 DOI: 10.3390/molecules28247964] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2023] [Revised: 11/29/2023] [Accepted: 12/04/2023] [Indexed: 12/24/2023] Open
Abstract
Unsupervised machine learning (ML) techniques are applied to the characterization of the adsorption of rare earth elements (REEs) by zeolites in continuous flow. The successful application of principal component analysis (PCA) and K-Means algorithms from ML allowed for a wide range assessment of the adsorption results. This global approach permits the evaluation of the different stages of the sorption cycles and their optimization and improvement. The results from ML are also used for the definition of a regression model to estimate other REEs' recoveries based on the known values of the tested REEs. Overall, it was possible to remove more than 70% of all REEs from aqueous solutions during the adsorption assays and to recover over 80% of the REEs entrapped on the zeolites using an optimized desorption cycle.
Collapse
Affiliation(s)
- Óscar Barros
- CEB—Centre of Biological Engineering, University of Minho, Campus de Gualtar, 4710-057 Braga, Portugal; (P.P.); (T.T.)
- CQUM, Centre of Chemistry, Chemistry Department, University of Minho, Campus de Gualtar, 4710-057 Braga, Portugal
| | - Pier Parpot
- CEB—Centre of Biological Engineering, University of Minho, Campus de Gualtar, 4710-057 Braga, Portugal; (P.P.); (T.T.)
- CQUM, Centre of Chemistry, Chemistry Department, University of Minho, Campus de Gualtar, 4710-057 Braga, Portugal
| | - Isabel C. Neves
- CEB—Centre of Biological Engineering, University of Minho, Campus de Gualtar, 4710-057 Braga, Portugal; (P.P.); (T.T.)
- CQUM, Centre of Chemistry, Chemistry Department, University of Minho, Campus de Gualtar, 4710-057 Braga, Portugal
| | - Teresa Tavares
- CEB—Centre of Biological Engineering, University of Minho, Campus de Gualtar, 4710-057 Braga, Portugal; (P.P.); (T.T.)
- LABBELS—Associate Laboratory, 4710-057 Braga, Portugal
| |
Collapse
|
6
|
Han HG, Chen C, Sun HY, Qiao JF. Multiobjective Integrated Optimal Control for Nonlinear Systems. IEEE TRANSACTIONS ON CYBERNETICS 2023; 53:7712-7722. [PMID: 36129866 DOI: 10.1109/tcyb.2022.3204030] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
The multiobjective optimal control method optimizes the performance indexes of nonlinear systems to obtain setpoints, and designs a controller to track the setpoints. However, the stepwise optimal control method that independently analyzes the optimization process may obtain unfeasible and difficult to track setpoints, which will reduce the operation and control performance of the systems. To solve this problem, a multiobjective integrated optimal control (MIOC) strategy is proposed for nonlinear systems in this article. The main contributions of MIOC are threefold. First, in the framework of multiobjective model predictive control, an integrated control structure with a comprehensive cost function and a collaborative optimization algorithm is designed to achieve the coordinate optimal control. Second, for the time inconformity of setpoints and control laws caused by the characteristic of tracking control, the different prediction horizons are designed for the comprehensive cost function. Then, the collaborative optimization algorithm is proposed for the comprehensive cost function to achieve the integrated solution of setpoints and control laws to enhance the operation and control performance of nonlinear systems. Third, the stability and control performance analysis of MIOC is provided. Finally, the proposed MIOC method is applied for a nonlinear system to demonstrate its effectiveness.
Collapse
|
7
|
Huang Y, Su R, Bu Y, Ma B. A predictive model for determining the nitrite concentration in the effluent of an anammox reactor using ensemble regression tree algorithm. CHEMOSPHERE 2023; 339:139553. [PMID: 37482314 DOI: 10.1016/j.chemosphere.2023.139553] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Revised: 07/07/2023] [Accepted: 07/16/2023] [Indexed: 07/25/2023]
Abstract
Anaerobic ammonium oxidation (anammox) is a cost-effective biological nitrogen removal method for treating wastewater. Nitrite has strong negative effect on microbial activity of anammox bacteria, while the conventional equitment available for determining nitrite on-line is challenging due to high price. By knowing the concentration of nitrite in the effluent, its concentration in the reactor can be controlled accordingly. To investigate this, an ensemble regression tree algorithm was used to establish the predictive model proposed in the current work. Moreover, the Bayesian algorithm was adopted to systematically optimize various parameters of machine learning algorithms. The predicted concentrations of nitrite were in good agreement with the observed values, and the coefficient of determination (R2) and root mean squared error (RMSE) values reached 0.91 and 4.81, respectively. Furthermore, the model established by the ensemble regression tree algorithm was compared with models established by commonly used machine learning algorithms. Finally, the established models were applied to another anammox reactor, and the predicted results of ensemble regression tree model were found to be in good agreement with the experimental values with R2 and RMSE values of 0.84 and 6.34, respectively.
Collapse
Affiliation(s)
- Yikun Huang
- Key Laboratory of Agro-Forestry Environmental Processes and Ecological Regulation of Hainan Province, School of Ecological and Environmental Science, Hainan University, Haikou, 570228, China
| | - Run Su
- Key Laboratory of Agro-Forestry Environmental Processes and Ecological Regulation of Hainan Province, School of Ecological and Environmental Science, Hainan University, Haikou, 570228, China
| | - Yinan Bu
- Key Laboratory of Agro-Forestry Environmental Processes and Ecological Regulation of Hainan Province, School of Ecological and Environmental Science, Hainan University, Haikou, 570228, China.
| | - Bin Ma
- Key Laboratory of Agro-Forestry Environmental Processes and Ecological Regulation of Hainan Province, School of Ecological and Environmental Science, Hainan University, Haikou, 570228, China.
| |
Collapse
|
8
|
Liu Z, Zou Y, Liu Y, Luo F, Wang R, Wu Z, Zhang Y. Effective adsorption of nutrients from simulated domestic sewage by modified maifanite. ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH INTERNATIONAL 2022; 29:25939-25951. [PMID: 34850346 DOI: 10.1007/s11356-021-17661-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/05/2021] [Accepted: 11/16/2021] [Indexed: 06/13/2023]
Abstract
Modified maifanite (MMF) was prepared by the synthesized method with sulfuric acid treatment and high-temperature calcination and evaluated as an effective adsorption material to remove the nutrient salt in waste watery. Compared with the raw maifanite (RMF), the MMF exhibited a higher adsorption capacity and higher removal efficiency. The results showed that the adsorption rates of total phosphorus (TP), total nitrogen (TN), ammonia nitrogen (NH3-N), nitrate-nitrogen (NOx-N), and chemical oxygen demand (COD) by MMF were 86.7%, 44.9%, 29.1%, 19.8%, and 11.9%, respectively, and compared to RMF, the average adsorption capacity of these nutrients by MMF increased by 20.5 mg/kg, 126.2 mg/kg, 61.9 mg/kg, 117.18 mg/kg, and 86.9 mg/kg, respectively. MMF maintained the basic structure and composition of maifanite, while having a rougher and looser surface, more irregular pores, wider gaps, and more active materials such as oxidizing Fe. This study suggests that MMF can be further applied to treat domestic sewage and eutrophic water.
Collapse
Affiliation(s)
- Zisen Liu
- State Key Laboratory of Freshwater Ecology and Biotechnology, Institute of Hydrobiology, Chinese Academy of Sciences, 7# Donghu South Road, Wuhan, 430072, China
- School of Environmental Studies, China University of Geosciences, Wuhan, 430074, China
| | - Yilingyun Zou
- State Key Laboratory of Freshwater Ecology and Biotechnology, Institute of Hydrobiology, Chinese Academy of Sciences, 7# Donghu South Road, Wuhan, 430072, China
- University of Chinese Academy of Sciences, Beijing, 100049, China
- School of Environmental Studies, China University of Geosciences, Wuhan, 430074, China
| | - Yunli Liu
- State Key Laboratory of Freshwater Ecology and Biotechnology, Institute of Hydrobiology, Chinese Academy of Sciences, 7# Donghu South Road, Wuhan, 430072, China
- University of Chinese Academy of Sciences, Beijing, 100049, China
- School of Environmental Studies, China University of Geosciences, Wuhan, 430074, China
| | - Feng Luo
- School of Environmental Studies, China University of Geosciences, Wuhan, 430074, China
- School of Resource & Environmental Engineering, Wuhan University of Technology, Wuhan, 430070, China
| | - Rou Wang
- State Key Laboratory of Freshwater Ecology and Biotechnology, Institute of Hydrobiology, Chinese Academy of Sciences, 7# Donghu South Road, Wuhan, 430072, China
- University of Chinese Academy of Sciences, Beijing, 100049, China
- School of Environmental Studies, China University of Geosciences, Wuhan, 430074, China
| | - Zhenbin Wu
- State Key Laboratory of Freshwater Ecology and Biotechnology, Institute of Hydrobiology, Chinese Academy of Sciences, 7# Donghu South Road, Wuhan, 430072, China
- School of Environmental Studies, China University of Geosciences, Wuhan, 430074, China
| | - Yi Zhang
- State Key Laboratory of Freshwater Ecology and Biotechnology, Institute of Hydrobiology, Chinese Academy of Sciences, 7# Donghu South Road, Wuhan, 430072, China.
- University of Chinese Academy of Sciences, Beijing, 100049, China.
- School of Environmental Studies, China University of Geosciences, Wuhan, 430074, China.
| |
Collapse
|
9
|
Steelmaking Process Optimised through a Decision Support System Aided by Self-Learning Machine Learning. Processes (Basel) 2022. [DOI: 10.3390/pr10030434] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/01/2023] Open
Abstract
This paper presents the application of a reinforcement learning (RL) algorithm, concretely Q-Learning, as the core of a decision support system (DSS) for a steelmaking subprocess, the Composition Adjustment by Sealed Argon-bubbling with Oxygen Blowing (CAS-OB) from the SSAB Raahe steel plant. Since many CAS-OB actions are selected based on operator experience, this research aims to develop a DSS to assist the operator in taking the proper decisions during the process, especially less experienced operators. The DSS is intended to supports the operators in real-time during the process to facilitate their work and optimise the process, improving material and energy efficiency, thus increasing the operation’s sustainability. The objective is that the algorithm learns the process based only on raw data from the CAS-OB historical database, and on rewards set according to the objectives. Finally, the DSS was tested and validated by a developer engineer from the CAS-OB steelmaking plant. The results show that the algorithm successfully learns the process, recommending the same actions as those taken by the operator 69.23% of the time. The algorithm also suggests a better option in 30.76% of the remaining cases. Thanks to the DSS, the heat rejection due to wrong composition is reduced by 4%, and temperature accuracy is increased to 83.33%. These improvements resulted in an estimated reduction of 2% in CO2 emissions, 0.5% in energy consumption and 1.5% in costs. Additionally, actions taken based on the operator’s experience are incorporated into the DSS knowledge, facilitating the integration of operators with lower experience in the process.
Collapse
|
10
|
Chen K, Wang H, Valverde-Pérez B, Zhai S, Vezzaro L, Wang A. Optimal control towards sustainable wastewater treatment plants based on multi-agent reinforcement learning. CHEMOSPHERE 2021; 279:130498. [PMID: 33892457 DOI: 10.1016/j.chemosphere.2021.130498] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/10/2020] [Revised: 03/25/2021] [Accepted: 04/03/2021] [Indexed: 06/12/2023]
Abstract
Wastewater treatment plants (WWTPs) are designed to eliminate pollutants and alleviate environmental pollution resulting from human activities. However, the construction and operation of WWTPs consume resources, emit greenhouse gases (GHGs) and produce residual sludge, thus require further optimization. WWTPs are complex to control and optimize because of high non-linearity and variation. This study used a novel technique, multi-agent deep reinforcement learning (MADRL), to simultaneously optimize dissolved oxygen (DO) and chemical dosage in a WWTP. The reward function was specially designed from life cycle perspective to achieve sustainable optimization. Five scenarios were considered: baseline, three different effluent quality and cost-oriented scenarios. The result shows that optimization based on LCA has lower environmental impacts compared to baseline scenario, as cost, energy consumption and greenhouse gas emissions reduce to 0.890 CNY/m3-ww, 0.530 kWh/m3-ww, 2.491 kg CO2-eq/m3-ww respectively. The cost-oriented control strategy exhibits comparable overall performance to the LCA-driven strategy since it sacrifices environmental benefits but has lower cost as 0.873 CNY/m3-ww. It is worth mentioning that the retrofitting of WWTPs based on resources should be implemented with the consideration of impact transfer. Specifically, LCA-SW scenario decreases 10 kg PO4-eq in eutrophication potential compared to the baseline within 10 days, while significantly increases other indicators. The major contributors of each indicator are identified for future study and improvement. Last, the authors discussed that novel dynamic control strategies required advanced sensors or a large amount of data, so the selection of control strategies should also consider economic and ecological conditions. In a nutshell, there are still limitations of this work and future studies are required.
Collapse
Affiliation(s)
- Kehua Chen
- Key Lab of Environmental Biotechnology, Research Center for Eco-Environmental Sciences, Chinese Academy of Sciences, 18 Shuangqing Road, Haidian District, Beijing, 100085, China; Sino-Danish Center for Education and Research, University of Chinese Academy of Sciences, Beijing, China
| | - Hongcheng Wang
- Key Lab of Environmental Biotechnology, Research Center for Eco-Environmental Sciences, Chinese Academy of Sciences, 18 Shuangqing Road, Haidian District, Beijing, 100085, China; School of Civil & Environmental Engineering, Harbin Institute of Technology (Shenzhen), Shenzhen, 518055, PR China; State Key Laboratory of Urban Water Resource and Environment, Harbin Institute of Technology, Harbin, 150001, China
| | - Borja Valverde-Pérez
- DTU Environment, Technical University of Denmark, Bygningstorvet, Building 115, 2800, Kongens Lyngby, Denmark
| | - Siyuan Zhai
- Key Lab of Environmental Biotechnology, Research Center for Eco-Environmental Sciences, Chinese Academy of Sciences, 18 Shuangqing Road, Haidian District, Beijing, 100085, China
| | - Luca Vezzaro
- DTU Environment, Technical University of Denmark, Bygningstorvet, Building 115, 2800, Kongens Lyngby, Denmark.
| | - Aijie Wang
- Key Lab of Environmental Biotechnology, Research Center for Eco-Environmental Sciences, Chinese Academy of Sciences, 18 Shuangqing Road, Haidian District, Beijing, 100085, China; State Key Laboratory of Urban Water Resource and Environment, Harbin Institute of Technology, Harbin, 150001, China.
| |
Collapse
|
11
|
Dutta D, Upreti SR. Artificial intelligence‐based process control in chemical, biochemical, and biomedical engineering. CAN J CHEM ENG 2021. [DOI: 10.1002/cjce.24246] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2023]
Affiliation(s)
- Debaprasad Dutta
- Department of Chemical Engineering Ryerson University Toronto Ontario Canada
| | - Simant R. Upreti
- Department of Chemical Engineering Ryerson University Toronto Ontario Canada
| |
Collapse
|
12
|
Liu B, Nan J, Zu X, Zhang X, Xiao Q. Identification of Genome Sequences of Polyphosphate-Accumulating Organisms by Machine Learning. Front Cell Dev Biol 2021; 8:626221. [PMID: 33537313 PMCID: PMC7848102 DOI: 10.3389/fcell.2020.626221] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2020] [Accepted: 12/15/2020] [Indexed: 11/13/2022] Open
Abstract
In the field of sewage treatment, the identification of polyphosphate-accumulating organisms (PAOs) usually relies on biological experiments. However, biological experiments are not only complicated and time-consuming, but also costly. In recent years, machine learning has been widely used in many fields, but it is seldom used in the water treatment. The present work presented a high accuracy support vector machine (SVM) algorithm to realize the rapid identification and prediction of PAOs. We obtained 6,318 genome sequences of microorganisms from the publicly available microbial genome database for comparative analysis (MBGD). Minimap2 was used to compare the genomes of the obtained microorganisms in pairs, and read the overlap. The SVM model was established using the similarity of the genome sequences. In this SVM model, the average accuracy is 0.9628 ± 0.019 with 10-fold cross-validation. By predicting 2,652 microorganisms, 22 potential PAOs were obtained. Through the analysis of the predicted potential PAOs, most of them could be indirectly verified their phosphorus removal characteristics from previous reports. The SVM model we built shows high prediction accuracy and good stability.
Collapse
Affiliation(s)
- Bohan Liu
- State Key Laboratory of Urban Water Resource and Environment, School of Environment, Harbin Institute of Technology, Harbin, China
| | - Jun Nan
- State Key Laboratory of Urban Water Resource and Environment, School of Environment, Harbin Institute of Technology, Harbin, China
| | - Xuehui Zu
- State Key Laboratory of Urban Water Resource and Environment, School of Environment, Harbin Institute of Technology, Harbin, China
| | - Xinhui Zhang
- State Key Laboratory of Urban Water Resource and Environment, School of Environment, Harbin Institute of Technology, Harbin, China
| | - Qiliang Xiao
- State Key Laboratory of Urban Water Resource and Environment, School of Environment, Harbin Institute of Technology, Harbin, China
| |
Collapse
|
13
|
Ouyang J, Li C, Wei L, Wei D, Zhao M, Zhao Z, Zhang J, Chang CC. Activated sludge and other aerobic suspended culture processes. WATER ENVIRONMENT RESEARCH : A RESEARCH PUBLICATION OF THE WATER ENVIRONMENT FEDERATION 2020; 92:1717-1725. [PMID: 32762078 DOI: 10.1002/wer.1427] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/27/2020] [Revised: 07/08/2020] [Accepted: 07/30/2020] [Indexed: 06/11/2023]
Abstract
This paper provides an overview of activated sludge related to suspended growth processes for the year 2019. The review encompasses process modeling of activated sludge, microbiology of activated sludge, process kinetics and mechanism, nitrogen and phosphorus control, design, and operation in the activated sludge field. The fate and effect of xenobiotics in activated sludge, including trace organic contaminant and heavy metal xenobiotics, which had influence on the growth of suspended sludge, are covered in this review. Compared to past reviews, many topics show increase in activity in 2019. These include, biokinetics process of aerobic granular sludge formation, pyrolysis kinetic mechanism of granular sludge. These topics are referred to formation and disintegration of granular sludge. Other sections include activated sludge settling model, toxicity resistant microbial community, nitritation-anammox processes for nitrogen removal, and respirometry used in the operation of real wastewater treatment plant are especially highlighted in this review. PRACTITIONER POINTS: Biokinetics process of aerobic granular sludge formation Toxicity resistant microbial community in activated sludge Nitritation-anammox processes for nitrogen removal in activated sludge.
Collapse
Affiliation(s)
- Jia Ouyang
- Guangzhou HKUST Fok Ying Tung Research Institute, Guang Zhou, China
| | - Chunying Li
- School of Energy and Civil Engineering, Harbin University of Commerce, Harbin, China
| | - Li Wei
- Guangzhou HKUST Fok Ying Tung Research Institute, Guang Zhou, China
- State Key Laboratory of Urban Water Resource and Environment, Harbin Institute of Technology, Harbin, Heilongjiang Province, China
| | - Dong Wei
- State Key Laboratory of Urban Water Resource and Environment, Harbin Institute of Technology, Harbin, Heilongjiang Province, China
- College of Life Sciences, Northeast Forestry University, Harbin, Heilongjiang Province, China
| | - Min Zhao
- College of Life Sciences, Northeast Forestry University, Harbin, Heilongjiang Province, China
| | - Zhen Zhao
- State Key Laboratory of Urban Water Resource and Environment, Harbin Institute of Technology, Harbin, Heilongjiang Province, China
| | - Jie Zhang
- College of Life Sciences, Northeast Forestry University, Harbin, Heilongjiang Province, China
| | - Chein-Chi Chang
- Department of Engineering and Technical Services, DC Water and Sewer Authority, Washington, DC, USA
| |
Collapse
|
14
|
Q-Learning-based parameters adaptive algorithm for active disturbance rejection control and its application to ship course control. Neurocomputing 2020. [DOI: 10.1016/j.neucom.2019.10.060] [Citation(s) in RCA: 35] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
|
15
|
Cui H, Yang SS, Pang JW, Mi HR, Nuer CC, Ding J. An improved ASM-GDA approach to evaluate the production kinetics of loosely bound and tightly bound extracellular polymeric substances in biological phosphorus removal process. RSC Adv 2020; 10:2495-2506. [PMID: 35496100 PMCID: PMC9048850 DOI: 10.1039/c9ra06845g] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2019] [Accepted: 12/03/2019] [Indexed: 11/21/2022] Open
Abstract
This study established an extended activated sludge model no. 2 (ASM2) for providing a new recognition of the contributions of both loosely-bound EPS (LB-EPS) and tightly-bound EPS (TB-EPS) into phosphorus (P) removal by incorporating their formation and degradation processes during the anaerobic-aerobic cycle. For determining the best-fit values for the new model parameters (k h,TB-EPS, k h,LB-EPS, f PP,TB-EPS, and f PP,LB-EPS) in this extended ASM2, a novel and convenient gradient descent algorithm (GDA) based ASM (ASM-GDA) method was developed. Sensitivity analysis of f PP,TB-EPS, f PP,LB-EPS, k h,TB-EPS, and k h,LB-EPS on the model target outputs of S PO4 , X TB-EPS, X LB-EPS, and X PP proved the accuracy of the chosen parameters. Eight batch experiments conducted under different influential chemical oxygen demand (COD) and P conditions were quantitatively and qualitatively analyzed. Respectively, 9.37-9.64% and 4.17-4.29% of P removal by TB-EPS and LB-EPS were achieved. Self-Organizing Map (SOM) has shown its high performance for visualization and abstraction for exhibiting the high correlations of the influential COD/P concentrations and the P% removal by TB-EPS (and LB-EPS). Comprehensive analyses of the influences of influential COD and P concentration on the biological phosphorus removal process help us in successfully establishing the mechanism kinetics of production and degradation of P in a dynamic P biological-treatment model.
Collapse
Affiliation(s)
- Hai Cui
- State Key Laboratory of Urban Water Resource and Environment, Harbin Institute of Technology Harbin 150000 PR China
| | - Shan-Shan Yang
- State Key Laboratory of Urban Water Resource and Environment, Harbin Institute of Technology Harbin 150000 PR China
| | - Ji-Wei Pang
- State Key Laboratory of Urban Water Resource and Environment, Harbin Institute of Technology Harbin 150000 PR China
| | - Hai-Rong Mi
- College of Aerospace and Civil Engineering, Harbin Engineering University Harbin 150001 PR China
| | - Chen-Chen Nuer
- College of Aerospace and Civil Engineering, Harbin Engineering University Harbin 150001 PR China
| | - Jie Ding
- State Key Laboratory of Urban Water Resource and Environment, Harbin Institute of Technology Harbin 150000 PR China
| |
Collapse
|
16
|
Antwi P, Zhang D, Xiao L, Kabutey FT, Quashie FK, Luo W, Meng J, Li J. Modeling the performance of Single-stage Nitrogen removal using Anammox and Partial nitritation (SNAP) process with backpropagation neural network and response surface methodology. THE SCIENCE OF THE TOTAL ENVIRONMENT 2019; 690:108-120. [PMID: 31284185 DOI: 10.1016/j.scitotenv.2019.06.530] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/20/2019] [Revised: 06/29/2019] [Accepted: 06/30/2019] [Indexed: 06/09/2023]
Abstract
Two novel feedforward backpropagation Artificial Neural Networks (ANN)-based-models (8:NH:1 and 7:NH:1) combined with Box-Behnken design of experiments methodology was proposed and developed to model NH4+ and Total Nitrogen (TN) removal within an upflow-sludge-bed (USB) reactor treating nitrogen-rich wastewater via Single-stage Nitrogen removal using Anammox and Partial nitritation (SNAP) process. ANN were developed by optimizing network architecture parameters via response surface methodology. Based on the goodness-of-fit standards, the proposed three-layered NH4+ and TN removal ANN-based-models trained with Levenberg-Marquardt-algorithm demonstrated high-performance as computations exhibited smaller deviations-(±2.1%) as well as satisfactory coefficient of determination (R2), fractional variance-(FV), and index of agreement-(IA) ranging 0.989-0.997, 0.003-0.031 and 0.993-0.998, respectively. The computational results affirmed that the ANN architecture which was optimized with response surface methodology enhanced the efficiency of the ANN-based-models. Furthermore, the overall performance of the developed ANN-based models revealed that modeling intricate biological systems (such as SNAP) using ANN-based models with the view to improve removal efficiencies, establish process control strategies and optimize performance is highly feasible. Microbial community analysis conducted with 16S rRNA high-throughput approach revealed that Candidatus Kuenenia was the most pronounced genera which accounted for 13.11% followed by Nitrosomonas-(6.23%) and Proteocatella-(3.1%), an indication that nitrogen removal pathway within the USB was mainly via partial-nitritation/anammox process.
Collapse
Affiliation(s)
- Philip Antwi
- Jiangxi University of Science and Technology, School of Resources and Environmental Engineering, Jiangxi Key Laboratory of Mining & Metallurgy Environmental Pollution Control, Jiangxi Province, Ganzhou City 341000, China.
| | - Dachao Zhang
- Jiangxi University of Science and Technology, School of Resources and Environmental Engineering, Jiangxi Key Laboratory of Mining & Metallurgy Environmental Pollution Control, Jiangxi Province, Ganzhou City 341000, China.
| | - Longwen Xiao
- Jiangxi University of Science and Technology, School of Resources and Environmental Engineering, Jiangxi Key Laboratory of Mining & Metallurgy Environmental Pollution Control, Jiangxi Province, Ganzhou City 341000, China.
| | - Felix Tetteh Kabutey
- Harbin Institute of Technology, School of Environmental, State Key Laboratory of Urban Water Resource and Environment, 73 Huanghe Road, Harbin 150090, China
| | - Frank Koblah Quashie
- Jiangxi University of Science and Technology, School of Resources and Environmental Engineering, Jiangxi Key Laboratory of Mining & Metallurgy Environmental Pollution Control, Jiangxi Province, Ganzhou City 341000, China
| | - Wuhui Luo
- Jiangxi University of Science and Technology, School of Resources and Environmental Engineering, Jiangxi Key Laboratory of Mining & Metallurgy Environmental Pollution Control, Jiangxi Province, Ganzhou City 341000, China
| | - Jia Meng
- Harbin Institute of Technology, School of Environmental, State Key Laboratory of Urban Water Resource and Environment, 73 Huanghe Road, Harbin 150090, China; University of Queensland, Advanced Water Management Centre, Gehrman Building, Research Road, The St Lucia, Brisbane, QLD 4072, Australia
| | - Jianzheng Li
- Harbin Institute of Technology, School of Environmental, State Key Laboratory of Urban Water Resource and Environment, 73 Huanghe Road, Harbin 150090, China
| |
Collapse
|