1
|
Shim J, Lee S, Yun N, Son M, Chae SH, Cho KH. Autonomous real-time control for membrane capacitive deionization. WATER RESEARCH 2024; 262:122086. [PMID: 39032338 DOI: 10.1016/j.watres.2024.122086] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/06/2024] [Revised: 07/10/2024] [Accepted: 07/11/2024] [Indexed: 07/23/2024]
Abstract
Artificial intelligence has been employed to simulate and optimize the performance of membrane capacitive deionization (MCDI), an emerging ion separation process. However, a real-time control for optimal MCDI operation has not been investigated yet. In this study, we aimed to develop a reinforcement learning (RL)-based control model and investigate the model to find an energy-efficient MCDI operation strategy. To fulfill the objectives, we established three long-short term memory models to predict applied voltage, outflow pH, and outflow electrical conductivity. Also, four RL agents were trained to minimize outflow concentration and energy consumption simultaneously. Consequently, actor-critic (A2C) and proximal policy optimization (PPO2) achieved the ion separation goal (<0.8 mS/cm) as they determined the electrical current and pump speed to be low. Particularly, A2C kept the parameters consistent in charging MCDI, which caused lower energy consumption (0.0128 kWh/m3) than PPO2 (0.0363 kWh/m3). To understand the decision-making process of A2C, the Shapley additive explanation based on the decision tree model estimated the influence of input parameters on the control parameters. The results of this study demonstrate the feasibility of RL-based controls in MCDI operations. Thus, we expect that the RL-based control model can improve further and enhance the efficiency of water treatment technologies.
Collapse
Affiliation(s)
- Jaegyu Shim
- Department of Civil Urban Earth and Environmental Engineering, Ulsan National Institute of Science and Technology, UNIST-gil 50, Ulsan 44919, Republic of Korea
| | - Suin Lee
- School of Civil, Environmental and Architectural Engineering, Korea University, 145 Anam-ro, Seongbuk-gu, Seoul 02841, Republic of Korea
| | - Nakyeong Yun
- Department of Environmental Health and Engineering, Johns Hopkins University, Baltimore, MD 21205, United States
| | - Moon Son
- Center for Water Cycle Research, Korea Institute of Science and Technology, 5 Hwarang-ro 14-gil, Seongbuk-gu, Seoul 02792, Republic of Korea; Division of Energy and Environment Technology, KIST-School, University of Science and Technology, Seoul 02792, Republic of Korea
| | - Sung Ho Chae
- Center for Water Cycle Research, Korea Institute of Science and Technology, 5 Hwarang-ro 14-gil, Seongbuk-gu, Seoul 02792, Republic of Korea.
| | - Kyung Hwa Cho
- School of Civil, Environmental and Architectural Engineering, Korea University, 145 Anam-ro, Seongbuk-gu, Seoul 02841, Republic of Korea.
| |
Collapse
|
2
|
Eryildiz B, Ozgun H, Ersahin ME, Koyuncu I. Antiviral drugs against influenza: Treatment methods, environmental risk assessment and analytical determination. JOURNAL OF ENVIRONMENTAL MANAGEMENT 2022; 318:115523. [PMID: 35779301 DOI: 10.1016/j.jenvman.2022.115523] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/07/2022] [Revised: 06/08/2022] [Accepted: 06/11/2022] [Indexed: 06/15/2023]
Abstract
Over the past few years, antiviral drugs against influenza are considered emerging contaminants since they cause environmental toxicity even at low concentrations. They have been found in environmental matrices all around the world, showing that conventional treatment methods fail to remove them from water and wastewater. In addition, the metabolites and transformation products of these drugs can be more persistent than original in the environment. Several techniques to degrade/remove antiviral drugs against influenza have been investigated to prevent this contamination. In this study, the characteristics of antiviral drugs against influenza, their measurement by analytical methods, and their removal in both water and wastewater treatment plants (WWTPs) were presented. Different treatment methods, such as traditional procedures (biological processes, filtration, coagulation, flocculation, and sedimentation), advanced oxidation processes (AOPs), adsorption and combined methods, were assessed. Ecotoxicological effects of both the antiviral drug and its metabolites as well as the transformation products formed as a result of treatment were evaluated. In addition, future perspectives for improving the removal of antiviral drugs against influenza, their metabolites and transformation products were further discussed. The research indicated that the main tested techniques in this study were ozonation, photolysis and photocatalysis. Combined methods, particularly those that use renewable energy and waste materials, appear to be the optimum approach for the treatment of effluents containing antiviral drugs against influenza. In light of high concentrations or probable antiviral resistance, this comprehensive assessment suggests that antiviral drug monitoring is required, and some of those substances may cause toxicological effects.
Collapse
Affiliation(s)
- Bahriye Eryildiz
- Istanbul Technical University, Environmental Engineering Department, Maslak, 34469, Istanbul, Turkey; National Research Center on Membrane Technologies, Istanbul Technical University, Maslak, 34469, Istanbul, Turkey
| | - Hale Ozgun
- Istanbul Technical University, Environmental Engineering Department, Maslak, 34469, Istanbul, Turkey; National Research Center on Membrane Technologies, Istanbul Technical University, Maslak, 34469, Istanbul, Turkey
| | - Mustafa Evren Ersahin
- Istanbul Technical University, Environmental Engineering Department, Maslak, 34469, Istanbul, Turkey; National Research Center on Membrane Technologies, Istanbul Technical University, Maslak, 34469, Istanbul, Turkey
| | - Ismail Koyuncu
- Istanbul Technical University, Environmental Engineering Department, Maslak, 34469, Istanbul, Turkey; National Research Center on Membrane Technologies, Istanbul Technical University, Maslak, 34469, Istanbul, Turkey.
| |
Collapse
|
3
|
Wang Q, Fang K, He C, Wang K. Ammonia removal from municipal wastewater via membrane capacitive deionization (MCDI) in pilot-scale. Sep Purif Technol 2022. [DOI: 10.1016/j.seppur.2022.120469] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|