1
|
Waqas M, Humphries UW. A critical review of RNN and LSTM variants in hydrological time series predictions. MethodsX 2024; 13:102946. [PMID: 39324077 PMCID: PMC11422155 DOI: 10.1016/j.mex.2024.102946] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2024] [Accepted: 09/01/2024] [Indexed: 09/27/2024] Open
Abstract
The rapid advancement in Artificial Intelligence (AI) and big data has developed significance in the water sector, particularly in hydrological time-series predictions. Recurrent Neural Networks (RNNs) and Long Short-Term Memory (LSTM) networks have become research focal points due to their effectiveness in modeling non-linear, time-variant hydrological systems. This review explores the different architectures of RNNs, LSTMs, and Gated Recurrent Units (GRUs) and their efficacy in predicting hydrological time-series data.•RNNs are foundational but face limitations such as vanishing gradients, which impede their ability to model long-term dependencies. LSTMs and GRUs have been developed to overcome these limitations, with LSTMs using memory cells and gating mechanisms, while GRUs provide a more streamlined architecture with similar benefits.•The integration of attention mechanisms and hybrid models that combine RNNs, LSTMs, and GRUs with other Machine learning (ML) and Deep Learning (DL) has improved prediction accuracy by capturing both temporal and spatial dependencies.•Despite their effectiveness, practical implementations of these models in hydrological time series prediction require extensive datasets and substantial computational resources. Future research should develop interpretable architectures, enhance data quality, incorporate domain knowledge, and utilize transfer learning to improve model generalization and scalability across diverse hydrological contexts.
Collapse
Affiliation(s)
- Muhammad Waqas
- The Joint Graduate School of Energy and Environment (JGSEE), King Mongkut's University of Technology Thonburi (KMUTT), Bangkok, 10140, Thailand
- Center of Excellence on Energy Technology and Environment (CEE), Ministry of Higher Education, Science, Research and Innovation, Bangkok, Thailand
| | - Usa Wannasingha Humphries
- Department of Mathematics, Faculty of Science, King Mongkut's University of Technology Thonburi (KMUTT), Bangkok, 10140, Thailand
| |
Collapse
|
2
|
Wang L, Meng F, Song H, An J, Wang Y. Multi-scale analysis of nutrient and environmental dynamics in Hongfeng Lake Southwest China. Sci Rep 2024; 14:25112. [PMID: 39443635 PMCID: PMC11499651 DOI: 10.1038/s41598-024-75812-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2024] [Accepted: 10/08/2024] [Indexed: 10/25/2024] Open
Abstract
Traditional linear correlation analysis may not fully capture the true relationship between these variables. Therefore, multi-scale running correlation analysis, such as time-dependent intrinsic correlation (TDIC) and continuous wavelet transform based on Hilbert-Huang transform (HHT), provides valuable insights into local correlations and the evolving relationship between nutrients and environmental factors over time. In this study, we investigated seven environmental factors and four water quality nutrient indicators in deep lakes on the Yungui Plateau in southwestern China. The results revealed that there may be strong correlations between environmental factors and nutrient levels during certain periods, while opposite trends may emerge at other times. These variations in correlation could be attributed to uncertain physical processes, spatial heterogeneity, or the impact of different climatic factors on local hydrological processes. Wavelet analysis indicated that changes in environmental factors lag behind those in nutrient levels, particularly on a cycle of about 12 months. This suggests that changes in environmental factors align with natural patterns after the water body has been polluted. These conclusions underscore the complexity and dynamic nature of the relationship between environmental factors and nutrient levels in water bodies, highlighting the importance of employing advanced analysis techniques to capture this complexity.
Collapse
Affiliation(s)
- Lizhi Wang
- Shandong Provincial Key Laboratory of Water and Soil Conservation and Environmental Protection, College of Resources and Environment, Linyi University, Linyi, 276005, China.
| | - Fanli Meng
- Guizhou Academy of Environmental Science Research and Design, Guiyang, China
- Guizhou Key Laboratory of Water Pollution Control and Resource Reuse, Guiyang, 550081, China
| | - Hongli Song
- Shandong Provincial Key Laboratory of Water and Soil Conservation and Environmental Protection, College of Resources and Environment, Linyi University, Linyi, 276005, China
| | - Juan An
- Shandong Provincial Key Laboratory of Water and Soil Conservation and Environmental Protection, College of Resources and Environment, Linyi University, Linyi, 276005, China
| | - Yun Wang
- Shandong Provincial Key Laboratory of Water and Soil Conservation and Environmental Protection, College of Resources and Environment, Linyi University, Linyi, 276005, China
| |
Collapse
|
3
|
Wang D, Ren Y, Yang Y, Guo H. Hybridized gated recurrent unit with variational mode decomposition and an error compensation mechanism for multi-step-ahead monthly rainfall forecasting. ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH INTERNATIONAL 2024; 31:1177-1194. [PMID: 38038925 DOI: 10.1007/s11356-023-31243-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Accepted: 11/21/2023] [Indexed: 12/02/2023]
Abstract
Highly accurate monthly rainfall predictions can provide early warnings for rain-related disasters, such as floods and droughts, and allow governments to make timely decisions. This paper proposes a two-phase error compensation model based on a gated recurrent unit (GRU), variational mode decomposition (VMD), and error compensation mechanism (ECM) (GRU-VMD-ECM) for accurate multi-step-ahead monthly rainfall forecasts. In the first phase, the GRU model is used to make an initial monthly rainfall prediction, and the error series is extracted. In the second phase, the error series is decomposed into eight subseries using the VMD method. Each subseries is then input into the GRU model to build different forecasting models. These predicted error sequences are added to the initial prediction results to obtain the final forecast. The model's performance is tested using six evaluation indicators based on Beijing's monthly rainfall data from 1951 to 2018. The results show that the error compensation mechanism significantly improved the prediction accuracy, particularly in the Nash-Sutcliffe efficiency (NSE) of single-step-ahead prediction which recorded a substantial increase of 281.16% from 0.259981 to 0.990944, as well as a decrease in root mean square error (RMSE) from 2.257580 to 0.249746. Furthermore, the GRU-VMD-ECM model outperforms the RF, GRU-CNN, and VMD-GRU models in terms of precision across all forecasting horizons. These findings highlight the potential of the GRU-VMD-ECM model in providing highly accurate monthly rainfall predictions for early warnings and informed decision-making by governments.
Collapse
Affiliation(s)
- Deyun Wang
- School of Economics and Management, China University of Geosciences, Wuhan, 430074, China.
- The Laboratory of Natural Disaster Risk Prevention and Emergency Management, China University of Geosciences, Wuhan, 430074, China.
| | - Yifei Ren
- School of Economics and Management, China University of Geosciences, Wuhan, 430074, China
| | - Yanchen Yang
- S.K. Lee Honors College, China University of Geosciences, Wuhan, 430074, China
| | - Haixiang Guo
- School of Economics and Management, China University of Geosciences, Wuhan, 430074, China
- The Laboratory of Natural Disaster Risk Prevention and Emergency Management, China University of Geosciences, Wuhan, 430074, China
| |
Collapse
|
4
|
Zou J, Wei M, Song Q, Zhou Z. A new hybrid model for photovoltaic output power prediction. ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH INTERNATIONAL 2023; 30:122934-122957. [PMID: 37980325 DOI: 10.1007/s11356-023-30878-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Accepted: 10/31/2023] [Indexed: 11/20/2023]
Abstract
Recently, with the development of renewable energy technologies, photovoltaic (PV) power generation is widely used in the grid. However, as PV power generation is influenced by external factors, such as solar radiation fluctuation, PV output power is intermittent and volatile, and thus the accurate PV output power prediction is imperative for the grid stability. To address this issue, based on complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN), improved artificial rabbits optimization (IARO) and convolutional bidirectional long short-term memory (CBiLSTM), a new hybrid model denoted by CEEMDAN-IARO-CBiLSTM is proposed. In addition, inputs of the proposed model are optimized by analyzing influential factors of PV output power with Pearson correlation coefficient method. In order to verify the prediction accuracy, CEEMDAN-IARO-CBiLSTM is compared with other well-known methods under different weather conditions and different seasons. Specifically, for different weather conditions, MAE and RMSE of the proposed model decrease by at least 0.329 and 0.411, 0.086 and 0.021, and 0.140 and 0.220, respectively. With respect to different seasons, MAE and RMSE of the proposed model decrease by at least 0.270 and 0.378, 0.158 and 0.209, 0.210 and 0.292, and 1.096 and 1.148, respectively. Moreover, two statistical tests are conducted, and the corresponding results show that the prediction performance of CEEMDAN-IARO-CBiLSTM is superior to other well-known methods.
Collapse
Affiliation(s)
- Jing Zou
- School of Physics and Electronic Engineering, Sichuan Normal University, Chengdu , 610101, Sichuan, China
| | - Menghan Wei
- School of Physics and Electronic Engineering, Sichuan Normal University, Chengdu , 610101, Sichuan, China
| | - Qixian Song
- School of Physics and Electronic Engineering, Sichuan Normal University, Chengdu , 610101, Sichuan, China
| | - Zhaorong Zhou
- School of Physics and Electronic Engineering, Sichuan Normal University, Chengdu , 610101, Sichuan, China.
- Meteorological Information and Signal Processing Key Laboratory of Sichuan Higher Education Institutes, Chengdu University of Information Technology, Chengdu, 610225, Sichuan, China.
| |
Collapse
|
5
|
P L, D SS. A novel model for rainfall prediction using hybrid stochastic-based Bayesian optimization algorithm. ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH INTERNATIONAL 2023; 30:92555-92567. [PMID: 37493914 DOI: 10.1007/s11356-023-28734-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Accepted: 07/07/2023] [Indexed: 07/27/2023]
Abstract
Rainfall forecasting is considered one of the key concerns in the meteorological department because it is related strongly to social as well as economic factors. But, because of modern context of climatic conditions and the intense activities of humans, the forecasting procedure of rainfall patterns becomes more problematic. Therefore, this paper proposes a novel timely and reliable rainfall prediction model using a hybrid stochastic Bayesian optimization approach (HS-BOA). The weather dataset containing different meteorological geographical features is provided as input to the introduced prediction method. Hybrid stochastic (HS) specifications are tuned by the Bayesian optimization algorithm (BOA) to upgrade the prediction accuracy. The weather data are initially preprocessed through the pipelines, namely, data separation, missing value prediction, weather condition cod separation, and normalization. After preprocessing, the highly correlated features are removed by correlation matrix using the Pearson correlation coefficient. Then, the most significant features which contribute more to predicting rainfall are selected through the feature selection process. At last, the suggested rainfall forecasting model accurately predicts rainfall using optimized parameters. The experimental analysis is performed, and for the proposed HS-BOA, MAE, RMSE, and COD, values attained for rainfall prediction are 0.513 mm, 59.90 mm, and 40.56 mm respectively. As a result, the proposed HS-BOA approach achieves minimum error rates with increased prediction accuracy than other existing approaches.
Collapse
Affiliation(s)
- Lathika P
- Department of Mathematics, Noorul Islam Centre for Higher Education, Kumarakovil, Thuckalay, Tamil Nadu, India.
| | - Sheeba Singh D
- Department of Mathematics, Noorul Islam Centre for Higher Education, Kumarakovil, Thuckalay, Tamil Nadu, India
| |
Collapse
|
6
|
Kassem Y, Gökçekuş H, Mosbah AAS. Prediction of monthly precipitation using various artificial models and comparison with mathematical models. ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH INTERNATIONAL 2023; 30:41209-41235. [PMID: 36630036 DOI: 10.1007/s11356-022-24912-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/02/2022] [Accepted: 12/18/2022] [Indexed: 06/17/2023]
Abstract
Precipitation (PP) prediction is an interesting topic in the meteorology or hydrology field since it is directly related to agriculture, the management of water resources in hydrologic basins, and water scarcity. Selecting the right model to predict precipitation has always been a challenge because it could help researchers to use the proper model for their purposes. Accordingly, the performance of five artificial models (feed-forward neural network, cascade forward neural network, Elman neural network, multi-layer perceptron neural network, and radial basis neural network) and three mathematical models (Poisson regression model (PRM), quadratic model, and multiple linear regression) were evaluated for their ability to predict the monthly precipitation in Mediterranean coastal cities located in Eastern part of Mediterranean Sea for the first time. Twenty-seven Mediterranean coastal cities are considered case studies. For this aim, scenario 1 and scenario 2 with various input variables are proposed. Scenario 1 is developed using the number of months (MN), maximum temperature (Tmax), minimum temperature (Tmin), downward radiation (DR), wind speed (WS), vapor pressure (VP), and actual evapotranspiration (AE). Scenario 2 is developed by adding geographical coordinates (latitude, longitude, and altitude) to the global meteorological data to see the impact of geographical coordinates on the accuracy of the prediction of monthly precipitation. This study utilized the monthly data, which were obtained from TerraClimate for the period from 2010 to 2021. Based on the performance indexes, the PRM model performed best for the prediction of monthly precipitation in all selected locations compared to other models. Moreover, the results indicate that scenario 2 ([Formula: see text]) has shown higher prediction accuracy compared to scenario 1 ([Formula: see text]). In conclusion, PRM with the combination of [[Formula: see text]] had RMSE value that was lower by 12% relative to PRM with the combination of [[Formula: see text]]. Consequently, the PRM model can be recommended for modeling the complexity of interactions for precipitation-climate conditions-geographical coordinates and predicting precipitation.
Collapse
Affiliation(s)
- Youssef Kassem
- Department of Mechanical Engineering, Near East University, Engineering Faculty, Via Mersin 10, 99138, Nicosia,Turkey, Cyprus.
- Department of Civil Engineering, Civil and Environmental Engineering Faculty, Near East University, Via Mersin 10, 99138, NicosiaTurkey, Cyprus.
- Energy, Environment, and Water Research Center, Near East University, Via Mersin 10, 99138, Nicosia,Turkey, Cyprus.
- Engineering Faculty, Kyrenia University, Via Mersin 10, 99138, KyreniaTurkey, Cyprus.
| | - Hüseyin Gökçekuş
- Department of Civil Engineering, Civil and Environmental Engineering Faculty, Near East University, Via Mersin 10, 99138, NicosiaTurkey, Cyprus
- Energy, Environment, and Water Research Center, Near East University, Via Mersin 10, 99138, Nicosia,Turkey, Cyprus
- Engineering Faculty, Kyrenia University, Via Mersin 10, 99138, KyreniaTurkey, Cyprus
| | | |
Collapse
|
7
|
Multivariate time-series blood donation/demand forecasting for resilient supply chain management during COVID-19 pandemic. CLEANER LOGISTICS AND SUPPLY CHAIN 2022. [PMCID: PMC9359598 DOI: 10.1016/j.clscn.2022.100078] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
|