An Attention-Based Multilayer GRU Model for Multistep-Ahead Short-Term Load Forecasting†

Prediction of Protein-Protein Interactions Based on Integrating Deep Learning and Feature Fusion

Understanding protein-protein interactions (PPIs) helps to identify protein functions and develop other important applications such as drug preparation and protein-disease relationship identification. Deep-learning-based approaches are being intensely researched for PPI determination to reduce the cost and time of previous testing methods. In this work, we integrate deep learning with feature fusion, harnessing the strengths of both approaches, handcrafted features, and protein sequence embedding. The accuracies of the proposed model using five-fold cross-validation on Yeast core and Human datasets are 96.34% and 99.30%, respectively. In the task of predicting interactions in important PPI networks, our model correctly predicted all interactions in one-core, Wnt-related, and cancer-specific networks. The experimental results on cross-species datasets, including Caenorhabditis elegans, Helicobacter pylori, Homo sapiens, Mus musculus, and Escherichia coli, also show that our feature fusion method helps increase the generalization capability of the PPI prediction model.

DDFC: deep learning approach for deep feature extraction and classification of brain tumors using magnetic resonance imaging in E-healthcare system

This research explores the use of gated recurrent units (GRUs) for automated brain tumor detection using MRI data. The GRU model captures sequential patterns and considers spatial information within individual MRI images and the temporal evolution of lesion characteristics. The proposed approach improves the accuracy of tumor detection using MRI images. The model's performance is benchmarked against conventional CNNs and other recurrent architectures. The research addresses interpretability concerns by employing attention mechanisms that highlight salient features contributing to the model's decisions. The proposed model attention-gated recurrent units (A-GRU) results show promising results, indicating that the proposed model surpasses the state-of-the-art models in terms of accuracy and obtained 99.32% accuracy. Due to the high predictive capability of the proposed model, we recommend it for the effective diagnosis of Brain tumors in the E-healthcare system.

Students learning performance prediction based on feature extraction algorithm and attention-based bidirectional gated recurrent unit network

With the development of information technology construction in schools, predicting student grades has become a hot area of application in current educational research. Using data mining to analyze the influencing factors of students' performance and predict their grades can help students identify their shortcomings, optimize teachers' teaching methods and enable parents to guide their children's progress. However, there are no models that can achieve satisfactory predictions for education-related public datasets, and most of these weakly correlated factors in the datasets can still adversely affect the predictive effect of the model. To solve this issue and provide effective policy recommendations for the modernization of education, this paper seeks to find the best grade prediction model based on data mining. Firstly, the study uses the Factor Analyze (FA) model to extract features from the original data and achieve dimension reduction. Then, the Bidirectional Gate Recurrent Unit (BiGRU) model and attention mechanism are utilized to predict grades. Lastly, Comparing the prediction results of ablation experiments and other single models, such as linear regression (LR), back propagation neural network (BP), random forest (RF), and Gate Recurrent Unit (GRU), the FA-BiGRU-attention model achieves the best prediction effect and performs equally well in different multi-step predictions. Previously, problems with students' grades were only detected when they had already appeared. However, the methods presented in this paper enable the prediction of students' learning in advance and the identification of factors affecting their grades. Therefore, this study has great potential to provide data support for the improvement of educational programs, transform the traditional education industry, and ensure the sustainable development of national talents.

High-Temperature Compression Behaviors and Constitutive Models of a 7046-Aluminum Alloy

High-temperature forming behaviors of a 7046-aluminum alloy were investigated by hot compression experiments. The microstructural evolution features with the changes in deformation parameters were dissected. Results indicated the formation of massive dislocation clusters/cells and subgrains through the intense DRV mechanism at low compression temperature. With an increase in deformation temperature, the annihilation of dislocations and the coarsening of subgrains/DRX grains became prominent, due to the collaborative effects of the DRV and DRX mechanisms. However, the growth of subgrains and DRX grains displayed the weakening trend at high strain rates. Moreover, two constitutive models involving a physically based (PB) model and a gate recurrent unit (GRU) model were proposed for predicting the hot compression features. By validation analysis, the predicted values of true stress perfectly fit with the experimental data, indicating that both the proposed PB model and the GRU model can accurately predict the hot compression behaviors of 7046-aluminum alloys.

A hybrid model of modal decomposition and gated recurrent units for short-term load forecasting

Electrical load forecasting is important to ensuring power systems are operated both economically and safely. However, accurately forecasting load is difficult because of variability and frequency aliasing. To eliminate frequency aliasing, some methods set parameters that depend on experiences. The present study proposes an adaptive hybrid model of modal decomposition and gated recurrent units (GRU) to reduce frequency aliasing and series randomness. This model uses average sample entropy and mutual correlation to jointly determine the modal number in the decomposition. Random adjustment parameters were introduced to the Adam algorithm to improve training speed. To assess the applicability and accuracy of the proposed hybrid model, it was compared with some state of the art forecasting methods. The results, which were validated by actual data sets from Shaanxi province, China, show that the proposed model had a higher accuracy and better reliability compared to the other forecasting methods.

Ultra-Short-Term Wind Power Forecasting Based on CGAN-CNN-LSTM Model Supported by Lidar

Accurate prediction of wind power is of great significance to the stable operation of the power system and the vigorous development of the wind power industry. In order to further improve the accuracy of ultra-short-term wind power forecasting, an ultra-short-term wind power forecasting method based on the CGAN-CNN-LSTM algorithm is proposed. Firstly, the conditional generative adversarial network (CGAN) is used to fill in the missing segments of the data set. Then, the convolutional neural network (CNN) is used to extract the eigenvalues of the data, combined with the long short-term memory network (LSTM) to jointly construct a feature extraction module, and add an attention mechanism after the LSTM to assign weights to features, accelerate model convergence, and construct an ultra-short-term wind power forecasting model combined with the CGAN-CNN-LSTM. Finally, the position and function of each sensor in the Sole du Moulin Vieux wind farm in France is introduced. Then, using the sensor observation data of the wind farm as a test set, the CGAN-CNN-LSTM model was compared with the CNN-LSTM, LSTM, and SVM to verify the feasibility. At the same time, in order to prove the universality of this model and the ability of the CGAN, the model of the CNN-LSTM combined with the linear interpolation method is used for a controlled experiment with a data set of a wind farm in China. The final test results prove that the CGAN-CNN-LSTM model is not only more accurate in prediction results, but also applicable to a wide range of regions and has good value for the development of wind power.

Energy consumption prediction using the GRU-MMattention-LightGBM model with features of Prophet decomposition

The prediction of energy consumption is of great significance to the stability of the regional energy supply. In previous research on energy consumption forecasting, researchers have constantly proposed improved neural network prediction models or improved machine learning models to predict time series data. Combining the well-performing machine learning model and neural network model in energy consumption prediction, we propose a hybrid model architecture of GRU-MMattention-LightGBM with feature selection based on Prophet decomposition. During the prediction process, first, the prophet features are extracted from the original time series. We select the best LightGBM model in the training set and save the best parameters. Then, the Prophet feature is input to GRU-MMattention for training. Finally, MLP is used to learn the final prediction weight between LightGBM and GRU-MMattention. After the prediction weights are learned, the final prediction result is determined. The innovation of this paper lies in that we propose a structure to learn the internal correlation between features based on Prophet feature extraction combined with the gating and attention mechanism. The structure also has the characteristics of a strong anti-noise ability of the LightGBM method, which can reduce the impact of the energy consumption mutation point on the overall prediction effect of the model. In addition, we propose a simple method to select the hyperparameters of the time window length using ACF and PACF diagrams. The MAPE of the GRU-MMattention-LightGBM model is 1.69%, and the relative error is 8.66% less than that of the GRU structure and 2.02% less than that of the LightGBM prediction. Compared with a single method, the prediction accuracy and stability of this hybrid architecture are significantly improved.

Short-Term Drift Prediction of Multi-Functional Buoys in Inland Rivers Based on Deep Learning

The multi-functional buoy is an important facility for assisting the navigation of inland waterway ships. Therefore, real-time tracking of its position is an essential process to ensure the safety of ship navigation. Aiming at the problem of the low accuracy of multi-functional buoy drift prediction, an integrated deep learning model incorporating the attention mechanism and ResNet-GRU (RGA) to predict short-term drift values of buoys is proposed. The model has the strong feature expression capability of ResNet and the temporal memory capability of GRU, and the attention mechanism can capture important information adaptively, which can solve the nonlinear time series drift prediction problem well. In this paper, the data collected from multi-functional buoy #4 at Nantong anchorage No. 2 in the Yangtze River waters in China were studied as an example, and first linear interpolation was used for filling in missing values; then, input variables were selected based on Pearson correlation analysis, and finally, the model structure was designed for training and testing. The experimental results show that the mean square error, mean absolute error, root mean square error and mean percentage error of the RGA model on the test set are 5.113036, 1.609969, 2.261202 and 15.575886, respectively, which are significantly better than other models. This study provides a new idea for predicting the short-term drift of multi-functional buoys, which is helpful for their tracking and management.

Multi-Step Hourly Power Consumption Forecasting in a Healthcare Building with Recurrent Neural Networks and Empirical Mode Decomposition

Short-term forecasting of electric energy consumption has become a critical issue for companies selling and buying electricity because of the fluctuating and rising trend of its price. Forecasting tools based on Artificial Intelligence have proved to provide accurate and reliable prediction, especially Neural Networks, which have been widely used and have become one of the preferred ones. In this work, two of them, Long Short-Term Memories and Gated Recurrent Units, have been used along with a preprocessing algorithm, the Empirical Mode Decomposition, to make up a hybrid model to predict the following 24 hourly consumptions (a whole day ahead) of a hospital. Two different datasets have been used to forecast them: a univariate one in which only consumptions are used and a multivariate one in which other three variables (reactive consumption, temperature, and humidity) have been also used. The results achieved show that the best performances were obtained with the multivariate dataset. In this scenario, the hybrid models (neural network with preprocessing) clearly outperformed the simple ones (only the neural network). Both neural models provided similar performances in all cases. The best results (Mean Absolute Percentage Error: 3.51% and Root Mean Square Error: 55.06) were obtained with the Long Short-Term Memory with preprocessing with the multivariate dataset.

Short-Term Streamflow Forecasting Using Hybrid Deep Learning Model Based on Grey Wolf Algorithm for Hydrological Time Series

The effects of developing technology and rapid population growth on the environment have been expanding gradually. Particularly, the growth in water consumption has revealed the necessity of water management. In this sense, accurate flow estimation is important to water management. Therefore, in this study, a grey wolf algorithm (GWO)-based gated recurrent unit (GRU) hybrid model is proposed for streamflow forecasting. In the study, daily flow data of Üçtepe and Tuzla flow observation stations located in various water collection areas of the Seyhan basin were utilized. In the test and training analysis of the models, the first 75% of the data were used for training, and the remaining 25% for testing. The accuracy and success of the hybrid model were compared via the comparison model and linear regression, one of the most basic models of artificial neural networks. The estimation results of the models were analyzed using different statistical indexes. Better results were obtained for the GWO-GRU hybrid model compared to the benchmark models in all statistical metrics except SD at the Üçtepe station and the whole Tuzla station. At Üçtepe, the FMS, despite the RMSE and MAE of the hybrid model being 82.93 and 85.93 m3/s, was 124.57 m3/s, and it was 184.06 m3/s in the single GRU model. We achieved around 34% and 53% improvements, respectively. Additionally, the R2 values for Tuzla FMS were 0.9827 and 0.9558 from GWO-GRU and linear regression, respectively. It was observed that the hybrid GWO-GRU model could be used successfully in forecasting studies.

Interpretable Short-Term Electrical Load Forecasting Scheme Using Cubist

Daily peak load forecasting (DPLF) and total daily load forecasting (TDLF) are essential for optimal power system operation from one day to one week later. This study develops a Cubist-based incremental learning model to perform accurate and interpretable DPLF and TDLF. To this end, we employ time-series cross-validation to effectively reflect recent electrical load trends and patterns when constructing the model. We also analyze variable importance to identify the most crucial factors in the Cubist model. In the experiments, we used two publicly available building datasets and three educational building cluster datasets. The results showed that the proposed model yielded averages of 7.77 and 10.06 in mean absolute percentage error and coefficient of variation of the root mean square error, respectively. We also confirmed that temperature and holiday information are significant external factors, and electrical loads one day and one week ago are significant internal factors.

A Two-Stage Multistep-Ahead Electricity Load ForecastingScheme Based on LightGBM and Attention-BiLSTM

An efficient energy operation strategy for the smart grid requires accurate day-ahead electricity load forecasts with high time resolutions, such as 15 or 30 min. Most high-time resolution electricity load prediction techniques deal with a single output prediction, so their ability to cope with sudden load changes is limited. Multistep-ahead forecasting addresses this problem, but conventional multistep-ahead prediction models suffer from deterioration in prediction performance as the prediction range is expanded. In this paper, we propose a novel two-stage multistep-ahead forecasting model that combines a single-output forecasting model and a multistep-ahead forecasting model to solve the aforementioned problem. In the first stage, we perform a single-output prediction based on recent electricity load data using a light gradient boosting machine with time-series cross-validation, and feed it to the second stage. In the second stage, we construct a multistep-ahead forecasting model that applies an attention mechanism to sequence-to-sequence bidirectional long short-term memory (S2S ATT-BiLSTM). Compared to the single S2S ATT-BiLSTM model, our proposed model achieved improvements of 3.23% and 4.92% in mean absolute percentage error and normalized root mean square error, respectively.

Short-Term Multiple Load Forecasting Model of Regional Integrated Energy System Based on QWGRU-MTL

In order to improve the accuracy of the multiple load forecasting of a regional integrated energy system, a short-term multiple load forecasting model based on the quantum weighted GRU and multi-task learning framework is proposed in this paper. Firstly, correlation analysis is carried out using a maximum information coefficient to select the input of the model. Then, a multi-task learning architecture is constructed based on the quantum weighted GRU neural network, and the coupling information among multiple loads is learned through the sharing layer in order to improve the prediction accuracy of multiple loads. Finally, the PSO algorithm is used to optimize the parameters of the quantum weighted GRU. The simulation data of a regional integrated energy system in northern China are used to predict the power and cooling loads on summer weekdays and rest days, and the results show that, compared with the LSTM, GRU and single task learning QWGRU models, the proposed model is more effective in the multiple load forecasting of a regional integrated energy system.