Towards a more efficient and cost-sensitive extreme learning machine: A state-of-the-art review of recent trend

A construction strategy of Kriging surrogate model based on Rosenblatt transformation of associated random variables and its application in groundwater remediation

When using simulation-optimization models for optimizing the design of groundwater pumping-treatment plans for pollution, building a surrogate model for the numerical simulation model has become an effective means of overcoming the computational load of such models. However, previous studies often treated pumping time as a single optimization variable, leading to unnecessary excessive pumping. This paper considers the location, pumping rate, start time, and end time of each candidate pumping well as optimization variables, and proposes a Rosenblatt-transform-based optimal Latin hypercube sampling method for the associated random variables to ensure that the start time is less than or equal to the end time. This method is coupled with an adaptive sampling method based on batch local optimal solutions to construct a dynamic adaptive Kriging surrogate model for the numerical model, ensuring that the true value of the optimal remediation scheme is not lost. The results show that, at the final stage of remediation, the pollutant concentration in the 4 scenarios achieves comprehensive compliance. However, when considering the minimization of remediation costs as the evaluation criterion, the remediation scheme in scenario 1 (the pumping start and end times are independent optimization variables for all candidate pumping wells) is optimal. In the optimization design of groundwater pumping-treatment plans, the pumping wells should be arranged in the midstream and downstream regions of the contaminant plume and parallel to the regional flow direction. This paper provides a method reference for the construction and adaptive updating of surrogate models involving associated random variables, as well as guidance for the dynamic optimization of groundwater pumping and treatment at contaminated sites.

Online dynamical learning and sequence memory with neuromorphic nanowire networks

Nanowire Networks (NWNs) belong to an emerging class of neuromorphic systems that exploit the unique physical properties of nanostructured materials. In addition to their neural network-like physical structure, NWNs also exhibit resistive memory switching in response to electrical inputs due to synapse-like changes in conductance at nanowire-nanowire cross-point junctions. Previous studies have demonstrated how the neuromorphic dynamics generated by NWNs can be harnessed for temporal learning tasks. This study extends these findings further by demonstrating online learning from spatiotemporal dynamical features using image classification and sequence memory recall tasks implemented on an NWN device. Applied to the MNIST handwritten digit classification task, online dynamical learning with the NWN device achieves an overall accuracy of 93.4%. Additionally, we find a correlation between the classification accuracy of individual digit classes and mutual information. The sequence memory task reveals how memory patterns embedded in the dynamical features enable online learning and recall of a spatiotemporal sequence pattern. Overall, these results provide proof-of-concept of online learning from spatiotemporal dynamics using NWNs and further elucidate how memory can enhance learning.

A Combined Model Based on the Social Cognitive Optimization Algorithm for Wind Speed Forecasting

The use of wind power generation can reduce the pollution in the environment and solve the problem of power shortages on offshore islands, grasslands, pastoral areas, mountain areas, and highlands. Wind speed forecasting plays a significant role in wind farms. It can improve economic and social benefits and make an operation schedule for wind turbines on large wind farms. This paper proposes a combined model based on the existing artificial neural network algorithms for wind speed forecasting at different heights. We first use the wavelet threshold method with the original wind speed dataset for noise reduction. After that, the three artificial neural networks, extreme learning machine (ELM), Elman neural network, and Long Short-term Memory (LSTM) neural network, are applied for wind speed forecasting. In addition, the variance reciprocal method and social cognitive optimization (SCO) algorithm are used to optimize the weight coefficients of the combined model. In order to evaluate the forecasting performance of the combined model, we select wind speed data at three heights (20 m, 50 m, and 80 m) at the National Wind Technology Center M2 Tower. The experimental results show that the forecasting performance of the combined model is better than the single model, and it has a good forecasting performance for the wind speed at different heights.

A new insight for real-time wastewater quality prediction using hybridized kernel-based extreme learning machines with advanced optimization algorithms

Accurate prediction of inlet chemical oxygen demand (COD) is vital for better planning and management of wastewater treatment plants. The COD values at the inlet follow a complex nonstationary pattern, making its prediction challenging. This study compared the performance of several novel machine learning models developed through hybridizing kernel-based extreme learning machines (KELMs) with intelligent optimization algorithms for the reliable prediction of real-time COD values. The combined time-series learning method and consumer behaviours, estimated from water-use data (hour/day), were used as the supplementary inputs of the hybrid KELM models. Comparison of model performances for different input combinations revealed the best performance using up to 2-day lag values of COD with the other wastewater properties. The results also showed the best performance of the KELM-salp swarm algorithm (SSA) model among all the hybrid models with a minimum root mean square error of 0.058 and mean absolute error of 0.044.

Random-based networks with dropout for embedded systems

Random-based learning paradigms exhibit efficient training algorithms and remarkable generalization performances. However, the computational cost of the training procedure scales with the cube of the number of hidden neurons. The paper presents a novel training procedure for random-based neural networks, which combines ensemble techniques and dropout regularization. This limits the computational complexity of the training phase without affecting classification performance significantly; the method best fits Internet of Things (IoT) applications. In the training algorithm, one first generates a pool of random neurons; then, an ensemble of independent sub-networks (each including a fraction of the original pool) is trained; finally, the sub-networks are integrated into one classifier. The experimental validation compared the proposed approach with state-of-the-art solutions, by taking into account both generalization performance and computational complexity. To verify the effectiveness in IoT applications, the training procedures were deployed on a pair of commercially available embedded devices. The results showed that the proposed approach overall improved accuracy, with a minor degradation in performance in a few cases. When considering embedded implementations as compared with conventional architectures, the speedup of the proposed method scored up to 20× in IoT devices.

A Hybrid Method Based on Extreme Learning Machine and Wavelet Transform Denoising for Stock Prediction

The trend prediction of the stock is a main challenge. Accidental factors often lead to short-term sharp fluctuations in stock markets, deviating from the original normal trend. The short-term fluctuation of stock price has high noise, which is not conducive to the prediction of stock trends. Therefore, we used discrete wavelet transform (DWT)-based denoising to denoise stock data. Denoising the stock data assisted us to eliminate the influences of short-term random events on the continuous trend of the stock. The denoised data showed more stable trend characteristics and smoothness. Extreme learning machine (ELM) is one of the effective training algorithms for fully connected single-hidden-layer feedforward neural networks (SLFNs), which possesses the advantages of fast convergence, unique results, and it does not converge to a local minimum. Therefore, this paper proposed a combination of ELM- and DWT-based denoising to predict the trend of stocks. The proposed method was used to predict the trend of 400 stocks in China. The prediction results of the proposed method are a good proof of the efficacy of DWT-based denoising for stock trends, and showed an excellent performance compared to 12 machine learning algorithms (e.g., recurrent neural network (RNN) and long short-term memory (LSTM)).

Deep learning in electron microscopy

Deep learning is transforming most areas of science and technology, including electron microscopy. This review paper offers a practical perspective aimed at developers with limited familiarity. For context, we review popular applications of deep learning in electron microscopy. Following, we discuss hardware and software needed to get started with deep learning and interface with electron microscopes. We then review neural network components, popular architectures, and their optimization. Finally, we discuss future directions of deep learning in electron microscopy.