An Advanced Pruning Method in the Architecture of Extreme Learning Machines Using L1-Regularization and Bootstrapping

k-Tournament Grasshopper Extreme Learner for FMG-Based Gesture Recognition

The recognition of hand signs is essential for several applications. Due to the variation of possible signals and the complexity of sensor-based systems for hand gesture recognition, a new artificial neural network algorithm providing high accuracy with a reduced architecture and automatic feature selection is needed. In this paper, a novel classification method based on an extreme learning machine (ELM), supported by an improved grasshopper optimization algorithm (GOA) as a core for a weight-pruning process, is proposed. The k-tournament grasshopper optimization algorithm was implemented to select and prune the ELM weights resulting in the proposed k-tournament grasshopper extreme learner (KTGEL) classifier. Myographic methods, such as force myography (FMG), deliver interesting signals that can build the basis for hand sign recognition. FMG was investigated to limit the number of sensors at suitable positions and provide adequate signal processing algorithms for perspective implementation in wearable embedded systems. Based on the proposed KTGEL, the number of sensors and the effect of the number of subjects was investigated in the first stage. It was shown that by increasing the number of subjects participating in the data collection, eight was the minimal number of sensors needed to result in acceptable sign recognition performance. Moreover, implemented with 3000 hidden nodes, after the feature selection wrapper, the ELM had both a microaverage precision and a microaverage sensitivity of 97% for the recognition of a set of gestures, including a middle ambiguity level. The KTGEL reduced the hidden nodes to only 1000, reaching the same total sensitivity with a reduced total precision of only 1% without needing an additional feature selection method.

A Novel Fusion Pruning Algorithm Based on Information Entropy Stratification and IoT Application

To further reduce the size of the neural network model and enable the network to be deployed on mobile devices, a novel fusion pruning algorithm based on information entropy stratification is proposed in this paper. Firstly, the method finds similar filters and removes redundant parts by Affinity Propagation Clustering, then secondly further prunes the channels by using information entropy stratification and batch normalization (BN) layer scaling factor, and finally restores the accuracy training by fine-tuning to achieve a reduced network model size without losing network accuracy. Experiments are conducted on the vgg16 and Resnet56 network using the cifar10 dataset. On vgg16, the results show that, compared with the original model, the parametric amount of the algorithm proposed in this paper is reduced by 90.69% and the computation is reduced to 24.46% of the original one. In ResNet56, we achieve a 63.82%-FLOPs reduction by removing 63.53% parameters. The memory occupation and computation speed of the new model are better than the baseline model while maintaining a high network accuracy. Compared with similar algorithms, the algorithm has obvious advantages in the dimensions of computational speed and model size. The pruned model is also deployed to the Internet of Things (IoT) as a target detection system. In addition, experiments show that the proposed model is able to detect targets accurately with low reasoning time and memory. It takes only 252.84 ms on embedded devices, thus matching the limited resources of IoT.

Special Issue: Regularization Techniques for Machine Learning and Their Applications

Over the last decade, learning theory performed significant progress in the development of sophisticated algorithms and their theoretical foundations. The theory builds on concepts that exploit ideas and methodologies from mathematical areas such as optimization theory. Regularization is probably the key to address the challenging problem of overfitting, which usually occurs in high-dimensional learning. Its primary goal is to make the machine learning algorithm “learn” and not “memorize” by penalizing the algorithm to reduce its generalization error in order to avoid the risk of overfitting. As a result, the variance of the model is significantly reduced, without substantial increase in its bias and without losing any important properties in the data.

Battery Sizing Optimization in Power Smoothing Applications

The main objective of this work was to determine the worth of installing an electrical battery in order to reduce peak power consumption. The importance of this question resides in the expensive terms of energy bills when using the maximum power level. If maximum power consumption decreases, it affects not only the revenues of maximum power level bills, but also results in important reductions at the source of the power. This way, the power of the transformer decreases, and other electrical elements can be removed from electrical installations. The authors studied the Spanish electrical system, and a particle swarm optimization (PSO) algorithm was used to model battery sizing in peak power smoothing applications for an electrical consumption point. This study proves that, despite not being entirely profitable at present due to current kWh prices, implanting a battery will definitely be an option to consider in the future when these prices come down.

Semi-Supervised Extreme Learning Machine Channel Estimator and Equalizer for Vehicle to Vehicle Communications

Wireless vehicular communications are a promising technology. Most applications related to vehicular communications aim to improve road safety and have special requirements concerning latency and reliability. The traditional channel estimation techniques used in the IEEE 802.11 standard do not properly perform over vehicular channels. This is because vehicular communications are subject to non-stationary, time-varying, frequency-selective wireless channels. Therefore, the main goal of this work is the introduction of a new channel estimation and equalization technique based on a Semi-supervised Extreme Learning Machine (SS-ELM) in order to address the harsh characteristics of the vehicular channel and improve the performance of the communication link. The performance of the proposed technique is compared with traditional estimators, as well as state-of-the-art machine-learning-based algorithms over an urban scenario setup in terms of bit error rate. The proposed SS-ELM scheme outperformed the extreme learning machine and the fully complex extreme learning machine algorithms for the evaluated scenarios. Compared to traditional techniques, the proposed SS-ELM scheme has a very similar performance. It is also observed that, although the SS-ELM scheme requires the largest operation time among the evaluated techniques, its execution time is still far away from the latency requirements specified by the standard for safety applications.