Functional deep echo state network improved by a bi-level optimization approach for multivariate time series classification

Distributed Robust Dictionary Pair Learning and Its Application to Aluminum Electrolysis Industrial Process

In modern industrial systems, high-dimensional process data provide rich information for process monitoring. To make full use of local information of industrial process, a distributed robust dictionary pair learning (DRDPL) is proposed for refined process monitoring. Firstly, the global system is divided into several sub-blocks based on the reliable prior knowledge of industrial processes, which achieves dimensionality reduction and reduces process complexity. Secondly, a robust dictionary pair learning (RDPL) method is developed to build a local monitoring model for each sub-block. The sparse constraint with l2,1 norm is added to the analytical dictionary, and a low rank constraint is applied to the synthetical dictionary, so as to obtain robust dictionary pairs. Then, Bayesian inference method is introduced to fuse local monitoring information to global anomaly detection, and the block contribution index and variable contribution index are used to realize anomaly isolation. Finally, the effectiveness of the proposed method is verified by a numerical simulation experiment and Tennessee Eastman benchmark tests, and the proposed method is then successfully applied to a real-world aluminum electrolysis process.

Bidirectional parallel echo state network for speech emotion recognition

Speech is an effective way for communicating and exchanging complex information between humans. Speech signal has involved a great attention in human-computer interaction. Therefore, emotion recognition from speech has become a hot research topic in the field of interacting machines with humans. In this paper, we proposed a novel speech emotion recognition system by adopting multivariate time series handcrafted feature representation from speech signals. Bidirectional echo state network with two parallel reservoir layers has been applied to capture additional independent information. The parallel reservoirs produce multiple representations for each direction from the bidirectional data with two stages of concatenation. The sparse random projection approach has been adopted to reduce the high-dimensional sparse output for each direction separately from both reservoirs. Random over-sampling and random under-sampling methods are used to overcome the imbalanced nature of the used speech emotion datasets. The performance of the proposed parallel ESN model is evaluated from the speaker-independent experiments on EMO-DB, SAVEE, RAVDESS, and FAU Aibo datasets. The results show that the proposed SER model is superior to the single reservoir and the state-of-the-art studies.