A Novel Capsule Network Based on Wide Convolution and Multi-Scale Convolution for Fault Diagnosis

Rapid diagnosis of rheumatoid arthritis and ankylosing spondylitis based on Fourier transform infrared spectroscopy and deep learning

OBJECTIVE

Rheumatoid arthritis and Ankylosing spondylitis are two common autoimmune inflammatory rheumatic diseases that negatively affect activities of daily living and can lead to structural and functional disability, reduced quality of life. Here, this study utilized Fourier transform infrared (FTIR) spectroscopy on dried serum samples and achieved early diagnosis of rheumatoid arthritis and ankylosing spondylitis based on deep learning models.

METHOD

A total of 243 dried serum samples were collected in this study, including 81 samples each from ankylosing spondylitis, rheumatoid arthritis, and healthy controls. Three multi-scale convolutional modules with different specifications were designed based on the multi-scale convolutional neural network (MSCNN) to effectively fuse the local features to enhance the generalization ability of the model. The FTIR was then combined with the MSCNN model to achieve a non-invasive, fast, and accurate diagnosis of ankylosing spondylitis, rheumatoid arthritis, and healthy controls.

RESULTS

Spectral analysis shows that the curves and waveforms of the three spectral graphs are similar. The main differences are distributed in the spectral regions of 3300-3250 cm-1, 3000-2800 cm-1, 1750-1500 cm-1, and 1500-1300 cm-1, which represent: Amides, fatty acids, cholesterol, proteins with a carboxyl group, amide II, free amino acids, and polysaccharides. Four classification models, namely artificial neural network (ANN), convolutional neural network (CNN), improved AlexNet model, and multi-scale convolutional neural network (MSCNN) were established. Through comparison, it was found that the diagnostic AUC value of the MSCNN model was 0.99, and the accuracy rate was as high as 0.93, which was much higher than the other three models.

CONCLUSION

The study demonstrated the superiority of MSCNN in distinguishing ankylosing spondylitis from rheumatoid arthritis and healthy controls. FTIR may become a rapid, sensitive, and non-invasive means of diagnosing rheumatism.

Heart Murmur Classification Using a Capsule Neural Network

The healthcare industry has made significant progress in the diagnosis of heart conditions due to the use of intelligent detection systems such as electrocardiograms, cardiac ultrasounds, and abnormal sound diagnostics that use artificial intelligence (AI) technology, such as convolutional neural networks (CNNs). Over the past few decades, methods for automated segmentation and classification of heart sounds have been widely studied. In many cases, both experimental and clinical data require electrocardiography (ECG)-labeled phonocardiograms (PCGs) or several feature extraction techniques from the mel-scale frequency cepstral coefficient (MFCC) spectrum of heart sounds to achieve better identification results with AI methods. Without good feature extraction techniques, the CNN may face challenges in classifying the MFCC spectrum of heart sounds. To overcome these limitations, we propose a capsule neural network (CapsNet), which can utilize iterative dynamic routing methods to obtain good combinations for layers in the translational equivariance of MFCC spectrum features, thereby improving the prediction accuracy of heart murmur classification. The 2016 PhysioNet heart sound database was used for training and validating the prediction performance of CapsNet and other CNNs. Then, we collected our own dataset of clinical auscultation scenarios for fine-tuning hyperparameters and testing results. CapsNet demonstrated its feasibility by achieving validation accuracies of 90.29% and 91.67% on the test dataset.

Intelligent Eye-Controlled Electric Wheelchair Based on Estimating Visual Intentions Using One-Dimensional Convolutional Neural Network and Long Short-Term Memory

When an electric wheelchair is operated using gaze motion, eye movements such as checking the environment and observing objects are also incorrectly recognized as input operations. This phenomenon is called the "Midas touch problem", and classifying visual intentions is extremely important. In this paper, we develop a deep learning model that estimates the user's visual intention in real time and an electric wheelchair control system that combines intention estimation and the gaze dwell time method. The proposed model consists of a 1DCNN-LSTM that estimates visual intention from feature vectors of 10 variables, such as eye movement, head movement, and distance to the fixation point. The evaluation experiments classifying four types of visual intentions show that the proposed model has the highest accuracy compared to other models. In addition, the results of the driving experiments of the electric wheelchair implementing the proposed model show that the user's efforts to operate the wheelchair are reduced and that the operability of the wheelchair is improved compared to the traditional method. From these results, we concluded that visual intentions could be more accurately estimated by learning time series patterns from eye and head movement data.

Ensemble Capsule Network with an Attention Mechanism for the Fault Diagnosis of Bearings from Imbalanced Data Samples

In order to solve the problem of imbalanced and noisy data samples for the fault diagnosis of rolling bearings, a novel ensemble capsule network (Capsnet) with a convolutional block attention module (CBAM) that is based on a weighted majority voting method is proposed in this study. Firstly, the complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) method was used to decompose the raw vibration signal into different IMF signals, which are noise reduction signals. Secondly, the IMF signals were input into the Capsnet with CBAM in order to diagnose the fault category preliminarily. Finally, the weighted majority voting method was utilized so as to fuse all of the preliminary diagnosis results in order to obtain the final diagnostic decision. In order to verify the effectiveness of the proposed ensemble of Capsnet with CBAM, this method was applied to the fault diagnosis of rolling bearings with imbalanced and different SNR data samples. The diagnostic results show that the proposed diagnostic method can achieve higher levels of accuracy than other methods, such as single CNN, single Capsnet, ensemble CNN and an ensemble capsule network without CBAM and that it has stronger immunity to noise than an ensemble capsule network without CBAM.

A Rolling Bearing Fault Diagnosis Method Based on Enhanced Integrated Filter Network

Aiming at the difficulty of rolling bearing fault diagnosis in a strong noise environment, this paper proposes an enhanced integrated filter network. In the method, we firstly design an enhanced integrated filter, which includes the filter enhancement module and the expression enhancement module. The filter enhancement module can not only filter the high-frequency noise to extract useful features of medium and low-frequency signals but also maintain frequency and time resolution to some extent. On this basis, the expression enhancement module analyzes fault features intercepted by the upper network at multiple scales to get deep features. Then we introduce vector neurons to integrate scalar features into vector space, which mine the correlation between features. The feature vectors are transmitted by dynamic routing to establish the relationship between low-level capsules and high-level capsules. In order to verify the diagnostic performance of the model, CWRU and IMS bearing datasets are used for experimental verification. In the strong noise environment of SNR = −4 dB, the fault diagnosis precisions of the method on CWRU and IMS reach 94.85% and 92.45%, respectively. Compared with typical bearing fault diagnosis methods, the method has higher fault diagnosis precision and better generalization ability in a strong noise environment.

Fault Diagnosis Method of Smart Meters Based on DBN-CapsNet

Rapid and accurate fault diagnosis of smart meters can greatly improve the operational and maintenance ability of power systems. Focusing on the historical fault data information of smart meters, a fault diagnosis model of smart meters based on an improved capsule network (CapsNet) is proposed. First, we count the sample size of each fault type, and a mixed sampling method combining undersampling and oversampling is used to solve the problem of distribution imbalance of sample size. The one-hot encoding method is adopted to solve the problem of the fault samples containing more discrete and disordered data. Then, the strong adaptive feature extraction capability and nonlinear mapping capability of the deep belief network (DBN) are utilized to improve the single convolution layer feature extraction part of a traditional capsule network; DBN can also address the problem of high data dimensions and sparse data due to one-hot encoding. The important features and key information of the input sample are extracted and used as the input of the primary capsule layer, and the dynamic routing algorithm is used to construct the digital capsule. Finally, the results of experiments show that the improved capsule network model can effectively improve the accuracy of diagnosis and shorten the training time.

A Novel Deep Learning Model for Mechanical Rotating Parts Fault Diagnosis Based on Optimal Transport and Generative Adversarial Networks

To solve the poor real-time performance of the existing fault diagnosis algorithms on transmission system rotating components, this paper proposes a novel high-dimensional OT-Caps (Optimal Transport–Capsule Network) model. Based on the traditional capsule network algorithm, an auxiliary loss is introduced during the offline training process to improve the network architecture. Simultaneously, an optimal transport theory and a generative adversarial network are introduced into the auxiliary loss, which accurately depicts the error distribution of the fault characteristic. The proposed model solves the low real-time performance of the capsule network algorithm due to complex architecture, long calculation time, and oversized hardware resource consumption. Meanwhile, it ensures the high precision, early prediction, and transfer aptitude of fault diagnosis. Finally, the model’s effectiveness is verified by the public data sets and the actual faults data of the transmission system, which provide technical support for the application.

Research on Bearing Fault Diagnosis Method Based on an Adaptive Anti-Noise Network under Long Time Series

In the era of big data, longer time series fault signals will not only be easy to copy and store, but also reduce the labor cost of manual labeling, which can better meet the needs of industrial big data. Aiming to effectively extract the key classification information from a longer time series of bearing vibration signals and achieve high diagnostic accuracy under noise and different load conditions. The one-dimensional adaptive long sequence convolutional network (ALSCN) is proposed. ALSCN can better extract features directly from high-dimensional original signals without manually extracting features and relying on expert knowledge. By adding two improved multi-scale modules, ALSCN can not only extract important features efficiently from noise signals, but also alleviate the problem of losing key information due to continuous down-sampling. Moreover, a Bayesian optimization algorithm is constructed to automatically find the best combination of hyperparameters in ALSCN. Based on two bearing data sets, the model is compared with traditional model such as SVM and deep learning models such as convolutional neural networks (CNN) et al. The results prove that ALSCN has a higher diagnostic accuracy rate on 5120-dimensional sequences under −5 signal to noise ratio (SNR) with better generalization.

Bearing Health Monitoring Using Relief-F-Based Feature Relevance Analysis and HMM

Nowadays, bearings installed in industrial electric motors are constituted as the primary mode of a failure affecting the global energy consumption. Since industries’ energy demand has a growing tendency, interest for efficient maintenance in electric motors is decisive. Vibration signals from bearings are employed commonly as a non-invasive approach to support fault diagnosis and severity evaluation of rotating machinery. However, vibration-based diagnosis poses a challenge concerning the signal properties, e.g., highly dynamic and non-stationary. Here, we introduce a knowledge-based tool to analyze multiple health conditions in bearings. Our approach includes a stochastic feature selection method, termed Stochastic Feature Selection (SFS), highlighting and interpreting relevant multi-domain attributes (time, frequency, and time–frequency) related to the bearing faults discriminability. In particular, a relief-F-based ranking and a Hidden Markov Model are trained under a windowing scheme to achieve our SFS. Obtained results in a public database demonstrate that our proposal is competitive compared to state-of-the-art algorithms concerning both the number of features selected and the classification accuracy.