1
|
Chen H, Luo H, Huang B, Jiang B, Kaynak O. Transfer Learning-Motivated Intelligent Fault Diagnosis Designs: A Survey, Insights, and Perspectives. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:2969-2983. [PMID: 37467093 DOI: 10.1109/tnnls.2023.3290974] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/21/2023]
Abstract
Over the last decade, transfer learning has attracted a great deal of attention as a new learning paradigm, based on which fault diagnosis (FD) approaches have been intensively developed to improve the safety and reliability of modern automation systems. Because of inevitable factors such as the varying work environment, performance degradation of components, and heterogeneity among similar automation systems, the FD method having long-term applicabilities becomes attractive. Motivated by these facts, transfer learning has been an indispensable tool that endows the FD methods with self-learning and adaptive abilities. On the presentation of basic knowledge in this field, a comprehensive review of transfer learning-motivated FD methods, whose two subclasses are developed based on knowledge calibration and knowledge compromise, is carried out in this survey article. Finally, some open problems, potential research directions, and conclusions are highlighted. Different from the existing reviews of transfer learning, this survey focuses on how to utilize previous knowledge specifically for the FD tasks, based on which three principles and a new classification strategy of transfer learning-motivated FD techniques are also presented. We hope that this work will constitute a timely contribution to transfer learning-motivated techniques regarding the FD topic.
Collapse
|
2
|
Di Maggio LG. Intelligent Fault Diagnosis of Industrial Bearings Using Transfer Learning and CNNs Pre-Trained for Audio Classification. SENSORS (BASEL, SWITZERLAND) 2022; 23:s23010211. [PMID: 36616809 PMCID: PMC9823443 DOI: 10.3390/s23010211] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/08/2022] [Revised: 12/16/2022] [Accepted: 12/21/2022] [Indexed: 06/12/2023]
Abstract
The training of Artificial Intelligence algorithms for machine diagnosis often requires a huge amount of data, which is scarcely available in industry. This work shows that convolutional networks pre-trained for audio classification already contain knowledge for classifying bearing vibrations, since both tasks share the need to extract features from spectrograms. Knowledge transfer is realized through transfer learning to identify localized defects in rolling element bearings. This technique provides a tool to transfer the knowledge embedded in neural networks pre-trained for fulfilling similar tasks to diagnostic scenarios, significantly limiting the amount of data needed for fine-tuning. The VGGish model was fine-tuned for the specific diagnostic task by handling vibration samples. Data were extracted from the test bench for medium-size bearings specially set up in the mechanical engineering laboratories of the Politecnico di Torino. The experiment involved three damage classes. Results show that the model pre-trained using sound spectrograms can be successfully employed for classifying the bearing state through vibration spectrograms. The effectiveness of the model is assessed through comparisons with the existing literature.
Collapse
Affiliation(s)
- Luigi Gianpio Di Maggio
- Dipartimento di Ingegneria Meccanica e Aerospaziale (DIMEAS), Politecnico di Torino, Corso Duca Degli Abruzzi 24, 10129 Torino, Italy
| |
Collapse
|
3
|
Toma RN, Piltan F, Im K, Shon D, Yoon TH, Yoo DS, Kim JM. A Bearing Fault Classification Framework Based on Image Encoding Techniques and a Convolutional Neural Network under Different Operating Conditions. SENSORS (BASEL, SWITZERLAND) 2022; 22:4881. [PMID: 35808372 PMCID: PMC9269757 DOI: 10.3390/s22134881] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/19/2022] [Revised: 06/25/2022] [Accepted: 06/26/2022] [Indexed: 06/01/2023]
Abstract
Diagnostics of mechanical problems in manufacturing systems are essential to maintaining safety and minimizing expenditures. In this study, an intelligent fault classification model that combines a signal-to-image encoding technique and a convolution neural network (CNN) with the motor-current signal is proposed to classify bearing faults. In the beginning, we split the dataset into four parts, considering the operating conditions. Then, the original signal is segmented into multiple samples, and we apply the Gramian angular field (GAF) algorithm on each sample to generate two-dimensional (2-D) images, which also converts the time-series signals into polar coordinates. The image conversion technique eliminates the requirement of manual feature extraction and creates a distinct pattern for individual fault signatures. Finally, the resultant image dataset is used to design and train a 2-layer deep CNN model that can extract high-level features from multiple images to classify fault conditions. For all the experiments that were conducted on different operating conditions, the proposed method shows a high classification accuracy of more than 99% and proves that the GAF can efficiently preserve the fault characteristics from the current signal. Three built-in CNN structures were also applied to classify the images, but the simple structure of a 2-layer CNN proved to be sufficient in terms of classification results and computational time. Finally, we compare the experimental results from the proposed diagnostic framework with some state-of-the-art diagnostic techniques and previously published works to validate its superiority under inconsistent working conditions. The results verify that the proposed method based on motor-current signal analysis is a good approach for bearing fault classification in terms of classification accuracy and other evaluation parameters.
Collapse
Affiliation(s)
- Rafia Nishat Toma
- Department of Electrical, Electronics and Computer Engineering, University of Ulsan, Ulsan 44610, Korea; (R.N.T.); (F.P.)
| | - Farzin Piltan
- Department of Electrical, Electronics and Computer Engineering, University of Ulsan, Ulsan 44610, Korea; (R.N.T.); (F.P.)
| | - Kichang Im
- ICT Convergence Safety Research Center, University of Ulsan, Ulsan 44610, Korea;
| | - Dongkoo Shon
- Electronics and Telecommunications Research Institute (ETRI), Daejeon 34129, Korea; (D.S.); (T.H.Y.); (D.-S.Y.)
| | - Tae Hyun Yoon
- Electronics and Telecommunications Research Institute (ETRI), Daejeon 34129, Korea; (D.S.); (T.H.Y.); (D.-S.Y.)
| | - Dae-Seung Yoo
- Electronics and Telecommunications Research Institute (ETRI), Daejeon 34129, Korea; (D.S.); (T.H.Y.); (D.-S.Y.)
| | - Jong-Myon Kim
- Department of Electrical, Electronics and Computer Engineering, University of Ulsan, Ulsan 44610, Korea; (R.N.T.); (F.P.)
| |
Collapse
|
4
|
Condition-Based Monitoring and Maintenance: State of the Art Review. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12020688] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
Manufacturing firms face great pressure to reduce downtime as well as maintenance costs. Condition-based maintenance (CBM) can be used to effectively manage operations and maintenance by monitoring detailed machine health information. CBM policies and the development of the mathematical models have been growing recently. This paper provides a review of the theoretical and practical development in the field of condition-based maintenance and its current advancements. Standard CBM platform could make it effective and efficient in implementation and performance improvement.
Collapse
|
5
|
Hasan MJ, Islam MMM, Kim JM. Bearing Fault Diagnosis Using Multidomain Fusion-Based Vibration Imaging and Multitask Learning. SENSORS (BASEL, SWITZERLAND) 2021; 22:56. [PMID: 35009595 PMCID: PMC8747317 DOI: 10.3390/s22010056] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/26/2021] [Revised: 12/16/2021] [Accepted: 12/20/2021] [Indexed: 11/28/2022]
Abstract
Statistical features extraction from bearing fault signals requires a substantial level of knowledge and domain expertise. Furthermore, existing feature extraction techniques are mostly confined to selective feature extraction methods namely, time-domain, frequency-domain, or time-frequency domain statistical parameters. Vibration signals of bearing fault are highly non-linear and non-stationary making it cumbersome to extract relevant information for existing methodologies. This process even became more complicated when the bearing operates at variable speeds and load conditions. To address these challenges, this study develops an autonomous diagnostic system that combines signal-to-image transformation techniques for multi-domain information with convolutional neural network (CNN)-aided multitask learning (MTL). To address variable operating conditions, a composite color image is created by fusing information from multi-domains, such as the raw time-domain signal, the spectrum of the time-domain signal, and the envelope spectrum of the time-frequency analysis. This 2-D composite image, named multi-domain fusion-based vibration imaging (MDFVI), is highly effective in generating a unique pattern even with variable speeds and loads. Following that, these MDFVI images are fed to the proposed MTL-based CNN architecture to identify faults in variable speed and health conditions concurrently. The proposed method is tested on two benchmark datasets from the bearing experiment. The experimental results suggested that the proposed method outperformed state-of-the-arts in both datasets.
Collapse
Affiliation(s)
- Md Junayed Hasan
- Department of Electrical, Electronics and Computer Engineering, University of Ulsan, Ulsan 44610, Korea;
| | - M. M. Manjurul Islam
- Department of Computer Science, American International University-Bangladesh, Dhaka 1229, Bangladesh;
| | - Jong-Myon Kim
- Department of Electrical, Electronics and Computer Engineering, University of Ulsan, Ulsan 44610, Korea;
| |
Collapse
|
6
|
A Deep Autoencoder-Based Convolution Neural Network Framework for Bearing Fault Classification in Induction Motors. SENSORS 2021; 21:s21248453. [PMID: 34960552 PMCID: PMC8706012 DOI: 10.3390/s21248453] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/21/2021] [Revised: 12/15/2021] [Accepted: 12/15/2021] [Indexed: 11/17/2022]
Abstract
Fault diagnosis and classification for machines are integral to condition monitoring in the industrial sector. However, in recent times, as sensor technology and artificial intelligence have developed, data-driven fault diagnosis and classification have been more widely investigated. The data-driven approach requires good-quality features to attain good fault classification accuracy, yet domain expertise and a fair amount of labeled data are important for better features. This paper proposes a deep auto-encoder (DAE) and convolutional neural network (CNN)-based bearing fault classification model using motor current signals of an induction motor (IM). Motor current signals can be easily and non-invasively collected from the motor. However, the current signal collected from industrial sources is highly contaminated with noise; feature calculation thus becomes very challenging. The DAE is utilized for estimating the nonlinear function of the system with the normal state data, and later, the residual signal is obtained. The subsequent CNN model then successfully classified the types of faults from the residual signals. Our proposed semi-supervised approach achieved very high classification accuracy (more than 99%). The inclusion of DAE was found to not only improve the accuracy significantly but also to be potentially useful when the amount of labeled data is small. The experimental outcomes are compared with some existing works on the same dataset, and the performance of this proposed combined approach is found to be comparable with them. In terms of the classification accuracy and other evaluation parameters, the overall method can be considered as an effective approach for bearing fault classification using the motor current signal.
Collapse
|
7
|
Condition Monitoring Method for the Detection of Fault Graduality in Outer Race Bearing Based on Vibration-Current Fusion, Statistical Features and Neural Network. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11178033] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Bearings are the elements that allow the rotatory movement in induction motors, and the fault occurrence in these elements is due to excessive working conditions. In induction motors, electrical erosion remains the most common phenomenon that damages bearings, leading to incipient faults that gradually increase to irreparable damages. Thus, condition monitoring strategies capable of assessing bearing fault severities are mandatory to overcome this critical issue. The contribution of this work lies in the proposal of a condition monitoring strategy that is focused on the analysis and identification of different fault severities of the outer race bearing fault in an induction motor. The proposed approach is supported by fusion information of different physical magnitudes and the use of Machine Learning and Artificial Intelligence. An important aspect of this proposal is the calculation of a hybrid-set of statistical features that are obtained to characterize vibration and stator current signals by its processing through domain analysis, i.e., time-domain and frequency-domain; also, the fusion of information of both signals by means of the Linear Discriminant Analysis is important due to the most discriminative and meaningful information is retained resulting in a high-performance condition characterization. Besides, a Neural Network-based classifier allows validating the effectiveness of fusion information from different physical magnitudes to face the diagnosis of multiple fault severities that appear in the bearing outer race. The method is validated under an experimental data set that includes information related to a healthy condition and five different severities that appear in the outer race of bearings.
Collapse
|
8
|
Yan Z, Liu G, Wang J, Bao H, Zhang Z, Zhang X, Han B. A New Universal Domain Adaptive Method for Diagnosing Unknown Bearing Faults. ENTROPY 2021; 23:e23081052. [PMID: 34441193 PMCID: PMC8391362 DOI: 10.3390/e23081052] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/22/2021] [Revised: 08/08/2021] [Accepted: 08/09/2021] [Indexed: 11/30/2022]
Abstract
The domain adaptation problem in transfer learning has received extensive attention in recent years. The existing transfer model for solving domain alignment always assumes that the label space is completely shared between domains. However, this assumption is untrue in the actual industry and limits the application scope of the transfer model. Therefore, a universal domain method is proposed, which not only effectively reduces the problem of network failure caused by unknown fault types in the target domain but also breaks the premise of sharing the label space. The proposed framework takes into account the discrepancy of the fault features shown by different fault types and forms the feature center for fault diagnosis by extracting the features of samples of each fault type. Three optimization functions are added to solve the negative transfer problem when the model solves samples of unknown fault types. This study verifies the performance advantages of the framework for variable speed through experiments of multiple datasets. It can be seen from the experimental results that the proposed method has better fault diagnosis performance than related transfer methods for solving unknown mechanical faults.
Collapse
Affiliation(s)
- Zhenhao Yan
- College of Mechanical and Electronic Engineering, Shandong University of Science and Technology, Qingdao 266590, China; (Z.Y.); (J.W.); (H.B.); (Z.Z.); (X.Z.); (B.H.)
| | - Guifang Liu
- College of Mechanical and Electronic Engineering, Shandong University of Science and Technology, Qingdao 266590, China; (Z.Y.); (J.W.); (H.B.); (Z.Z.); (X.Z.); (B.H.)
- Correspondence: ; Tel.: +86-137-3098-1732
| | - Jinrui Wang
- College of Mechanical and Electronic Engineering, Shandong University of Science and Technology, Qingdao 266590, China; (Z.Y.); (J.W.); (H.B.); (Z.Z.); (X.Z.); (B.H.)
| | - Huaiqian Bao
- College of Mechanical and Electronic Engineering, Shandong University of Science and Technology, Qingdao 266590, China; (Z.Y.); (J.W.); (H.B.); (Z.Z.); (X.Z.); (B.H.)
| | - Zongzhen Zhang
- College of Mechanical and Electronic Engineering, Shandong University of Science and Technology, Qingdao 266590, China; (Z.Y.); (J.W.); (H.B.); (Z.Z.); (X.Z.); (B.H.)
- College of Energy and Power Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China
| | - Xiao Zhang
- College of Mechanical and Electronic Engineering, Shandong University of Science and Technology, Qingdao 266590, China; (Z.Y.); (J.W.); (H.B.); (Z.Z.); (X.Z.); (B.H.)
| | - Baokun Han
- College of Mechanical and Electronic Engineering, Shandong University of Science and Technology, Qingdao 266590, China; (Z.Y.); (J.W.); (H.B.); (Z.Z.); (X.Z.); (B.H.)
| |
Collapse
|
9
|
The Use of Deep Learning Methods in Diagnosing Rotating Machines Operating in Variable Conditions. ENERGIES 2021. [DOI: 10.3390/en14144231] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
This paper presents the use of artificial neural networks in diagnosing the technical condition of drive systems operating under variable conditions. The effects of temperature and load variations on the values of diagnostic parameters were considered. An experiment was conducted on a testing rig where a variable load was introduced corresponding to the load of the main gearbox of the bucket wheel excavator. The signals of vibration acceleration on the gearbox body, rotational speed, and current consumption of the drive motor for different values of oil temperature were measured. Synchronous analysis was performed, and the values of order amplitudes and the corresponding values of current, speed, and temperature were determined. Such datasets were the learning vectors for a set of artificial deep learning neural networks. A new approach proposed in this paper is to train the network using a learning set consisting only of data from the efficient system. The responses of the trained neural networks to new data from the undamaged system were performed against the response to data recorded for three damage states: misalignment, unbalance, and simultaneous misalignment and unbalance. As a result, a diagnostic parameter as a normalized measure of the deviation of the network results was developed for the faulted system from the result for the undamaged condition.
Collapse
|
10
|
Hasan MJ, Sohaib M, Kim JM. An Explainable AI-Based Fault Diagnosis Model for Bearings. SENSORS (BASEL, SWITZERLAND) 2021; 21:4070. [PMID: 34199163 PMCID: PMC8231543 DOI: 10.3390/s21124070] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/25/2021] [Revised: 06/08/2021] [Accepted: 06/11/2021] [Indexed: 11/28/2022]
Abstract
In this paper, an explainable AI-based fault diagnosis model for bearings is proposed with five stages, i.e., (1) a data preprocessing method based on the Stockwell Transformation Coefficient (STC) is proposed to analyze the vibration signals for variable speed and load conditions, (2) a statistical feature extraction method is introduced to capture the significance from the invariant pattern of the analyzed data by STC, (3) an explainable feature selection process is proposed by introducing a wrapper-based feature selector-Boruta, (4) a feature filtration method is considered on the top of the feature selector to avoid the multicollinearity problem, and finally, (5) an additive Shapley explanation followed by k-NN is proposed to diagnose and to explain the individual decision of the k-NN classifier for debugging the performance of the diagnosis model. Thus, the idea of explainability is introduced for the first time in the field of bearing fault diagnosis in two steps: (a) incorporating explainability to the feature selection process, and (b) interpretation of the classifier performance with respect to the selected features. The effectiveness of the proposed model is demonstrated on two different datasets obtained from separate bearing testbeds. Lastly, an assessment of several state-of-the-art fault diagnosis algorithms in rotating machinery is included.
Collapse
Affiliation(s)
- Md Junayed Hasan
- Department of Electrical, Electronics and Computer Engineering, University of Ulsan, Ulsan 44610, Korea;
| | - Muhammad Sohaib
- Department of Computer Science, Lahore Garrison University, Lahore 54000, Pakistan;
| | - Jong-Myon Kim
- Department of Electrical, Electronics and Computer Engineering, University of Ulsan, Ulsan 44610, Korea;
| |
Collapse
|
11
|
A Weighted Subdomain Adaptation Network for Partial Transfer Fault Diagnosis of Rotating Machinery. ENTROPY 2021; 23:e23040424. [PMID: 33916268 PMCID: PMC8065703 DOI: 10.3390/e23040424] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/12/2021] [Revised: 03/27/2021] [Accepted: 03/31/2021] [Indexed: 11/17/2022]
Abstract
Domain adaptation-based models for fault classification under variable working conditions have become a research focus in recent years. Previous domain adaptation approaches generally assume identical label spaces in the source and target domains, however, such an assumption may be no longer legitimate in a more realistic situation that requires adaptation from a larger and more diverse source domain to a smaller target domain with less number of fault classes. To address the above deficiencies, we propose a partial transfer fault diagnosis model based on a weighted subdomain adaptation network (WSAN) in this paper. Our method pays more attention to the local data distribution while aligning the global distribution. An auxiliary classifier is introduced to obtain the class-level weights of the source samples, so the network can avoid negative transfer caused by unique fault classes in the source domain. Furthermore, a weighted local maximum mean discrepancy (WLMMD) is proposed to capture the fine-grained transferable information and obtain sample-level weights. Finally, relevant distributions of domain-specific layer activations across different domains are aligned. Experimental results show that our method could assign appropriate weights to each source sample and realize efficient partial transfer fault diagnosis.
Collapse
|