1
|
Luo J, Zhou X, Zeng C, Jiang Y, Qi W, Xiang K, Pang M, Tang B. Robotics Perception and Control: Key Technologies and Applications. MICROMACHINES 2024; 15:531. [PMID: 38675342 PMCID: PMC11052398 DOI: 10.3390/mi15040531] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/05/2024] [Revised: 04/10/2024] [Accepted: 04/11/2024] [Indexed: 04/28/2024]
Abstract
The integration of advanced sensor technologies has significantly propelled the dynamic development of robotics, thus inaugurating a new era in automation and artificial intelligence. Given the rapid advancements in robotics technology, its core area-robot control technology-has attracted increasing attention. Notably, sensors and sensor fusion technologies, which are considered essential for enhancing robot control technologies, have been widely and successfully applied in the field of robotics. Therefore, the integration of sensors and sensor fusion techniques with robot control technologies, which enables adaptation to various tasks in new situations, is emerging as a promising approach. This review seeks to delineate how sensors and sensor fusion technologies are combined with robot control technologies. It presents nine types of sensors used in robot control, discusses representative control methods, and summarizes their applications across various domains. Finally, this survey discusses existing challenges and potential future directions.
Collapse
Affiliation(s)
- Jing Luo
- School of Automation, Wuhan University of Technology, Wuhan 430070, China; (J.L.); (X.Z.); (K.X.)
- Chongqing Research Institute, Wuhan University of Technology, Chongqing 401135, China
| | - Xiangyu Zhou
- School of Automation, Wuhan University of Technology, Wuhan 430070, China; (J.L.); (X.Z.); (K.X.)
| | - Chao Zeng
- Department of Informatics, University of Hamburg, 22527 Hamburg, Germany;
| | - Yiming Jiang
- School of Robotics, Hunan University, Changsha 410082, China;
| | - Wen Qi
- School of Future Technology, South China University of Technology, Guangzhou 510641, China;
| | - Kui Xiang
- School of Automation, Wuhan University of Technology, Wuhan 430070, China; (J.L.); (X.Z.); (K.X.)
| | - Muye Pang
- School of Automation, Wuhan University of Technology, Wuhan 430070, China; (J.L.); (X.Z.); (K.X.)
| | - Biwei Tang
- School of Automation, Wuhan University of Technology, Wuhan 430070, China; (J.L.); (X.Z.); (K.X.)
| |
Collapse
|
2
|
Villegas-Ch W, Govea J, Jaramillo-Alcazar A. Tamper Detection in Industrial Sensors: An Approach Based on Anomaly Detection. SENSORS (BASEL, SWITZERLAND) 2023; 23:8908. [PMID: 37960607 PMCID: PMC10650466 DOI: 10.3390/s23218908] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/06/2023] [Revised: 10/19/2023] [Accepted: 10/26/2023] [Indexed: 11/15/2023]
Abstract
The Industrial Revolution 4.0 has catapulted the integration of advanced technologies in industrial operations, where interconnected systems rely heavily on sensor information. However, this dependency has revealed an essential vulnerability: Sabotaging these sensors can lead to costly and dangerous interruptions in the production chain. To address this threat, we introduce an innovative methodological approach focused on developing an anomaly detection algorithm specifically designed to track manipulations in industrial sensors. Through a series of meticulous tests in an industrial environment, we validate the robustness and accuracy of our proposal. What distinguishes this study is its unique adaptability to various sensor conditions, achieving high detection accuracy and prompt response. Our algorithm demonstrates superiority in accuracy and sensitivity compared to previously established methodologies. Beyond detection, we incorporate a proactive alert and response system, guaranteeing timely action against detected anomalies. This work offers a tangible solution to a growing challenge. It lays the foundation for strengthening security in industrial systems of the digital age, harmonizing efficiency with protection in the Industry 4.0 landscape.
Collapse
Affiliation(s)
- William Villegas-Ch
- Escuela de Ingeniería en Ciberseguridad, Facultad de Ingenierías Ciencias Aplicadas, Universidad de Las Américas, Quito 170125, Ecuador; (J.G.); (A.J.-A.)
| | | | | |
Collapse
|
3
|
Arruda HM, Bavaresco RS, Kunst R, Bugs EF, Pesenti GC, Barbosa JLV. Data Science Methods and Tools for Industry 4.0: A Systematic Literature Review and Taxonomy. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23115010. [PMID: 37299736 DOI: 10.3390/s23115010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Revised: 05/17/2023] [Accepted: 05/19/2023] [Indexed: 06/12/2023]
Abstract
The Fourth Industrial Revolution, also named Industry 4.0, is leveraging several modern computing fields. Industry 4.0 comprises automated tasks in manufacturing facilities, which generate massive quantities of data through sensors. These data contribute to the interpretation of industrial operations in favor of managerial and technical decision-making. Data science supports this interpretation due to extensive technological artifacts, particularly data processing methods and software tools. In this regard, the present article proposes a systematic literature review of these methods and tools employed in distinct industrial segments, considering an investigation of different time series levels and data quality. The systematic methodology initially approached the filtering of 10,456 articles from five academic databases, 103 being selected for the corpus. Thereby, the study answered three general, two focused, and two statistical research questions to shape the findings. As a result, this research found 16 industrial segments, 168 data science methods, and 95 software tools explored by studies from the literature. Furthermore, the research highlighted the employment of diverse neural network subvariations and missing details in the data composition. Finally, this article organized these results in a taxonomic approach to synthesize a state-of-the-art representation and visualization, favoring future research studies in the field.
Collapse
Affiliation(s)
- Helder Moreira Arruda
- Applied Computing Graduate Program, University of Vale do Rio dos Sinos, 950, Unisinos Av., São Leopoldo 93022-000, RS, Brazil
| | - Rodrigo Simon Bavaresco
- Applied Computing Graduate Program, University of Vale do Rio dos Sinos, 950, Unisinos Av., São Leopoldo 93022-000, RS, Brazil
| | - Rafael Kunst
- Applied Computing Graduate Program, University of Vale do Rio dos Sinos, 950, Unisinos Av., São Leopoldo 93022-000, RS, Brazil
| | - Elvis Fernandes Bugs
- HT Micron Semiconductors S.A., 1550, Unisinos Av., São Leopoldo 93022-750, RS, Brazil
| | | | - Jorge Luis Victória Barbosa
- Applied Computing Graduate Program, University of Vale do Rio dos Sinos, 950, Unisinos Av., São Leopoldo 93022-000, RS, Brazil
| |
Collapse
|
4
|
Anvar AAT, Mohammadi H. A novel application of deep transfer learning with audio pre-trained models in pump audio fault detection. COMPUT IND 2023. [DOI: 10.1016/j.compind.2023.103872] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/09/2023]
|
5
|
Alharbi F, Luo S, Zhang H, Shaukat K, Yang G, Wheeler CA, Chen Z. A Brief Review of Acoustic and Vibration Signal-Based Fault Detection for Belt Conveyor Idlers Using Machine Learning Models. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23041902. [PMID: 36850498 PMCID: PMC9959905 DOI: 10.3390/s23041902] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/30/2022] [Revised: 02/05/2023] [Accepted: 02/05/2023] [Indexed: 06/01/2023]
Abstract
Due to increasing demands for ensuring the safety and reliability of a system, fault detection (FD) has received considerable attention in modern industries to monitor their machines. Bulk materials are transported worldwide using belt conveyors as an essential transport system. The majority of conveyor components are monitored continuously to ensure their reliability, but idlers remain a challenge to monitor due to the large number of idlers (rollers) distributed throughout the working environment. These idlers are prone to external noises or disturbances that cause a failure in the underlying system operations. The research community has begun using machine learning (ML) to detect idler's defects to assist industries in responding to failures on time. Vibration and acoustic measurements are commonly employed to monitor the condition of idlers. However, there has been no comprehensive review of FD for belt conveyor idlers. This paper presents a recent review of acoustic and vibration signal-based fault detection for belt conveyor idlers using ML models. It also discusses major steps in the approaches, such as data collection, signal processing, feature extraction and selection, and ML model construction. Additionally, the paper provides an overview of the main components of belt conveyor systems, sources of defects in idlers, and a brief introduction to ML models. Finally, it highlights critical open challenges and provides future research directions.
Collapse
Affiliation(s)
- Fahad Alharbi
- School of Information and Physical Sciences, The University of Newcastle, Newcastle, NSW 2308, Australia
- Department of Information Technology, College of Computers and Information Technology, Taif University, P.O. Box 11099, Taif 21944, Saudi Arabia
| | - Suhuai Luo
- School of Information and Physical Sciences, The University of Newcastle, Newcastle, NSW 2308, Australia
| | - Hongyu Zhang
- School of Information and Physical Sciences, The University of Newcastle, Newcastle, NSW 2308, Australia
| | - Kamran Shaukat
- School of Information and Physical Sciences, The University of Newcastle, Newcastle, NSW 2308, Australia
- Department of Data Science, University of the Punjab, Lahore 54890, Pakistan
| | - Guang Yang
- School of Information and Physical Sciences, The University of Newcastle, Newcastle, NSW 2308, Australia
| | - Craig A. Wheeler
- School of Engineering, University of Newcastle, Callaghan, NSW 2308, Australia
| | - Zhiyong Chen
- School of Engineering, University of Newcastle, Callaghan, NSW 2308, Australia
| |
Collapse
|
6
|
Application of Generative Adversarial Network and Diverse Feature Extraction Methods to Enhance Classification Accuracy of Tool-Wear Status. ELECTRONICS 2022. [DOI: 10.3390/electronics11152364] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
The means of accurately determining tool-wear status has long been important to manufacturers. Tool-wear status classification enables factories to avoid the unnecessary costs incurred by replacing tools too early and to prevent product damage caused by overly worn tools. While researchers have examined this topic for over a decade, most existing studies have focused on model development but have neglected two fundamental issues in machine learning: data imbalance and feature extraction. In view of this, we propose two improvements: (1) using a generative adversarial network to generate realistic computer numerical control machine vibration data to overcome data imbalance and (2) extracting features in the time domain, the frequency domain, and the time–frequency domain simultaneously for modeling and integrating these in an ensemble model. The experiment results demonstrate how both proposed modifications are reasonable and valid.
Collapse
|
7
|
The Method of Rolling Bearing Fault Diagnosis Based on Multi-Domain Supervised Learning of Convolution Neural Network. ENERGIES 2022. [DOI: 10.3390/en15134614] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
The rolling bearing is a critical part of rotating machinery and its condition determines the performance of industrial equipment; it is necessary to detect rolling bearing faults as early as possible. The traditional methods of fault diagnosis are not efficient and are time-consuming. With the help of deep learning, the convolution neural network (CNN) plays a huge role in the data-driven methods of bearing fault diagnosis. However, the vibration signal is non-stationary, contains high noise, and is one-dimensional, which is difficult to analyze directly by the CNN model. Considering the multi-domain learning as an advantage of deep learning, this paper proposes a novel rolling bearing fault diagnosis approach using an improved one-dimensional (1D) and two-dimensional (2D) convolution neural network (CNN) of two-domain information learning. The constructed fault diagnosis model combining 1D and 2D CNN extracts the fault features from the two-domain information of bearing fault samples. The padding and dropout technology are utilized to fully extract features from the raw data and reduce over-fitting. To prove the validity of the proposed method, this paper performs two tests with two bearing datasets, the Case Western Reserve University (CWRU) bearing dataset and the Dalian University of Technology (DUT) vibration laboratory dataset. The experimental results show that our proposed method achieves high recognition accuracy of rolling bearing fault states via two-domain learning of monitoring data, and there is no manual experience necessary. Vibration data under strong noise were also used to test the method, and the results show the superiority and robustness of the proposed method.
Collapse
|
8
|
A Fault Detection Method for Electrohydraulic Switch Machine Based on Oil-Pressure-Signal-Sectionalized Feature Extraction. ENTROPY 2022; 24:e24070848. [PMID: 35885072 PMCID: PMC9316213 DOI: 10.3390/e24070848] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/04/2022] [Revised: 06/17/2022] [Accepted: 06/17/2022] [Indexed: 02/04/2023]
Abstract
A turnout switch machine is key equipment in a railway, and its fault condition has an enormous impact on the safety of train operation. Electrohydraulic switch machines are increasingly used in high-speed railways, and how to extract effective fault features from their working condition monitoring signal is a difficult problem. This paper focuses on the sectionalized feature extraction method of the oil pressure signal of the electrohydraulic switch machine and realizes the fault detection of the switch machine based on this method. First, the oil pressure signal is divided into three stages according to the working principle and action process of the switch machine, and multiple features of each stage are extracted. Then the max-relevance and min-redundancy (mRMR) algorithm is applied to select the effective features. Finally, the mini batch k-means method is used to achieve unsupervised fault diagnosis. Through experimental verification, this method can not only derive the best sectionalization mode and feature types of the oil pressure signal, but also achieve the fault diagnosis and the prediction of the status of the electrohydraulic switch machine.
Collapse
|
9
|
Detection of Mechanical Failures in Industrial Machines Using Overlapping Acoustic Anomalies: A Systematic Literature Review. SENSORS 2022; 22:s22103888. [PMID: 35632297 PMCID: PMC9144725 DOI: 10.3390/s22103888] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/22/2022] [Revised: 05/16/2022] [Accepted: 05/18/2022] [Indexed: 11/28/2022]
Abstract
One of the most important strategies for preventative factory maintenance is anomaly detection without the need for dedicated sensors for each industrial unit. The implementation of sound-data-based anomaly detection is an unduly complicated process since factory-collected sound data are frequently corrupted and affected by ordinary production noises. The use of acoustic methods to detect the irregularities in systems has a long history. Unfortunately, limited reference to the implementation of the acoustic approach could be found in the failure detection of industrial machines. This paper presents a systematic review of acoustic approaches in mechanical failure detection in terms of recent implementations and structural extensions. The 52 articles are selected from IEEEXplore, Science Direct and Springer Link databases following the PRISMA methodology for performing systematic literature reviews. The study identifies the research gaps while considering the potential in responding to the challenges of the mechanical failure detection of industrial machines. The results of this study reveal that the use of acoustic emission is still dominant in the research community. In addition, based on the 52 selected articles, research that discusses failure detection in noisy conditions is still very limited and shows that it will still be a challenge in the future.
Collapse
|
10
|
Prediction of Machine Failure in Industry 4.0: A Hybrid CNN-LSTM Framework. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12094221] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The proliferation of sensing technologies such as sensors has resulted in vast amounts of time-series data being produced by machines in industrial plants and factories. There is much information available that can be used to predict machine breakdown and degradation in a given factory. The downtime of industrial equipment accounts for heavy losses in revenue that can be reduced by making accurate failure predictions using the sensor data. Internet of Things (IoT) technologies have made it possible to collect sensor data in real time. We found that hybrid modelling can result in efficient predictions as they are capable of capturing the abstract features which facilitate better predictions. In addition, developing effective optimization strategy is difficult because of the complex nature of different sensor data in real time scenarios. This work proposes a method for multivariate time-series forecasting for predictive maintenance (PdM) based on a combination of convolutional neural networks and long short term memory with skip connection (CNN-LSTM). We experiment with CNN, LSTM, and CNN-LSTM forecasting models one by one for the prediction of machine failures. The data used in this experiment are from Microsoft’s case study. The dataset provides information about the failure history, maintenance history, error conditions, and machine features and telemetry, which consists of information such as voltage, pressure, vibration, and rotation sensor values recorded between 2015 and 2016. The proposed hybrid CNN-LSTM framework is a two-stage end-to-end model in which the LSTM is leveraged to analyze the relationships among different time-series data variables through its memory function, and 1-D CNNs are responsible for effective extraction of high-level features from the data. Our method learns the long-term patterns of the time series by extracting the short-term dependency patterns of different time-series variables. In our evaluation, CNN-LSTM provided the most reliable and highest prediction accuracy.
Collapse
|