1
|
Shyalika C, Roy K, Prasad R, Kalach FE, Zi Y, Mittal P, Narayanan V, Harik R, Sheth A. RI2AP: Robust and Interpretable 2D Anomaly Prediction in Assembly Pipelines. SENSORS (BASEL, SWITZERLAND) 2024; 24:3244. [PMID: 38794098 PMCID: PMC11125630 DOI: 10.3390/s24103244] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/24/2024] [Revised: 05/16/2024] [Accepted: 05/16/2024] [Indexed: 05/26/2024]
Abstract
Predicting anomalies in manufacturing assembly lines is crucial for reducing time and labor costs and improving processes. For instance, in rocket assembly, premature part failures can lead to significant financial losses and labor inefficiencies. With the abundance of sensor data in the Industry 4.0 era, machine learning (ML) offers potential for early anomaly detection. However, current ML methods for anomaly prediction have limitations, with F1 measure scores of only 50% and 66% for prediction and detection, respectively. This is due to challenges like the rarity of anomalous events, scarcity of high-fidelity simulation data (actual data are expensive), and the complex relationships between anomalies not easily captured using traditional ML approaches. Specifically, these challenges relate to two dimensions of anomaly prediction: predicting when anomalies will occur and understanding the dependencies between them. This paper introduces a new method called Robust and Interpretable 2D Anomaly Prediction (RI2AP) designed to address both dimensions effectively. RI2AP is demonstrated on a rocket assembly simulation, showing up to a 30-point improvement in F1 measure compared to current ML methods. This highlights its potential to enhance automated anomaly prediction in manufacturing. Additionally, RI2AP includes a novel interpretation mechanism inspired by a causal-influence framework, providing domain experts with valuable insights into sensor readings and their impact on predictions. Finally, the RI2AP model was deployed in a real manufacturing setting for assembling rocket parts. Results and insights from this deployment demonstrate the promise of RI2AP for anomaly prediction in manufacturing assembly pipelines.
Collapse
|
2
|
Stathatos E, Tzimas E, Benardos P, Vosniakos GC. Convolutional Neural Networks for Raw Signal Classification in CNC Turning Process Monitoring. SENSORS (BASEL, SWITZERLAND) 2024; 24:1390. [PMID: 38474926 DOI: 10.3390/s24051390] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/05/2024] [Revised: 02/19/2024] [Accepted: 02/19/2024] [Indexed: 03/14/2024]
Abstract
This study addresses the need for advanced machine learning-based process monitoring in smart manufacturing. A methodology is developed for near-real-time part quality prediction based on process-related data obtained from a CNC turning center. Instead of the manual feature extraction methods typically employed in signal processing, a novel one-dimensional convolutional architecture allows the trained model to autonomously extract pertinent features directly from the raw signals. Several signal channels are utilized, including vibrations, motor speeds, and motor torques. Three quality indicators-average roughness, peak-to-valley roughness, and diameter deviation-are monitored using a single model, resulting in a compact and efficient classifier. Training data are obtained via a small number of experiments designed to induce variability in the quality metrics by varying feed, cutting speed, and depth of cut. A sliding window technique augments the dataset and allows the model to seamlessly operate over the entire process. This is further facilitated by the model's ability to distinguish between cutting and non-cutting phases. The base model is evaluated via k-fold cross validation and achieves average F1 scores above 0.97 for all outputs. Consistent performance is exhibited by additional instances trained under various combinations of design parameters, validating the robustness of the proposed methodology.
Collapse
|
3
|
Shi C, Rothrock L. Investigating the effects of age, task load, task complexity, and input device on monitoring performance for smart manufacturing in the oil refining industry. ERGONOMICS 2024; 67:102-110. [PMID: 37083694 DOI: 10.1080/00140139.2023.2206071] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/06/2023] [Accepted: 04/18/2023] [Indexed: 05/03/2023]
Abstract
Human beings play an important role in a smart manufacturing economy. In this study, we explored the effects of age, task load, task complexity, and input device on abnormal event detection performance in an oil refinery control room task. Thirty participants were recruited to complete a process plant monitoring task in which they were asked to continuously monitor the gauge states, and immediately detect and solve the abnormal events. Participants' accuracy in detecting abnormal states was recorded and analysed during the task. We found that the complexity factor affected accuracy significantly, and younger adults had significantly higher accuracy than older adults in high task load trials. No significant effect was found for the input device factor. These findings suggest that age, task load, and task complexity should be taken into consideration when designing tools to improve older operators' performance.Practitioner summary: The smart manufacturing economy elicits higher requirements for older operators in oil refinery monitoring tasks. Under high task load, older adults had lower accuracy in detecting abnormal conditions than younger adults. The task complexity affected participants' accuracy in detecting abnormal states.
Collapse
|
4
|
Ura S, Zaman L. Biologicalization of Smart Manufacturing Using DNA-Based Computing. Biomimetics (Basel) 2023; 8:620. [PMID: 38132559 PMCID: PMC10742096 DOI: 10.3390/biomimetics8080620] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2023] [Revised: 12/11/2023] [Accepted: 12/14/2023] [Indexed: 12/23/2023] Open
Abstract
Smart manufacturing needs cognitive computing methods to make the relevant systems more intelligent and autonomous. In this respect, bio-inspired cognitive computing methods (i.e., biologicalization) can play a vital role. This article is written from this perspective. In particular, this article provides a general overview of the bio-inspired computing method called DNA-Based Computing (DBC), including its theory and applications. The main theme of DBC is the central dogma of molecular biology (once information of DNA/RNA has got into a protein, it cannot get out again), i.e., DNA to RNA (sequences of four types of nucleotides) and DNA/RNA to protein (sequence of twenty types of amino acids) are allowed, but not the reverse ones. Thus, DBC transfers few-element information (DNA/RAN-like) to many-element information (protein-like). This characteristic of DBC can help to solve cognitive problems (e.g., pattern recognition). DBC can take many forms; this article elucidates two main forms, denoted as DBC-1 and DBC-2. Using arbitrary numerical examples, we demonstrate that DBC-1 can solve various cognitive problems, e.g., "similarity indexing between seemingly different but inherently identical objects" and "recognizing regions of an image separated by a complex boundary." In addition, using an arbitrary numerical example, we demonstrate that DBC-2 can solve the following cognitive problem: "pattern recognition when the relevant information is insufficient." The remarkable thing is that smart manufacturing-based systems (e.g., digital twins and big data analytics) must solve the abovementioned problems to make the manufacturing enablers (e.g., machine tools and monitoring systems) more self-reliant and autonomous. Consequently, DBC can improve the cognitive problem-solving ability of smart manufacturing-relevant systems and enrich their biologicalization.
Collapse
|
5
|
Laky DJ, Casas-Orozco D, Abdi M, Feng X, Wood E, Reklaitis GV, Nagy ZK. Using PharmaPy with Jupyter Notebook to teach digital design in pharmaceutical manufacturing. COMPUTER APPLICATIONS IN ENGINEERING EDUCATION 2023; 31:1662-1677. [PMID: 38314247 PMCID: PMC10838379 DOI: 10.1002/cae.22660] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/05/2022] [Accepted: 06/03/2023] [Indexed: 02/06/2024]
Abstract
The use of digital tools in pharmaceutical manufacturing has gained traction over the past two decades. Whether supporting regulatory filings or attempting to modernize manufacturing processes to adopt new and quickly evolving Industry 4.0 standards, engineers entering the workforce must exhibit proficiency in modeling, simulation, optimization, data processing, and other digital analysis techniques. In this work, a course that addresses digital tools in pharmaceutical manufacturing for chemical engineers was adjusted to utilize a new tool, PharmaPy, instead of traditional chemical engineering simulation tools. Jupyter Notebook was utilized as an instructional and interactive environment to teach students to use PharmaPy, a new, open-source pharmaceutical manufacturing process simulator. Students were then surveyed to see if PharmaPy was able to meet the learning objectives of the course. During the semester, PharmaPy's model library was used to simulate both individual unit operations as well as multiunit pharmaceutical processes. Through the initial survey results, students indicated that: (i) through Jupyter Notebook, learning Python and PharmaPy was approachable from varied coding experience backgrounds and (ii) PharmaPy strengthened their understanding of pharmaceutical manufacturing through active pharmaceutical ingredient process design and development.
Collapse
|
6
|
Hammad M, Jillani RM, Ullah S, Namoun A, Tufail A, Kim KH, Shah H. Security Framework for Network-Based Manufacturing Systems with Personalized Customization: An Industry 4.0 Approach. SENSORS (BASEL, SWITZERLAND) 2023; 23:7555. [PMID: 37688011 PMCID: PMC10490734 DOI: 10.3390/s23177555] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/29/2023] [Revised: 08/20/2023] [Accepted: 08/24/2023] [Indexed: 09/10/2023]
Abstract
Smart manufacturing is pivotal in the context of Industry 4.0, as it integrates advanced technologies like the Internet of Things (IoT) and automation to streamline production processes and improve product quality, paving the way for a competitive industrial landscape. Machines have become network-based through the IoT, where integrated and collaborated manufacturing system responds in real time to meet demand fluctuations for personalized customization. Within the network-based manufacturing system (NBMS), mobile industrial robots (MiRs) are vital in increasing operational efficiency, adaptability, and productivity. However, with the advent of IoT-enabled manufacturing systems, security has become a serious challenge because of the communication of various devices acting as mobile nodes. This paper proposes the framework for a newly personalized customization factory, considering all the advanced technologies and tools used throughout the production process. To encounter the security concern, an IoT-enabled NBMS is selected as the system model to tackle a black hole attack (BHA) using the NTRUEncrypt cryptography and the ad hoc on-demand distance-vector (AODV) routing protocol. NTRUEncrypt performs encryption and decryption while sending and receiving messages. The proposed technique is simulated by network simulator NS-2.35, and its performance is evaluated for different network environments, such as a healthy network, a malicious network, and an NTRUEncrypt-secured network based on different evaluation metrics, including throughput, goodput, end-to-end delay, and packet delivery ratio. The results show that the proposed scheme performs safely in the presence of a malicious node. The implications of this study are beneficial for manufacturing industries looking to embrace IoT-enabled subtractive and additive manufacturing facilitated by mobile industrial robots. Implementation of the proposed scheme ensures operational efficiency, enables personalized customization, and protects confidential data and communication in the manufacturing ecosystem.
Collapse
|
7
|
Schöppenthau F, Patzer F, Schnebel B, Watson K, Baryschnikov N, Obst B, Chauhan Y, Kaever D, Usländer T, Kulkarni P. Building a Digital Manufacturing as a Service Ecosystem for Catena-X. SENSORS (BASEL, SWITZERLAND) 2023; 23:7396. [PMID: 37687851 PMCID: PMC10490677 DOI: 10.3390/s23177396] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/28/2023] [Revised: 08/16/2023] [Accepted: 08/18/2023] [Indexed: 09/10/2023]
Abstract
Manufacturing as a Service (MaaS) enables a paradigm shift in the current manufacturing landscape, from integrated production and inflexible, fragile supply chains to open production and flexible, robust supply chains. As part of this evolution, new scaling effects for production capacities and customer segments are possible. This article describes how to accomplish this paradigm shift for the automotive industry by building a digital MaaS ecosystem for the large-scale automotive innovation project Catena-X, which aims at a standardized global data exchange based on European values. A digital MaaS ecosystem can not only achieve scaling effects, but also realize new business models and overcome current and future challenges in the areas of legislation, sustainability, and standardization. This article analyzes the state-of-the-art of MaaS ecosystems and describes the development of a digital MaaS ecosystem based on an updated and advanced version of the reference architecture for smart connected factories, called the Smart Factory Web. Furthermore, this article describes a demonstrator for a federated MaaS marketplace for Catena-X which leverages the full technological potential of this digital ecosystem. In conclusion, the evaluation of the implemented digital ecosystem enables the advancement of the reference architecture Smart Factory Web, which can now be used as a blueprint for open, sustainable, and resilient digital manufacturing ecosystems.
Collapse
|
8
|
Animashaun D, Hussain M. Automated Micro-Crack Detection within Photovoltaic Manufacturing Facility via Ground Modelling for a Regularized Convolutional Network. SENSORS (BASEL, SWITZERLAND) 2023; 23:6235. [PMID: 37448085 PMCID: PMC10346706 DOI: 10.3390/s23136235] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/18/2023] [Revised: 07/04/2023] [Accepted: 07/05/2023] [Indexed: 07/15/2023]
Abstract
The manufacturing of photovoltaic cells is a complex and intensive process involving the exposure of the cell surface to high temperature differentials and external pressure, which can lead to the development of surface defects, such as micro-cracks. Currently, domain experts manually inspect the cell surface to detect micro-cracks, a process that is subject to human bias, high error rates, fatigue, and labor costs. To overcome the need for domain experts, this research proposes modelling cell surfaces via representative augmentations grounded in production floor conditions. The modelled dataset is then used as input for a custom 'lightweight' convolutional neural network architecture for training a robust, noninvasive classifier, essentially presenting an automated micro-crack detector. In addition to data modelling, the proposed architecture is further regularized using several regularization strategies to enhance performance, achieving an overall F1-score of 85%.
Collapse
|
9
|
Othman U, Yang E. Human-Robot Collaborations in Smart Manufacturing Environments: Review and Outlook. SENSORS (BASEL, SWITZERLAND) 2023; 23:5663. [PMID: 37420834 DOI: 10.3390/s23125663] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/29/2023] [Revised: 06/07/2023] [Accepted: 06/15/2023] [Indexed: 07/09/2023]
Abstract
The successful implementation of Human-Robot Collaboration (HRC) has become a prominent feature of smart manufacturing environments. Key industrial requirements, such as flexibility, efficiency, collaboration, consistency, and sustainability, present pressing HRC needs in the manufacturing sector. This paper provides a systemic review and an in-depth discussion of the key technologies currently being employed in smart manufacturing with HRC systems. The work presented here focuses on the design of HRC systems, with particular attention given to the various levels of Human-Robot Interaction (HRI) observed in the industry. The paper also examines the key technologies being implemented in smart manufacturing, including Artificial Intelligence (AI), Collaborative Robots (Cobots), Augmented Reality (AR), and Digital Twin (DT), and discusses their applications in HRC systems. The benefits and practical instances of deploying these technologies are showcased, emphasizing the substantial prospects for growth and improvement in sectors such as automotive and food. However, the paper also addresses the limitations of HRC utilization and implementation and provides some insights into how the design of these systems should be approached in future work and research. Overall, this paper provides new insights into the current state of HRC in smart manufacturing and serves as a useful resource for those interested in the ongoing development of HRC systems in the industry.
Collapse
|
10
|
Park JH, Kim YS, Seo H, Cho YJ. Analysis of Training Deep Learning Models for PCB Defect Detection. SENSORS (BASEL, SWITZERLAND) 2023; 23:2766. [PMID: 36904970 PMCID: PMC10006999 DOI: 10.3390/s23052766] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/02/2023] [Revised: 02/20/2023] [Accepted: 02/24/2023] [Indexed: 06/18/2023]
Abstract
Recently, many companies have introduced automated defect detection methods for defect-free PCB manufacturing. In particular, deep learning-based image understanding methods are very widely used. In this study, we present an analysis of training deep learning models to perform PCB defect detection stably. To this end, we first summarize the characteristics of industrial images, such as PCB images. Then, the factors that can cause changes (contamination and quality degradation) to the image data in the industrial field are analyzed. Subsequently, we organize defect detection methods that can be applied according to the situation and purpose of PCB defect detection. In addition, we review the characteristics of each method in detail. Our experimental results demonstrated the impact of various degradation factors, such as defect detection methods, data quality, and image contamination. Based on our overview of PCB defect detection and experiment results, we present knowledge and guidelines for correct PCB defect detection.
Collapse
|
11
|
Sundaram S, Zeid A. Artificial Intelligence-Based Smart Quality Inspection for Manufacturing. MICROMACHINES 2023; 14:570. [PMID: 36984977 PMCID: PMC10058274 DOI: 10.3390/mi14030570] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/20/2023] [Revised: 02/18/2023] [Accepted: 02/24/2023] [Indexed: 06/18/2023]
Abstract
In today's era, monitoring the health of the manufacturing environment has become essential in order to prevent unforeseen repairs, shutdowns, and to be able to detect defective products that could incur big losses. Data-driven techniques and advancements in sensor technology with Internet of the Things (IoT) have made real-time tracking of systems a reality. The health of a product can also be continuously assessed throughout the manufacturing lifecycle by using Quality Control (QC) measures. Quality inspection is one of the critical processes in which the product is evaluated and deemed acceptable or rejected. The visual inspection or final inspection process involves a human operator sensorily examining the product to ascertain its status. However, there are several factors that impact the visual inspection process resulting in an overall inspection accuracy of around 80% in the industry. With the goal of 100% inspection in advanced manufacturing systems, manual visual inspection is both time-consuming and costly. Computer Vision (CV) based algorithms have helped in automating parts of the visual inspection process, but there are still unaddressed challenges. This paper presents an Artificial Intelligence (AI) based approach to the visual inspection process by using Deep Learning (DL). The approach includes a custom Convolutional Neural Network (CNN) for inspection and a computer application that can be deployed on the shop floor to make the inspection process user-friendly. The inspection accuracy for the proposed model is 99.86% on image data of casting products.
Collapse
|
12
|
Abdallah M, Joung BG, Lee WJ, Mousoulis C, Raghunathan N, Shakouri A, Sutherland JW, Bagchi S. Anomaly Detection and Inter-Sensor Transfer Learning on Smart Manufacturing Datasets. SENSORS (BASEL, SWITZERLAND) 2023; 23:486. [PMID: 36617091 PMCID: PMC9823713 DOI: 10.3390/s23010486] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/08/2022] [Revised: 12/27/2022] [Accepted: 12/30/2022] [Indexed: 06/17/2023]
Abstract
Smart manufacturing systems are considered the next generation of manufacturing applications. One important goal of the smart manufacturing system is to rapidly detect and anticipate failures to reduce maintenance cost and minimize machine downtime. This often boils down to detecting anomalies within the sensor data acquired from the system which has different characteristics with respect to the operating point of the environment or machines, such as, the RPM of the motor. In this paper, we analyze four datasets from sensors deployed in manufacturing testbeds. We detect the level of defect for each sensor data leveraging deep learning techniques. We also evaluate the performance of several traditional and ML-based forecasting models for predicting the time series of sensor data. We show that careful selection of training data by aggregating multiple predictive RPM values is beneficial. Then, considering the sparse data from one kind of sensor, we perform transfer learning from a high data rate sensor to perform defect type classification. We release our manufacturing database corpus (4 datasets) and codes for anomaly detection and defect type classification for the community to build on it. Taken together, we show that predictive failure classification can be achieved, paving the way for predictive maintenance.
Collapse
|
13
|
Guo X, Zhang G, Zhang Y. A Comprehensive Review of Blockchain Technology-Enabled Smart Manufacturing: A Framework, Challenges and Future Research Directions. SENSORS (BASEL, SWITZERLAND) 2022; 23:155. [PMID: 36616753 PMCID: PMC9824102 DOI: 10.3390/s23010155] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Revised: 12/15/2022] [Accepted: 12/15/2022] [Indexed: 06/17/2023]
Abstract
As a new generation of information technology, blockchain plays an important role in business and industrial innovation. The employment of blockchain technologies in industry has increased transparency, security and traceability, improved efficiency, and reduced costs of production activities. Many studies on blockchain technology-enabled system construction and performance optimization in Industry 4.0 have been carried out. However, blockchain technology and smart manufacturing have been individually researched in academia and industry, according to the literature. This survey aims to summarize the existing research to provide theoretical foundations for applying blockchain technology to smart manufacturing, thus creating a more reliable and authentic smart manufacturing system. In this regard, the literature related to four types of critical issues in smart manufacturing is introduced: data security, data sharing, trust mechanisms and system coordination issues. The corresponding blockchain solutions were reviewed and analyzed. Based on the insights obtained from the above analysis, a reference framework for blockchain technology-enabled smart manufacturing systems is put forward. The challenges and future research directions are also discussed to provide potential guides for achieving better utilization of this technology in smart manufacturing.
Collapse
|
14
|
Noor-A-Rahim M, John J, Firyaguna F, Sherazi HHR, Kushch S, Vijayan A, O’Connell E, Pesch D, O’Flynn B, O’Brien W, Hayes M, Armstrong E. Wireless Communications for Smart Manufacturing and Industrial IoT: Existing Technologies, 5G and Beyond. SENSORS (BASEL, SWITZERLAND) 2022; 23:s23010073. [PMID: 36616671 PMCID: PMC9824593 DOI: 10.3390/s23010073] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/25/2022] [Revised: 12/09/2022] [Accepted: 12/12/2022] [Indexed: 06/12/2023]
Abstract
Smart manufacturing is a vision and major driver for change in today's industry. The goal of smart manufacturing is to optimize manufacturing processes through constantly monitoring, controlling, and adapting processes towards more efficient and personalised manufacturing. This requires and relies on technologies for connected machines incorporating a variety of computation, sensing, actuation, and machine to machine communications modalities. As such, understanding the change towards smart manufacturing requires knowledge of the enabling technologies, their applications in real world scenarios and the communication protocols and their performance to meet application requirements. Particularly, wireless communication is becoming an integral part of modern smart manufacturing and is expected to play an important role in achieving the goals of smart manufacturing. This paper presents an extensive review of wireless communication protocols currently applied in manufacturing environments and provides a comprehensive review of the associated use cases whilst defining their expected impact on the future of smart manufacturing. Based on the review, we point out a number of open challenges and directions for future research in wireless communication technologies for smart manufacturing.
Collapse
|
15
|
Verma P, Breslin JG, O’Shea D. FLDID: Federated Learning Enabled Deep Intrusion Detection in Smart Manufacturing Industries. SENSORS (BASEL, SWITZERLAND) 2022; 22:8974. [PMID: 36433569 PMCID: PMC9694635 DOI: 10.3390/s22228974] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/14/2022] [Revised: 11/14/2022] [Accepted: 11/17/2022] [Indexed: 06/16/2023]
Abstract
The rapid development in manufacturing industries due to the introduction of IIoT devices has led to the emergence of Industry 4.0 which results in an industry with intelligence, increased efficiency and reduction in the cost of manufacturing. However, the introduction of IIoT devices opens up the door for a variety of cyber threats in smart industries. The detection of cyber threats against such extensive, complex, and heterogeneous smart manufacturing industries is very challenging due to the lack of sufficient attack traces. Therefore, in this work, a Federated Learning enabled Deep Intrusion Detection framework is proposed to detect cyber threats in smart manufacturing industries. The proposed FLDID framework allows multiple smart manufacturing industries to build a collaborative model to detect threats and overcome the limited attack example problem with individual industries. Moreover, to ensure the privacy of model gradients, Paillier-based encryption is used in communication between edge devices (representative of smart industries) and the server. The deep learning-based hybrid model, which consists of a Convolutional Neural Network, Long Short Term Memory, and Multi-Layer Perceptron is used in the intrusion detection model. An exhaustive set of experiments on the publically available dataset proves the effectiveness of the proposed framework for detecting cyber threats in smart industries over the state-of-the-art approaches.
Collapse
|
16
|
Fraga-Lamas P, Barros D, Lopes SI, Fernández-Caramés TM. Mist and Edge Computing Cyber-Physical Human-Centered Systems for Industry 5.0: A Cost-Effective IoT Thermal Imaging Safety System. SENSORS (BASEL, SWITZERLAND) 2022; 22:8500. [PMID: 36366192 PMCID: PMC9658932 DOI: 10.3390/s22218500] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/05/2022] [Revised: 10/28/2022] [Accepted: 11/02/2022] [Indexed: 06/16/2023]
Abstract
While many companies worldwide are still striving to adjust to Industry 4.0 principles, the transition to Industry 5.0 is already underway. Under such a paradigm, Cyber-Physical Human-centered Systems (CPHSs) have emerged to leverage operator capabilities in order to meet the goals of complex manufacturing systems towards human-centricity, resilience and sustainability. This article first describes the essential concepts for the development of Industry 5.0 CPHSs and then analyzes the latest CPHSs, identifying their main design requirements and key implementation components. Moreover, the major challenges for the development of such CPHSs are outlined. Next, to illustrate the previously described concepts, a real-world Industry 5.0 CPHS is presented. Such a CPHS enables increased operator safety and operation tracking in manufacturing processes that rely on collaborative robots and heavy machinery. Specifically, the proposed use case consists of a workshop where a smarter use of resources is required, and human proximity detection determines when machinery should be working or not in order to avoid incidents or accidents involving such machinery. The proposed CPHS makes use of a hybrid edge computing architecture with smart mist computing nodes that processes thermal images and reacts to prevent industrial safety issues. The performed experiments show that, in the selected real-world scenario, the developed CPHS algorithms are able to detect human presence with low-power devices (with a Raspberry Pi 3B) in a fast and accurate way (in less than 10 ms with a 97.04% accuracy), thus being an effective solution (e.g., a good trade-off between cost, accuracy, resilience and computational efficiency) that can be integrated into many Industry 5.0 applications. Finally, this article provides specific guidelines that will help future developers and managers to overcome the challenges that will arise when deploying the next generation of CPHSs for smart and sustainable manufacturing.
Collapse
|
17
|
Shi C, Rothrock L. Using eye movements to evaluate the effectiveness of the situation awareness rating technique scale in measuring situation awareness for smart manufacturing. ERGONOMICS 2022:1-9. [PMID: 36189950 DOI: 10.1080/00140139.2022.2132299] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/04/2022] [Accepted: 09/26/2022] [Indexed: 06/16/2023]
Abstract
Physiological indicators, including eye-tracking measures, may provide insight into human internal states in many domains, such as smart manufacturing. The Situation Awareness Rating Technique (SART) scale has been criticised for not assessing situation awareness (SA) accurately. In this study, we investigated the precision of the SART scale for assessing SA by comparing the scores to eye movement data. Thirty participants were recruited to complete a process plant monitoring task. Participants' eye movements and SART scores were recorded and analysed. Our results moderately supported the idea that the SART scale did not accurately measure SA. We found that four dimensions in the SART scale need to be revised to reflect real SA, which may partially solve the divergence between objective and subjective SA measurements. Moreover, these findings provided solutions for designing a revised SART scale to measure the internal states of operators for smart manufacturing. Practitioner summary: Situation awareness (SA) is a critical component of decision-making and performance for smart manufacturing. The present study examines the relationships among eye movement, the SART scale, and SA for smart manufacturing in a refinery control room.
Collapse
|
18
|
Farhadi A, Lee SKH, Hinchy EP, O’Dowd NP, McCarthy CT. The Development of a Digital Twin Framework for an Industrial Robotic Drilling Process. SENSORS (BASEL, SWITZERLAND) 2022; 22:7232. [PMID: 36236330 PMCID: PMC9571147 DOI: 10.3390/s22197232] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/15/2022] [Revised: 09/19/2022] [Accepted: 09/20/2022] [Indexed: 06/16/2023]
Abstract
A digital twin is a digital representation of a physical entity that is updated in real-time by transfer of data between physical and digital (virtual) entities. In this manuscript we aim to introduce a digital twin framework for robotic drilling. Initially, a generic reference model is proposed to highlight elements of the digital twin relevant to robotic drilling. Then, a precise reference digital twin architecture model is developed, based on available standards and technologies. Finally, real-time visualisation of drilling process parameters is demonstrated as an initial step towards implementing a digital twin of a robotic drilling process.
Collapse
|
19
|
Hussain M, Al-Aqrabi H, Munawar M, Hill R, Alsboui T. Domain Feature Mapping with YOLOv7 for Automated Edge-Based Pallet Racking Inspections. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22186927. [PMID: 36146273 PMCID: PMC9501564 DOI: 10.3390/s22186927] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/25/2022] [Revised: 09/07/2022] [Accepted: 09/12/2022] [Indexed: 06/01/2023]
Abstract
Pallet racking is an essential element within warehouses, distribution centers, and manufacturing facilities. To guarantee its safe operation as well as stock protection and personnel safety, pallet racking requires continuous inspections and timely maintenance in the case of damage being discovered. Conventionally, a rack inspection is a manual quality inspection process completed by certified inspectors. The manual process results in operational down-time as well as inspection and certification costs and undiscovered damage due to human error. Inspired by the trend toward smart industrial operations, we present a computer vision-based autonomous rack inspection framework centered around YOLOv7 architecture. Additionally, we propose a domain variance modeling mechanism for addressing the issue of data scarcity through the generation of representative data samples. Our proposed framework achieved a mean average precision of 91.1%.
Collapse
|
20
|
Li C, Bian S, Wu T, Donovan RP, Li B. Affordable Artificial Intelligence-Assisted Machine Supervision System for the Small and Medium-Sized Manufacturers. SENSORS (BASEL, SWITZERLAND) 2022; 22:6246. [PMID: 36016006 PMCID: PMC9414792 DOI: 10.3390/s22166246] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/17/2022] [Revised: 08/15/2022] [Accepted: 08/17/2022] [Indexed: 06/15/2023]
Abstract
With the rapid concurrent advance of artificial intelligence (AI) and Internet of Things (IoT) technology, manufacturing environments are being upgraded or equipped with a smart and connected infrastructure that empowers workers and supervisors to optimize manufacturing workflow and processes for improved energy efficiency, equipment reliability, quality, safety, and productivity. This challenges capital cost and complexity for many small and medium-sized manufacturers (SMMs) who heavily rely on people to supervise manufacturing processes and facilities. This research aims to create an affordable, scalable, accessible, and portable (ASAP) solution to automate the supervision of manufacturing processes. The proposed approach seeks to reduce the cost and complexity of smart manufacturing deployment for SMMs through the deployment of consumer-grade electronics and a novel AI development methodology. The proposed system, AI-assisted Machine Supervision (AIMS), provides SMMs with two major subsystems: direct machine monitoring (DMM) and human-machine interaction monitoring (HIM). The AIMS system was evaluated and validated with a case study in 3D printing through the affordable AI accelerator solution of the vision processing unit (VPU).
Collapse
|
21
|
Leite D, Martins A, Rativa D, De Oliveira JFL, Maciel AMA. An Automated Machine Learning Approach for Real-Time Fault Detection and Diagnosis. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22166138. [PMID: 36015899 PMCID: PMC9413480 DOI: 10.3390/s22166138] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/25/2022] [Revised: 08/09/2022] [Accepted: 08/12/2022] [Indexed: 05/24/2023]
Abstract
This work presents a novel Automated Machine Learning (AutoML) approach for Real-Time Fault Detection and Diagnosis (RT-FDD). The approach's particular characteristics are: it uses only data that are commonly available in industrial automation systems; it automates all ML processes without human intervention; a non-ML expert can deploy it; and it considers the behavior of cyclic sequential machines, combining discrete timed events and continuous variables as features. The capacity for fault detection is analyzed in two case studies, using data from a 3D machine simulation system with faulty and non-faulty conditions. The enhancement of the RT-FDD performance when the proposed approach is applied is proved with the Feature Importance, Confusion Matrix, and F1 Score analysis, reaching mean values of 85% and 100% in each case study. Finally, considering that faults are rare events, the sensitivity of the models to the number of faulty samples is analyzed.
Collapse
|
22
|
Barbosa CRH, Sousa MC, Almeida MFL, Calili RF. Smart Manufacturing and Digitalization of Metrology: A Systematic Literature Review and a Research Agenda. SENSORS (BASEL, SWITZERLAND) 2022; 22:6114. [PMID: 36015873 PMCID: PMC9460109 DOI: 10.3390/s22166114] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/25/2022] [Revised: 08/07/2022] [Accepted: 08/11/2022] [Indexed: 06/15/2023]
Abstract
Smart manufacturing comprises fully integrated manufacturing systems that respond in real time to meet the changing demands and conditions in industrial activities, supply networks and customer needs. A smart manufacturing environment will face new challenges, including those concerning metrological issues, i.e., analysis of large quantities of data; communication systems for digitalization; measurement standards for automated process control; digital transformation of metrological services; and simulations and virtual measurement processes for the automatic assessment of measured data. Based on the assumption that the interplay between smart manufacturing and digitalization of metrology is an emerging research field, this paper aims to present a systematic literature review (SLR) based on a bibliographic data collection of 160 scientific articles retrieved from the Web of Science and Scopus databases over the 2016-2022 time frame. The findings presented in this review and recommendations for building a research agenda can help policy makers, researchers and practitioners by providing directions for the evolution of digital metrology and its role in the digitalization of the economy and society.
Collapse
|
23
|
Choi S, Woo J, Kim J, Lee JY. Digital Twin-Based Integrated Monitoring System: Korean Application Cases. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22145450. [PMID: 35891132 PMCID: PMC9319650 DOI: 10.3390/s22145450] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/27/2022] [Revised: 07/18/2022] [Accepted: 07/19/2022] [Indexed: 05/27/2023]
Abstract
A digital twin is a virtual model of a process, product, or service, which is one of the key technologies in the fourth industry. The pairing of the virtual and physical world allows analysis of data and monitoring of systems to head off problems before they occur. This paper presents a digital twin architecture and a system based on an interoperable data model. It explains how to build a digital twin for the integrated control monitoring using edge devices, data analytics, and realistic 3D visualization. The system allows continuous collaboration between field engineers for data gathering, designers for modeling 3D models, and layout engineers for layout changing by generating 3D digital twin models automatically. The system helps stakeholders focus on their respective roles to build digital twins. Examples applied to the Korean automotive parts makers are also introduced in this paper. The system can be easily used by small and medium-sized enterprises (SMEs) as well as large companies. Beyond simply watching the production site with CCTV, the production site can be intuitively managed based on the digital twin.
Collapse
|
24
|
Chen TA, Chen SC, Tang W, Chen BT. Internet of Things: Development Intelligent Programmable IoT Controller for Emerging Industry Applications. SENSORS 2022; 22:s22145138. [PMID: 35890819 PMCID: PMC9317047 DOI: 10.3390/s22145138] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/09/2022] [Revised: 06/29/2022] [Accepted: 07/05/2022] [Indexed: 01/16/2023]
Abstract
The Internet of Things (IoT) has become critical to the implementation of Industry 4.0. The successful operation of smart manufacturing depends on the ability to connect everything together. In this research, we applied the TOC (Theory of Constraints) to develop a wireless Wi-Fi intelligent programmable IoT controller that can be connected to and easily control PLCs. By applying the TOC-focused thinking steps to break through their original limitations, the development process guides the user to use the powerful and simple flow language process control syntax to efficiently connect to PLCs and realize the full range of IoT applications. Finally, this research uses oil–water mixer equipment as the target of continuous improvement and verification. The verification results meet the requirements of the default function. The IoT controller developed in this research uses a marine boiler to illustrate the application. The successful development of flow control language by TOC in this research will enable academic research on PLC-derivative applications. The results of this research will help more SMEs to move into smart manufacturing and the new realm of Industry 4.0.
Collapse
|
25
|
Tsanousa A, Bektsis E, Kyriakopoulos C, González AG, Leturiondo U, Gialampoukidis I, Karakostas A, Vrochidis S, Kompatsiaris I. A Review of Multisensor Data Fusion Solutions in Smart Manufacturing: Systems and Trends. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22051734. [PMID: 35270880 PMCID: PMC8914726 DOI: 10.3390/s22051734] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/22/2022] [Revised: 02/14/2022] [Accepted: 02/18/2022] [Indexed: 05/05/2023]
Abstract
Manufacturing companies increasingly become "smarter" as a result of the Industry 4.0 revolution. Multiple sensors are used for industrial monitoring of machines and workers in order to detect events and consequently improve the manufacturing processes, lower the respective costs, and increase safety. Multisensor systems produce big amounts of heterogeneous data. Data fusion techniques address the issue of multimodality by combining data from different sources and improving the results of monitoring systems. The current paper presents a detailed review of state-of-the-art data fusion solutions, on data storage and indexing from various types of sensors, feature engineering, and multimodal data integration. The review aims to serve as a guide for the early stages of an analytic pipeline of manufacturing prognosis. The reviewed literature showed that in fusion and in preprocessing, the methods chosen to be applied in this sector are beyond the state-of-the-art. Existing weaknesses and gaps that lead to future research goals were also identified.
Collapse
|