1
|
Stathatos E, Tzimas E, Benardos P, Vosniakos GC. Convolutional Neural Networks for Raw Signal Classification in CNC Turning Process Monitoring. Sensors (Basel) 2024; 24:1390. [PMID: 38474926 DOI: 10.3390/s24051390] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/05/2024] [Revised: 02/19/2024] [Accepted: 02/19/2024] [Indexed: 03/14/2024]
Abstract
This study addresses the need for advanced machine learning-based process monitoring in smart manufacturing. A methodology is developed for near-real-time part quality prediction based on process-related data obtained from a CNC turning center. Instead of the manual feature extraction methods typically employed in signal processing, a novel one-dimensional convolutional architecture allows the trained model to autonomously extract pertinent features directly from the raw signals. Several signal channels are utilized, including vibrations, motor speeds, and motor torques. Three quality indicators-average roughness, peak-to-valley roughness, and diameter deviation-are monitored using a single model, resulting in a compact and efficient classifier. Training data are obtained via a small number of experiments designed to induce variability in the quality metrics by varying feed, cutting speed, and depth of cut. A sliding window technique augments the dataset and allows the model to seamlessly operate over the entire process. This is further facilitated by the model's ability to distinguish between cutting and non-cutting phases. The base model is evaluated via k-fold cross validation and achieves average F1 scores above 0.97 for all outputs. Consistent performance is exhibited by additional instances trained under various combinations of design parameters, validating the robustness of the proposed methodology.
Collapse
Affiliation(s)
- Emmanuel Stathatos
- Manufacturing Technology Laboratory, School of Mechanical Engineering, National Technical University of Athens, Heroon Polytechniou 9, GR15772 Athens, Greece
| | - Evangelos Tzimas
- Manufacturing Technology Laboratory, School of Mechanical Engineering, National Technical University of Athens, Heroon Polytechniou 9, GR15772 Athens, Greece
| | - Panorios Benardos
- Manufacturing Technology Laboratory, School of Mechanical Engineering, National Technical University of Athens, Heroon Polytechniou 9, GR15772 Athens, Greece
| | - George-Christopher Vosniakos
- Manufacturing Technology Laboratory, School of Mechanical Engineering, National Technical University of Athens, Heroon Polytechniou 9, GR15772 Athens, Greece
| |
Collapse
|
2
|
Shi C, Rothrock L. Investigating the effects of age, task load, task complexity, and input device on monitoring performance for smart manufacturing in the oil refining industry. Ergonomics 2024; 67:102-110. [PMID: 37083694 DOI: 10.1080/00140139.2023.2206071] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/06/2023] [Accepted: 04/18/2023] [Indexed: 05/03/2023]
Abstract
Human beings play an important role in a smart manufacturing economy. In this study, we explored the effects of age, task load, task complexity, and input device on abnormal event detection performance in an oil refinery control room task. Thirty participants were recruited to complete a process plant monitoring task in which they were asked to continuously monitor the gauge states, and immediately detect and solve the abnormal events. Participants' accuracy in detecting abnormal states was recorded and analysed during the task. We found that the complexity factor affected accuracy significantly, and younger adults had significantly higher accuracy than older adults in high task load trials. No significant effect was found for the input device factor. These findings suggest that age, task load, and task complexity should be taken into consideration when designing tools to improve older operators' performance.Practitioner summary: The smart manufacturing economy elicits higher requirements for older operators in oil refinery monitoring tasks. Under high task load, older adults had lower accuracy in detecting abnormal conditions than younger adults. The task complexity affected participants' accuracy in detecting abnormal states.
Collapse
Affiliation(s)
- Chao Shi
- The Department of Systems Science and Industrial Engineering, Binghamton University, Binghamton, NY, USA
| | - Ling Rothrock
- The Harold and Inge Marcus Department of Industrial and Manufacturing Engineering, The Pennsylvania State University, University Park, PA, USA
| |
Collapse
|
3
|
Ura S, Zaman L. Biologicalization of Smart Manufacturing Using DNA-Based Computing. Biomimetics (Basel) 2023; 8:620. [PMID: 38132559 PMCID: PMC10742096 DOI: 10.3390/biomimetics8080620] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2023] [Revised: 12/11/2023] [Accepted: 12/14/2023] [Indexed: 12/23/2023] Open
Abstract
Smart manufacturing needs cognitive computing methods to make the relevant systems more intelligent and autonomous. In this respect, bio-inspired cognitive computing methods (i.e., biologicalization) can play a vital role. This article is written from this perspective. In particular, this article provides a general overview of the bio-inspired computing method called DNA-Based Computing (DBC), including its theory and applications. The main theme of DBC is the central dogma of molecular biology (once information of DNA/RNA has got into a protein, it cannot get out again), i.e., DNA to RNA (sequences of four types of nucleotides) and DNA/RNA to protein (sequence of twenty types of amino acids) are allowed, but not the reverse ones. Thus, DBC transfers few-element information (DNA/RAN-like) to many-element information (protein-like). This characteristic of DBC can help to solve cognitive problems (e.g., pattern recognition). DBC can take many forms; this article elucidates two main forms, denoted as DBC-1 and DBC-2. Using arbitrary numerical examples, we demonstrate that DBC-1 can solve various cognitive problems, e.g., "similarity indexing between seemingly different but inherently identical objects" and "recognizing regions of an image separated by a complex boundary." In addition, using an arbitrary numerical example, we demonstrate that DBC-2 can solve the following cognitive problem: "pattern recognition when the relevant information is insufficient." The remarkable thing is that smart manufacturing-based systems (e.g., digital twins and big data analytics) must solve the abovementioned problems to make the manufacturing enablers (e.g., machine tools and monitoring systems) more self-reliant and autonomous. Consequently, DBC can improve the cognitive problem-solving ability of smart manufacturing-relevant systems and enrich their biologicalization.
Collapse
Affiliation(s)
- Sharifu Ura
- Division of Mechanical and Electrical Engineering, Kitami Institute of Technology, 165 Koen-cho, Kitami 090-0055, Japan
| | - Lubna Zaman
- Advanced Manufacturing Engineering Laboratory, Kitami Institute of Technology, 165 Koen-cho, Kitami 090-0055, Japan;
| |
Collapse
|
4
|
Laky DJ, Casas-Orozco D, Abdi M, Feng X, Wood E, Reklaitis GV, Nagy ZK. Using PharmaPy with Jupyter Notebook to teach digital design in pharmaceutical manufacturing. Comput Appl Eng Educ 2023; 31:1662-1677. [PMID: 38314247 PMCID: PMC10838379 DOI: 10.1002/cae.22660] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/05/2022] [Accepted: 06/03/2023] [Indexed: 02/06/2024]
Abstract
The use of digital tools in pharmaceutical manufacturing has gained traction over the past two decades. Whether supporting regulatory filings or attempting to modernize manufacturing processes to adopt new and quickly evolving Industry 4.0 standards, engineers entering the workforce must exhibit proficiency in modeling, simulation, optimization, data processing, and other digital analysis techniques. In this work, a course that addresses digital tools in pharmaceutical manufacturing for chemical engineers was adjusted to utilize a new tool, PharmaPy, instead of traditional chemical engineering simulation tools. Jupyter Notebook was utilized as an instructional and interactive environment to teach students to use PharmaPy, a new, open-source pharmaceutical manufacturing process simulator. Students were then surveyed to see if PharmaPy was able to meet the learning objectives of the course. During the semester, PharmaPy's model library was used to simulate both individual unit operations as well as multiunit pharmaceutical processes. Through the initial survey results, students indicated that: (i) through Jupyter Notebook, learning Python and PharmaPy was approachable from varied coding experience backgrounds and (ii) PharmaPy strengthened their understanding of pharmaceutical manufacturing through active pharmaceutical ingredient process design and development.
Collapse
Affiliation(s)
- Daniel J. Laky
- Davidson School of Chemical Engineering, Purdue University, West Lafayette, Indiana, USA
- Department of Chemical and Biological Engineering, University of Wisconsin-Madison, Madison, Wisconsin, USA
| | - Daniel Casas-Orozco
- Davidson School of Chemical Engineering, Purdue University, West Lafayette, Indiana, USA
| | - Mesfin Abdi
- Office of Pharmaceutical Quality, Center for Drug Evaluation and Research, Food & Drug Administration, Silver Spring, Maryland, USA
| | - Xin Feng
- Office of Pharmaceutical Quality, Center for Drug Evaluation and Research, Food & Drug Administration, Silver Spring, Maryland, USA
| | - Erin Wood
- Office of Pharmaceutical Quality, Center for Drug Evaluation and Research, Food & Drug Administration, Silver Spring, Maryland, USA
| | - Gintaras V. Reklaitis
- Davidson School of Chemical Engineering, Purdue University, West Lafayette, Indiana, USA
| | - Zoltan K. Nagy
- Davidson School of Chemical Engineering, Purdue University, West Lafayette, Indiana, USA
| |
Collapse
|
5
|
Hammad M, Jillani RM, Ullah S, Namoun A, Tufail A, Kim KH, Shah H. Security Framework for Network-Based Manufacturing Systems with Personalized Customization: An Industry 4.0 Approach. Sensors (Basel) 2023; 23:7555. [PMID: 37688011 PMCID: PMC10490734 DOI: 10.3390/s23177555] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/29/2023] [Revised: 08/20/2023] [Accepted: 08/24/2023] [Indexed: 09/10/2023]
Abstract
Smart manufacturing is pivotal in the context of Industry 4.0, as it integrates advanced technologies like the Internet of Things (IoT) and automation to streamline production processes and improve product quality, paving the way for a competitive industrial landscape. Machines have become network-based through the IoT, where integrated and collaborated manufacturing system responds in real time to meet demand fluctuations for personalized customization. Within the network-based manufacturing system (NBMS), mobile industrial robots (MiRs) are vital in increasing operational efficiency, adaptability, and productivity. However, with the advent of IoT-enabled manufacturing systems, security has become a serious challenge because of the communication of various devices acting as mobile nodes. This paper proposes the framework for a newly personalized customization factory, considering all the advanced technologies and tools used throughout the production process. To encounter the security concern, an IoT-enabled NBMS is selected as the system model to tackle a black hole attack (BHA) using the NTRUEncrypt cryptography and the ad hoc on-demand distance-vector (AODV) routing protocol. NTRUEncrypt performs encryption and decryption while sending and receiving messages. The proposed technique is simulated by network simulator NS-2.35, and its performance is evaluated for different network environments, such as a healthy network, a malicious network, and an NTRUEncrypt-secured network based on different evaluation metrics, including throughput, goodput, end-to-end delay, and packet delivery ratio. The results show that the proposed scheme performs safely in the presence of a malicious node. The implications of this study are beneficial for manufacturing industries looking to embrace IoT-enabled subtractive and additive manufacturing facilitated by mobile industrial robots. Implementation of the proposed scheme ensures operational efficiency, enables personalized customization, and protects confidential data and communication in the manufacturing ecosystem.
Collapse
Affiliation(s)
- Muhammad Hammad
- Faculty of Mechanical Engineering, GIK Institute of Engineering Sciences and Technology, Topi 23640, Pakistan
| | - Rashad Maqbool Jillani
- Faculty of Computer Science and Engineering, GIK Institute of Engineering Sciences and Technology, Topi 23640, Pakistan;
| | - Sami Ullah
- Department of Computer Science, Shaheed Benazir Bhutto University, Sheringal 18050, Pakistan;
| | - Abdallah Namoun
- Faculty of Computer and Information Systems, Islamic University of Madinah, Madinah 42351, Saudi Arabia;
| | - Ali Tufail
- School of Digital Science, Universiti Brunei Darussalam, Tungku Link, Gadong BE1410, Brunei;
| | - Ki-Hyung Kim
- Department of Cyber Security, Ajou University, Suwon 16499, Republic of Korea;
| | - Habib Shah
- Department and College of Computer Science, King Khalid University, Abha 62529, Saudi Arabia;
| |
Collapse
|
6
|
Schöppenthau F, Patzer F, Schnebel B, Watson K, Baryschnikov N, Obst B, Chauhan Y, Kaever D, Usländer T, Kulkarni P. Building a Digital Manufacturing as a Service Ecosystem for Catena-X. Sensors (Basel) 2023; 23:7396. [PMID: 37687851 PMCID: PMC10490677 DOI: 10.3390/s23177396] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/28/2023] [Revised: 08/16/2023] [Accepted: 08/18/2023] [Indexed: 09/10/2023]
Abstract
Manufacturing as a Service (MaaS) enables a paradigm shift in the current manufacturing landscape, from integrated production and inflexible, fragile supply chains to open production and flexible, robust supply chains. As part of this evolution, new scaling effects for production capacities and customer segments are possible. This article describes how to accomplish this paradigm shift for the automotive industry by building a digital MaaS ecosystem for the large-scale automotive innovation project Catena-X, which aims at a standardized global data exchange based on European values. A digital MaaS ecosystem can not only achieve scaling effects, but also realize new business models and overcome current and future challenges in the areas of legislation, sustainability, and standardization. This article analyzes the state-of-the-art of MaaS ecosystems and describes the development of a digital MaaS ecosystem based on an updated and advanced version of the reference architecture for smart connected factories, called the Smart Factory Web. Furthermore, this article describes a demonstrator for a federated MaaS marketplace for Catena-X which leverages the full technological potential of this digital ecosystem. In conclusion, the evaluation of the implemented digital ecosystem enables the advancement of the reference architecture Smart Factory Web, which can now be used as a blueprint for open, sustainable, and resilient digital manufacturing ecosystems.
Collapse
Affiliation(s)
- Felix Schöppenthau
- Fraunhofer IOSB, Fraunhoferstraße 1, 76131 Karlsruhe, Germany; (F.P.); (B.S.); (K.W.); (T.U.)
| | - Florian Patzer
- Fraunhofer IOSB, Fraunhoferstraße 1, 76131 Karlsruhe, Germany; (F.P.); (B.S.); (K.W.); (T.U.)
| | - Boris Schnebel
- Fraunhofer IOSB, Fraunhoferstraße 1, 76131 Karlsruhe, Germany; (F.P.); (B.S.); (K.W.); (T.U.)
| | - Kym Watson
- Fraunhofer IOSB, Fraunhoferstraße 1, 76131 Karlsruhe, Germany; (F.P.); (B.S.); (K.W.); (T.U.)
| | | | - Birgit Obst
- Siemens AG, Technology, Otto-Hahn-Ring 6, 81739 München, Germany; (B.O.); (D.K.)
| | - Yashkumar Chauhan
- up2parts GmbH, Dr.-Müller Straße 26, 92637 Weiden in der Oberpfalz, Germany;
| | - Domenik Kaever
- Siemens AG, Technology, Otto-Hahn-Ring 6, 81739 München, Germany; (B.O.); (D.K.)
| | - Thomas Usländer
- Fraunhofer IOSB, Fraunhoferstraße 1, 76131 Karlsruhe, Germany; (F.P.); (B.S.); (K.W.); (T.U.)
| | - Piyush Kulkarni
- mipart GmbH, Dr.-Müller Straße 26, 92637 Weiden in der Oberpfalz, Germany;
| |
Collapse
|
7
|
Animashaun D, Hussain M. Automated Micro-Crack Detection within Photovoltaic Manufacturing Facility via Ground Modelling for a Regularized Convolutional Network. Sensors (Basel) 2023; 23:6235. [PMID: 37448085 DOI: 10.3390/s23136235] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/18/2023] [Revised: 07/04/2023] [Accepted: 07/05/2023] [Indexed: 07/15/2023]
Abstract
The manufacturing of photovoltaic cells is a complex and intensive process involving the exposure of the cell surface to high temperature differentials and external pressure, which can lead to the development of surface defects, such as micro-cracks. Currently, domain experts manually inspect the cell surface to detect micro-cracks, a process that is subject to human bias, high error rates, fatigue, and labor costs. To overcome the need for domain experts, this research proposes modelling cell surfaces via representative augmentations grounded in production floor conditions. The modelled dataset is then used as input for a custom 'lightweight' convolutional neural network architecture for training a robust, noninvasive classifier, essentially presenting an automated micro-crack detector. In addition to data modelling, the proposed architecture is further regularized using several regularization strategies to enhance performance, achieving an overall F1-score of 85%.
Collapse
Affiliation(s)
- Damilola Animashaun
- Department of Computer Science, Centre for Industrial Analytics, School of Computing and Engineering, University of Huddersfield, Queensgate, Huddersfield HD1 3DH, UK
| | - Muhammad Hussain
- Department of Computer Science, Centre for Industrial Analytics, School of Computing and Engineering, University of Huddersfield, Queensgate, Huddersfield HD1 3DH, UK
| |
Collapse
|
8
|
Othman U, Yang E. Human-Robot Collaborations in Smart Manufacturing Environments: Review and Outlook. Sensors (Basel) 2023; 23:5663. [PMID: 37420834 DOI: 10.3390/s23125663] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/29/2023] [Revised: 06/07/2023] [Accepted: 06/15/2023] [Indexed: 07/09/2023]
Abstract
The successful implementation of Human-Robot Collaboration (HRC) has become a prominent feature of smart manufacturing environments. Key industrial requirements, such as flexibility, efficiency, collaboration, consistency, and sustainability, present pressing HRC needs in the manufacturing sector. This paper provides a systemic review and an in-depth discussion of the key technologies currently being employed in smart manufacturing with HRC systems. The work presented here focuses on the design of HRC systems, with particular attention given to the various levels of Human-Robot Interaction (HRI) observed in the industry. The paper also examines the key technologies being implemented in smart manufacturing, including Artificial Intelligence (AI), Collaborative Robots (Cobots), Augmented Reality (AR), and Digital Twin (DT), and discusses their applications in HRC systems. The benefits and practical instances of deploying these technologies are showcased, emphasizing the substantial prospects for growth and improvement in sectors such as automotive and food. However, the paper also addresses the limitations of HRC utilization and implementation and provides some insights into how the design of these systems should be approached in future work and research. Overall, this paper provides new insights into the current state of HRC in smart manufacturing and serves as a useful resource for those interested in the ongoing development of HRC systems in the industry.
Collapse
Affiliation(s)
- Uqba Othman
- Department of Design, Manufacturing and Engineering Management, University of Strathclyde, Glasgow G1 1XJ, UK
| | - Erfu Yang
- Department of Design, Manufacturing and Engineering Management, University of Strathclyde, Glasgow G1 1XJ, UK
| |
Collapse
|
9
|
Park JH, Kim YS, Seo H, Cho YJ. Analysis of Training Deep Learning Models for PCB Defect Detection. Sensors (Basel) 2023; 23:2766. [PMID: 36904970 PMCID: PMC10006999 DOI: 10.3390/s23052766] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/02/2023] [Revised: 02/20/2023] [Accepted: 02/24/2023] [Indexed: 06/18/2023]
Abstract
Recently, many companies have introduced automated defect detection methods for defect-free PCB manufacturing. In particular, deep learning-based image understanding methods are very widely used. In this study, we present an analysis of training deep learning models to perform PCB defect detection stably. To this end, we first summarize the characteristics of industrial images, such as PCB images. Then, the factors that can cause changes (contamination and quality degradation) to the image data in the industrial field are analyzed. Subsequently, we organize defect detection methods that can be applied according to the situation and purpose of PCB defect detection. In addition, we review the characteristics of each method in detail. Our experimental results demonstrated the impact of various degradation factors, such as defect detection methods, data quality, and image contamination. Based on our overview of PCB defect detection and experiment results, we present knowledge and guidelines for correct PCB defect detection.
Collapse
Affiliation(s)
- Joon-Hyung Park
- Data Science Team, Hyundai Mobis, 203 Teheran-ro, Gangnam-gu, Seoul 06141, Republic of Korea
| | - Yeong-Seok Kim
- Data Science Team, Hyundai Mobis, 203 Teheran-ro, Gangnam-gu, Seoul 06141, Republic of Korea
| | - Hwi Seo
- Data Science Team, Hyundai Mobis, 203 Teheran-ro, Gangnam-gu, Seoul 06141, Republic of Korea
| | - Yeong-Jun Cho
- Department of Artificial Intelligence Convergence, Chonnam National University, 77 Yongbong-ro, Buk-gu, Gwang-ju 61186, Republic of Korea
| |
Collapse
|
10
|
Sundaram S, Zeid A. Artificial Intelligence-Based Smart Quality Inspection for Manufacturing. Micromachines (Basel) 2023; 14:570. [PMID: 36984977 PMCID: PMC10058274 DOI: 10.3390/mi14030570] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/20/2023] [Revised: 02/18/2023] [Accepted: 02/24/2023] [Indexed: 06/18/2023]
Abstract
In today's era, monitoring the health of the manufacturing environment has become essential in order to prevent unforeseen repairs, shutdowns, and to be able to detect defective products that could incur big losses. Data-driven techniques and advancements in sensor technology with Internet of the Things (IoT) have made real-time tracking of systems a reality. The health of a product can also be continuously assessed throughout the manufacturing lifecycle by using Quality Control (QC) measures. Quality inspection is one of the critical processes in which the product is evaluated and deemed acceptable or rejected. The visual inspection or final inspection process involves a human operator sensorily examining the product to ascertain its status. However, there are several factors that impact the visual inspection process resulting in an overall inspection accuracy of around 80% in the industry. With the goal of 100% inspection in advanced manufacturing systems, manual visual inspection is both time-consuming and costly. Computer Vision (CV) based algorithms have helped in automating parts of the visual inspection process, but there are still unaddressed challenges. This paper presents an Artificial Intelligence (AI) based approach to the visual inspection process by using Deep Learning (DL). The approach includes a custom Convolutional Neural Network (CNN) for inspection and a computer application that can be deployed on the shop floor to make the inspection process user-friendly. The inspection accuracy for the proposed model is 99.86% on image data of casting products.
Collapse
|
11
|
Abdallah M, Joung BG, Lee WJ, Mousoulis C, Raghunathan N, Shakouri A, Sutherland JW, Bagchi S. Anomaly Detection and Inter-Sensor Transfer Learning on Smart Manufacturing Datasets. Sensors (Basel) 2023; 23:486. [PMID: 36617091 PMCID: PMC9823713 DOI: 10.3390/s23010486] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/08/2022] [Revised: 12/27/2022] [Accepted: 12/30/2022] [Indexed: 06/17/2023]
Abstract
Smart manufacturing systems are considered the next generation of manufacturing applications. One important goal of the smart manufacturing system is to rapidly detect and anticipate failures to reduce maintenance cost and minimize machine downtime. This often boils down to detecting anomalies within the sensor data acquired from the system which has different characteristics with respect to the operating point of the environment or machines, such as, the RPM of the motor. In this paper, we analyze four datasets from sensors deployed in manufacturing testbeds. We detect the level of defect for each sensor data leveraging deep learning techniques. We also evaluate the performance of several traditional and ML-based forecasting models for predicting the time series of sensor data. We show that careful selection of training data by aggregating multiple predictive RPM values is beneficial. Then, considering the sparse data from one kind of sensor, we perform transfer learning from a high data rate sensor to perform defect type classification. We release our manufacturing database corpus (4 datasets) and codes for anomaly detection and defect type classification for the community to build on it. Taken together, we show that predictive failure classification can be achieved, paving the way for predictive maintenance.
Collapse
Affiliation(s)
- Mustafa Abdallah
- Computer and Information Technology, Indiana University-Purdue University Indianapolis, Indianapolis, IN 46202, USA
| | - Byung-Gun Joung
- Electrical and Computer Engineering, Purdue University, West Lafayette, IN 47907, USA
| | - Wo Jae Lee
- Environmental and Ecological Engineering, Purdue University, West Lafayette, IN 47907, USA
| | - Charilaos Mousoulis
- Electrical and Computer Engineering, Purdue University, West Lafayette, IN 47907, USA
| | - Nithin Raghunathan
- Electrical and Computer Engineering, Purdue University, West Lafayette, IN 47907, USA
| | - Ali Shakouri
- Electrical and Computer Engineering, Purdue University, West Lafayette, IN 47907, USA
| | - John W. Sutherland
- Environmental and Ecological Engineering, Purdue University, West Lafayette, IN 47907, USA
| | - Saurabh Bagchi
- Electrical and Computer Engineering, Purdue University, West Lafayette, IN 47907, USA
| |
Collapse
|
12
|
Guo X, Zhang G, Zhang Y. A Comprehensive Review of Blockchain Technology-Enabled Smart Manufacturing: A Framework, Challenges and Future Research Directions. Sensors (Basel) 2022; 23:155. [PMID: 36616753 PMCID: PMC9824102 DOI: 10.3390/s23010155] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Revised: 12/15/2022] [Accepted: 12/15/2022] [Indexed: 06/17/2023]
Abstract
As a new generation of information technology, blockchain plays an important role in business and industrial innovation. The employment of blockchain technologies in industry has increased transparency, security and traceability, improved efficiency, and reduced costs of production activities. Many studies on blockchain technology-enabled system construction and performance optimization in Industry 4.0 have been carried out. However, blockchain technology and smart manufacturing have been individually researched in academia and industry, according to the literature. This survey aims to summarize the existing research to provide theoretical foundations for applying blockchain technology to smart manufacturing, thus creating a more reliable and authentic smart manufacturing system. In this regard, the literature related to four types of critical issues in smart manufacturing is introduced: data security, data sharing, trust mechanisms and system coordination issues. The corresponding blockchain solutions were reviewed and analyzed. Based on the insights obtained from the above analysis, a reference framework for blockchain technology-enabled smart manufacturing systems is put forward. The challenges and future research directions are also discussed to provide potential guides for achieving better utilization of this technology in smart manufacturing.
Collapse
|
13
|
Noor-A-Rahim M, John J, Firyaguna F, Sherazi HHR, Kushch S, Vijayan A, O’Connell E, Pesch D, O’Flynn B, O’Brien W, Hayes M, Armstrong E. Wireless Communications for Smart Manufacturing and Industrial IoT: Existing Technologies, 5G and Beyond. Sensors (Basel) 2022; 23:s23010073. [PMID: 36616671 PMCID: PMC9824593 DOI: 10.3390/s23010073] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/25/2022] [Revised: 12/09/2022] [Accepted: 12/12/2022] [Indexed: 06/12/2023]
Abstract
Smart manufacturing is a vision and major driver for change in today's industry. The goal of smart manufacturing is to optimize manufacturing processes through constantly monitoring, controlling, and adapting processes towards more efficient and personalised manufacturing. This requires and relies on technologies for connected machines incorporating a variety of computation, sensing, actuation, and machine to machine communications modalities. As such, understanding the change towards smart manufacturing requires knowledge of the enabling technologies, their applications in real world scenarios and the communication protocols and their performance to meet application requirements. Particularly, wireless communication is becoming an integral part of modern smart manufacturing and is expected to play an important role in achieving the goals of smart manufacturing. This paper presents an extensive review of wireless communication protocols currently applied in manufacturing environments and provides a comprehensive review of the associated use cases whilst defining their expected impact on the future of smart manufacturing. Based on the review, we point out a number of open challenges and directions for future research in wireless communication technologies for smart manufacturing.
Collapse
Affiliation(s)
- Md. Noor-A-Rahim
- School of Computer Science and Information Technology, University College Cork, Cork T12 R229, Ireland
| | - Jobish John
- School of Computer Science and Information Technology, University College Cork, Cork T12 R229, Ireland
| | - Fadhil Firyaguna
- School of Computer Science and Information Technology, University College Cork, Cork T12 R229, Ireland
| | | | - Sergii Kushch
- Department of Electronic and Computer Engineering, University of Limerick, Limerick V94 T9PX, Ireland
| | - Aswathi Vijayan
- School of Computer Science and Information Technology, University College Cork, Cork T12 R229, Ireland
| | - Eoin O’Connell
- Department of Electronic and Computer Engineering, University of Limerick, Limerick V94 T9PX, Ireland
| | - Dirk Pesch
- School of Computer Science and Information Technology, University College Cork, Cork T12 R229, Ireland
| | - Brendan O’Flynn
- Tyndall National Institute, University College Cork, Cork T12 R5CP, Ireland
| | - William O’Brien
- Department of Electronic and Computer Engineering, University of Limerick, Limerick V94 T9PX, Ireland
| | - Martin Hayes
- Department of Electronic and Computer Engineering, University of Limerick, Limerick V94 T9PX, Ireland
| | | |
Collapse
|
14
|
Verma P, Breslin JG, O’Shea D. FLDID: Federated Learning Enabled Deep Intrusion Detection in Smart Manufacturing Industries. Sensors (Basel) 2022; 22:8974. [PMID: 36433569 PMCID: PMC9694635 DOI: 10.3390/s22228974] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/14/2022] [Revised: 11/14/2022] [Accepted: 11/17/2022] [Indexed: 06/16/2023]
Abstract
The rapid development in manufacturing industries due to the introduction of IIoT devices has led to the emergence of Industry 4.0 which results in an industry with intelligence, increased efficiency and reduction in the cost of manufacturing. However, the introduction of IIoT devices opens up the door for a variety of cyber threats in smart industries. The detection of cyber threats against such extensive, complex, and heterogeneous smart manufacturing industries is very challenging due to the lack of sufficient attack traces. Therefore, in this work, a Federated Learning enabled Deep Intrusion Detection framework is proposed to detect cyber threats in smart manufacturing industries. The proposed FLDID framework allows multiple smart manufacturing industries to build a collaborative model to detect threats and overcome the limited attack example problem with individual industries. Moreover, to ensure the privacy of model gradients, Paillier-based encryption is used in communication between edge devices (representative of smart industries) and the server. The deep learning-based hybrid model, which consists of a Convolutional Neural Network, Long Short Term Memory, and Multi-Layer Perceptron is used in the intrusion detection model. An exhaustive set of experiments on the publically available dataset proves the effectiveness of the proposed framework for detecting cyber threats in smart industries over the state-of-the-art approaches.
Collapse
Affiliation(s)
- Priyanka Verma
- Data Science Institute, University of Galway, H91TK33 Galway, Ireland
| | - John G. Breslin
- Data Science Institute, University of Galway, H91TK33 Galway, Ireland
| | - Donna O’Shea
- Department of Computer Science, Munster Technological University, T12P928 Cork, Ireland
| |
Collapse
|
15
|
Fraga-Lamas P, Barros D, Lopes SI, Fernández-Caramés TM. Mist and Edge Computing Cyber-Physical Human-Centered Systems for Industry 5.0: A Cost-Effective IoT Thermal Imaging Safety System. Sensors (Basel) 2022; 22:8500. [PMID: 36366192 PMCID: PMC9658932 DOI: 10.3390/s22218500] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/05/2022] [Revised: 10/28/2022] [Accepted: 11/02/2022] [Indexed: 06/16/2023]
Abstract
While many companies worldwide are still striving to adjust to Industry 4.0 principles, the transition to Industry 5.0 is already underway. Under such a paradigm, Cyber-Physical Human-centered Systems (CPHSs) have emerged to leverage operator capabilities in order to meet the goals of complex manufacturing systems towards human-centricity, resilience and sustainability. This article first describes the essential concepts for the development of Industry 5.0 CPHSs and then analyzes the latest CPHSs, identifying their main design requirements and key implementation components. Moreover, the major challenges for the development of such CPHSs are outlined. Next, to illustrate the previously described concepts, a real-world Industry 5.0 CPHS is presented. Such a CPHS enables increased operator safety and operation tracking in manufacturing processes that rely on collaborative robots and heavy machinery. Specifically, the proposed use case consists of a workshop where a smarter use of resources is required, and human proximity detection determines when machinery should be working or not in order to avoid incidents or accidents involving such machinery. The proposed CPHS makes use of a hybrid edge computing architecture with smart mist computing nodes that processes thermal images and reacts to prevent industrial safety issues. The performed experiments show that, in the selected real-world scenario, the developed CPHS algorithms are able to detect human presence with low-power devices (with a Raspberry Pi 3B) in a fast and accurate way (in less than 10 ms with a 97.04% accuracy), thus being an effective solution (e.g., a good trade-off between cost, accuracy, resilience and computational efficiency) that can be integrated into many Industry 5.0 applications. Finally, this article provides specific guidelines that will help future developers and managers to overcome the challenges that will arise when deploying the next generation of CPHSs for smart and sustainable manufacturing.
Collapse
Affiliation(s)
- Paula Fraga-Lamas
- Department of Computer Engineering, Faculty of Computer Science, Universidade da Coruña, 15071 A Coruña, Spain
- Centro de Investigación CITIC, Universidade da Coruña, 15071 A Coruña, Spain
| | - Daniel Barros
- ADiT-Lab, Instituto Politécnico de Viana do Castelo, 4900-348 Viana do Castelo, Portugal
| | - Sérgio Ivan Lopes
- ADiT-Lab, Instituto Politécnico de Viana do Castelo, 4900-348 Viana do Castelo, Portugal
- CiTin—Centro de Interface Tecnológico Industrial, 4970-786 Arcos de Valdevez, Portugal
- IT—Instituto de Telecomunicações, Campus Universitário de Santiago, 3810-193 Aveiro, Portugal
| | - Tiago M. Fernández-Caramés
- Department of Computer Engineering, Faculty of Computer Science, Universidade da Coruña, 15071 A Coruña, Spain
- Centro de Investigación CITIC, Universidade da Coruña, 15071 A Coruña, Spain
| |
Collapse
|
16
|
Shi C, Rothrock L. Using eye movements to evaluate the effectiveness of the situation awareness rating technique scale in measuring situation awareness for smart manufacturing. Ergonomics 2022:1-9. [PMID: 36189950 DOI: 10.1080/00140139.2022.2132299] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/04/2022] [Accepted: 09/26/2022] [Indexed: 06/16/2023]
Abstract
Physiological indicators, including eye-tracking measures, may provide insight into human internal states in many domains, such as smart manufacturing. The Situation Awareness Rating Technique (SART) scale has been criticised for not assessing situation awareness (SA) accurately. In this study, we investigated the precision of the SART scale for assessing SA by comparing the scores to eye movement data. Thirty participants were recruited to complete a process plant monitoring task. Participants' eye movements and SART scores were recorded and analysed. Our results moderately supported the idea that the SART scale did not accurately measure SA. We found that four dimensions in the SART scale need to be revised to reflect real SA, which may partially solve the divergence between objective and subjective SA measurements. Moreover, these findings provided solutions for designing a revised SART scale to measure the internal states of operators for smart manufacturing. Practitioner summary: Situation awareness (SA) is a critical component of decision-making and performance for smart manufacturing. The present study examines the relationships among eye movement, the SART scale, and SA for smart manufacturing in a refinery control room.
Collapse
Affiliation(s)
- Chao Shi
- The Department of Systems Science and Industrial Engineering, Binghamton University, Binghamton, NY, USA
| | - Ling Rothrock
- The Harold and Inge Marcus Department of Industrial and Manufacturing Engineering, The Pennsylvania State University, University Park, PA, USA
| |
Collapse
|
17
|
Farhadi A, Lee SKH, Hinchy EP, O’Dowd NP, McCarthy CT. The Development of a Digital Twin Framework for an Industrial Robotic Drilling Process. Sensors (Basel) 2022; 22:7232. [PMID: 36236330 PMCID: PMC9571147 DOI: 10.3390/s22197232] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/15/2022] [Revised: 09/19/2022] [Accepted: 09/20/2022] [Indexed: 06/16/2023]
Abstract
A digital twin is a digital representation of a physical entity that is updated in real-time by transfer of data between physical and digital (virtual) entities. In this manuscript we aim to introduce a digital twin framework for robotic drilling. Initially, a generic reference model is proposed to highlight elements of the digital twin relevant to robotic drilling. Then, a precise reference digital twin architecture model is developed, based on available standards and technologies. Finally, real-time visualisation of drilling process parameters is demonstrated as an initial step towards implementing a digital twin of a robotic drilling process.
Collapse
Affiliation(s)
- Ahmad Farhadi
- Confirm Centre, University of Limerick, V94 C928 Limerick, Ireland
- Bernal Institute, University of Limerick, V94 T9PX Limerick, Ireland
- School of Engineering, University of Limerick, V94 T9PX Limerick, Ireland
| | - Stephen K. H. Lee
- Confirm Centre, University of Limerick, V94 C928 Limerick, Ireland
- Bernal Institute, University of Limerick, V94 T9PX Limerick, Ireland
- School of Engineering, University of Limerick, V94 T9PX Limerick, Ireland
| | - Eoin P. Hinchy
- Confirm Centre, University of Limerick, V94 C928 Limerick, Ireland
- Bernal Institute, University of Limerick, V94 T9PX Limerick, Ireland
- School of Engineering, University of Limerick, V94 T9PX Limerick, Ireland
| | - Noel P. O’Dowd
- Confirm Centre, University of Limerick, V94 C928 Limerick, Ireland
- Bernal Institute, University of Limerick, V94 T9PX Limerick, Ireland
- School of Engineering, University of Limerick, V94 T9PX Limerick, Ireland
| | - Conor T. McCarthy
- Confirm Centre, University of Limerick, V94 C928 Limerick, Ireland
- Bernal Institute, University of Limerick, V94 T9PX Limerick, Ireland
- School of Engineering, University of Limerick, V94 T9PX Limerick, Ireland
| |
Collapse
|
18
|
Hussain M, Al-Aqrabi H, Munawar M, Hill R, Alsboui T. Domain Feature Mapping with YOLOv7 for Automated Edge-Based Pallet Racking Inspections. Sensors (Basel) 2022; 22:s22186927. [PMID: 36146273 PMCID: PMC9501564 DOI: 10.3390/s22186927] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/25/2022] [Revised: 09/07/2022] [Accepted: 09/12/2022] [Indexed: 06/01/2023]
Abstract
Pallet racking is an essential element within warehouses, distribution centers, and manufacturing facilities. To guarantee its safe operation as well as stock protection and personnel safety, pallet racking requires continuous inspections and timely maintenance in the case of damage being discovered. Conventionally, a rack inspection is a manual quality inspection process completed by certified inspectors. The manual process results in operational down-time as well as inspection and certification costs and undiscovered damage due to human error. Inspired by the trend toward smart industrial operations, we present a computer vision-based autonomous rack inspection framework centered around YOLOv7 architecture. Additionally, we propose a domain variance modeling mechanism for addressing the issue of data scarcity through the generation of representative data samples. Our proposed framework achieved a mean average precision of 91.1%.
Collapse
Affiliation(s)
- Muhammad Hussain
- Department of Computer Science, School of Computing and Engineering, University of Huddersfield, Huddersfield HD1 3DH, UK
| | - Hussain Al-Aqrabi
- Department of Computer Science, School of Computing and Engineering, University of Huddersfield, Huddersfield HD1 3DH, UK
| | - Muhammad Munawar
- Department of Computer Science, COMSATS University of Islamabad, Islamabad 45550, Pakistan
| | - Richard Hill
- Department of Computer Science, School of Computing and Engineering, University of Huddersfield, Huddersfield HD1 3DH, UK
| | - Tariq Alsboui
- Department of Computer Science, School of Computing and Engineering, University of Huddersfield, Huddersfield HD1 3DH, UK
| |
Collapse
|
19
|
Li C, Bian S, Wu T, Donovan RP, Li B. Affordable Artificial Intelligence-Assisted Machine Supervision System for the Small and Medium-Sized Manufacturers. Sensors (Basel) 2022; 22:6246. [PMID: 36016006 PMCID: PMC9414792 DOI: 10.3390/s22166246] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/17/2022] [Revised: 08/15/2022] [Accepted: 08/17/2022] [Indexed: 06/15/2023]
Abstract
With the rapid concurrent advance of artificial intelligence (AI) and Internet of Things (IoT) technology, manufacturing environments are being upgraded or equipped with a smart and connected infrastructure that empowers workers and supervisors to optimize manufacturing workflow and processes for improved energy efficiency, equipment reliability, quality, safety, and productivity. This challenges capital cost and complexity for many small and medium-sized manufacturers (SMMs) who heavily rely on people to supervise manufacturing processes and facilities. This research aims to create an affordable, scalable, accessible, and portable (ASAP) solution to automate the supervision of manufacturing processes. The proposed approach seeks to reduce the cost and complexity of smart manufacturing deployment for SMMs through the deployment of consumer-grade electronics and a novel AI development methodology. The proposed system, AI-assisted Machine Supervision (AIMS), provides SMMs with two major subsystems: direct machine monitoring (DMM) and human-machine interaction monitoring (HIM). The AIMS system was evaluated and validated with a case study in 3D printing through the affordable AI accelerator solution of the vision processing unit (VPU).
Collapse
Affiliation(s)
- Chen Li
- Autonomy Research Center for STEAHM (ARCS), California State University Northridge, Northridge, CA 91324, USA
- Department of Computer Science, Columbia University, New York, NY 10027, USA
| | - Shijie Bian
- Autonomy Research Center for STEAHM (ARCS), California State University Northridge, Northridge, CA 91324, USA
- Language Technologies Institute, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA 15213, USA
| | - Tongzi Wu
- Autonomy Research Center for STEAHM (ARCS), California State University Northridge, Northridge, CA 91324, USA
| | - Richard P. Donovan
- California Institute for Telecommunications and Information Technology (Calit2), University of California Irvine, Irvine, CA 92297, USA
| | - Bingbing Li
- Autonomy Research Center for STEAHM (ARCS), California State University Northridge, Northridge, CA 91324, USA
- Department of Manufacturing Systems Engineering and Management, California State University Northridge, Northridge, CA 91330, USA
| |
Collapse
|
20
|
Leite D, Martins A, Rativa D, De Oliveira JFL, Maciel AMA. An Automated Machine Learning Approach for Real-Time Fault Detection and Diagnosis. Sensors (Basel) 2022; 22:s22166138. [PMID: 36015899 PMCID: PMC9413480 DOI: 10.3390/s22166138] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/25/2022] [Revised: 08/09/2022] [Accepted: 08/12/2022] [Indexed: 05/24/2023]
Abstract
This work presents a novel Automated Machine Learning (AutoML) approach for Real-Time Fault Detection and Diagnosis (RT-FDD). The approach's particular characteristics are: it uses only data that are commonly available in industrial automation systems; it automates all ML processes without human intervention; a non-ML expert can deploy it; and it considers the behavior of cyclic sequential machines, combining discrete timed events and continuous variables as features. The capacity for fault detection is analyzed in two case studies, using data from a 3D machine simulation system with faulty and non-faulty conditions. The enhancement of the RT-FDD performance when the proposed approach is applied is proved with the Feature Importance, Confusion Matrix, and F1 Score analysis, reaching mean values of 85% and 100% in each case study. Finally, considering that faults are rare events, the sensitivity of the models to the number of faulty samples is analyzed.
Collapse
Affiliation(s)
- Denis Leite
- Mekatronik I.C. Automacao Ltda, R. Itapeva, 43a-Imbiribeira, Recife 51180-320, Brazil
- Institute of Technological Innovation, University of Pernambuco, R. Benfica, 455-Madalena, Recife 50670-90, Brazil
| | - Aldonso Martins
- Institute of Technological Innovation, University of Pernambuco, R. Benfica, 455-Madalena, Recife 50670-90, Brazil
- Stellantis, Rodovia BR 101 Norte, Km 13-15a, Goiana 32530-900, Brazil
| | - Diego Rativa
- Institute of Technological Innovation, University of Pernambuco, R. Benfica, 455-Madalena, Recife 50670-90, Brazil
| | - Joao F. L. De Oliveira
- Institute of Technological Innovation, University of Pernambuco, R. Benfica, 455-Madalena, Recife 50670-90, Brazil
| | - Alexandre M. A. Maciel
- Institute of Technological Innovation, University of Pernambuco, R. Benfica, 455-Madalena, Recife 50670-90, Brazil
| |
Collapse
|
21
|
Barbosa CRH, Sousa MC, Almeida MFL, Calili RF. Smart Manufacturing and Digitalization of Metrology: A Systematic Literature Review and a Research Agenda. Sensors (Basel) 2022; 22:6114. [PMID: 36015873 PMCID: PMC9460109 DOI: 10.3390/s22166114] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/25/2022] [Revised: 08/07/2022] [Accepted: 08/11/2022] [Indexed: 06/15/2023]
Abstract
Smart manufacturing comprises fully integrated manufacturing systems that respond in real time to meet the changing demands and conditions in industrial activities, supply networks and customer needs. A smart manufacturing environment will face new challenges, including those concerning metrological issues, i.e., analysis of large quantities of data; communication systems for digitalization; measurement standards for automated process control; digital transformation of metrological services; and simulations and virtual measurement processes for the automatic assessment of measured data. Based on the assumption that the interplay between smart manufacturing and digitalization of metrology is an emerging research field, this paper aims to present a systematic literature review (SLR) based on a bibliographic data collection of 160 scientific articles retrieved from the Web of Science and Scopus databases over the 2016-2022 time frame. The findings presented in this review and recommendations for building a research agenda can help policy makers, researchers and practitioners by providing directions for the evolution of digital metrology and its role in the digitalization of the economy and society.
Collapse
|
22
|
Choi S, Woo J, Kim J, Lee JY. Digital Twin-Based Integrated Monitoring System: Korean Application Cases. Sensors (Basel) 2022; 22:s22145450. [PMID: 35891132 PMCID: PMC9319650 DOI: 10.3390/s22145450] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/27/2022] [Revised: 07/18/2022] [Accepted: 07/19/2022] [Indexed: 05/27/2023]
Abstract
A digital twin is a virtual model of a process, product, or service, which is one of the key technologies in the fourth industry. The pairing of the virtual and physical world allows analysis of data and monitoring of systems to head off problems before they occur. This paper presents a digital twin architecture and a system based on an interoperable data model. It explains how to build a digital twin for the integrated control monitoring using edge devices, data analytics, and realistic 3D visualization. The system allows continuous collaboration between field engineers for data gathering, designers for modeling 3D models, and layout engineers for layout changing by generating 3D digital twin models automatically. The system helps stakeholders focus on their respective roles to build digital twins. Examples applied to the Korean automotive parts makers are also introduced in this paper. The system can be easily used by small and medium-sized enterprises (SMEs) as well as large companies. Beyond simply watching the production site with CCTV, the production site can be intuitively managed based on the digital twin.
Collapse
Affiliation(s)
- Sangsu Choi
- R&D Research Center, IGI Korea, Seoul 08376, Korea; (S.C.); (J.W.)
| | - Jungyub Woo
- R&D Research Center, IGI Korea, Seoul 08376, Korea; (S.C.); (J.W.)
| | - Jun Kim
- IT Converged Process R&D Group, Korea Institute of Industrial Technology, Ansan-si 15588, Korea;
| | - Ju Yeon Lee
- Department of Mechanical System Design Engineering, Seoul National University of Science and Technology, Seoul 01811, Korea
| |
Collapse
|
23
|
Chen TA, Chen SC, Tang W, Chen BT. Internet of Things: Development Intelligent Programmable IoT Controller for Emerging Industry Applications. Sensors (Basel) 2022; 22:s22145138. [PMID: 35890819 PMCID: PMC9317047 DOI: 10.3390/s22145138] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/09/2022] [Revised: 06/29/2022] [Accepted: 07/05/2022] [Indexed: 01/16/2023]
Abstract
The Internet of Things (IoT) has become critical to the implementation of Industry 4.0. The successful operation of smart manufacturing depends on the ability to connect everything together. In this research, we applied the TOC (Theory of Constraints) to develop a wireless Wi-Fi intelligent programmable IoT controller that can be connected to and easily control PLCs. By applying the TOC-focused thinking steps to break through their original limitations, the development process guides the user to use the powerful and simple flow language process control syntax to efficiently connect to PLCs and realize the full range of IoT applications. Finally, this research uses oil–water mixer equipment as the target of continuous improvement and verification. The verification results meet the requirements of the default function. The IoT controller developed in this research uses a marine boiler to illustrate the application. The successful development of flow control language by TOC in this research will enable academic research on PLC-derivative applications. The results of this research will help more SMEs to move into smart manufacturing and the new realm of Industry 4.0.
Collapse
Affiliation(s)
- Ti-An Chen
- Department of Business Administration, JinWen University of Science & Technology, New Taipei City 231307, Taiwan;
| | - Shu-Chuan Chen
- Department of Business Administration, JinWen University of Science & Technology, New Taipei City 231307, Taiwan;
- Department of Industrial Engineering and Management, National Taipei University of Technology, Taipei 10608, Taiwan
- Tsing Hua Youzhu Technology Services Co., Ltd., Taipei 10455, Taiwan
- Correspondence:
| | - William Tang
- College of Management, National Taipei University of Technology, Taipei 10608, Taiwan;
| | - Bo-Tsang Chen
- Suncre Smart Auto Technology Co., Ltd., Tainan 70815, Taiwan;
| |
Collapse
|
24
|
Tsanousa A, Bektsis E, Kyriakopoulos C, González AG, Leturiondo U, Gialampoukidis I, Karakostas A, Vrochidis S, Kompatsiaris I. A Review of Multisensor Data Fusion Solutions in Smart Manufacturing: Systems and Trends. Sensors (Basel) 2022; 22:s22051734. [PMID: 35270880 PMCID: PMC8914726 DOI: 10.3390/s22051734] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/22/2022] [Revised: 02/14/2022] [Accepted: 02/18/2022] [Indexed: 05/05/2023]
Abstract
Manufacturing companies increasingly become "smarter" as a result of the Industry 4.0 revolution. Multiple sensors are used for industrial monitoring of machines and workers in order to detect events and consequently improve the manufacturing processes, lower the respective costs, and increase safety. Multisensor systems produce big amounts of heterogeneous data. Data fusion techniques address the issue of multimodality by combining data from different sources and improving the results of monitoring systems. The current paper presents a detailed review of state-of-the-art data fusion solutions, on data storage and indexing from various types of sensors, feature engineering, and multimodal data integration. The review aims to serve as a guide for the early stages of an analytic pipeline of manufacturing prognosis. The reviewed literature showed that in fusion and in preprocessing, the methods chosen to be applied in this sector are beyond the state-of-the-art. Existing weaknesses and gaps that lead to future research goals were also identified.
Collapse
Affiliation(s)
- Athina Tsanousa
- Information Technologies Institute, Centre for Research and Technology Hellas, 6th km Charilaou-Thermi Road, 57001 Thessaloniki, Greece; (E.B.); (C.K.); (I.G.); (A.K.); (S.V.); (I.K.)
- Correspondence:
| | - Evangelos Bektsis
- Information Technologies Institute, Centre for Research and Technology Hellas, 6th km Charilaou-Thermi Road, 57001 Thessaloniki, Greece; (E.B.); (C.K.); (I.G.); (A.K.); (S.V.); (I.K.)
| | - Constantine Kyriakopoulos
- Information Technologies Institute, Centre for Research and Technology Hellas, 6th km Charilaou-Thermi Road, 57001 Thessaloniki, Greece; (E.B.); (C.K.); (I.G.); (A.K.); (S.V.); (I.K.)
| | - Ana Gómez González
- Ikerlan Technology Research Centre, Basque Research and Technology Alliance (BRTA), P. J. M. Arizmendiarrieta 2, 20500 Arrasate-Mondragón, Spain; (A.G.G.); (U.L.)
| | - Urko Leturiondo
- Ikerlan Technology Research Centre, Basque Research and Technology Alliance (BRTA), P. J. M. Arizmendiarrieta 2, 20500 Arrasate-Mondragón, Spain; (A.G.G.); (U.L.)
| | - Ilias Gialampoukidis
- Information Technologies Institute, Centre for Research and Technology Hellas, 6th km Charilaou-Thermi Road, 57001 Thessaloniki, Greece; (E.B.); (C.K.); (I.G.); (A.K.); (S.V.); (I.K.)
| | - Anastasios Karakostas
- Information Technologies Institute, Centre for Research and Technology Hellas, 6th km Charilaou-Thermi Road, 57001 Thessaloniki, Greece; (E.B.); (C.K.); (I.G.); (A.K.); (S.V.); (I.K.)
| | - Stefanos Vrochidis
- Information Technologies Institute, Centre for Research and Technology Hellas, 6th km Charilaou-Thermi Road, 57001 Thessaloniki, Greece; (E.B.); (C.K.); (I.G.); (A.K.); (S.V.); (I.K.)
| | - Ioannis Kompatsiaris
- Information Technologies Institute, Centre for Research and Technology Hellas, 6th km Charilaou-Thermi Road, 57001 Thessaloniki, Greece; (E.B.); (C.K.); (I.G.); (A.K.); (S.V.); (I.K.)
| |
Collapse
|
25
|
Kiangala KS, Wang Z. An Experimental Safety Response Mechanism for an Autonomous Moving Robot in a Smart Manufacturing Environment Using Q-Learning Algorithm and Speech Recognition. Sensors (Basel) 2022; 22:941. [PMID: 35161688 DOI: 10.3390/s22030941] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/21/2021] [Revised: 12/15/2021] [Accepted: 12/22/2021] [Indexed: 11/17/2022]
Abstract
The industrial manufacturing sector is undergoing a tremendous revolution moving from traditional production processes to intelligent techniques. Under this revolution, known as Industry 4.0 (I40), a robot is no longer static equipment but an active workforce to the factory production alongside human operators. Safety becomes crucial for humans and robots to ensure a smooth production run in such environments. The loss of operating moving robots in plant evacuation can be avoided with the adequate safety induction for them. Operators are subject to frequent safety inductions to react in emergencies, but very little is done for robots. Our research proposes an experimental safety response mechanism for a small manufacturing plant, through which an autonomous robot learns the obstacle-free trajectory to the closest safety exit in emergencies. We implement a reinforcement learning (RL) algorithm, Q-learning, to enable the path learning abilities of the robot. After obtaining the robot optimal path selection options with Q-learning, we code the outcome as a rule-based system for the safety response. We also program a speech recognition system for operators to react timeously, with a voice command, to an emergency that requires stopping all plant activities even when they are far away from the emergency stops (ESTOPs) button. An ESTOP or a voice command sent directly to the factory central controller can give the factory an emergency signal. We tested this functionality on real hardware from an S7-1200 Siemens programmable logic controller (PLC). We simulate a simple and small manufacturing environment overview to test our safety procedure. Our results show that the safety response mechanism successfully generates paths without obstacles to the closest safety exits from all the factory locations. Our research benefits any manufacturing SME intending to implement the initial and primary use of autonomous moving robots (AMR) in their factories. It also impacts manufacturing SMEs using legacy devices such as traditional PLCs by offering them intelligent strategies to incorporate current state-of-the-art technologies such as speech recognition to improve their performances. Our research empowers SMEs to adopt advanced and innovative technological concepts within their operations.
Collapse
|
26
|
Gellert A, Sorostinean R, Pirvu BC. Robust Assembly Assistance Using Informed Tree Search with Markov Chains. Sensors (Basel) 2022; 22:495. [PMID: 35062456 DOI: 10.3390/s22020495] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/09/2021] [Revised: 01/03/2022] [Accepted: 01/06/2022] [Indexed: 02/04/2023]
Abstract
Manual work accounts for one of the largest workgroups in the European manufacturing sector, and improving the training capacity, quality, and speed brings significant competitive benefits to companies. In this context, this paper presents an informed tree search on top of a Markov chain that suggests possible next assembly steps as a key component of an innovative assembly training station for manual operations. The goal of the next step suggestions is to provide support to inexperienced workers or to assist experienced workers by providing choices for the next assembly step in an automated manner without the involvement of a human trainer on site. Data stemming from 179 experiment participants, 111 factory workers, and 68 students, were used to evaluate different prediction methods. From our analysis, Markov chains fail in new scenarios and, therefore, by using an informed tree search to predict the possible next assembly step in such situations, the prediction capability of the hybrid algorithm increases significantly while providing robust solutions to unseen scenarios. The proposed method proved to be the most efficient for next assembly step prediction among all the evaluated predictors and, thus, the most suitable method for an adaptive assembly support system such as for manual operations in industry.
Collapse
|
27
|
Patera L, Garbugli A, Bujari A, Scotece D, Corradi A. A Layered Middleware for OT/IT Convergence to Empower Industry 5.0 Applications. Sensors (Basel) 2021; 22:s22010190. [PMID: 35009732 PMCID: PMC8749629 DOI: 10.3390/s22010190] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/15/2021] [Revised: 12/22/2021] [Accepted: 12/27/2021] [Indexed: 11/16/2022]
Abstract
We are still in the midst of Industry 4.0 (I4.0), with more manufacturing lines being labeled as smart thanks to the integration of advanced ICT in Cyber-Physical Systems (CPS). While I4.0 aims to provision cognitive CPS systems, the nascent Industry 5.0 (I5.0) era goes a step beyond, aiming to build cross-border, sustainable, and circular value chains benefiting society as a whole. An enabler of this vision is the integration of data and AI in the industrial decision-making process, which does not exhibit yet a coordination between the Operation and Information Technology domains (OT/IT). This work proposes an architectural approach and an accompanying software prototype addressing the OT/IT convergence problem. The approach is based on a two-layered middleware solution, where each layer aims to better serve the specific differentiated requirements of the OT and IT layers. The proposal is validated in a real testbed, employing actual machine data, showing the capacity of the components to gracefully scale and serve increasing data volumes.
Collapse
|
28
|
Lin SY, Li HY. Integrated Circuit Board Object Detection and Image Augmentation Fusion Model Based on YOLO. Front Neurorobot 2021; 15:762702. [PMID: 34858159 PMCID: PMC8632558 DOI: 10.3389/fnbot.2021.762702] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2021] [Accepted: 10/22/2021] [Indexed: 11/16/2022] Open
Abstract
Industry 4.0 has been a hot topic in recent years. The process of integrating Cyber-Physical Systems (CPS), Artificial Intelligence (AI), and Internet of Things (IoT) technology, will become the trend in future construction of smart factories. In the past, smart factories were developed around the concept of the Flexible Manufacturing System (FMS). Most parts of the quality management process still needed to be implemented by Automated Optical Inspection (AOI) methods which required human resources and time to perform second stage testing. Screening standards also resulted in the elimination of about 30% of the products. In this study, we sort and analyze several Region-based Convolutional Neural Network (R-CNN) and YOLO models that are currently more advanced and widely used, analyze the methods and development problems of the various models, and propose a suitable real-time image recognition model and architecture suitable for Integrated Circuit Board (ICB) in manufacturing process. The goal of the first stage of this study is to collect and use different types of ICBs as model training data sets, and establish a preliminary image recognition model that can classify and predict different types of ICBs based on different feature points. The second stage explores image augmentation fusion and optimization methods. The data augmentation method used in this study can reach an average accuracy of 96.53%. In the final stage, there is discussion of the applicability of the model to detect and recognize the ICB directionality in <1 s with a 98% accuracy rate to meet the real-time requirements of smart manufacturing. Accurate and instant object image recognition in the smart manufacturing process can save manpower required for testing, improve equipment effectiveness, and increase both the production capacity and the yield rate of the production line. The proposed model improves the overall manufacturing process.
Collapse
Affiliation(s)
- Szu-Yin Lin
- Department of Computer Science and Information Engineering, National Ilan University, Yilan City, Taiwan
| | - Hao-Yu Li
- Department of Information Management, Chung Yuan Christian University, Taoyuan City, Taiwan
| |
Collapse
|
29
|
Ura S, Ghosh AK. Time Latency-Centric Signal Processing: A Perspective of Smart Manufacturing. Sensors (Basel) 2021; 21:s21217336. [PMID: 34770644 PMCID: PMC8587126 DOI: 10.3390/s21217336] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/17/2021] [Revised: 10/27/2021] [Accepted: 10/29/2021] [Indexed: 11/20/2022]
Abstract
Smart manufacturing employs embedded systems such as CNC machine tools, programable logic controllers, automated guided vehicles, robots, digital measuring instruments, cyber-physical systems, and digital twins. These systems collectively perform high-level cognitive tasks (monitoring, understanding, deciding, and adapting) by making sense of sensor signals. When sensor signals are exchanged through the abovementioned embedded systems, a phenomenon called time latency or delay occurs. As a result, the signal at its origin (e.g., machine tools) and signal received at the receiver end (e.g., digital twin) differ. The time and frequency domain-based conventional signal processing cannot adequately address the delay-centric issues. Instead, these issues can be addressed by the delay domain, as suggested in the literature. Based on this consideration, this study first processes arbitrary signals in time, frequency, and delay domains and elucidates the significance of delay domain over time and frequency domains. Afterward, real-life signals collected while machining different materials are analyzed using frequency and delay domains to reconfirm its (the delay domain’s) significance in real-life settings. In both cases, it is found that the delay domain is more informative and reliable than the time and frequency domains when the delay is unavoidable. Moreover, the delay domain can act as a signature of a machining situation, distinguishing it (the situation) from others. Therefore, computational arrangements enabling delay domain-based signal processing must be enacted to effectively functionalize the smart manufacturing-centric embedded systems.
Collapse
Affiliation(s)
- Sharifu Ura
- Division of Mechanical and Electrical Engineering, Kitami Institute of Technology, 165 Koen-cho, Kitami 090-8507, Japan
- Correspondence:
| | - Angkush Kumar Ghosh
- Graduate School of Engineering, Kitami Institute of Technology, 165 Koen-cho, Kitami 090-8507, Japan;
| |
Collapse
|
30
|
Zhang D, Wang G, Xin Y, Shi X, Evans R, Guo B, Huang P. Knowledge-Driven Manufacturing Process Innovation: A Case Study on Problem Solving in Micro-Turbine Machining. Micromachines (Basel) 2021; 12:1357. [PMID: 34832769 DOI: 10.3390/mi12111357] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/15/2021] [Revised: 11/01/2021] [Accepted: 11/01/2021] [Indexed: 11/17/2022]
Abstract
Micromachining techniques have been applied widely to many industrial sectors, including aerospace, automotive, and precision instruments. However, due to their high-precision machining requirements, and the knowledge-intensive characteristics of miniaturized parts, complex manufacturing process problems often hinder production. To solve these problems, a systematic scheme for structured micromachining process problem solving and an innovation support system is required. This paper presents a knowledge-based holistic framework that enables process planners to achieve micromachining innovation design. By analyzing innovation design procedures and available knowledge sources, an open multi-source Machining Process Innovation Knowledge (MPIK) acquisition paradigm is presented, including knowledge units and a knowledge network. Further, a MPIK network-driven structured process problem-solving and heuristic innovation design method was explored. Subsequently, a knowledge-driven heuristic design system for machining process innovation was integrated in the Computer-Aided Process Innovation (CAPI) platform. Finally, a case study involving specific process problem-solving and innovation scheme design for micro-turbine machining was studied to validate the proposed approach.
Collapse
|
31
|
Babamiri M, Heidarimoghadam R, Ghasemi F, Tapak L, Mortezapour A. Ergonomics 4.0: A bibliometric review of Human Factors research in Industrial Revolution 4.0 (IR 4.0). Work 2021; 70:321-334. [PMID: 34511475 DOI: 10.3233/wor-213576] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
BACKGROUND The scientometric study is a visualization method used to collect big data from databases, to explore the relationships between citing and co-cited documents and then visualize the results. Unlike the new term Ergonomics 4.0, bibliometric analysis has been studied in various related fields of Ergonomics. OBJECTIVE The aim of this study was to create a bibliometric analysis in related field of Ergonomics and Fourth Industrial Revolution. This analysis can shed light on the new developed research field in both sides of the present study, occupational ergonomics and industry 4.0. METHODS After selecting related keywords, Advance search was done in Scopus and Web of Science. Bibliometric results were presented by these databases' analyzer and by exported data to VOS viewer software. No time or language restriction was applied. RESULTS Retrieved Articles were 104 and 285 for Web of Science and Scopus respectively. The frequent co-occurrences for keywords were seen between "industry 4.0" and "Human Factors". The USA and Germany were also the most productive countries in this field. Well-known Ergonomics journals had low participation in the Evolution of Ergonomics and Fourth Industrial Revolution topics. CONCLUSION Due to more participation of industry 4.0-related researchers in this topic, it is recommended that ergonomists from around the world, and especially Eastern countries, attempt to conduct research in this field. Furthermore, devoting some forth-coming special issues in this field is recommended to top ergonomics journals.
Collapse
Affiliation(s)
- Mohammad Babamiri
- Department of Ergonomics, Research Center for Health Sciences, School of Public Health, Hamadan University of Medical Sciences, Hamadan, Iran
| | - Rashid Heidarimoghadam
- Department of Ergonomics, Research Center for Health Sciences, School of Public Health, Hamadan University of Medical Sciences, Hamadan, Iran
| | - Fakhradin Ghasemi
- Department of Occupational Health and Safety Engineering, Abadan University of Medical Sciences, Abadan, Iran.,Department of Ergonomics, Occupational Health and Safety Research Center, School of Public Health, Hamadan University of Medical Sciences, Hamadan, Iran
| | - Leili Tapak
- Department of Biostatistics and Epidemiology, School of Public of Health, Hamadan University of Medical Sciences, Hamadan, Iran
| | - Alireza Mortezapour
- Department of Ergonomics, School of Public Health, Hamadan University of Medical Sciences, Hamadan, Iran
| |
Collapse
|
32
|
Kim TH, Kim HR, Cho YJ. Product Inspection Methodology via Deep Learning: An Overview. Sensors (Basel) 2021; 21:5039. [PMID: 34372276 PMCID: PMC8346960 DOI: 10.3390/s21155039] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/28/2021] [Revised: 07/21/2021] [Accepted: 07/21/2021] [Indexed: 11/16/2022]
Abstract
In this study, we present a framework for product quality inspection based on deep learning techniques. First, we categorize several deep learning models that can be applied to product inspection systems. In addition, we explain the steps for building a deep-learning-based inspection system in detail. Second, we address connection schemes that efficiently link deep learning models to product inspection systems. Finally, we propose an effective method that can maintain and enhance a product inspection system according to improvement goals of the existing product inspection systems. The proposed system is observed to possess good system maintenance and stability owing to the proposed methods. All the proposed methods are integrated into a unified framework and we provide detailed explanations of each proposed method. In order to verify the effectiveness of the proposed system, we compare and analyze the performance of the methods in various test scenarios. We expect that our study will provide useful guidelines to readers who desire to implement deep-learning-based systems for product inspection.
Collapse
Affiliation(s)
- Tae-Hyun Kim
- Data Science Team, Hyundai Mobis, Seoul 06141, Korea; (T.-H.K.); (H.-R.K.)
| | - Hye-Rin Kim
- Data Science Team, Hyundai Mobis, Seoul 06141, Korea; (T.-H.K.); (H.-R.K.)
| | - Yeong-Jun Cho
- Department of Artificial Intelligence Convergence, Chonnam National University, Gwangju 61186, Korea
| |
Collapse
|
33
|
Tripathi S, Muhr D, Brunner M, Jodlbauer H, Dehmer M, Emmert-Streib F. Ensuring the Robustness and Reliability of Data-Driven Knowledge Discovery Models in Production and Manufacturing. Front Artif Intell 2021; 4:576892. [PMID: 34195608 PMCID: PMC8236533 DOI: 10.3389/frai.2021.576892] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2020] [Accepted: 02/12/2021] [Indexed: 11/20/2022] Open
Abstract
The Cross-Industry Standard Process for Data Mining (CRISP-DM) is a widely accepted framework in production and manufacturing. This data-driven knowledge discovery framework provides an orderly partition of the often complex data mining processes to ensure a practical implementation of data analytics and machine learning models. However, the practical application of robust industry-specific data-driven knowledge discovery models faces multiple data- and model development-related issues. These issues need to be carefully addressed by allowing a flexible, customized and industry-specific knowledge discovery framework. For this reason, extensions of CRISP-DM are needed. In this paper, we provide a detailed review of CRISP-DM and summarize extensions of this model into a novel framework we call Generalized Cross-Industry Standard Process for Data Science (GCRISP-DS). This framework is designed to allow dynamic interactions between different phases to adequately address data- and model-related issues for achieving robustness. Furthermore, it emphasizes also the need for a detailed business understanding and the interdependencies with the developed models and data quality for fulfilling higher business objectives. Overall, such a customizable GCRISP-DS framework provides an enhancement for model improvements and reusability by minimizing robustness-issues.
Collapse
Affiliation(s)
- Shailesh Tripathi
- Production and Operations Management, University of Applied Sciences Upper Austria, Linz, Austria
| | - David Muhr
- Production and Operations Management, University of Applied Sciences Upper Austria, Linz, Austria
| | - Manuel Brunner
- Production and Operations Management, University of Applied Sciences Upper Austria, Linz, Austria
| | - Herbert Jodlbauer
- Production and Operations Management, University of Applied Sciences Upper Austria, Linz, Austria
| | - Matthias Dehmer
- Department of Computer Science, Swiss Distance University of Applied Sciences, Brig, Switzerland
- School of Science, Xian Technological University, Xian, China
- Department of Biomedical Computer Science and Mechatronics, UMIT-The Health and Life Science University, Hall in Tyrol, Austria
- College of Artificial Intelligence, Nankai University, Tianjin, China
| | - Frank Emmert-Streib
- Predictive Society and Data Analytics Lab, Faculty of Information Technology and Communication Sciences, Tampere University, Tampere, Finland
- Institute of Biosciences and Medical Technology, Tampere University, Tampere, Finland
| |
Collapse
|
34
|
Bousdekis A, Mentzas G. Enterprise Integration and Interoperability for Big Data-Driven Processes in the Frame of Industry 4.0. Front Big Data 2021; 4:644651. [PMID: 34151258 PMCID: PMC8210777 DOI: 10.3389/fdata.2021.644651] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2020] [Accepted: 04/13/2021] [Indexed: 11/26/2022] Open
Abstract
Traditional manufacturing businesses lack the standards, skills, processes, and technologies to meet today's challenges of Industry 4.0 driven by an interconnected world. Enterprise Integration and Interoperability can ensure efficient communication among various services driven by big data. However, the data management challenges affect not only the technical implementation of software solutions but the function of the whole organization. In this paper, we bring together Enterprise Integration and Interoperability, Big Data Processing, and Industry 4.0 in order to identify synergies that have the potential to enable the so-called “Fourth Industrial Revolution.” On this basis, we propose an architectural framework for designing and modeling Industry 4.0 solutions for big data-driven manufacturing operations. We demonstrate the applicability of the proposed framework through its instantiation to predictive maintenance, a manufacturing function that increasingly concerns manufacturers due to the high costs, safety issues, and complexity of its application.
Collapse
Affiliation(s)
- Alexandros Bousdekis
- Information Management Unit (IMU), School of Electrical and Computer Engineering, National Technical University of Athens (NTUA), Athens, Greece
| | - Gregoris Mentzas
- Information Management Unit (IMU), School of Electrical and Computer Engineering, National Technical University of Athens (NTUA), Athens, Greece
| |
Collapse
|
35
|
Martínez-Gutiérrez A, Díez-González J, Ferrero-Guillén R, Verde P, Álvarez R, Perez H. Digital Twin for Automatic Transportation in Industry 4.0. Sensors (Basel) 2021; 21:3344. [PMID: 34065011 DOI: 10.3390/s21103344] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/16/2021] [Revised: 05/05/2021] [Accepted: 05/10/2021] [Indexed: 11/16/2022]
Abstract
Industry 4.0 is the fourth industrial revolution consisting of the digitalization of processes facilitating an incremental value chain. Smart Manufacturing (SM) is one of the branches of the Industry 4.0 regarding logistics, visual inspection of pieces, optimal organization of processes, machine sensorization, real-time data adquisition and treatment and virtualization of industrial activities. Among these tecniques, Digital Twin (DT) is attracting the research interest of the scientific community in the last few years due to the cost reduction through the simulation of the dynamic behaviour of the industrial plant predicting potential problems in the SM paradigm. In this paper, we propose a new DT design concept based on external service for the transportation of the Automatic Guided Vehicles (AGVs) which are being recently introduced for the Material Requirement Planning satisfaction in the collaborative industrial plant. We have performed real experimentation in two different scenarios through the definition of an Industrial Ethernet platform for the real validation of the DT results obtained. Results show the correlation between the virtual and real experiments carried out in the two scenarios defined in this paper with an accuracy of 97.95% and 98.82% in the total time of the missions analysed in the DT. Therefore, these results validate the model created for the AGV navigation, thus fulfilling the objectives of this paper.
Collapse
|
36
|
Xin Y, Li Y, Li W, Wang G. Towards Efficient Milling of Multi-Cavity Aeronautical Structural Parts Considering ACO-Based Optimal Tool Feed Position and Path. Micromachines (Basel) 2021; 12:88. [PMID: 33466997 DOI: 10.3390/mi12010088] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/24/2020] [Revised: 01/08/2021] [Accepted: 01/13/2021] [Indexed: 11/27/2022]
Abstract
Cavities are typical features in aeronautical structural parts and molds. For high-speed milling of multi-cavity parts, a reasonable processing sequence planning can significantly affect the machining accuracy and efficiency. This paper proposes an improved continuous peripheral milling method for multi-cavity based on ant colony optimization algorithm (ACO). Firstly, by analyzing the mathematical model of cavity corner milling process, the geometric center of the corner is selected as the initial tool feed position. Subsequently, the tool path is globally optimized through ant colony dissemination and pheromone perception for path solution of multi-cavity milling. With the advantages of ant colony parallel search and pheromone positive feedback, the searching efficiency of the global shortest processing path is effectively improved. Finally, the milling programming of an aeronautical structural part is taken as a sample to verify the effectiveness of the proposed methodology. Compared with zigzag milling and genetic algorithm (GA)-based peripheral milling modes in the computer aided manufacturing (CAM) software, the results show that the ACO-based methodology can shorten the milling time of a sample part by more than 13%.
Collapse
|
37
|
Wang L, Du P, Jin R. MOSS-Multi-Modal Best Subset Modeling in Smart Manufacturing. Sensors (Basel) 2021; 21:E243. [PMID: 33401493 DOI: 10.3390/s21010243] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/09/2020] [Revised: 12/28/2020] [Accepted: 12/28/2020] [Indexed: 11/23/2022]
Abstract
Smart manufacturing, which integrates a multi-sensing system with physical manufacturing processes, has been widely adopted in the industry to support online and real-time decision making to improve manufacturing quality. A multi-sensing system for each specific manufacturing process can efficiently collect the in situ process variables from different sensor modalities to reflect the process variations in real-time. However, in practice, we usually do not have enough budget to equip too many sensors in each manufacturing process due to the cost consideration. Moreover, it is also important to better interpret the relationship between the sensing modalities and the quality variables based on the model. Therefore, it is necessary to model the quality-process relationship by selecting the most relevant sensor modalities with the specific quality measurement from the multi-modal sensing system in smart manufacturing. In this research, we adopted the concept of best subset variable selection and proposed a new model called Multi-mOdal beSt Subset modeling (MOSS). The proposed MOSS can effectively select the important sensor modalities and improve the modeling accuracy in quality-process modeling via functional norms that characterize the overall effects of individual modalities. The significance of sensor modalities can be used to determine the sensor placement strategy in smart manufacturing. Moreover, the selected modalities can better interpret the quality-process model by identifying the most correlated root cause of quality variations. The merits of the proposed model are illustrated by both simulations and a real case study in an additive manufacturing (i.e., fused deposition modeling) process.
Collapse
|
38
|
Yalcinkaya E, Maffei A, Onori M. Blockchain Reference System Architecture Description for the ISA95 Compliant Traditional and Smart Manufacturing Systems. Sensors (Basel) 2020; 20:s20226456. [PMID: 33198154 PMCID: PMC7696017 DOI: 10.3390/s20226456] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/04/2020] [Revised: 11/05/2020] [Accepted: 11/06/2020] [Indexed: 12/14/2022]
Abstract
The next-generation technologies enabled by the industry 4.0 revolution put immense pressure on traditional ISA95 compliant manufacturing systems to evolve into smart manufacturing systems. Unfortunately, the transformation of old to new manufacturing technologies is a slow process. Therefore, the manufacturing industry is currently in a situation that the legacy and modern manufacturing systems share the same factory environment. This heterogeneous ecosystem leads to challenges in systems scalability, interoperability, information security, and data quality domains. Our former research effort concluded that blockchain technology has promising features to address these challenges. Moreover, our systematic assessment revealed that most of the ISA95 enterprise functions are suitable for applying blockchain technology. However, no blockchain reference architecture explicitly focuses on the ISA95 compliant traditional and smart manufacturing systems available in the literature. This research aims to fill the gap by first methodically specifying the design requirements and then meticulously elaborating on how the reference architecture components fulfill the design requirements.
Collapse
|
39
|
Runji JM, Lin CY. Switchable Glass Enabled Contextualization for a Cyber-Physical Safe and Interactive Spatial Augmented Reality PCBA Manufacturing Inspection System. Sensors (Basel) 2020; 20:s20154286. [PMID: 32752016 PMCID: PMC7435772 DOI: 10.3390/s20154286] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/22/2020] [Revised: 07/23/2020] [Accepted: 07/28/2020] [Indexed: 11/24/2022]
Abstract
Augmented reality (AR) has been demonstrated to improve efficiency by up to thrice the level of traditional methods. Specifically, the adoption of visual AR is performed widely using handheld and head-mount technologies. Despite spatial augmented reality (SAR) addressing several shortcomings of wearable AR, its potential is yet to be fully explored. To date, it enhances the cooperation of users with its wide field of view and supports hands-free mobile operation, yet it has remained a challenge to provide references without relying on restrictive static empty surfaces of the same object or nearby objects for projection. Towards this end, we propose a novel approach that contextualizes projected references in real-time and on demand, onto and through the surface across a wireless network. To demonstrate the effectiveness of the approach, we apply the method to the safe inspection of printed circuit board assembly (PCBA) wirelessly networked to a remote automatic optical inspection (AOI) system. A defect detected and localized by the AOI system is wirelessly remitted to the proposed remote inspection system for prompt guidance to the inspector by augmenting a rectangular bracket and a reference image. The rectangular bracket transmitted through the switchable glass aids defect localization over the PCBA, whereas the image is projected over the opaque cells of the switchable glass to provide reference to a user. The developed system is evaluated in a user study for its robustness, precision and performance. Results indicate that the resulting contextualization from variability in occlusion levels not only positively affect inspection performance but also supersedes the state of the art in user preference. Furthermore, it supports a variety of complex visualization needs including varied sizes, contrast, online or offline tracking, with a simple robust integration requiring no additional calibration for registration.
Collapse
Affiliation(s)
- Joel Murithi Runji
- Department of Mechanical Engineering, National Taiwan University of Science and Technology, Taipei 106, Taiwan;
| | - Chyi-Yeu Lin
- Department of Mechanical Engineering, National Taiwan University of Science and Technology, Taipei 106, Taiwan;
- Center for Cyber-Physical System Innovation, National Taiwan University of Science and Technology, Taipei 106, Taiwan
- Taiwan Building Technology Center, National Taiwan University of Science and Technology, Taipei 106, Taiwan
- Correspondence:
| |
Collapse
|
40
|
Abstract
We review the impact of control systems and strategies on the energy efficiency of chemical processes. We show that, in many ways, good control performance is a necessary but not sufficient condition for energy efficiency. The direct effect of process control on energy efficiency is manyfold: Reducing output variability allows for operating chemical plants closer to their limits, where the energy/economic optima typically lie. Further, good control enables novel, transient operating strategies, such as conversion smoothing and demand response. Indirectly, control systems are key to the implementation and operation of more energy-efficient plant designs, as dictated by the process integration and intensification paradigms. These conclusions are supported with references to numerous examples from the literature.
Collapse
Affiliation(s)
- Jodie M Simkoff
- McKetta Department of Chemical Engineering, The University of Texas at Austin, Austin, Texas 78712, USA; , , , ,
| | - Fernando Lejarza
- McKetta Department of Chemical Engineering, The University of Texas at Austin, Austin, Texas 78712, USA; , , , ,
| | - Morgan T Kelley
- McKetta Department of Chemical Engineering, The University of Texas at Austin, Austin, Texas 78712, USA; , , , ,
| | - Calvin Tsay
- McKetta Department of Chemical Engineering, The University of Texas at Austin, Austin, Texas 78712, USA; , , , ,
| | - Michael Baldea
- McKetta Department of Chemical Engineering, The University of Texas at Austin, Austin, Texas 78712, USA; , , , ,
| |
Collapse
|
41
|
Perez-Alfaro I, Gil-Hernandez D, Muñoz-Navascues O, Casbas-Gimenez J, Sanchez-Catalan JC, Murillo N. Low-Cost Piezoelectric Sensors for Time Domain Load Monitoring of Metallic Structures During Operational and Maintenance Processes. Sensors (Basel) 2020; 20:s20051471. [PMID: 32156027 PMCID: PMC7085522 DOI: 10.3390/s20051471] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/09/2020] [Revised: 03/04/2020] [Accepted: 03/05/2020] [Indexed: 11/25/2022]
Abstract
The versatility of piezoelectric sensors in measurement techniques and their performance in applications has given rise to an increased interest in their use for structural and manufacturing component monitoring. They enable wireless and sensor network solutions to be developed in order to directly integrate the sensors into machines, fixtures and tools. Piezoelectric sensors increasingly compete with strain-gauges due to their wide operational temperature range, load and strain sensing accuracy, low power consumption and low cost. This research sets out the use of piezoelectric sensors for real-time monitoring of mechanical strength in metallic structures in the ongoing operational control of machinery components. The behaviour of aluminium and steel structures under flexural strength was studied using piezoelectric sensors. Variations in structural behaviour and geometry were measured, and the load and μstrains during operational conditions were quantified in the time domain at a specific frequency. The lead zirconium titanate (PZT) sensors were able to distinguish between material types and thicknesses. Moreover, this work covers frequency selection and optimisation from 20 Hz to 300 kHz. Significant differences in terms of optimal operating frequencies and sensitivity were found in both structures. The influence of the PZT voltage applied was assessed to reduce power consumption without signal loss, and calibration to μstrains and loads was performed.
Collapse
Affiliation(s)
- Irene Perez-Alfaro
- Universidad de Zaragoza, Pedro Cerbuna 12, E-50009 Zaragoza, Spain
- Correspondence: (I.P.-A.); (N.M.)
| | - Daniel Gil-Hernandez
- Industry and Transport Division, TECNALIA, Pº Mikeletegi 7, E-20009 Donostia-San Sebastian, Spain
| | - Oscar Muñoz-Navascues
- Industry and Transport Division, TECNALIA, Pº Mikeletegi 7, E-20009 Donostia-San Sebastian, Spain
| | - Jesus Casbas-Gimenez
- Industry and Transport Division, TECNALIA, Pº Mikeletegi 7, E-20009 Donostia-San Sebastian, Spain
| | | | - Nieves Murillo
- Industry and Transport Division, TECNALIA, Pº Mikeletegi 7, E-20009 Donostia-San Sebastian, Spain
- Correspondence: (I.P.-A.); (N.M.)
| |
Collapse
|
42
|
Raman AS, Haapala KR, Raoufi K, Linke BS, Bernstein WZ, Morris KC. Defining Near-Term to Long-Term Research Opportunities to Advance Metrics, Models, and Methods for Smart and Sustainable Manufacturing. Smart Sustain Manuf Syst 2020; 4:https://doi.org/10.1520/ssms20190047. [PMID: 33043276 PMCID: PMC7542542] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Over the past century, research has focused on continuously improving the performance of manufacturing processes and systems-often measured in terms of cost, quality, productivity, and material and energy efficiency. With the advent of smart manufacturing technologies-better production equipment, sensing technologies, computational methods, and data analytics applied from the process to enterprise levels-the potential for sustainability performance improvement is tremendous. Sustainable manufacturing seeks the best balance of a variety of performance measures to satisfy and optimize the goals of all stakeholders. Accurate measures of performance are the foundation on which sustainability objectives can be pursued. Historically, operational and information technologies have undergone disparate development, with little convergence across the domains. To focus future research efforts in advanced manufacturing, the authors organized a one-day workshop, sponsored by the U.S. National Science Foundation, at the joint manufacturing research conferences of the American Society of Mechanical Engineers and Society of Manufacturing Engineers. Research needs were identified to help harmonize disparate manufacturing metrics, models, and methods from across conventional manufacturing, nanomanufacturing, and additive/hybrid manufacturing processes and systems. Experts from academia and government labs presented invited lightning talks to discuss their perspectives on current advanced manufacturing research challenges. Workshop participants also provided their perspectives in facilitated brainstorming breakouts and a reflection activity. The aim was to define advanced manufacturing research and educational needs for improving manufacturing process performance through improved sustainability metrics, modeling approaches, and decision support methods. In addition to these workshop outcomes, a review of the recent literature is presented, which identifies research opportunities across several advanced manufacturing domains. Recommendations for future research describe the short-, mid-, and long-term needs of the advanced manufacturing community for enabling smart and sustainable manufacturing.
Collapse
Affiliation(s)
- Arvind Shankar Raman
- School of Mechanical, Industrial, and Manufacturing Engineering, Oregon State University, 200 SW Monroe Ave., Corvallis, OR 97331, USA
| | - Karl R Haapala
- School of Mechanical, Industrial, and Manufacturing Engineering, Oregon State University, 200 SW Monroe Ave., Corvallis, OR 97331, USA
| | - Kamyar Raoufi
- School of Mechanical, Industrial, and Manufacturing Engineering, Oregon State University, 200 SW Monroe Ave., Corvallis, OR 97331, USA
| | - Barbara S Linke
- Department of Mechanical and Aerospace Engineering, University of California Davis, One Shields Ave., Davis, CA 95616, USA
| | - William Z Bernstein
- Systems Integration Division, Engineering Laboratory, National Institute of Standards and Technology, 100 Bureau Dr., Gaithersburg, MD 20899, USA
| | - K C Morris
- Systems Integration Division, Engineering Laboratory, National Institute of Standards and Technology, 100 Bureau Dr., Gaithersburg, MD 20899, USA
| |
Collapse
|
43
|
García-Garza MA, Ahuett-Garza H, Lopez MG, Orta-Castañón P, Kurfess TR, Urbina Coronado PD, Güemes-Castorena D, Villa SG, Salinas S. A Case about the Upgrade of Manufacturing Equipment for Insertion into an Industry 4.0 Environment. Sensors (Basel) 2019; 19:s19153304. [PMID: 31357583 PMCID: PMC6696624 DOI: 10.3390/s19153304] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/29/2019] [Revised: 07/07/2019] [Accepted: 07/19/2019] [Indexed: 11/16/2022]
Abstract
Industry 4.0 is a synonym for the confluence of technologies that allows the integration of information technology, data science, and automated equipment, to produce smart industrial systems. The process of inserting new technologies into current conventional environments involves a wide range of disciplines and approaches. This article presents the process that was followed to identify and upgrade one station in an industrial workshop to make it compatible with the more extensive system as it evolves into the Industry 4.0 environment. An information processing kit was developed to upgrade the equipment from an automated machine to an Industry 4.0 station. The kit includes a structure to support the sensor and the data processing unit; this unit consisted of a minicomputer that records the data, graded the performance of the components, and sent the data to the cloud for storage, reporting, and further analysis. The information processing kit allowed the monitoring of the inspection system and improved the quality and speed of the inspection process.
Collapse
Affiliation(s)
- Marcelo A García-Garza
- Tecnologico de Monterrey, Escuela de Ingeniería y Ciencias, Ave. Eugenio Garza Sada 2501, Monterrey 64849, Mexico
| | - Horacio Ahuett-Garza
- Tecnologico de Monterrey, Escuela de Ingeniería y Ciencias, Ave. Eugenio Garza Sada 2501, Monterrey 64849, Mexico.
| | - Maria G Lopez
- Tecnologico de Monterrey, Escuela de Ingeniería y Ciencias, Ave. Eugenio Garza Sada 2501, Monterrey 64849, Mexico
| | - Pedro Orta-Castañón
- Tecnologico de Monterrey, Escuela de Ingeniería y Ciencias, Ave. Eugenio Garza Sada 2501, Monterrey 64849, Mexico
| | - Thomas R Kurfess
- Tecnologico de Monterrey, Escuela de Ingeniería y Ciencias, Ave. Eugenio Garza Sada 2501, Monterrey 64849, Mexico
- George W. Woodruff School of Mechanical Engineering, Georgia Institute of Technology, 771 Ferst Drive, NW, Love Bldg. Room 101, Atlanta, GA 30332-0405, USA
| | - Pedro D Urbina Coronado
- Tecnologico de Monterrey, Escuela de Ingeniería y Ciencias, Ave. Eugenio Garza Sada 2501, Monterrey 64849, Mexico
| | - David Güemes-Castorena
- Tecnologico de Monterrey, Escuela de Ingeniería y Ciencias, Ave. Eugenio Garza Sada 2501, Monterrey 64849, Mexico
| | - Salvador G Villa
- Sisamex, S.A. de C.V. Carretera Monterrey-Colombia Km. 6, Gral. Escobedo 66050, Mexico
| | - Sergio Salinas
- Tecnologico de Monterrey, Escuela de Ingeniería y Ciencias, Ave. Eugenio Garza Sada 2501, Monterrey 64849, Mexico
| |
Collapse
|
44
|
Wang J, Li D. Task Scheduling Based on a Hybrid Heuristic Algorithm for Smart Production Line with Fog Computing. Sensors (Basel) 2019; 19:E1023. [PMID: 30823391 DOI: 10.3390/s19051023] [Citation(s) in RCA: 47] [Impact Index Per Article: 9.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/15/2019] [Revised: 02/10/2019] [Accepted: 02/21/2019] [Indexed: 11/23/2022]
Abstract
Fog computing provides computation, storage and network services for smart manufacturing. However, in a smart factory, the task requests, terminal devices and fog nodes have very strong heterogeneity, such as the different task characteristics of terminal equipment: fault detection tasks have high real-time demands; production scheduling tasks require a large amount of calculation; inventory management tasks require a vast amount of storage space, and so on. In addition, the fog nodes have different processing abilities, such that strong fog nodes with considerable computing resources can help terminal equipment to complete the complex task processing, such as manufacturing inspection, fault detection, state analysis of devices, and so on. In this setting, a new problem has appeared, that is, determining how to perform task scheduling among the different fog nodes to minimize the delay and energy consumption as well as improve the smart manufacturing performance metrics, such as production efficiency, product quality and equipment utilization rate. Therefore, this paper studies the task scheduling strategy in the fog computing scenario. A task scheduling strategy based on a hybrid heuristic (HH) algorithm is proposed that mainly solves the problem of terminal devices with limited computing resources and high energy consumption and makes the scheme feasible for real-time and efficient processing tasks of terminal devices. Finally, the experimental results show that the proposed strategy achieves superior performance compared to other strategies.
Collapse
|
45
|
Kulvatunyou B(S, Oh H, Ivezic N, Nieman ST. Standards-based Semantic Integration of Manufacturing Information: Past, Present, and Future. J Manuf Syst 2019; 52:10.1016/j.jmsy.2019.07.003. [PMID: 32116404 PMCID: PMC7047720 DOI: 10.1016/j.jmsy.2019.07.003] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Service-oriented architecture (SOA) has been identified as a key to enabling the emerging manufacturing paradigms such as smart manufacturing, Industrie 4.0, and cloud manufacturing where things (i.e., various kinds of devices and software systems) from heterogeneous sources have to be dynamically connected. Data exchange standards are playing an increasingly important role to reduce risks associated with investments in these Industrial Internet of Things (IIoT) and adoptions of those emerging manufacturing paradigms. This paper looks back into the history of the standards for carrying the semantics of data across systems (or things), how they are developed, maintained, and represented, and then presents an insight into the current trends. In particular, the paper discusses the emerging move in data exchange standards practices toward model-based development and usage. We present functional requirements for a system supporting the model-based approach and conclude with implications and future directions.
Collapse
Affiliation(s)
| | - Hakju Oh
- Systems Integration Division, National Institute of Standards and Technology Gaithersburg, MD 20899, USA
| | - Nenad Ivezic
- Systems Integration Division, National Institute of Standards and Technology Gaithersburg, MD 20899, USA
| | | |
Collapse
|
46
|
Ismail A, Idris MYI, Ayub MN, Por LY. Vision-Based Apple Classification for Smart Manufacturing. Sensors (Basel) 2018; 18:E4353. [PMID: 30544660 DOI: 10.3390/s18124353] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/30/2018] [Revised: 11/28/2018] [Accepted: 12/03/2018] [Indexed: 11/16/2022]
Abstract
Smart manufacturing enables an efficient manufacturing process by optimizing production and product transaction. The optimization is performed through data analytics that requires reliable and informative data as input. Therefore, in this paper, an accurate data capture approach based on a vision sensor is proposed. Three image recognition methods are studied to determine the best vision-based classification technique, namely Bag of Words (BOW), Spatial Pyramid Matching (SPM) and Convolutional Neural Network (CNN). The vision-based classifiers categorize the apple as defective and non-defective that can be used for automatic inspection, sorting and further analytics. A total of 550 apple images are collected to test the classifiers. The images consist of 275 non-defective and 275 defective apples. The defective category includes various types of defect and severity. The vision-based classifiers are trained and evaluated according to the K-fold cross-validation. The performances of the classifiers from 2-fold, 3-fold, 4-fold, 5-fold and 10-fold are compared. From the evaluation, SPM with SVM classifier attained 98.15% classification accuracy for 10-fold and outperformed the others. In terms of computational time, CNN with SVM classifier is the fastest. However, minimal time difference is observed between the computational time of CNN and SPM, which were separated by only 0.05 s.
Collapse
|
47
|
Abstract
Recent advances enable data from manufacturing systems to be captured and contextualised relative to other phases of the product lifecycle, a necessary step toward understanding system behaviour and satisfying traceability requirements. Significant challenges remain for integrating information across the lifecycle and enabling efficient decision-making. In this paper, we explore opportunities for mapping standard data representations, such as the Standard for the Exchange of Product Data (STEP), MTConnect, and the Quality Information Framework (QIF) to integrate information silos existing across the lifecycle. To demonstrate this vision, we describe a reference implementation with a contract manufacturer in the National Institute of Standards and Technology (NIST) Smart Manufacturing Systems Test Bed. Using this implementation, we explore how knowledge generated from manufacturing can support lifecycle decision-making. As a case study, we then present an interactive prototype correlating the test bed's data based on the context that must be provided for a specific decision-making viewpoint.
Collapse
Affiliation(s)
- William Z Bernstein
- Engineering Laboratory, National Institute of Standards and Technology, Gaithersburg, MD, USA
| | - Thomas D Hedberg
- Engineering Laboratory, National Institute of Standards and Technology, Gaithersburg, MD, USA
| | - Moneer Helu
- Engineering Laboratory, National Institute of Standards and Technology, Gaithersburg, MD, USA
| | - Allison Barnard Feeney
- Engineering Laboratory, National Institute of Standards and Technology, Gaithersburg, MD, USA
| |
Collapse
|
48
|
Tien KW, Kulvatunyou B, Jung K, Prabhu V. An Investigation to Manufacturing Analytical Services Composition using the Analytical Target Cascading Method. IFIP Adv Inf Commun Technol 2017; IFIP International Conference on Advances in Production Management Systems:469-477. [PMID: 28770014 PMCID: PMC5535276 DOI: 10.1007/978-3-319-51133-7_56] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
As cloud computing is increasingly adopted, the trend is to offer software functions as modular services and compose them into larger, more meaningful ones. The trend is attractive to analytical problems in the manufacturing system design and performance improvement domain because 1) finding a global optimization for the system is a complex problem; and 2) sub-problems are typically compartmentalized by the organizational structure. However, solving sub-problems by independent services can result in a sub-optimal solution at the system level. This paper investigates the technique called Analytical Target Cascading (ATC) to coordinate the optimization of loosely-coupled sub-problems, each may be modularly formulated by differing departments and be solved by modular analytical services. The result demonstrates that ATC is a promising method in that it offers system-level optimal solutions that can scale up by exploiting distributed and modular executions while allowing easier management of the problem formulation.
Collapse
Affiliation(s)
| | | | - Kiwook Jung
- National Institute of Standards and Technology, Gaithersburg, MD, U.S.A
| | | |
Collapse
|
49
|
Abstract
Historic manufacturing enterprises based on vertically optimized companies, practices, market share, and competitiveness are giving way to enterprises that are responsive across an entire value chain to demand dynamic markets and customized product value adds; increased expectations for environmental sustainability, reduced energy usage, and zero incidents; and faster technology and product adoption. Agile innovation and manufacturing combined with radically increased productivity become engines for competitiveness and reinvestment, not simply for decreased cost. A focus on agility, productivity, energy, and environmental sustainability produces opportunities that are far beyond reducing market volatility. Agility directly impacts innovation, time-to-market, and faster, broader exploration of the trade space. These changes, the forces driving them, and new network-based information technologies offering unprecedented insights and analysis are motivating the advent of smart manufacturing and new information technology infrastructure for manufacturing.
Collapse
Affiliation(s)
- Jim Davis
- Institute for Digital Research and Education, Office of Information Technology, University of California, Los Angeles, California 90095;
| | | | | | | | | | | | | | | |
Collapse
|
50
|
Kibira D, Morris KC, Kumaraguru S. Methods and Tools for Performance Assurance of Smart Manufacturing Systems. J Res Natl Inst Stand Technol 2016; 121:282-313. [PMID: 34434624 PMCID: PMC7339637 DOI: 10.6028/jres.121.013] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 05/23/2016] [Indexed: 06/13/2023]
Abstract
The emerging concept of smart manufacturing systems is defined in part by the introduction of new technologies that are promoting rapid and widespread information flow within the manufacturing system and surrounding its control. These systems can deliver unprecedented awareness, agility, productivity, and resilience within the production process by exploiting the ever-increasing availability of real-time manufacturing data. Optimized collection and analysis of this voluminous data to guide decision-making is, however, a complex and dynamic process. To establish and maintain confidence that smart manufacturing systems function as intended, performance assurance measures will be vital. The activities for performance assurance span manufacturing system design, operation, performance assessment, evaluation, analysis, decision making, and control. Changes may be needed for traditional approaches in these activities to address smart manufacturing systems. This paper reviews the current methods and tools used for establishing and maintaining required system performance. It then identifies trends in data and information systems, integration, performance measurement, analysis, and performance improvement that will be vital for assured performance of smart manufacturing systems. Finally, we analyze how those trends apply to the methods studied and propose future research for assessing and improving manufacturing performance in the uncertain, multi-objective operating environment.
Collapse
Affiliation(s)
| | - K C Morris
- National Institute of Standards and Technology, Gaithersburg, MD 20899
| | - Senthilkumaran Kumaraguru
- Indian Institute of Information Technology, Design and Manufacture, Chennai, Tamil Nadu 60012, India
| |
Collapse
|