1
|
Scott S, Chen WY, Heifetz A. Multi-Task Learning of Scanning Electron Microscopy and Synthetic Thermal Tomography Images for Detection of Defects in Additively Manufactured Metals. SENSORS (BASEL, SWITZERLAND) 2023; 23:8462. [PMID: 37896555 PMCID: PMC10611061 DOI: 10.3390/s23208462] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/09/2023] [Revised: 10/09/2023] [Accepted: 10/12/2023] [Indexed: 10/29/2023]
Abstract
One of the key challenges in laser powder bed fusion (LPBF) additive manufacturing of metals is the appearance of microscopic pores in 3D-printed metallic structures. Quality control in LPBF can be accomplished with non-destructive imaging of the actual 3D-printed structures. Thermal tomography (TT) is a promising non-contact, non-destructive imaging method, which allows for the visualization of subsurface defects in arbitrary-sized metallic structures. However, because imaging is based on heat diffusion, TT images suffer from blurring, which increases with depth. We have been investigating the enhancement of TT imaging capability using machine learning. In this work, we introduce a novel multi-task learning (MTL) approach, which simultaneously performs the classification of synthetic TT images, and segmentation of experimental scanning electron microscopy (SEM) images. Synthetic TT images are obtained from computer simulations of metallic structures with subsurface elliptical-shaped defects, while experimental SEM images are obtained from imaging of LPBF-printed stainless-steel coupons. MTL network is implemented as a shared U-net encoder between the classification and the segmentation tasks. Results of this study show that the MTL network performs better in both the classification of synthetic TT images and the segmentation of SEM images tasks, as compared to the conventional approach when the individual tasks are performed independently of each other.
Collapse
Affiliation(s)
- Sarah Scott
- Nuclear Science and Engineering Division, Argonne National Laboratory, Lemont, IL 60439, USA; (S.S.); (W.-Y.C.)
- Department of Civil and Environmental Engineering, Duke University, Durham, NC 27708, USA
| | - Wei-Ying Chen
- Nuclear Science and Engineering Division, Argonne National Laboratory, Lemont, IL 60439, USA; (S.S.); (W.-Y.C.)
| | - Alexander Heifetz
- Nuclear Science and Engineering Division, Argonne National Laboratory, Lemont, IL 60439, USA; (S.S.); (W.-Y.C.)
| |
Collapse
|
2
|
Kim RG, Abisado M, Villaverde J, Sampedro GA. A Survey of Image-Based Fault Monitoring in Additive Manufacturing: Recent Developments and Future Directions. SENSORS (BASEL, SWITZERLAND) 2023; 23:6821. [PMID: 37571604 PMCID: PMC10422627 DOI: 10.3390/s23156821] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Revised: 07/10/2023] [Accepted: 07/24/2023] [Indexed: 08/13/2023]
Abstract
Additive manufacturing (AM) has emerged as a transformative technology for various industries, enabling the production of complex and customized parts. However, ensuring the quality and reliability of AM parts remains a critical challenge. Thus, image-based fault monitoring has gained significant attention as an efficient approach for detecting and classifying faults in AM processes. This paper presents a comprehensive survey of image-based fault monitoring in AM, focusing on recent developments and future directions. Specifically, the proponents garnered relevant papers from 2019 to 2023, gathering a total of 53 papers. This paper discusses the essential techniques, methodologies, and algorithms employed in image-based fault monitoring. Furthermore, recent developments are explored such as the use of novel image acquisition techniques, algorithms, and methods. In this paper, insights into future directions are provided, such as the need for more robust image processing algorithms, efficient data acquisition and analysis methods, standardized benchmarks and datasets, and more research in fault monitoring. By addressing these challenges and pursuing future directions, image-based fault monitoring in AM can be enhanced, improving quality control, process optimization, and overall manufacturing reliability.
Collapse
Affiliation(s)
- Ryanne Gail Kim
- Research and Development Center, Philippine Coding Camp, 2401 Taft Ave, Malate, Manila 1004, Philippines;
| | - Mideth Abisado
- College of Computing and Information Technologies, National University, Manila 1008, Philippines;
| | - Jocelyn Villaverde
- School of Electrical, Electronics and Computer Engineering, Mapúa University, Manila 1002, Philippines;
| | - Gabriel Avelino Sampedro
- Research and Development Center, Philippine Coding Camp, 2401 Taft Ave, Malate, Manila 1004, Philippines;
- Faculty of Information and Communication Studies, University of the Philippines Open University, Laguna 4031, Philippines
- College of Computer Studies, De La Salle University, 2401 Taft Ave, Malate, Manila 1004, Philippines
| |
Collapse
|
3
|
An Evaluation of 3D-Printed Materials' Structural Properties Using Active Infrared Thermography and Deep Neural Networks Trained on the Numerical Data. MATERIALS 2022; 15:ma15103727. [PMID: 35629753 PMCID: PMC9146560 DOI: 10.3390/ma15103727] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/27/2022] [Revised: 05/13/2022] [Accepted: 05/18/2022] [Indexed: 01/25/2023]
Abstract
This article describes an approach to evaluating the structural properties of samples manufactured through 3D printing via active infrared thermography. The mentioned technique was used to test the PETG sample, using halogen lamps as an excitation source. First, a simplified, general numerical model of the phenomenon was prepared; then, the obtained data were used in a process of the deep neural network training. Finally, the network trained in this manner was used for the material evaluation on the basis of the original experimental data. The described methodology allows for the automated assessment of the structural state of 3D-printed materials. The usage of a generalized model is an innovative method that allows for greater product assessment flexibility.
Collapse
|
4
|
Kumar S, Kolekar T, Patil S, Bongale A, Kotecha K, Zaguia A, Prakash C. A Low-Cost Multi-Sensor Data Acquisition System for Fault Detection in Fused Deposition Modelling. SENSORS 2022; 22:s22020517. [PMID: 35062478 PMCID: PMC8779455 DOI: 10.3390/s22020517] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/12/2021] [Revised: 01/04/2022] [Accepted: 01/07/2022] [Indexed: 11/16/2022]
Abstract
Fused deposition modelling (FDM)-based 3D printing is a trending technology in the era of Industry 4.0 that manufactures products in layer-by-layer form. It shows remarkable benefits such as rapid prototyping, cost-effectiveness, flexibility, and a sustainable manufacturing approach. Along with such advantages, a few defects occur in FDM products during the printing stage. Diagnosing defects occurring during 3D printing is a challenging task. Proper data acquisition and monitoring systems need to be developed for effective fault diagnosis. In this paper, the authors proposed a low-cost multi-sensor data acquisition system (DAQ) for detecting various faults in 3D printed products. The data acquisition system was developed using an Arduino micro-controller that collects real-time multi-sensor signals using vibration, current, and sound sensors. The different types of fault conditions are referred to introduce various defects in 3D products to analyze the effect of the fault conditions on the captured sensor data. Time and frequency domain analyses were performed on captured data to create feature vectors by selecting the chi-square method, and the most significant features were selected to train the CNN model. The K-means cluster algorithm was used for data clustering purposes, and the bell curve or normal distribution curve was used to define individual sensor threshold values under normal conditions. The CNN model was used to classify the normal and fault condition data, which gave an accuracy of around 94%, by evaluating the model performance based on recall, precision, and F1 score.
Collapse
Affiliation(s)
- Satish Kumar
- Symbiosis Institute of Technology, Symbiosis International (Deemed University), Pune 412115, India; (T.K.); (S.P.); (A.B.)
- Symbiosis Centre for Applied Artificial Intelligence, Symbiosis International (Deemed University), Pune 412115, India
- Correspondence: (S.K.); or (K.K.)
| | - Tushar Kolekar
- Symbiosis Institute of Technology, Symbiosis International (Deemed University), Pune 412115, India; (T.K.); (S.P.); (A.B.)
| | - Shruti Patil
- Symbiosis Institute of Technology, Symbiosis International (Deemed University), Pune 412115, India; (T.K.); (S.P.); (A.B.)
- Symbiosis Centre for Applied Artificial Intelligence, Symbiosis International (Deemed University), Pune 412115, India
| | - Arunkumar Bongale
- Symbiosis Institute of Technology, Symbiosis International (Deemed University), Pune 412115, India; (T.K.); (S.P.); (A.B.)
| | - Ketan Kotecha
- Symbiosis Institute of Technology, Symbiosis International (Deemed University), Pune 412115, India; (T.K.); (S.P.); (A.B.)
- Symbiosis Centre for Applied Artificial Intelligence, Symbiosis International (Deemed University), Pune 412115, India
- Correspondence: (S.K.); or (K.K.)
| | - Atef Zaguia
- Department of Computer Science, College of Computers and Information Technology, Taif University, P.O. Box 11099, Taif 21944, Saudi Arabia;
| | - Chander Prakash
- School of Mechanical Engineering, Lovely Professional University, Jalandhar 144411, India;
| |
Collapse
|
5
|
Maciusowicz M, Psuj G, Kochmański P. Identification of Grain Oriented SiFe Steels Based on Imaging the Instantaneous Dynamics of Magnetic Barkhausen Noise Using Short-Time Fourier Transform and Deep Convolutional Neural Network. MATERIALS 2021; 15:ma15010118. [PMID: 35009269 PMCID: PMC8746057 DOI: 10.3390/ma15010118] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/08/2021] [Revised: 12/20/2021] [Accepted: 12/22/2021] [Indexed: 11/16/2022]
Abstract
This paper presents a new approach to the extraction and analysis of information contained in magnetic Barkhausen noise (MBN) for evaluation of grain oriented (GO) electrical steels. The proposed methodology for MBN analysis is based on the combination of the Short-Time Fourier Transform for the observation of the instantaneous dynamics of the phenomenon and deep convolutional neural networks (DCNN) for the extraction of hidden information and building the knowledge. The use of DCNN makes it possible to find even complex and convoluted rules of the Barkhausen phenomenon course, difficult to determine based solely on the selected features of MBN signals. During the tests, several samples made of conventional and high permeability GO steels were tested at different angles between the rolling and transverse directions. The influences of the angular resolution and the proposed additional prediction update algorithm on the DCNN accuracy were investigated, obtaining the highest gain for the angle of 3.6°, for which the overall accuracy exceeded 80%. The obtained results indicate that the proposed new solution combining time-frequency analysis and DCNN for the quantification of information from MBN having stochastic nature may be a very effective tool in the characterization of the magnetic materials.
Collapse
Affiliation(s)
- Michal Maciusowicz
- Center for Electromagnetic Fields Engineering and High-Frequency Techniques, Faculty of Electrical Engineering, West Pomeranian University of Technology, ul. Sikorskiego 37, 70-313 Szczecin, Poland;
- Correspondence:
| | - Grzegorz Psuj
- Center for Electromagnetic Fields Engineering and High-Frequency Techniques, Faculty of Electrical Engineering, West Pomeranian University of Technology, ul. Sikorskiego 37, 70-313 Szczecin, Poland;
| | - Paweł Kochmański
- Department of Materials Technologies, Faculty of Mechanical Engineering and Mechatronics, West Pomeranian University of Technology Szczecin, Al. Piastów 19, 70-310 Szczecin, Poland;
| |
Collapse
|
6
|
Traditional Artificial Neural Networks Versus Deep Learning in Optimization of Material Aspects of 3D Printing. MATERIALS 2021; 14:ma14247625. [PMID: 34947222 PMCID: PMC8707385 DOI: 10.3390/ma14247625] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/02/2021] [Revised: 11/28/2021] [Accepted: 12/09/2021] [Indexed: 12/04/2022]
Abstract
3D printing of assistive devices requires optimization of material selection, raw materials formulas, and complex printing processes that have to balance a high number of variable but highly correlated variables. The performance of patient-specific 3D printed solutions is still limited by both the increasing number of available materials with different properties (including multi-material printing) and the large number of process features that need to be optimized. The main purpose of this study is to compare the optimization of 3D printing properties toward the maximum tensile force of an exoskeleton sample based on two different approaches: traditional artificial neural networks (ANNs) and a deep learning (DL) approach based on convolutional neural networks (CNNs). Compared with the results from the traditional ANN approach, optimization based on DL decreased the speed of the calculations by up to 1.5 times with the same print quality, improved the quality, decreased the MSE, and a set of printing parameters not previously determined by trial and error was also identified. The above-mentioned results show that DL is an effective tool with significant potential for wide application in the planning and optimization of material properties in the 3D printing process. Further research is needed to apply low-cost but more computationally efficient solutions to multi-tasking and multi-material additive manufacturing.
Collapse
|