1
|
Palma-Ramírez D, Ross-Veitía BD, Font-Ariosa P, Espinel-Hernández A, Sanchez-Roca A, Carvajal-Fals H, Nuñez-Alvarez JR, Hernández-Herrera H. Deep convolutional neural network for weld defect classification in radiographic images. Heliyon 2024; 10:e30590. [PMID: 38726185 PMCID: PMC11079250 DOI: 10.1016/j.heliyon.2024.e30590] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2024] [Revised: 04/29/2024] [Accepted: 04/30/2024] [Indexed: 05/12/2024] Open
Abstract
The quality of welds is critical to the safety of structures in construction, so early detection of irregularities is crucial. Advances in machine vision inspection technologies, such as deep learning models, have improved the detection of weld defects. This paper presents a new CNN model based on ResNet50 to classify four types of weld defects in radiographic images: crack, pore, non-penetration, and no defect. Stratified cross-validation, data augmentation, and regularization were used to improve generalization and avoid over-fitting. The model was tested on three datasets, RIAWELC, GDXray, and a private dataset of low image quality, obtaining an accuracy of 98.75 %, 90.255 %, and 75.83 %, respectively. The model proposed in this paper achieves high accuracies on different datasets and constitutes a valuable tool to improve the efficiency and effectiveness of quality control processes in the welding industry. Moreover, experimental tests show that the proposed approach performs well on even low-resolution images.
Collapse
Affiliation(s)
- Dayana Palma-Ramírez
- Postgraduate Program Doctorate in Applied Computer Engineering School of Computer Engineering. University of Valparaiso. Valparaiso, Chile
| | - Bárbara D. Ross-Veitía
- Production Engineering Doctorate Postgraduate Program Federal Technological University of Paraná (UTFPR) - Ponta Grossa Campus. PR, Brazil
| | - Pablo Font-Ariosa
- Defectoscopy and Welding Technical Services Company, Road O'Burke km. 2½ Pastorita, Cienfuegos, Cuba
| | - Alejandro Espinel-Hernández
- National Center for Applied Electromagnetism (CNEA), Universidad de Oriente, Ave. de Las Américas s/n, 90100, Santiago de Cuba, Cuba
| | - Angel Sanchez-Roca
- Intranox SL Pol. La Portalada C/ Circunde, 23 26006, Logroño, La Rioja, Spain
| | - Hipólito Carvajal-Fals
- Pesquisador Visitante. Departamento de Engenharia de Manufatura e Materiais. Universidade Estadual de Campinas. SP, Brazil
| | - José R. Nuñez-Alvarez
- Energy Department, Universidad de la Costa, (CUC), Calle 58 # 55-66, Barranquilla, 080002, Colombia
| | - Hernan Hernández-Herrera
- Faculty of Engineering, Universidad Simón Bolívar, Carrera 59 #59-132, Barranquilla, 080002, Colombia
| |
Collapse
|
2
|
Weng C, Gu X, Jin H. Coded Excitation for Ultrasonic Testing: A Review. SENSORS (BASEL, SWITZERLAND) 2024; 24:2167. [PMID: 38610378 PMCID: PMC11014118 DOI: 10.3390/s24072167] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/16/2024] [Revised: 03/12/2024] [Accepted: 03/21/2024] [Indexed: 04/14/2024]
Abstract
Originating in the early 20th century, ultrasonic testing has found increasingly extensive applications in medicine, industry, and materials science. Achieving both a high signal-to-noise ratio and high efficiency is crucial in ultrasonic testing. The former means an increase in imaging clarity as well as the detection depth, while the latter facilitates a faster refresh of the image. It is difficult to balance these two indicators with a conventional short pulse to excite the probe, so in general handling methods, these two factors have a trade-off. To solve the above problems, coded excitation (CE) can increase the pulse duration and offers great potential to improve the signal-to-noise ratio with equivalent or even higher efficiency. In this paper, we first review the fundamentals of CE, including signal modulation, signal transmission, signal reception, pulse compression, and optimization methods. Then, we introduce the application of CE in different areas of ultrasonic testing, with a focus on industrial bulk wave single-probe detection, industrial guided wave detection, industrial bulk wave phased array detection, and medical phased array imaging. Finally, we point out the advantages as well as a few future directions of CE.
Collapse
Affiliation(s)
| | | | - Haoran Jin
- The State Key Laboratory of Fluid Power and Mechatronic Systems, College of Mechanical Engineering, Zhejiang University, Hangzhou 310027, China; (C.W.); (X.G.)
| |
Collapse
|
3
|
Chen M, Xu X, Yang K, Wu H. Full-Matrix Imaging in Fourier Domain towards Ultrasonic Inspection with Wide-Angle Oblique Incidence for Welded Structures. SENSORS (BASEL, SWITZERLAND) 2024; 24:832. [PMID: 38339549 PMCID: PMC10857186 DOI: 10.3390/s24030832] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/01/2024] [Revised: 01/13/2024] [Accepted: 01/25/2024] [Indexed: 02/12/2024]
Abstract
The total focusing method (TFM) has been increasingly applied to weld inspection given its high image quality and defect sensitivity. Oblique incidence is widely used to steer the beam effectively, considering the defect orientation and structural complexity of welded structures. However, the conventional TFM based on the delay-and-sum (DAS) principle is time-consuming, especially for oblique incidence. In this paper, a fast full-matrix imaging algorithm in the Fourier domain is proposed to accelerate the TFM under the condition of oblique incidence. The algorithm adopts the Chebyshev polynomials of the second kind to directly expand the Fourier extrapolator with lateral sound velocity variation. The direct expansion maintains image accuracy and resolution in wide-angle situations, covering both small and large angles, making it highly suitable for weld inspection. Simulations prove that the third-order Chebyshev expansion is required to achieve image accuracy equivalent to the TFM with wide-angle incidence. Experiments verify the algorithm's performance for weld flaws using the proposed method with the transverse wave and the full-skip mode. The depth deviation is within 0.53 mm, and the sizing error is below 15%. The imaging efficiency is improved by a factor of up to 8 compared to conventional TFM. We conclude that the proposed method is applicable to high-speed weld inspection with various oblique incidence angles.
Collapse
Affiliation(s)
- Mu Chen
- The State Key Laboratory of Fluid Power and Mechatronic Systems, College of Mechanical Engineering, Zhejiang University, Hangzhou 310027, China; (M.C.); (X.X.); (K.Y.)
| | - Xintao Xu
- The State Key Laboratory of Fluid Power and Mechatronic Systems, College of Mechanical Engineering, Zhejiang University, Hangzhou 310027, China; (M.C.); (X.X.); (K.Y.)
| | - Keji Yang
- The State Key Laboratory of Fluid Power and Mechatronic Systems, College of Mechanical Engineering, Zhejiang University, Hangzhou 310027, China; (M.C.); (X.X.); (K.Y.)
| | - Haiteng Wu
- Hangzhou Shenhao Technology Co., Ltd., Hangzhou 311121, China
- Zhejiang Key Laboratory of Intelligent Operation and Maintenance Robot, Hangzhou 311121, China
| |
Collapse
|
4
|
Wang W, Wang P, Zhang H, Chen X, Wang G, Lu Y, Chen M, Liu H, Li J. A Real-Time Defect Detection Strategy for Additive Manufacturing Processes Based on Deep Learning and Machine Vision Technologies. MICROMACHINES 2023; 15:28. [PMID: 38258148 PMCID: PMC11154342 DOI: 10.3390/mi15010028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/22/2023] [Revised: 12/17/2023] [Accepted: 12/19/2023] [Indexed: 01/24/2024]
Abstract
Nowadays, additive manufacturing (AM) is advanced to deliver high-value end-use products rather than individual components. This evolution necessitates integrating multiple manufacturing processes to implement multi-material processing, much more complex structures, and the realization of end-user functionality. One significant product category that benefits from such advanced AM technologies is 3D microelectronics. However, the complexity of the entire manufacturing procedure and the various microstructures of 3D microelectronic products significantly intensified the risk of product failure due to fabrication defects. To respond to this challenge, this work presents a defect detection technology based on deep learning and machine vision for real-time monitoring of the AM fabrication process. We have proposed an enhanced YOLOv8 algorithm to train a defect detection model capable of identifying and evaluating defect images. To assess the feasibility of our approach, we took the extrusion 3D printing process as an application object and tailored a dataset comprising a total of 3550 images across four typical defect categories. Test results demonstrated that the improved YOLOv8 model achieved an impressive mean average precision (mAP50) of 91.7% at a frame rate of 71.9 frames per second.
Collapse
Affiliation(s)
- Wei Wang
- Key Laboratory of MEMS of the Ministry of Education, Southeast University, Nanjing 210096, China; (W.W.); (P.W.); (H.Z.); (X.C.); (G.W.); (Y.L.)
| | - Peiren Wang
- Key Laboratory of MEMS of the Ministry of Education, Southeast University, Nanjing 210096, China; (W.W.); (P.W.); (H.Z.); (X.C.); (G.W.); (Y.L.)
| | - Hanzhong Zhang
- Key Laboratory of MEMS of the Ministry of Education, Southeast University, Nanjing 210096, China; (W.W.); (P.W.); (H.Z.); (X.C.); (G.W.); (Y.L.)
| | - Xiaoyi Chen
- Key Laboratory of MEMS of the Ministry of Education, Southeast University, Nanjing 210096, China; (W.W.); (P.W.); (H.Z.); (X.C.); (G.W.); (Y.L.)
| | - Guoqi Wang
- Key Laboratory of MEMS of the Ministry of Education, Southeast University, Nanjing 210096, China; (W.W.); (P.W.); (H.Z.); (X.C.); (G.W.); (Y.L.)
| | - Yang Lu
- Key Laboratory of MEMS of the Ministry of Education, Southeast University, Nanjing 210096, China; (W.W.); (P.W.); (H.Z.); (X.C.); (G.W.); (Y.L.)
| | - Min Chen
- School of Advanced Technology, Xi’an Jiaotong-Liverpool University, Suzhou 215400, China;
| | - Haiyun Liu
- College of Computer and Information, Hohai University, Nanjing 211100, China;
| | - Ji Li
- Key Laboratory of MEMS of the Ministry of Education, Southeast University, Nanjing 210096, China; (W.W.); (P.W.); (H.Z.); (X.C.); (G.W.); (Y.L.)
| |
Collapse
|
5
|
Pan K, Hu H, Gu P. WD-YOLO: A More Accurate YOLO for Defect Detection in Weld X-ray Images. SENSORS (BASEL, SWITZERLAND) 2023; 23:8677. [PMID: 37960377 PMCID: PMC10649023 DOI: 10.3390/s23218677] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/24/2023] [Revised: 10/18/2023] [Accepted: 10/19/2023] [Indexed: 11/15/2023]
Abstract
X-ray images are an important industrial non-destructive testing method. However, the contrast of some weld seam images is low, and the shapes and sizes of defects vary greatly, which makes it very difficult to detect defects in weld seams. In this paper, we propose a gray value curve enhancement (GCE) module and a model specifically designed for weld defect detection, namely WD-YOLO. The GCE module can improve image contrast to make detection easier. WD-YOLO adopts feature pyramid and path aggregation designs. In particular, we propose the NeXt backbone for extraction and fusion of image features. In the YOLO head, we added a dual attention mechanism to enable the model to better distinguish between foreground and background areas. Experimental results show that our model achieves a satisfactory balance between performance and accuracy. Our model achieved 92.6% mAP@0.5 with 98 frames per second.
Collapse
Affiliation(s)
| | - Haiyang Hu
- School of Computer Science, Hangzhou Dianzi University, Hangzhou 310018, China; (K.P.); (P.G.)
| | | |
Collapse
|
6
|
Chernov AV, Savvas IK, Alexandrov AA, Kartashov OO, Polyanichenko DS, Butakova MA, Soldatov AV. Integrated Video and Acoustic Emission Data Fusion for Intelligent Decision Making in Material Surface Inspection System. SENSORS (BASEL, SWITZERLAND) 2022; 22:8554. [PMID: 36366252 PMCID: PMC9656752 DOI: 10.3390/s22218554] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Revised: 10/27/2022] [Accepted: 11/03/2022] [Indexed: 06/16/2023]
Abstract
In the field of intelligent surface inspection systems, particular attention is paid to decision making problems, based on data from different sensors. The combination of such data helps to make an intelligent decision. In this research, an approach to intelligent decision making based on a data integration strategy to raise awareness of a controlled object is used. In the following article, this approach is considered in the context of reasonable decisions when detecting defects on the surface of welds that arise after the metal pipe welding processes. The main data types were RGB, RGB-D images, and acoustic emission signals. The fusion of such multimodality data, which mimics the eyes and ears of an experienced person through computer vision and digital signal processing, provides more concrete and meaningful information for intelligent decision making. The main results of this study include an overview of the architecture of the system with a detailed description of its parts, methods for acquiring data from various sensors, pseudocodes for data processing algorithms, and an approach to data fusion meant to improve the efficiency of decision making in detecting defects on the surface of various materials.
Collapse
Affiliation(s)
- Andrey V. Chernov
- The Smart Materials Research Institute, Southern Federal University, 178/24 Sladkova, 344090 Rostov-on-Don, Russia
| | - Ilias K. Savvas
- School of Technology, University of Thessaly, Larissa-Trikala Ring-Road, 415000 Larissa, Greece
| | - Alexander A. Alexandrov
- The Smart Materials Research Institute, Southern Federal University, 178/24 Sladkova, 344090 Rostov-on-Don, Russia
| | - Oleg O. Kartashov
- The Smart Materials Research Institute, Southern Federal University, 178/24 Sladkova, 344090 Rostov-on-Don, Russia
| | - Dmitry S. Polyanichenko
- The Smart Materials Research Institute, Southern Federal University, 178/24 Sladkova, 344090 Rostov-on-Don, Russia
| | - Maria A. Butakova
- The Smart Materials Research Institute, Southern Federal University, 178/24 Sladkova, 344090 Rostov-on-Don, Russia
| | - Alexander V. Soldatov
- The Smart Materials Research Institute, Southern Federal University, 178/24 Sladkova, 344090 Rostov-on-Don, Russia
| |
Collapse
|
7
|
Ciecieląg K, Kęcik K, Skoczylas A, Matuszak J, Korzec I, Zaleski R. Non-Destructive Detection of Real Defects in Polymer Composites by Ultrasonic Testing and Recurrence Analysis. MATERIALS (BASEL, SWITZERLAND) 2022; 15:ma15207335. [PMID: 36295400 PMCID: PMC9611944 DOI: 10.3390/ma15207335] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/18/2022] [Revised: 10/10/2022] [Accepted: 10/18/2022] [Indexed: 06/01/2023]
Abstract
This paper presents results of ultrasonic non-destructive testing of carbon fibre-reinforced plastics (CFRPs) and glass-fibre reinforced plastics (GFRPs). First, ultrasonic C-scan analysis was used to detect real defects inside the composite materials. Next, the composite materials were subjected to drilling in the area of defect formation, and measured forces were used to analyse the drilling process using recurrence methods. Results have confirmed that recurrence methods can be used to detect defects formed inside a composite material during machining.
Collapse
Affiliation(s)
- Krzysztof Ciecieląg
- Department of Production Engineering, Faculty of Mechanical Engineering, Lublin University of Technology, 36 Nadbystrzycka, 20-618 Lublin, Poland
| | - Krzysztof Kęcik
- Department of Applied Mechanics, Faculty of Mechanical Engineering, Lublin University of Technology, 36 Nadbystrzycka, 20-618 Lublin, Poland
| | - Agnieszka Skoczylas
- Department of Production Engineering, Faculty of Mechanical Engineering, Lublin University of Technology, 36 Nadbystrzycka, 20-618 Lublin, Poland
| | - Jakub Matuszak
- Department of Production Engineering, Faculty of Mechanical Engineering, Lublin University of Technology, 36 Nadbystrzycka, 20-618 Lublin, Poland
| | - Izabela Korzec
- Department of Applied Mechanics, Faculty of Mechanical Engineering, Lublin University of Technology, 36 Nadbystrzycka, 20-618 Lublin, Poland
| | - Radosław Zaleski
- Department of Materials Physics, Institute of Physics, Faculty of Mathematics, Physics and Computer Science, Maria Curie-Sklodowska University, Marii Curie-Sklodowskiej Sq. 1, 20-031 Lublin, Poland
| |
Collapse
|
8
|
Zhang J, Liu M, Jia X, Gao R. Numerical Study and Optimal Design of the Butterfly Coil EMAT for Signal Amplitude Enhancement. SENSORS (BASEL, SWITZERLAND) 2022; 22:4985. [PMID: 35808478 PMCID: PMC9269711 DOI: 10.3390/s22134985] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/13/2022] [Revised: 06/27/2022] [Accepted: 06/29/2022] [Indexed: 12/10/2022]
Abstract
The low energy conversion efficiency of electromagnetic acoustic transducers (EMATs) is a critical issue in nondestructive testing applications. To overcome this shortcoming, a butterfly coil EMAT was developed and optimized by numerical simulation based on a 2-D finite element model. First, the effect of the structural parameters of the butterfly coil EMAT was investigated by orthogonal test theory. Then, a modified butterfly coil EMAT was designed that consists of three-square permanent magnets with opposite polarity (TSPM-OP) to enhance the signal amplitude. Finally, the signal amplitude obtained from the three types of EMATs, that is, the traditional EMAT, the EMAT optimized by orthogonal test theory, and the modified EMAT with TSPM-OP, were analyzed and compared. The results show that the signal amplitude achieved by the modified butterfly coil EMAT with TSPM-OP can be increased by 4.97 times compared to the traditional butterfly coil EMAT.
Collapse
Affiliation(s)
| | | | - Xiaojuan Jia
- College of Mechanical and Equipment Engineering, Hebei University of Engineering, Handan 056038, China; (J.Z.); (M.L.); (R.G.)
| | | |
Collapse
|
9
|
Shi M, Yang L, Gao S, Wang G. Metal Surface Defect Detection Method Based on TE01 Mode Microwave. SENSORS 2022; 22:s22134848. [PMID: 35808343 PMCID: PMC9268824 DOI: 10.3390/s22134848] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Revised: 06/21/2022] [Accepted: 06/24/2022] [Indexed: 11/16/2022]
Abstract
With the aim of addressing the difficulty of detecting metal surface cracks and corrosion defects in complex environments, we propose a detection method for metal surface cracks and corrosion defects based on TE01-mode microwave. The microwave detection equations of cracks and corrosion defects were established by the Maxwell equations when the TE01 mode was excited by microwaves, and the relationship model between the defect size and the microwave characteristic quantity was established. A finite integral simulation model was established to analyze the influence of defects on the microwave electric field, magnetic field, and tube wall current in the rectangular waveguide, as well as the return loss at the defect; an experimental platform for the detection of metal surface cracks and corrosion defects was built. The absolute value of the return loss of the microwave reflected wave increased, and with the increase of the defect width, the microwave detection frequency at the defect decreased. The TE01-mode microwave has good detection ability for metal surface cracks and corrosion defects and can effectively detect cracks with a width of 0.3 mm.
Collapse
|