1
|
Ibragimov E, Kim Y, Lee JH, Cho J, Lee JJ. Automated Pavement Condition Index Assessment with Deep Learning and Image Analysis: An End-to-End Approach. Sensors (Basel) 2024; 24:2333. [PMID: 38610545 PMCID: PMC11014408 DOI: 10.3390/s24072333] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/13/2024] [Revised: 04/02/2024] [Accepted: 04/03/2024] [Indexed: 04/14/2024]
Abstract
The degradation of road pavements due to environmental factors is a pressing issue in infrastructure maintenance, necessitating precise identification of pavement distresses. The pavement condition index (PCI) serves as a critical metric for evaluating pavement conditions, essential for effective budget allocation and performance tracking. Traditional manual PCI assessment methods are limited by labor intensity, subjectivity, and susceptibility to human error. Addressing these challenges, this paper presents a novel, end-to-end automated method for PCI calculation, integrating deep learning and image processing technologies. The first stage employs a deep learning algorithm for accurate detection of pavement cracks, followed by the application of a segmentation-based skeleton algorithm in image processing to estimate crack width precisely. This integrated approach enhances the assessment process, providing a more comprehensive evaluation of pavement integrity. The validation results demonstrate a 95% accuracy in crack detection and 90% accuracy in crack width estimation. Leveraging these results, the automated PCI rating is achieved, aligned with standards, showcasing significant improvements in the efficiency and reliability of PCI evaluations. This method offers advancements in pavement maintenance strategies and potential applications in broader road infrastructure management.
Collapse
Affiliation(s)
- Eldor Ibragimov
- SISTech Co., Ltd., Seoul 05006, Republic of Korea; (E.I.); (Y.K.)
| | - Yongsoo Kim
- SISTech Co., Ltd., Seoul 05006, Republic of Korea; (E.I.); (Y.K.)
| | - Jung Hee Lee
- Department of Artificial Intelligence, Ajou University, Suwon-si 16499, Republic of Korea;
| | - Junsang Cho
- Korea Expressway Corporation Research Institute, Hwaseong-si 13550, Republic of Korea;
| | - Jong-Jae Lee
- Department of Civil & Environmental Engineering, Sejong University, Seoul 05006, Republic of Korea
| |
Collapse
|
2
|
Jung YJ, Jang SH. Crack Detection of Reinforced Concrete Structure Using Smart Skin. Nanomaterials (Basel) 2024; 14:632. [PMID: 38607166 PMCID: PMC11013725 DOI: 10.3390/nano14070632] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/14/2024] [Revised: 04/01/2024] [Accepted: 04/03/2024] [Indexed: 04/13/2024]
Abstract
The availability of carbon nanotube (CNT)-based polymer composites allows the development of surface-attached self-sensing crack sensors for the structural health monitoring of reinforced concrete (RC) structures. These sensors are fabricated by integrating CNTs as conductive fillers into polymer matrices such as polyurethane (PU) and can be applied by coating on RC structures before the composite hardens. The principle of crack detection is based on the electrical change characteristics of the CNT-based polymer composites when subjected to a tensile load. In this study, the electrical conductivity and electro-mechanical/environmental characterization of smart skin fabricated with various CNT concentrations were investigated. This was performed to derive the tensile strain sensitivity of the smart skin according to different CNT contents and to verify their environmental impact. The optimal CNT concentration for the crack detection sensor was determined to be 5 wt% CNT. The smart skin was applied to an RC structure to validate its effectiveness as a crack detection sensor. It successfully detected and monitored crack formation and growth in the structure. During repeated cycles of crack width variations, the smart skin also demonstrated excellent reproducibility and electrical stability in response to the progressive occurrence of cracks, thereby reinforcing the reliability of the crack detection sensor. Overall, the presented results describe the crack detection characteristics of smart skin and demonstrate its potential as a structural health monitoring (SHM) sensor.
Collapse
Affiliation(s)
- Yu-Jin Jung
- Department of Smart City Engineering, Hanyang University ERICA, Ansan 15588, Republic of Korea;
| | - Sung-Hwan Jang
- Department of Smart City Engineering, Hanyang University ERICA, Ansan 15588, Republic of Korea;
- Department of Civil and Environmental Engineering, Hanyang University ERICA, Ansan 15588, Republic of Korea
| |
Collapse
|
3
|
Sokhangou F, Sorelli L, Chouinard L, Dey P, Conciatori D. Detecting Multiple Damages in UHPFRC Beams through Modal Curvature Analysis. Sensors (Basel) 2024; 24:971. [PMID: 38339688 PMCID: PMC10857179 DOI: 10.3390/s24030971] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/13/2023] [Revised: 01/20/2024] [Accepted: 01/29/2024] [Indexed: 02/12/2024]
Abstract
Curvature-based damage detection has been previously applied to identify damage in concrete structures, but little attention has been given to the capacity of this method to identify distributed damage in multiple damage zones. This study aims to apply for the first time an enhanced existing method based on modal curvature analysis combined with wavelet transform curvature (WTC) to identify zones and highlight the damage zones of a beam made of ultra-high-performance fiber-reinforced concrete (UHPFRC), a construction material that is emerging worldwide for its outstanding performance and durability. First, three beams with a 2 m span of UHPFRC material were cast, and damaged zones were created by sawing. A reference beam without cracks was also cast. The free vibration responses were measured by 12 accelerometers and calculated by operational modal analysis. Moreover, for the sake of comparison, a finite element model (FEM) was also applied to two identical beams to generate numerical acceleration without noise. Second, the modal curvature was calculated for different modes for both experimental and FEM-simulated acceleration after applying cubic spline interpolation. Finally, two damage identification methods were considered: (i) the damage index (DI), based on averaging the quadratic difference of the local curvature with respect to the reference beam, and (ii) the WTC method, applied to the quadratic difference of the local curvature with respect the reference beam. The results indicate that the developed coupled modal curvature WTC method can better identify the damaged zones of UHPFRC beams.
Collapse
Affiliation(s)
- Fahime Sokhangou
- Water and Civil Engineering Department, Laval University, Quebec City, QC G1V 0A6, Canada; (F.S.); (L.S.); (P.D.); (D.C.)
| | - Luca Sorelli
- Water and Civil Engineering Department, Laval University, Quebec City, QC G1V 0A6, Canada; (F.S.); (L.S.); (P.D.); (D.C.)
| | - Luc Chouinard
- Department of Civil Engineering, McGill University, Montreal, QC H3A 0G4, Canada
| | - Pampa Dey
- Water and Civil Engineering Department, Laval University, Quebec City, QC G1V 0A6, Canada; (F.S.); (L.S.); (P.D.); (D.C.)
| | - David Conciatori
- Water and Civil Engineering Department, Laval University, Quebec City, QC G1V 0A6, Canada; (F.S.); (L.S.); (P.D.); (D.C.)
- ICUBE, UMR 7357, CNRS, INSA de Strasbourg, Université de Strasbourg, 67000 Strasbourg, France
| |
Collapse
|
4
|
Cosoli G, Calcagni MT, Salerno G, Mancini A, Narang G, Galdelli A, Mobili A, Tittarelli F, Revel GM. In the Direction of an Artificial Intelligence-Enabled Monitoring Platform for Concrete Structures. Sensors (Basel) 2024; 24:572. [PMID: 38257663 PMCID: PMC10820885 DOI: 10.3390/s24020572] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/18/2023] [Revised: 01/08/2024] [Accepted: 01/15/2024] [Indexed: 01/24/2024]
Abstract
In a seismic context, it is fundamental to deploy distributed sensor networks for Structural Health Monitoring (SHM). Indeed, regularly gathering data from a structure/infrastructure gives insight on the structural health status, and Artificial Intelligence (AI) technologies can help in exploiting this information to generate early warnings useful for decision-making purposes. With a perspective of developing a remote monitoring platform for the built environment in a seismic context, the authors tested self-sensing concrete beams in loading tests, focusing on the measured electrical impedance. The formed cracks were objectively assessed through a vision-based system. Also, a comparative analysis of AI-based and statistical prediction methods, including Prophet, ARIMA, and SARIMAX, was conducted for predicting electrical impedance. Results show that the real part of electrical impedance is highly correlated with the applied load (Pearson's correlation coefficient > 0.9); hence, the piezoresistive ability of the manufactured specimens has been confirmed. Concerning prediction methods, the superiority of the Prophet model over statistical techniques was demonstrated (Mean Absolute Percentage Error, MAPE < 1.00%). Thus, the exploitation of electrical impedance sensors, vision-based systems, and AI technologies can be significant to enhance SHM and maintenance needs prediction in the built environment.
Collapse
Affiliation(s)
- Gloria Cosoli
- Department of Industrial Engineering and Mathematical Sciences, Università Politecnica delle Marche, 60131 Ancona, Italy; (M.T.C.); (G.S.); (G.M.R.)
| | - Maria Teresa Calcagni
- Department of Industrial Engineering and Mathematical Sciences, Università Politecnica delle Marche, 60131 Ancona, Italy; (M.T.C.); (G.S.); (G.M.R.)
| | - Giovanni Salerno
- Department of Industrial Engineering and Mathematical Sciences, Università Politecnica delle Marche, 60131 Ancona, Italy; (M.T.C.); (G.S.); (G.M.R.)
| | - Adriano Mancini
- Department of Information Engineering, Università Politecnica delle Marche, 60131 Ancona, Italy; (A.M.); (G.N.); (A.G.)
| | - Gagan Narang
- Department of Information Engineering, Università Politecnica delle Marche, 60131 Ancona, Italy; (A.M.); (G.N.); (A.G.)
| | - Alessandro Galdelli
- Department of Information Engineering, Università Politecnica delle Marche, 60131 Ancona, Italy; (A.M.); (G.N.); (A.G.)
| | - Alessandra Mobili
- Department of Science and Engineering of Matter, Environment and Urban Planning, Università Politecnica delle Marche, 60131 Ancona, Italy;
| | - Francesca Tittarelli
- Department of Science and Engineering of Matter, Environment and Urban Planning, Università Politecnica delle Marche, 60131 Ancona, Italy;
- Institute of Atmospheric Sciences and Climate, National Research Council (ISAC-CNR), 40129 Bologna, Italy
| | - Gian Marco Revel
- Department of Industrial Engineering and Mathematical Sciences, Università Politecnica delle Marche, 60131 Ancona, Italy; (M.T.C.); (G.S.); (G.M.R.)
| |
Collapse
|
5
|
Zhao M, Xu X, Bao X, Chen X, Yang H. An Automated Instance Segmentation Method for Crack Detection Integrated with CrackMover Data Augmentation. Sensors (Basel) 2024; 24:446. [PMID: 38257539 PMCID: PMC10818670 DOI: 10.3390/s24020446] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/15/2023] [Revised: 01/04/2024] [Accepted: 01/05/2024] [Indexed: 01/24/2024]
Abstract
Crack detection plays a critical role in ensuring road safety and maintenance. Traditional, manual, and semi-automatic detection methods have proven inefficient. Nowadays, the emergence of deep learning techniques has opened up new possibilities for automatic crack detection. However, there are few methods with both localization and segmentation abilities, and most perform poorly. The consistent nature of pavement over a small mileage range gives us the opportunity to make improvements. A novel data-augmentation strategy called CrackMover, specifically tailored for crack detection methods, is proposed. Experiments demonstrate the effectiveness of CrackMover for various methods. Moreover, this paper presents a new instance segmentation method for crack detection. It adopts a redesigned backbone network and incorporates a cascade structure for the region-based convolutional network (R-CNN) part. The experimental evaluation showcases significant performance improvements achieved by these approaches in crack detection. The proposed method achieves an average precision of 33.3%, surpassing Mask R-CNN with a Residual Network 50 backbone by 8.6%, proving its effectiveness in detecting crack distress.
Collapse
Affiliation(s)
- Mian Zhao
- School of Rail Transportation, Soochow University, Suzhou 215006, China;
| | - Xiangyang Xu
- School of Rail Transportation, Soochow University, Suzhou 215006, China;
| | - Xiaohua Bao
- College of Civil and Transportation Engineering, Shenzhen University, Shenzhen 518061, China; (X.B.)
| | - Xiangsheng Chen
- College of Civil and Transportation Engineering, Shenzhen University, Shenzhen 518061, China; (X.B.)
| | - Hao Yang
- School of Transportation and Civil Engineering, Nantong University, Nantong 226019, China
| |
Collapse
|
6
|
Sohaib M, Jamil S, Kim JM. An Ensemble Approach for Robust Automated Crack Detection and Segmentation in Concrete Structures. Sensors (Basel) 2024; 24:257. [PMID: 38203119 PMCID: PMC10781400 DOI: 10.3390/s24010257] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/10/2023] [Revised: 12/24/2023] [Accepted: 12/29/2023] [Indexed: 01/12/2024]
Abstract
To prevent potential instability the early detection of cracks is imperative due to the prevalent use of concrete in critical infrastructure. Automated techniques leveraging artificial intelligence, machine learning, and deep learning as the traditional manual inspection methods are time-consuming. The existing automated concrete crack detection algorithms, despite recent advancements, face challenges in robustness, particularly in precise crack detection amidst complex backgrounds and visual distractions, while also maintaining low inference times. Therefore, this paper introduces a novel ensemble mechanism based on multiple quantized You Only Look Once version 8 (YOLOv8) models for the detection and segmentation of cracks in concrete structures. The proposed model is tested on different concrete crack datasets yielding enhanced segmentation results with at least 89.62% precision and intersection over a union score of 0.88. Moreover, the inference time per image is reduced to 27 milliseconds which is at least a 5% improvement over other models in the comparison. This is achieved by amalgamating the predictions of the trained models to calculate the final segmentation mask. The noteworthy contributions of this work encompass the creation of a model with low inference time, an ensemble mechanism for robust crack segmentation, and the enhancement of the learning capabilities of crack detection models. The fast inference time of the model renders it appropriate for real-time applications, effectively tackling challenges in infrastructure maintenance and safety.
Collapse
Affiliation(s)
- Muhammad Sohaib
- School of Computer Science and Technology, Zhejiang Normal University, Jinhua 321004, China;
- Zhejiang Institute of Photoelectronics & Zhejiang Institute for Advanced Light Source, Zhejiang Normal University, Jinhua 321004, China
| | - Saima Jamil
- Department of Computer Science, Virtual University of Pakistan, Peshawar 25000, Pakistan;
| | - Jong-Myon Kim
- Department of Electrical, Electronic and Computer Engineering, University of Ulsan, Ulsan 44610, Republic of Korea
- Prognosis and Diagnostics Technologies Co., Ltd., Ulsan 44610, Republic of Korea
| |
Collapse
|
7
|
Cai C, Chen S, Liu L. Detection of Fatigue Cracks for Concrete Structures by Using Carbon Ink-Based Conductive Skin and Electrical Resistance Tomography. Sensors (Basel) 2023; 23:8382. [PMID: 37896476 PMCID: PMC10610693 DOI: 10.3390/s23208382] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/07/2023] [Revised: 09/29/2023] [Accepted: 10/09/2023] [Indexed: 10/29/2023]
Abstract
Concrete is among the most widely used structural materials in buildings and bridges all over the world. During their service life, concrete structures may inevitably display cracks due to long-term fatigue loads, leading to the degradation of structural integrity. Thus, it is very important to detect cracks and their growth in concrete structures using an automated structural health monitoring system. In this paper, experimental research on crack detection and imaging of concrete structures by using sensing skin and electrical resistance tomography (ERT) is presented. Carbon ink is screen-printed on the surface of concrete as a conductive material to form sensing skins. With these sensing skins, when cracks occur on or near the surface, it breaks the continuity of the sensing skins and significantly reduces conductivity in cracking areas. Then, after exciting small currents in sensing skins and measuring related voltage data, an inverse analysis based on total variation (TV) regularization is adopted to reconstruct tomographic images showing conductivity changes in sensing skins, to detect the occurrence and growth of cracks. The effectiveness of conductive sensing skins and our related crack detection method is validated in experimental studies on a concrete beam subjected to fatigue tests.
Collapse
Affiliation(s)
| | - Shaolin Chen
- College of Civil Aviation, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China; (C.C.)
| | | |
Collapse
|
8
|
Dong Q, Wang S, Chen X, Jiang W, Li R, Gu X. Pavement crack detection based on point cloud data and data fusion. Philos Trans A Math Phys Eng Sci 2023; 381:20220165. [PMID: 37454693 DOI: 10.1098/rsta.2022.0165] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Accepted: 02/16/2023] [Indexed: 07/18/2023]
Abstract
The three-dimensional detection in point cloud data for pavement cracks has drawn the attention of many researchers recently. In the field of pavement surface point cloud detection, the key tasks include the identification of pavement cracks and the extraction of the location and size information of pavement cracks. Based on the point cloud data of pavement surface, we developed two methods to directly extract and detect cracks, respectively. The first method is based on the improved sliding window algorithm by combining the random sample consensus (RANSAC) technique to directly extract the crack information from point clouds. The second method is developed based on YOLOv5 to process the two-dimensional images transformed from point cloud data for automatic pavement crack detection. We also attempted to fuse the point cloud images with greyscale images as input for the YOLOv5. Analysis results show that the improved sliding window algorithm efficiently extracts pavement cracks with less noise, and the YOLOv5-based method obtains a good detection of pavement cracks. This article is part of the theme issue 'Artificial intelligence in failure analysis of transportation infrastructure and materials'.
Collapse
Affiliation(s)
- Qiao Dong
- Department of Roadway Engineering, School of Transportation, Southeast University, Nanjing 211189, People's Republic of China
| | - Sike Wang
- Department of Roadway Engineering, School of Transportation, Southeast University, Nanjing 211189, People's Republic of China
| | - Xueqin Chen
- Department of Civil Engineering, College of Science, Nanjing University of Science and Technology, Nanjing, Xuanwu District 210094, People's Republic of China
| | - Wanqi Jiang
- Department of Roadway Engineering, School of Transportation, Southeast University, Nanjing 211189, People's Republic of China
| | - Ruiqi Li
- Department of Roadway Engineering, School of Transportation, Southeast University, Nanjing 211189, People's Republic of China
| | - Xingyu Gu
- Department of Roadway Engineering, School of Transportation, Southeast University, Nanjing 211189, People's Republic of China
| |
Collapse
|
9
|
Xu Z, Wang Y, Hao X, Fan J. Crack Detection of Bridge Concrete Components Based on Large-Scene Images Using an Unmanned Aerial Vehicle. Sensors (Basel) 2023; 23:6271. [PMID: 37514565 PMCID: PMC10384031 DOI: 10.3390/s23146271] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/15/2023] [Revised: 06/30/2023] [Accepted: 07/04/2023] [Indexed: 07/30/2023]
Abstract
The current method of crack detection in bridges using unmanned aerial vehicles (UAVs) relies heavily on acquiring local images of bridge concrete components, making image acquisition inefficient. To address this, we propose a crack detection method that utilizes large-scene images acquired by a UAV. First, our approach involves designing a UAV-based scheme for acquiring large-scene images of bridges, followed by processing these images using a background denoising algorithm. Subsequently, we use a maximum crack width calculation algorithm that is based on the region of interest and the maximum inscribed circle. Finally, we applied the method to a typical reinforced concrete bridge. The results show that the large-scene images are only 1/9-1/22 of the local images for this bridge, which significantly improves detection efficiency. Moreover, the accuracy of the crack detection can reach up to 93.4%.
Collapse
Affiliation(s)
- Zhen Xu
- School of Civil and Resource Engineering, University of Science and Technology Beijing, Beijing 100083, China
- Beijing Advanced Innovation Center for Materials Genome Engineering, University of Science and Technology Beijing, Beijing 100083, China
| | - Yingwang Wang
- School of Civil and Resource Engineering, University of Science and Technology Beijing, Beijing 100083, China
| | - Xintian Hao
- School of Civil and Resource Engineering, University of Science and Technology Beijing, Beijing 100083, China
| | - Jingjing Fan
- School of Civil and Resource Engineering, University of Science and Technology Beijing, Beijing 100083, China
| |
Collapse
|
10
|
Gomez MJ, Castejon C, Corral E, Cocconcelli M. Railway Axle Early Fatigue Crack Detection through Condition Monitoring Techniques. Sensors (Basel) 2023; 23:6143. [PMID: 37447993 DOI: 10.3390/s23136143] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/07/2023] [Revised: 06/29/2023] [Accepted: 06/30/2023] [Indexed: 07/15/2023]
Abstract
The detection of cracks in rotating machinery is an unresolved issue today. In this work, a methodology for condition monitoring of railway axles is presented, based on crack detection by means of the automatic selection of patterns from the vibration signal measurement. The time waveforms were processed using the Wavelet Packet Transform, and appropriate alarm values for diagnosis were calculated automatically using non-supervised learning techniques based on Change Point Analysis algorithms. The validation was performed using vibration signals obtained during fatigue tests of two identical railway axle specimens, one of which cracked during the test while the other did not. During the test in which the axle cracked, the results show trend changes in the energy of the vibration signal associated with theoretical defect frequencies, which were particularly evident in the direction of vibration that was parallel to the track. These results are contrasted with those obtained during the test in which the fatigue limit was not exceeded, and the test therefore ended with the axle intact, verifying that the effects that were related to the crack did not appear in this case. With the results obtained, an adjusted alarm value for a condition monitoring process was established.
Collapse
Affiliation(s)
- María Jesús Gomez
- Mechanical Engineering Department, Avenida de la Universidad 30, 28982 Madrid, Spain
| | - Cristina Castejon
- Mechanical Engineering Department, Avenida de la Universidad 30, 28982 Madrid, Spain
| | - Eduardo Corral
- Mechanical Engineering Department, Avenida de la Universidad 30, 28982 Madrid, Spain
| | - Marco Cocconcelli
- Department of Sciences and Methods for Engineering, University of Modena and Reggio Emilia, Via G. Amendola 2, 42124 Reggio Emilia, Italy
| |
Collapse
|
11
|
Liu X, Hong Z, Shi W, Guo X. Image-Processing-Based Subway Tunnel Crack Detection System. Sensors (Basel) 2023; 23:6070. [PMID: 37447919 DOI: 10.3390/s23136070] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/06/2023] [Revised: 06/28/2023] [Accepted: 06/29/2023] [Indexed: 07/15/2023]
Abstract
With the increase in urban rail transit construction, instances of tunnel disease are on the rise, and cracks have become the focus of tunnel maintenance and management. Therefore, it is essential to carry out crack detection in a timely and efficient manner to not only prolong the service life of the tunnel but also reduce the incidence of accidents. In this paper, the design and structure of a tunnel crack detection system are analyzed. On this basis, this paper proposes a new method for crack identification and feature detection using image processing technology. This method fully considers the characteristics of tunnel images and the combination of these characteristics with deep learning, while a deep convolutional network (Single-Shot MultiBox Detector (SSD)) is proposed based on deep learning for object detection in complex images. The experimental results show that the test set accuracy and training set accuracy of the support vector machine (SVM) in the classification comparison test are up to 88% and 87.8%, respectively; while the test accuracy of Alexnet's deep convolutional neural network-based classification and identification is up to 96.7%, and the training set accuracy is up to 97.5%. It can be seen that this deep convolutional network recognition algorithm based on deep learning and image processing is better and more suitable for the detection of cracks in subway tunnels.
Collapse
Affiliation(s)
- Xiaofeng Liu
- School of Land Engineering, Chang'an University, Xi'an 710054, China
| | - Zenglin Hong
- School of Land Engineering, Chang'an University, Xi'an 710054, China
- Shaanxi Province Institute of Geological Survey, Xi'an 710054, China
| | - Wei Shi
- Shaanxi Hydrogeology Engineering Geology and Environment Geology Survey Center, Xi'an 710068, China
- Shaanxi Engineering Technology Research Center for Urban Geology and Underground Space, Xi'an 710068, China
| | - Xiaodan Guo
- Shaanxi Province Institute of Geological Survey, Xi'an 710054, China
| |
Collapse
|
12
|
Guo Y, Shen X, Linke J, Wang Z, Barati K. Quantification of Structural Defects Using Pixel Level Spatial Information from Photogrammetry. Sensors (Basel) 2023; 23:5878. [PMID: 37447731 DOI: 10.3390/s23135878] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Revised: 06/12/2023] [Accepted: 06/19/2023] [Indexed: 07/15/2023]
Abstract
Aging infrastructure has drawn increased attention globally, as its collapse would be destructive economically and socially. Precise quantification of minor defects is essential for identifying issues before structural failure occurs. Most studies measured the dimension of defects at image level, ignoring the third-dimensional information available from close-range photogrammetry. This paper aims to develop an efficient approach to accurately detecting and quantifying minor defects on complicated infrastructures. Pixel sizes of inspection images are estimated using spatial information generated from three-dimensional (3D) point cloud reconstruction. The key contribution of this research is to obtain the actual pixel size within the grided small sections by relating spatial information. To automate the process, deep learning technology is applied to detect and highlight the cracked area at the pixel level. The adopted convolutional neural network (CNN) achieves an F1 score of 0.613 for minor crack extraction. After that, the actual crack dimension can be derived by multiplying the pixel number with the pixel size. Compared with the traditional approach, defects distributed on a complex structure can be estimated with the proposed approach. A pilot case study was conducted on a concrete footpath with cracks distributed on a selected 1500 mm × 1500 mm concrete road section. Overall, 10 out of 88 images are selected for validation; average errors ranging from 0.26 mm to 0.71 mm were achieved for minor cracks under 5 mm, which demonstrates a promising result of the proposed study.
Collapse
Affiliation(s)
- Youheng Guo
- School of Civil and Environmental Engineering, University of New South Wales, Sydney, NSW 2052, Australia
- Linke & Linke Surveys, 34-36 Byrnes St, Botany, Sydney, NSW 2019, Australia
| | - Xuesong Shen
- School of Civil and Environmental Engineering, University of New South Wales, Sydney, NSW 2052, Australia
| | - James Linke
- Linke & Linke Surveys, 34-36 Byrnes St, Botany, Sydney, NSW 2019, Australia
| | - Zihao Wang
- Linke & Linke Surveys, 34-36 Byrnes St, Botany, Sydney, NSW 2019, Australia
| | - Khalegh Barati
- School of Civil and Environmental Engineering, University of New South Wales, Sydney, NSW 2052, Australia
| |
Collapse
|
13
|
Huang Y, Luo Y, Cao Y, Lin X, Wei H, Wu M, Yang X, Zhao Z. Damage Detection of Unwashed Eggs through Video and Deep Learning. Foods 2023; 12:foods12112179. [PMID: 37297424 DOI: 10.3390/foods12112179] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2023] [Revised: 05/22/2023] [Accepted: 05/24/2023] [Indexed: 06/12/2023] Open
Abstract
Broken eggs can be harmful to human health but are also unfavorable for transportation and production. This study proposes a video-based detection model for the real-time detection of broken eggs regarding unwashed eggs in dynamic scenes. A system capable of the continuous rotation and translation of eggs was designed to display the entire surface of an egg. We added CA into the backbone network, fusing BiFPN and GSConv with the neck to improve YOLOv5. The improved YOLOV5 model uses intact and broken eggs for training. In order to accurately judge the category of eggs in the process of movement, ByteTrack was used to track the eggs and assign an ID to each egg. The detection results of the different frames of YOLOv5 in the video were associated by ID, and we used the method of five consecutive frames to determine the egg category. The experimental results show that, when compared to the original YOLOv5, the improved YOLOv5 model improves the precision of detecting broken eggs by 2.2%, recall by 4.4%, and mAP:0.5 by 4.1%. The experimental field results showed an accuracy of 96.4% when the improved YOLOv5 (combined with ByteTrack) was used for the video detection of broken eggs. The video-based model can detect eggs that are always in motion, which is more suitable for actual detection than a single image-based detection model. In addition, this study provides a reference for the research of video-based non-destructive testing.
Collapse
Affiliation(s)
- Yuan Huang
- College of Engineering, South China Agricultural University, Guangzhou 510642, China
| | - Yangfan Luo
- College of Engineering, South China Agricultural University, Guangzhou 510642, China
| | - Yangyang Cao
- College of Engineering, South China Agricultural University, Guangzhou 510642, China
| | - Xu Lin
- College of Engineering, South China Agricultural University, Guangzhou 510642, China
| | - Hongfei Wei
- College of Engineering, South China Agricultural University, Guangzhou 510642, China
| | - Mengcheng Wu
- College of Engineering, South China Agricultural University, Guangzhou 510642, China
| | - Xiaonan Yang
- College of Engineering, South China Agricultural University, Guangzhou 510642, China
| | - Zuoxi Zhao
- College of Engineering, South China Agricultural University, Guangzhou 510642, China
- Key Laboratory of Key Technology on Agricultural Machine and Equipment, South China Agricultural University, Ministry of Education, Guangzhou 510642, China
| |
Collapse
|
14
|
Shah J, El-Hawwat S, Wang H. Guided Wave Ultrasonic Testing for Crack Detection in Polyethylene Pipes: Laboratory Experiments and Numerical Modeling. Sensors (Basel) 2023; 23:s23115131. [PMID: 37299858 DOI: 10.3390/s23115131] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/01/2023] [Revised: 05/20/2023] [Accepted: 05/25/2023] [Indexed: 06/12/2023]
Abstract
The use of guided wave-based Ultrasonic Testing (UT) for monitoring Polyethylene (PE) pipes is mostly restricted to detecting defects in welded zones, despite its diversified success in monitoring metallic pipes. PE's viscoelastic behavior and semi-crystalline structure make it prone to crack formation under extreme loads and environmental factors, which is a leading cause of pipeline failure. This state-of-the-art study aims to demonstrate the potential of UT for detecting cracks in non-welded regions of natural gas PE pipes. Laboratory experiments were conducted using a UT system consisting of low-cost piezoceramic transducers assembled in a pitch-catch configuration. The amplitude of the transmitted wave was analyzed to study wave interaction with cracks of different geometries. The frequency of the inspecting signal was optimized through wave dispersion and attenuation analysis, guiding the selection of third- and fourth- order longitudinal modes for the study. The findings revealed that cracks with lengths equal to or greater than the wavelength of the interacting mode were more easily detectable, while smaller crack lengths required greater crack depths for detection. However, there were potential limitations in the proposed technique related to crack orientation. These insights were validated using a finite element-based numerical model, confirming the potential of UT for detecting cracks in PE pipes.
Collapse
Affiliation(s)
- Jay Shah
- Centre of Advance Infrastructure and Transportation, Rutgers-The State University of New Jersey, Piscataway, NJ 08854, USA
| | - Said El-Hawwat
- Department of Civil and Environmental Engineering, Rutgers-The State University of New Jersey, Piscataway, NJ 08854, USA
| | - Hao Wang
- Department of Civil and Environmental Engineering, Rutgers-The State University of New Jersey, Piscataway, NJ 08854, USA
| |
Collapse
|
15
|
Roh CJ, Ko EK, Chang Y, Park SH, Mun J, Kim M, Noh TW. Nanoscale Enhancement of the Local Optical Conductivity near Cracks in Metallic SrRuO 3 Film. ACS Nano 2023; 17:8233-8241. [PMID: 37094108 PMCID: PMC10173690 DOI: 10.1021/acsnano.2c12333] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/03/2023]
Abstract
Cracking has been recognized as a major obstacle degrading material properties, including structural stability, electrical conductivity, and thermal conductivity. Recently, there have been several reports on the nanosized cracks (nanocracks), particularly in the insulating oxides. In this work, we comprehensively investigate how nanocracks affect the physical properties of metallic SrRuO3 (SRO) thin films. We grow SRO/SrTiO3 (STO) bilayers on KTaO3 (KTO) (001) substrates, which provide +1.7% tensile strain if the SRO layer is grown epitaxially. However, the SRO/STO bilayers suffer from the generation and propagation of nanocracks, and then, the strain becomes inhomogeneously relaxed. As the thickness increases, the nanocracks in the SRO layer become percolated, and its dc conductivity approaches zero. Notably, we observe an enhancement of the local optical conductivity near the nanocrack region using scanning-type near-field optical microscopy. This enhancement is attributed to the strain relaxation near the nanocracks. Our work indicates that nanocracks can be utilized as promising platforms for investigating local emergent phenomena related to strain effects.
Collapse
Affiliation(s)
- Chang Jae Roh
- Center for Correlated Electron Systems, Institute for Basic Science (IBS), Seoul 08826, Republic of Korea
- Department of Physics and Astronomy, Seoul National University, Seoul 08826, Republic of Korea
| | - Eun Kyo Ko
- Center for Correlated Electron Systems, Institute for Basic Science (IBS), Seoul 08826, Republic of Korea
- Department of Physics and Astronomy, Seoul National University, Seoul 08826, Republic of Korea
| | - Yunyeong Chang
- Department of Materials Science and Engineering and Research Institute of Advanced Materials, Seoul National University, Seoul 08826, Republic of Korea
| | - Soon Hee Park
- Pohang Accelerator Laboratory, Pohang University of Science and Technology (POSTECH), Pohang 37673, Republic of Korea
| | - Junsik Mun
- Department of Materials Science and Engineering and Research Institute of Advanced Materials, Seoul National University, Seoul 08826, Republic of Korea
| | - Miyoung Kim
- Department of Materials Science and Engineering and Research Institute of Advanced Materials, Seoul National University, Seoul 08826, Republic of Korea
| | - Tae Won Noh
- Center for Correlated Electron Systems, Institute for Basic Science (IBS), Seoul 08826, Republic of Korea
- Department of Physics and Astronomy, Seoul National University, Seoul 08826, Republic of Korea
| |
Collapse
|
16
|
Sghaier S, Krichen M, Ben Dhaou I, Elmannai H, Alkanhel R. Identification, 3D-Reconstruction, and Classification of Dangerous Road Cracks. Sensors (Basel) 2023; 23:3578. [PMID: 37050640 PMCID: PMC10098584 DOI: 10.3390/s23073578] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Revised: 03/03/2023] [Accepted: 03/18/2023] [Indexed: 06/19/2023]
Abstract
Advances in semiconductor technology and wireless sensor networks have permitted the development of automated inspection at diverse scales (machine, human, infrastructure, environment, etc.). However, automated identification of road cracks is still in its early stages. This is largely owing to the difficulty obtaining pavement photographs and the tiny size of flaws (cracks). The existence of pavement cracks and potholes reduces the value of the infrastructure, thus the severity of the fracture must be estimated. Annually, operators in many nations must audit thousands of kilometers of road to locate this degradation. This procedure is costly, sluggish, and produces fairly subjective results. The goal of this work is to create an efficient automated system for crack identification, extraction, and 3D reconstruction. The creation of crack-free roads is critical to preventing traffic deaths and saving lives. The proposed method consists of five major stages: detection of flaws after processing the input picture with the Gaussian filter, contrast adjustment, and ultimately, threshold-based segmentation. We created a database of road cracks to assess the efficacy of our proposed method. The result obtained are commendable and outperform previous state-of-the-art studies.
Collapse
Affiliation(s)
- Souhir Sghaier
- Department of Science and Technology, College of Ranyah, Taif University, P.O. Box 11099, Taif 21944, Saudi Arabia
| | - Moez Krichen
- Faculty of Computer Science and Information Technology, Al-Baha University, Al-Baha 65528, Saudi Arabia
- ReDCAD Laboratory, National School of Engineers of Sfax, University of Sfax, Sfax 3029, Tunisia
| | - Imed Ben Dhaou
- Department of Computer Science, Hekma School of Engineering, Computing and Informatics, Dar Al-Hekma University, Jeddah P.O. Box 34801, Saudi Arabia
- Department of Computing, University of Turku, 20500 Turku, Finland
- Higher Institute of Computer Sciences and Mathematics, Department of Technology, University of Monastir, Monastir 5000, Tunisia
| | - Hela Elmannai
- Department of Information Technology, College of Computer and Information Sciences, Princess Nourah Bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia
| | - Reem Alkanhel
- Department of Information Technology, College of Computer and Information Sciences, Princess Nourah Bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia
| |
Collapse
|
17
|
Tse KW, Pi R, Sun Y, Wen CY, Feng Y. A Novel Real-Time Autonomous Crack Inspection System Based on Unmanned Aerial Vehicles. Sensors (Basel) 2023; 23:3418. [PMID: 37050478 PMCID: PMC10098570 DOI: 10.3390/s23073418] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/14/2023] [Revised: 03/16/2023] [Accepted: 03/22/2023] [Indexed: 06/19/2023]
Abstract
Traditional methods on crack inspection for large infrastructures require a number of structural health inspection devices and instruments. They usually use the signal changes caused by physical deformations from cracks to detect the cracks, which is time-consuming and cost-ineffective. In this work, we propose a novel real-time crack inspection system based on unmanned aerial vehicles for real-world applications. The proposed system successfully detects and classifies various types of cracks. It can accurately find the crack positions in the world coordinate system. Our detector is based on an improved YOLOv4 with an attention module, which produces 90.02% mean average precision (mAP) and outperforms the YOLOv4-original by 5.23% in terms of mAP. The proposed system is low-cost and lightweight. Moreover, it is not restricted by navigation trajectories. The experimental results demonstrate the robustness and effectiveness of our system in real-world crack inspection tasks.
Collapse
Affiliation(s)
- Kwai-Wa Tse
- Department of Aeronautical and Aviation Engineering, The Hong Kong Polytechnic University, Kowloon 999077, Hong Kong; (K.-W.T.)
| | - Rendong Pi
- Department of Mechanical Engineering, The Hong Kong Polytechnic University, Kowloon 999077, Hong Kong
| | - Yuxiang Sun
- Department of Mechanical Engineering, The Hong Kong Polytechnic University, Kowloon 999077, Hong Kong
| | - Chih-Yung Wen
- Department of Aeronautical and Aviation Engineering, The Hong Kong Polytechnic University, Kowloon 999077, Hong Kong; (K.-W.T.)
| | - Yurong Feng
- Department of Aeronautical and Aviation Engineering, The Hong Kong Polytechnic University, Kowloon 999077, Hong Kong; (K.-W.T.)
| |
Collapse
|
18
|
Lee H, Yoo J. Fast Attention CNN for Fine-Grained Crack Segmentation. Sensors (Basel) 2023; 23:2244. [PMID: 36850841 PMCID: PMC9962498 DOI: 10.3390/s23042244] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/26/2023] [Revised: 02/06/2023] [Accepted: 02/13/2023] [Indexed: 06/18/2023]
Abstract
Deep learning-based computer vision algorithms, especially image segmentation, have been successfully applied to pixel-level crack detection. The prediction accuracy relies heavily on detecting the performance of fine-grained cracks and removing crack-like noise. We propose a fast encoder-decoder network with scaling attention. We focus on a low-level feature map by minimizing encoder-decoder pairs and adopting an Atrous Spatial Pyramid Pooling (ASPP) layer to improve the detection accuracy of tiny cracks. Another challenge is the reduction in crack-like noise. This introduces a novel scaling attention, AG+, to suppress irrelevant regions. However, removing crack-like noise, such as grooving, is difficult by using only improved segmentation networks. In this study, a crack dataset is generated. It contains 11,226 sets of images and masks, which are effective for detecting detailed tiny cracks and removing non-semantic objects. Our model is evaluated on the generated dataset and compared with state-of-the-art segmentation networks. We use the mean Dice coefficient (mDice) and mean Intersection over union (mIoU) to compare the performance and FLOPs for computational complexity. The experimental results show that our model improves the detection accuracy of fine-grained cracks and reduces the computational cost dramatically. The mDice score of the proposed model is close to the best score, with only a 1.2% difference but two times fewer FLOPs.
Collapse
Affiliation(s)
- Hyunnam Lee
- Incheon International Airport Corporation, Incheon 22382, Republic of Korea
| | - Juhan Yoo
- Department of Computer, Semyung University, Jecheon 02468, Republic of Korea
| |
Collapse
|
19
|
Meoni A, D’Alessandro A, Saviano F, Lignola GP, Parisi F, Ubertini F. Strain Monitoring and Crack Detection in Masonry Walls under In-Plane Shear Loading Using Smart Bricks: First Results from Experimental Tests and Numerical Simulations. Sensors (Basel) 2023; 23:2211. [PMID: 36850809 PMCID: PMC9960584 DOI: 10.3390/s23042211] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/15/2023] [Revised: 02/08/2023] [Accepted: 02/09/2023] [Indexed: 06/18/2023]
Abstract
A diffuse and continuous monitoring of the in-service structural response of buildings can allow for the early identification of the formation of cracks and collapse mechanisms before the occurrence of severe consequences. In the case of existing masonry constructions, the implementation of tailored Structural Health Monitoring (SHM) systems appears quite significant, given their well-known susceptibility to brittle failures. Recently, a new sensing technology based on smart bricks, i.e., piezoresistive brick-like sensors, was proposed in the literature for the SHM of masonry constructions. Smart bricks can be integrated within masonry to monitor strain and detect cracks. At present, the effectiveness of smart bricks has been proven in different structural settings. This paper contributes to the research by investigating the strain-sensitivity of smart bricks of standard dimensions when inserted in masonry walls subjected to in-plane shear loading. Real-scale masonry walls instrumented with smart bricks and displacement sensors were tested under diagonal compression, and numerical simulations were conducted to interpret the experimental results. At peak condition, numerical models provided comparable strain values to those of smart bricks, i.e., approximately equal to 10-4, with similar trends. Overall, the effectiveness of smart bricks in strain monitoring and crack detection is demonstrated.
Collapse
Affiliation(s)
- Andrea Meoni
- Department of Civil and Environmental Engineering, University of Perugia, Via G. Duranti 93, 06125 Perugia, Italy
| | - Antonella D’Alessandro
- Department of Civil and Environmental Engineering, University of Perugia, Via G. Duranti 93, 06125 Perugia, Italy
| | - Felice Saviano
- Department of Structures for Engineering and Architecture, University of Naples “Federico II”, Via Claudio 21, 80125 Naples, Italy
| | - Gian Piero Lignola
- Department of Structures for Engineering and Architecture, University of Naples “Federico II”, Via Claudio 21, 80125 Naples, Italy
| | - Fulvio Parisi
- Department of Structures for Engineering and Architecture, University of Naples “Federico II”, Via Claudio 21, 80125 Naples, Italy
| | - Filippo Ubertini
- Department of Civil and Environmental Engineering, University of Perugia, Via G. Duranti 93, 06125 Perugia, Italy
| |
Collapse
|
20
|
Stolze FHG, Worden K, Manson G, Staszewski WJ. Fatigue- Crack Detection in a Multi-Riveted Strap-Joint Aluminium Aircraft Panel Using Amplitude Characteristics of Diffuse Lamb Wave Field. Materials (Basel) 2023; 16:1619. [PMID: 36837249 PMCID: PMC9960847 DOI: 10.3390/ma16041619] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/14/2022] [Revised: 01/11/2023] [Accepted: 02/09/2023] [Indexed: 06/18/2023]
Abstract
Structural health monitoring of riveted aircraft panels is a real challenge for maintenance engineers. Here, a diffused Lamb wave field is used for fatigue-crack detection in a multi-riveted strap-joint aircraft panel. The panel is instrumented with a network of low-profile surface-bonded piezoceramic transducers. Various amplitude characteristics of Lamb waves are used to extract information on fatigue damage. A statistical outlier analysis based on these characteristics is also performed to detect damage. The experimental work is supported by simplified modelling of wave scattering from crack tips to explain complex response features. The Local Interaction Simulation Approach (LISA) is used for this modelling task. The results demonstrate the potential and limitations of the method for reliable fatigue-crack detection in complex aircraft components.
Collapse
Affiliation(s)
- Frank H. G. Stolze
- Department of Mechanical Engineering, Sheffield University, Mappin St., Sheffield S1 3JD, UK
| | - Keith Worden
- Department of Mechanical Engineering, Sheffield University, Mappin St., Sheffield S1 3JD, UK
| | - Graeme Manson
- Department of Mechanical Engineering, Sheffield University, Mappin St., Sheffield S1 3JD, UK
| | - Wieslaw J. Staszewski
- Department of Robotics and Mechatronics, AGH University of Science and Technology, Al. Mickiewicza 30, 30-059 Krakow, Poland
| |
Collapse
|
21
|
Kim Y, Yi S, Ahn H, Hong CH. Accurate Crack Detection Based on Distributed Deep Learning for IoT Environment. Sensors (Basel) 2023; 23:858. [PMID: 36679655 PMCID: PMC9862405 DOI: 10.3390/s23020858] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Revised: 12/23/2022] [Accepted: 01/09/2023] [Indexed: 06/17/2023]
Abstract
Defects or cracks in roads, building walls, floors, and product surfaces can degrade the completeness of the product and become an impediment to quality control. Machine learning can be a solution for detecting defects effectively without human experts; however, the low-power computing device cannot afford that. In this paper, we suggest a crack detection system accelerated by edge computing. Our system consists of two: Rsef and Rsef-Edge. Rsef is a real-time segmentation method based on effective feature extraction that can perform crack image segmentation by optimizing conventional deep learning models. Then, we construct the edge-based system, named Rsef-Edge, to significantly decrease the inference time of Rsef, even in low-power IoT devices. As a result, we show both a fast inference time and good accuracy even in a low-powered computing environment.
Collapse
Affiliation(s)
- Youngpil Kim
- Department of Information and Telecommunication Engineering, Incheon National University, 119, Academy-ro, Yeonsu-gu, Incheon 22012, Republic of Korea
| | - Shinuk Yi
- Metaverse World Co., 134, Teheran-ro, Gangnam-gu, Seoul 06235, Republic of Korea
| | - Hyunho Ahn
- School of Electrical and Electronics Engineering, Chung-Ang University, 84 Heukseok-ro, Dongjak-gu, Seoul 06974, Republic of Korea
| | - Cheol-Ho Hong
- School of Electrical and Electronics Engineering, Chung-Ang University, 84 Heukseok-ro, Dongjak-gu, Seoul 06974, Republic of Korea
| |
Collapse
|
22
|
Ohana R, Klein R, Shneck R, Bortman J. Experimental Investigation of the Spall Propagation Mechanism in Bearing Raceways. Materials (Basel) 2022; 16:68. [PMID: 36614405 PMCID: PMC9821043 DOI: 10.3390/ma16010068] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/17/2022] [Revised: 12/12/2022] [Accepted: 12/19/2022] [Indexed: 06/17/2023]
Abstract
This article investigates the spall propagation mechanism for ball bearing raceways by focusing on an experimental investigation of cracks that evolve in the vicinity of the spall edge. Understanding the spall propagation mechanism is an important step towards developing a physics-based prognostic tool for ball bearings. This research reflects an investigation of different spall sizes that propagate naturally both in laboratory experiments and in the field. By using a combined model of a rigid body dynamic model and a finite element model that simulates the rolling element-spall edge interaction, our results shed light on the material behavior (displacements, strains, and stresses) that creates an environment for crack formation and propagation. With the support of the experimental results and the rolling element-spall edge interaction model results, three stages of the mechanism that control fragment release from the raceway were identified. In Stage one, sub-surface cracks appear underneath the spall trailing edge. In Stage two, cracks appear in front of the trailing edge of the spall and, in Stage three, the cracks propagate until a fragment is released from the raceway. These stages were observed in all the tested bearings. In addition, other phenomena that affect the propagation of the cracks and the geometry of the fragment were observed, such as blistering and plastic deformation. We include an explanation of what determines the shape of the fragments.
Collapse
Affiliation(s)
- Ravit Ohana
- PHM Laboratory, Department of Mechanical Engineering, Ben-Gurion University of the Negev, P.O. Box 653, Beer-Sheva 8410501, Israel
| | - Renata Klein
- R. K. Diagnostics, Gilon, P.O. Box 101, D. N. Misgav 2010300, Israel
| | - Roni Shneck
- Department of Material Engineering, Ben-Gurion University of the Negev, P.O. Box 653, Beer-Sheva 8410501, Israel
| | - Jacob Bortman
- PHM Laboratory, Department of Mechanical Engineering, Ben-Gurion University of the Negev, P.O. Box 653, Beer-Sheva 8410501, Israel
| |
Collapse
|
23
|
Nowak S, Sherizadeh T, Esmaeelpour M, Guner D, Karadeniz KE. Hybrid Fiber Optic Cable for Strain Profiling and Crack Growth Measurement in Rock, Cement, and Brittle Installation Media. Sensors (Basel) 2022; 22:9685. [PMID: 36560053 PMCID: PMC9783028 DOI: 10.3390/s22249685] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/14/2022] [Revised: 12/06/2022] [Accepted: 12/08/2022] [Indexed: 06/17/2023]
Abstract
Brillouin scattering-based distributed fiber optic sensing (DFOS) technologies such as Brillouin optical time domain reflectometry (BOTDR) and Brillouin optical time domain analysis (BOTDA) have broad applicability for the long term and real-time monitoring of large concrete structures, underground mine excavations, pit slopes, and deep subsurface wellbores. When installed in brittle media, however, the meter scale spatial resolution of the BOTDR/A technology prohibits the detection or measurement of highly localized deformations, such as those which form at or along cracks, faults, and other discontinuities. This work presents a novel hybrid fiber optic cable with the ability to self-anchor to any brittle installation media without the need for manual installation along fixed interval points. Laboratory scale testing demonstrates the ability of the hybrid fiber optic cable to measure strains across highly localized deformation zones in both tension and shear. In addition, results show the applicability of the developed technology for strain monitoring in high displacement environments. Linear relationships are proposed for use in estimating the displacement magnitude along discontinuities in brittle media from strain signals collected from the hybrid fiber optic cable. The hybrid fiber optic cable has broad potential applications, such as geomechanical monitoring in underground mines, surface pits, large civil infrastructure projects, and deep subsurface wellbores. The benefits of fiber optic sensing, such as the intrinsic safety of the sensors, the long sensing range, and real time capabilities make this a compelling technique for long term structural health monitoring (SHM) in a wide range of industrial and civil applications.
Collapse
Affiliation(s)
- Samuel Nowak
- Department of Mining and Explosives Engineering, Missouri University of Science and Technology, Rolla, MO 65409, USA
| | - Taghi Sherizadeh
- Department of Mining and Explosives Engineering, Missouri University of Science and Technology, Rolla, MO 65409, USA
| | - Mina Esmaeelpour
- Department of Electrical and Computer Engineering, Missouri University of Science and Technology, Rolla, MO 65409, USA
| | - Dogukan Guner
- Department of Mining and Explosives Engineering, Missouri University of Science and Technology, Rolla, MO 65409, USA
| | - Kutay E. Karadeniz
- Department of Mining and Explosives Engineering, Missouri University of Science and Technology, Rolla, MO 65409, USA
| |
Collapse
|
24
|
Machikhin A, Poroykov A, Bardakov V, Marchenkov A, Zhgut D, Sharikova M, Barat V, Meleshko N, Kren A. Combined Acoustic Emission and Digital Image Correlation for Early Detection and Measurement of Fatigue Cracks in Rails and Train Parts under Dynamic Loading. Sensors (Basel) 2022; 22:9256. [PMID: 36501957 PMCID: PMC9736736 DOI: 10.3390/s22239256] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/26/2022] [Revised: 11/24/2022] [Accepted: 11/26/2022] [Indexed: 06/17/2023]
Abstract
Fatigue crack in rails and cyclic-loaded train parts is a contributory factor in multiple railroad accidents. We address the problem of crack detection and measurement at early stages, when total failure has not yet occurred. We propose to combine acoustic emission (AE) testing for prediction of crack growth with digital image correlation (DIC) for its accurate quantitative characterization. In this study, we imitated fatigue crack appearance and growth in samples of railway rail and two train parts by cyclic loading, and applied these two techniques for inspection. Experimental results clearly indicate the efficiency of AE in the early detection of fatigue cracks, and excellent DIC capabilities in terms of geometrical measurements. Combination of these techniques reveals a promising basis for real-time and non-destructive monitoring of rails and train parts.
Collapse
Affiliation(s)
- Alexander Machikhin
- Moscow Power Engineering Institute, 14, Krasnokazarmennaya Str., 111250 Moscow, Russia
- Scientific and Technological Center of Unique Instrumentation, Russian Academy of Sciences, 15, Butlerova Str., 117342 Moscow, Russia
| | - Anton Poroykov
- Moscow Power Engineering Institute, 14, Krasnokazarmennaya Str., 111250 Moscow, Russia
| | - Vladimir Bardakov
- Moscow Power Engineering Institute, 14, Krasnokazarmennaya Str., 111250 Moscow, Russia
- INTERUNIS-IT, POB 140, 20B, Shosse Entusiastov, 111024 Moscow, Russia
| | - Artem Marchenkov
- Moscow Power Engineering Institute, 14, Krasnokazarmennaya Str., 111250 Moscow, Russia
| | - Daria Zhgut
- Moscow Power Engineering Institute, 14, Krasnokazarmennaya Str., 111250 Moscow, Russia
| | - Milana Sharikova
- Moscow Power Engineering Institute, 14, Krasnokazarmennaya Str., 111250 Moscow, Russia
- Scientific and Technological Center of Unique Instrumentation, Russian Academy of Sciences, 15, Butlerova Str., 117342 Moscow, Russia
| | - Vera Barat
- Moscow Power Engineering Institute, 14, Krasnokazarmennaya Str., 111250 Moscow, Russia
- INTERUNIS-IT, POB 140, 20B, Shosse Entusiastov, 111024 Moscow, Russia
| | - Natalia Meleshko
- Moscow Power Engineering Institute, 14, Krasnokazarmennaya Str., 111250 Moscow, Russia
| | - Alexander Kren
- Institute of Applied Physics, National Academy of Sciences, 16, St. Akademicheskaya, 220072 Minsk, Belarus
| |
Collapse
|
25
|
Kou L, Sysyn M, Fischer S, Liu J, Nabochenko O. Optical Rail Surface Crack Detection Method Based on Semantic Segmentation Replacement for Magnetic Particle Inspection. Sensors (Basel) 2022; 22:8214. [PMID: 36365912 PMCID: PMC9658924 DOI: 10.3390/s22218214] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/15/2022] [Revised: 10/23/2022] [Accepted: 10/24/2022] [Indexed: 06/16/2023]
Abstract
Railway damage detection is of great significance in ensuring railway safety. The cracks on the rail surface play a key role in studying the formation and development process of rail damage, predicting the occurrence of rail defects, and then improving the service life of the rail. However, due to the small shape of the cracks, the typical detection method is relatively complicated, and the speed is quite slow. Although traditional magnetic particle inspection technology is fairly accurate at detection, it is costly and inconvenient to carry and install, while also limiting the detection speed and affecting the system's operation. In this paper, a semantic segmentation detection method is developed by using various collected rail surface crack data and deep learning through a neural network. By comparing the inspection of the same rail surface with magnetic particle inspection technology, only inexpensive cameras are used and the inspection speed is increased while maintaining relatively high accuracy. In addition, the method can achieve fast detection speeds if it is extended to be combined with high-frequency cameras. It is an economical, efficient, and environmentally friendly method for future rail surface detection.
Collapse
Affiliation(s)
- Lei Kou
- Institute of Railway Systems and Public Transport, TU-Dresden, 01069 Dresden, Germany
| | - Mykola Sysyn
- Institute of Railway Systems and Public Transport, TU-Dresden, 01069 Dresden, Germany
| | - Szabolcs Fischer
- Department of Transport Infrastructure and Water Resources Engineering, Faculty of Architecture, Civil- and Transport Engineering, Széchenyi István University, H-9026 Győr, Hungary
| | - Jianxing Liu
- Institute of Railway Systems and Public Transport, TU-Dresden, 01069 Dresden, Germany
| | - Olga Nabochenko
- Institute of Railway Systems and Public Transport, TU-Dresden, 01069 Dresden, Germany
| |
Collapse
|
26
|
Zhao M, Shi P, Xu X, Xu X, Liu W, Yang H. Improving the Accuracy of an R-CNN-Based Crack Identification System Using Different Preprocessing Algorithms. Sensors (Basel) 2022; 22:s22187089. [PMID: 36146444 PMCID: PMC9503856 DOI: 10.3390/s22187089] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/07/2022] [Revised: 09/06/2022] [Accepted: 09/13/2022] [Indexed: 05/27/2023]
Abstract
The accurate intelligent identification and detection of road cracks is a key issue in road maintenance, and it has become popular to perform this task through the field of computer vision. In this paper, we proposed a deep learning-based crack detection method that initially uses the idea of image sparse representation and compressed sensing to preprocess the datasets. Only the pixels that represent the crack features remain, while most pixels of non-crack features are relatively sparse, which can significantly improve the accuracy and efficiency of crack identification. The proposed method achieved good results based on the limited datasets of crack images. Various algorithms were tested, namely, linear smooth, median filtering, Gaussian smooth, and grayscale threshold, where the optimal parameters of the various algorithms were analyzed and trained with faster regions with convolutional neural network features (faster R-CNN). The results of the experiments showed that the proposed method has good robustness, with higher detection efficiency in the presence of, for example, road markings, shallow cracks, multiple cracks, and blurring. The result shows that the improvement of mean average precision (mAP) can reach 5% compared with the original method.
Collapse
Affiliation(s)
- Mian Zhao
- School of Rail Transportation, Soochow University, Suzhou 215006, China
| | - Peixin Shi
- School of Rail Transportation, Soochow University, Suzhou 215006, China
| | - Xunqian Xu
- School of Transportation and Civil Engineering, Nantong University, Nantong 226019, China
| | - Xiangyang Xu
- School of Rail Transportation, Soochow University, Suzhou 215006, China
| | - Wei Liu
- School of Rail Transportation, Soochow University, Suzhou 215006, China
| | - Hao Yang
- School of Transportation and Civil Engineering, Nantong University, Nantong 226019, China
| |
Collapse
|
27
|
Peng K, Zhang Y, Xu X, Han J, Luo Y. Crack Detection of Threaded Steel Rods Based on Ultrasonic Guided Waves. Sensors (Basel) 2022; 22:6885. [PMID: 36146234 PMCID: PMC9501074 DOI: 10.3390/s22186885] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/14/2022] [Revised: 09/04/2022] [Accepted: 09/07/2022] [Indexed: 06/16/2023]
Abstract
Fatigue cracks are typical damage of threaded steel rods under dynamic loads. This paper presents a study on ultrasonic guided waves-based, fatigue-crack detection of threaded rods. A threaded rod with given sizes is theoretically simplified as a cylindrical rod. The propagation characteristics of ultrasonic guided waves in the cylindrical rod are investigated by semi-analytical finite element method and the longitudinal L(0, 1) modal ultrasonic guided waves in low frequency band is proposed for damage detection of the rod. Numerical simulation on the propagation of the proposed ultrasonic guided waves in the threaded rod without damage shows that the thread causes echoes of the ultrasonic guided waves. A numerical study on the propagation of the proposed ultrasonic guided waves in the threaded rod with a crack on the intersection of the smooth segment and the threaded segment shows that both linear indexes (Rf and ARS) and nonlinear indexes (βre' and β') are able to detect the crack. A constant-amplitude tensile fatigue experiment was conducted on a specimen of the threaded rod to generate fatigue cracks in the specimen. After every 20,000 loading cycles, the specimen was tested by the proposed ultrasonic guided waves and evaluated by the linear indexes and nonlinear indexes. Experimental results show that both the linear and nonlinear indexes of the ultrasonic guided waves are able to identify the crack before it enters the rapid growth stage and the nonlinear indexes detect the crack easier than the linear indexes.
Collapse
Affiliation(s)
- Kunhong Peng
- College of Civil Engineering and Architecture, Zhejiang University, Hangzhou 310058, China
| | - Yi Zhang
- College of Civil Engineering and Architecture, Zhejiang University, Hangzhou 310058, China
| | - Xian Xu
- College of Civil Engineering and Architecture, Zhejiang University, Hangzhou 310058, China
- Center for Balance Architecture, Zhejiang University, Hangzhou 310058, China
| | - Jinsong Han
- College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China
| | - Yaozhi Luo
- College of Civil Engineering and Architecture, Zhejiang University, Hangzhou 310058, China
| |
Collapse
|
28
|
Li Y, Ma J, Zhao Z, Shi G. A Novel Approach for UAV Image Crack Detection. Sensors (Basel) 2022; 22:3305. [PMID: 35590994 DOI: 10.3390/s22093305] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/11/2022] [Revised: 04/23/2022] [Accepted: 04/25/2022] [Indexed: 02/01/2023]
Abstract
Cracks are the most significant pre-disaster of a road, and are also important indicators for evaluating the damage level of a road. At present, road crack detection mainly depends on manual detection and road detection vehicles, with which the safety of detection workers is not guaranteed and the detection efficiency is low. A road detection vehicle can speed up the efficiency to a certain extent, but the automation level is low and it is easy to block the traffic. Unmanned Aerial Vehicles (UAV) have the characteristics of low energy consumption and easy control. If UAV technology can be applied to road crack detection, it will greatly improve the detection efficiency and produce huge economic benefits. In order to find a way to apply UAV to road crack detection, we developed a new technique for road crack detection based on UAV pictures, called DenxiDeepCrack, which is a trainable deep convolutional neural network for automatic crack detection which utilises learning high-level features for crack representation. In addition, we create a new dataset based on drone images called UCrack 11 to enrich the crack database of drone images for future crack detection research.
Collapse
|
29
|
Huang R, Lu M, Chen Z, Yin W. Reduction of Coil-Crack Angle Sensitivity Effect Using a Novel Flux Feature of ACFM Technique. Sensors (Basel) 2021; 22:201. [PMID: 35009744 PMCID: PMC8747747 DOI: 10.3390/s22010201] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/03/2021] [Revised: 12/22/2021] [Accepted: 12/26/2021] [Indexed: 06/14/2023]
Abstract
Alternating current field measurement (ACFM) testing is one of the promising techniques in the field of non-destructive testing with advantages of the non-contact capability and the reduction of lift-off effects. In this paper, a novel crack detection approach was proposed to reduce the effect of the angled crack (cack orientation) by using rotated ACFM techniques. The sensor probe is composed of an excitation coil and two receiving coils. Two receiving coils are orthogonally placed in the center of the excitation coil where the magnetic field is measured. It was found that the change of the x component and the peak value of the z component of the magnetic field when the sensor probe rotates around a crack followed a sine wave shape. A customized accelerated finite element method solver programmed in MATLAB was adopted to simulate the performance of the designed sensor probe which could significantly improve the computation efficiency due to the small crack perturbation. The experiments were also carried out to validate the simulations. It was found that the ratio between the z and x components of the magnetic field remained stable under various rotation angles. It showed the potential to estimate the depth of the crack from the ratio detected by combining the magnetic fields from both receiving coils (i.e., the x and z components of the magnetic field) using the rotated ACFM technique.
Collapse
|
30
|
Pecho P, Hrúz M, Novák A, Trško L. Internal Damage Detection of Composite Structures Using Passive RFID Tag Antenna Deformation Method: Basic Research. Sensors (Basel) 2021; 21:8236. [PMID: 34960329 DOI: 10.3390/s21248236] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/09/2021] [Revised: 11/30/2021] [Accepted: 12/07/2021] [Indexed: 11/16/2022]
Abstract
This manuscript deals with the detection of internal cracks and defects in aeronautical fibreglass structures. In technical practice, it is problematic to accurately determine the service life or MTBF (Mean Time Between Failure) of composite materials by the methods used in metallic materials. The problem is mainly the inhomogeneous and anisotropic structure of composites, possibly due to the differences in the macrostructure during production, production processes, etc. Diagnostic methods for detecting internal cracks and damage are slightly different, and in practice, it is more difficult to detect defects using non-destructive testing (NDT). The article deals with the use of Radio frequency identification (RFID) technology integrated in the fibreglass laminates of aircraft structures to detect internal defects based on deformation behaviour of passive RFID tag antenna. The experiments proved the potential of using RFID technology in fibreglass composite laminates when using tensile tests applied on specimens with different structural properties. Therefore, the implementation of passive RFID tags into fibreglass composite structures presents the possibilities of detecting internal cracks and structural health monitoring. The result and conclusion of the basic research is determination of the application conditions for our proposed technology in practice. Moreover, the basic research provides recommendations for the applied research in terms of the use in real composite airframe structures.
Collapse
|
31
|
Kurnyta A, Baran M, Kurnyta-Mazurek P, Kowalczyk K, Dziendzikowski M, Dragan K. The Experimental Verification of Direct-Write Silver Conductive Grid and ARIMA Time Series Analysis for Crack Propagation. Sensors (Basel) 2021; 21:s21206916. [PMID: 34696130 PMCID: PMC8539668 DOI: 10.3390/s21206916] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/20/2021] [Revised: 10/12/2021] [Accepted: 10/15/2021] [Indexed: 11/16/2022]
Abstract
The paper presents experimental verification of customized resistive crack propagation sensors as an alternative method for other common structural health monitoring (SHM) techniques. Most of these are sensitive to changes in the sensor network configuration and a baseline dataset must be collected for the analysis of the structure condition. Sensors investigated within the paper are manufactured by the direct-write process with electrically conductive, silver-microparticle-filled paint to prepare a tailored measuring grid on an epoxy or polyurethane coating as a driving/insulating layer. This method is designed to enhance the functionality and usability compared to commercially available crack gauges. By using paint with conductive metal particles, the shape of the sensor measuring grid can be more easily adapted to the structure, while, in the previous approach, only a few grid-fixed sensors are available. A fatigue test on the compact tension (CT) specimen is presented and discussed to evaluate the ability of the developed sensors to detect and monitor fatigue cracks. Additionally, the ARIMA time series algorithm is developed both for monitoring and predicting crack growth, based on the acquired data. The proposed sensors' verification reveal their good performance to detect and monitor fatigue fractures with a relatively low measurement error and ARIMA estimated crack length compared with the crack opening displacement (COD) gauge.
Collapse
Affiliation(s)
- Artur Kurnyta
- Airworthiness Division, Air Force Institute of Technology, 01-494 Warsaw, Poland; (M.B.); (K.K.); (M.D.); (K.D.)
- Correspondence:
| | - Marta Baran
- Airworthiness Division, Air Force Institute of Technology, 01-494 Warsaw, Poland; (M.B.); (K.K.); (M.D.); (K.D.)
| | - Paulina Kurnyta-Mazurek
- Faculty of Mechatronics, Armament and Aerospace, Military University of Technology, 00-908 Warsaw, Poland;
| | - Kamil Kowalczyk
- Airworthiness Division, Air Force Institute of Technology, 01-494 Warsaw, Poland; (M.B.); (K.K.); (M.D.); (K.D.)
| | - Michał Dziendzikowski
- Airworthiness Division, Air Force Institute of Technology, 01-494 Warsaw, Poland; (M.B.); (K.K.); (M.D.); (K.D.)
| | - Krzysztof Dragan
- Airworthiness Division, Air Force Institute of Technology, 01-494 Warsaw, Poland; (M.B.); (K.K.); (M.D.); (K.D.)
| |
Collapse
|
32
|
Colom M, Rodríguez-Aseguinolaza J, Mendioroz A, Salazar A. Sizing the Depth and Width of Narrow Cracks in Real Parts by Laser-Spot Lock-In Thermography. Materials (Basel) 2021; 14:ma14195644. [PMID: 34640042 PMCID: PMC8510446 DOI: 10.3390/ma14195644] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/03/2021] [Revised: 09/08/2021] [Accepted: 09/22/2021] [Indexed: 11/16/2022]
Abstract
We present a complete characterization of the width and depth of a very narrow fatigue crack developed in an Al-alloy dog bone plate using laser-spot lock-in thermography. Unlike visible micrographs, which show many surface scratches, the thermographic image clearly identifies the presence of a single crack about 1.5 mm long. Once detected, we focus a modulated laser beam close to the crack and we record the temperature amplitude. By fitting the numerical model to the temperature profile across the crack, we obtain both the width and depth simultaneously, at the location of the laser spot. Repeating the process for different positions of the laser spot along the crack length, we obtain the distribution of the crack width and depth. We show that the crack has an almost constant depth (0.7 mm) and width (1.5 µm) along 0.7 mm and features a fast reduction in both quantities until the crack vanishes. The results prove the ability of laser-spot lock-in thermography to fully characterize quantitatively narrow cracks, even below 1 µm.
Collapse
|
33
|
Mevissen F, Meo M. Nonlinear Ultrasound Crack Detection with Multi-Frequency Excitation-A Comparison. Sensors (Basel) 2021; 21:s21165368. [PMID: 34450807 PMCID: PMC8398877 DOI: 10.3390/s21165368] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/23/2021] [Revised: 08/04/2021] [Accepted: 08/04/2021] [Indexed: 11/16/2022]
Abstract
Nonlinear ultrasound crack detection methods are used as modern, non-destructive testing tools for inspecting early damages in various materials. Nonlinear ultrasonic wave modulation, where typically two or more frequencies are excited, was demonstrated to be a robust method for failure indicators when using measured harmonics and modulated response frequencies. The aim of this study is to address the capability of multi-frequency wave excitation, where more than two excitation frequencies are used, for better damage identification when compared to single and double excitation frequencies without the calculation of dispersion curves. The excitation frequencies were chosen in such a way that harmonic and modulated response frequencies meet at a specific frequency to amplify signal energy. A new concept of nonlinearity parameter grouping with multi-frequency excitation was developed as an early failure parameter. An analytical solution of the one-dimensional wave equation was derived with four fundamental frequencies, and a total of 64 individual and 30 group nonlinearity parameters. Experimental validation of the approach was conducted on metal plates with different types of cracks and on turbine blades where cracks originated under service conditions. The results showed that the use of multi-frequency excitation offers advantages in detecting cracks.
Collapse
|
34
|
Kertész I, Zsom-Muha V, András R, Horváth F, Németh C, Felföldi J. Development of a Novel Acoustic Spectroscopy Method for Detection of Eggshell Cracks. Molecules 2021; 26:4693. [PMID: 34361851 DOI: 10.3390/molecules26154693] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2021] [Revised: 07/26/2021] [Accepted: 07/27/2021] [Indexed: 11/20/2022] Open
Abstract
Non-destructive testing (NDT) for eggshell faults is highly important for the egg industry, as cracked eggs account for around 3% of total production. The most commonly used method at present, candling, is labor intensive, while computer vision systems are expensive and complicated. In this paper, we present a simple, yet efficient, novel method for eggshell crack detection by acoustic spectroscopy. Altogether, 693 sound recordings were evaluated by different classification methods. The results show a cross-validated 2.1% total classification error, with only 0.87% false positive rate, which is the crucial metric for fresh eggs. Adapting the developed method to an industrial setting may lead to a reliable, fast and cost-effective detection method.
Collapse
|
35
|
Hallee MJ, Napolitano RK, Reinhart WF, Glisic B. Crack Detection in Images of Masonry Using CNNs. Sensors (Basel) 2021; 21:4929. [PMID: 34300668 DOI: 10.3390/s21144929] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/01/2021] [Revised: 07/03/2021] [Accepted: 07/09/2021] [Indexed: 11/29/2022]
Abstract
While there is a significant body of research on crack detection by computer vision methods in concrete and asphalt, less attention has been given to masonry. We train a convolutional neural network (CNN) on images of brick walls built in a laboratory environment and test its ability to detect cracks in images of brick-and-mortar structures both in the laboratory and on real-world images taken from the internet. We also compare the performance of the CNN to a variety of simpler classifiers operating on handcrafted features. We find that the CNN performed better on the domain adaptation from laboratory to real-world images than these simple models. However, we also find that performance is significantly better in performing the reverse domain adaptation task, where the simple classifiers are trained on real-world images and tested on the laboratory images. This work demonstrates the ability to detect cracks in images of masonry using a variety of machine learning methods and provides guidance for improving the reliability of such models when performing domain adaptation for crack detection in masonry.
Collapse
|
36
|
Kang KC, Park KK. Noncontact Laser Ultrasound Detection of Cracks Using Hydrophone. Sensors (Basel) 2021; 21:3371. [PMID: 34066179 DOI: 10.3390/s21103371] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/31/2021] [Revised: 05/02/2021] [Accepted: 05/10/2021] [Indexed: 11/17/2022]
Abstract
We present a noncontact, non-immersion ultrasonic inspection method. A broadband ultrasound signal generated by a pulsed laser was measured using a hydrophone. The generated ultrasound signals propagated through the specimen and received a signal from the hydrophone in the water. Soldered chip ceramic capacitors, resistors, and surface-mount-type chip amplifiers were used as experimental specimens. A polydimethylsiloxane layer was used to prevent the specimen from being impacted by contact with water. The presence of a crack in the middle of the specimen resulted in an air layer, and the intermediate air layer reduced the magnitude of the signal transmitted owing to impedance mismatch. Using this principle, the cracks in each specimen could be distinguished. The image contrast ratio derived from the proposed method is approximately two to three times higher than that derived using the conventional immersion ultrasonic method. These results show that the proposed method can replace existing immersion-type ultrasound transmitted images.
Collapse
|
37
|
Choi D, Bell W, Kim D, Kim J. UAV-Driven Structural Crack Detection and Location Determination Using Convolutional Neural Networks. Sensors (Basel) 2021; 21:s21082650. [PMID: 33918951 PMCID: PMC8069420 DOI: 10.3390/s21082650] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/14/2021] [Revised: 04/04/2021] [Accepted: 04/07/2021] [Indexed: 11/16/2022]
Abstract
Structural cracks are a vital feature in evaluating the health of aging structures. Inspectors regularly monitor structures’ health using visual information because early detection of cracks on highly trafficked structures is critical for maintaining the public’s safety. In this work, a framework for detecting cracks along with their locations is proposed. Image data provided by an unmanned aerial vehicle (UAV) is stitched using image processing techniques to overcome limitations in the resolution of cameras. This stitched image is analyzed to identify cracks using a deep learning model that makes judgements regarding the presence of cracks in the image. Moreover, cracks’ locations are determined using data from UAV sensors. To validate the system, cracks forming on an actual building are captured by a UAV, and these images are analyzed to detect and locate cracks. The proposed framework is proven as an effective way to detect cracks and to represent the cracks’ locations.
Collapse
Affiliation(s)
- Daegyun Choi
- Department of Aerospace Engineering & Engineering Mechanics, University of Cincinnati, Cincinnati, OH 45221, USA;
| | | | - Donghoon Kim
- Department of Aerospace Engineering & Engineering Mechanics, University of Cincinnati, Cincinnati, OH 45221, USA;
- Correspondence:
| | - Jichul Kim
- Department of Aerospace Engineering, Mississippi State University, Mississippi State, MS 39759, USA;
| |
Collapse
|
38
|
Ramli J, Coulson J, Martin J, Nagaratnam B, Poologanathan K, Cheung WM. Crack Detection and Localisation in Steel-Fibre-Reinforced Self-Compacting Concrete Using Triaxial Accelerometers. Sensors (Basel) 2021; 21:2044. [PMID: 33799406 DOI: 10.3390/s21062044] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/19/2021] [Revised: 03/09/2021] [Accepted: 03/09/2021] [Indexed: 11/17/2022]
Abstract
Cracking in concrete structures can significantly affect their structural integrity and eventually lead to catastrophic failure if undetected. Recent advances in sensor technology for structural health monitoring techniques have led to the development of new and improved sensors for real-time detection and monitoring of cracks in various applications, from laboratory tests to large structures. In this study, triaxial accelerometers have been employed to detect and locate micro- and macrocrack formation in plain self-compacting concrete (SCC) and steel-fibre-reinforced SCC (SFRSCC) beams under three-point bending. Experiments were carried out with triaxial accelerometers mounted on the surface of the beams. The experimental results revealed that triaxial accelerometers could be used to identify the locations of cracks and provide a greater quantity of useful data for more accurate measurement and interpretation. The study sheds light on the structural monitoring capability of triaxial acceleration measurements for SFRSCC structural elements that can act as an early warning system for structural failure.
Collapse
|
39
|
Ali L, Alnajjar F, Jassmi HA, Gocho M, Khan W, Serhani MA. Performance Evaluation of Deep CNN-Based Crack Detection and Localization Techniques for Concrete Structures. Sensors (Basel) 2021; 21:1688. [PMID: 33804490 DOI: 10.3390/s21051688] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/05/2021] [Revised: 02/19/2021] [Accepted: 02/23/2021] [Indexed: 11/25/2022]
Abstract
This paper proposes a customized convolutional neural network for crack detection in concrete structures. The proposed method is compared to four existing deep learning methods based on training data size, data heterogeneity, network complexity, and the number of epochs. The performance of the proposed convolutional neural network (CNN) model is evaluated and compared to pretrained networks, i.e., the VGG-16, VGG-19, ResNet-50, and Inception V3 models, on eight datasets of different sizes, created from two public datasets. For each model, the evaluation considered computational time, crack localization results, and classification measures, e.g., accuracy, precision, recall, and F1-score. Experimental results demonstrated that training data size and heterogeneity among data samples significantly affect model performance. All models demonstrated promising performance on a limited number of diverse training data; however, increasing the training data size and reducing diversity reduced generalization performance, and led to overfitting. The proposed customized CNN and VGG-16 models outperformed the other methods in terms of classification, localization, and computational time on a small amount of data, and the results indicate that these two models demonstrate superior crack detection and localization for concrete structures.
Collapse
|
40
|
Wu Y, Cui B, Xiao Y. Crack Detection during Laser Metal Deposition by Infrared Monochrome Pyrometer. Materials (Basel) 2020; 13:ma13245643. [PMID: 33321942 PMCID: PMC7763096 DOI: 10.3390/ma13245643] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/08/2020] [Revised: 12/05/2020] [Accepted: 12/08/2020] [Indexed: 06/12/2023]
Abstract
Laser metal deposition (LMD) is an advanced technology of additive manufacturing which involves sophisticated processes. However, it is associated with high risks of failure due to the possible generation of cracks and bubbles. If not identified in time, such defects can cause substantial losses. In this paper, real-time monitoring of LMD samples and online detection of cracks by an infrared monochrome pyrometer (IMP) could mitigate this risk. An experimental platform for crack detection in LMD samples was developed, and the identification of four simulated cracks in a 316L austenitic stainless-steel LMD sample was conducted. Data at temperatures higher than 150 °C were collected by an IMP, and the results indicated that crack depth is an important factor affecting the peak temperature. Based on this factor, the locations of cracks in LMD-316L austenitic stainless-steel samples can be determined. The proposed technique can provide real-time detection of cracks through layers of cladding during large-scale manufacturing, which suggests its relevance for optimizing the technological process and parameters, as well as reducing the possibility of cracks in the LMD process.
Collapse
Affiliation(s)
- Yin Wu
- School of Aerospace Engineering, Xi’an Jiaotong University, Xi’an 710049, China;
- State Key Laboratory for Manufacturing Systems Engineering, Xi’an Jiaotong University, Xi’an 710049, China;
| | - Bin Cui
- State Key Laboratory for Manufacturing Systems Engineering, Xi’an Jiaotong University, Xi’an 710049, China;
- Collaborative Innovation Center of High-End Manufacturing Equipment, Xi’an Jiaotong University, Xi’an 710049, China
| | - Yao Xiao
- State Key Laboratory for Manufacturing Systems Engineering, Xi’an Jiaotong University, Xi’an 710049, China;
| |
Collapse
|
41
|
Silva LA, Sanchez San Blas H, Peral García D, Sales Mendes A, Villarubia González G. An Architectural Multi-Agent System for a Pavement Monitoring System with Pothole Recognition in UAV Images. Sensors (Basel) 2020; 20:E6205. [PMID: 33143311 DOI: 10.3390/s20216205] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/09/2020] [Revised: 10/21/2020] [Accepted: 10/27/2020] [Indexed: 12/21/2022]
Abstract
In recent years, maintenance work on public transport routes has drastically decreased in many countries due to difficult economic situations. The various studies that have been conducted by groups of drivers and groups related to road safety concluded that accidents are increasing due to the poor conditions of road surfaces, even affecting the condition of vehicles through costly breakdowns. Currently, the processes of detecting any type of damage to a road are carried out manually or are based on the use of a road vehicle, which incurs a high labor cost. To solve this problem, many research centers are investigating image processing techniques to identify poor-condition road areas using deep learning algorithms. The main objective of this work is to design of a distributed platform that allows the detection of damage to transport routes using drones and to provide the results of the most important classifiers. A case study is presented using a multi-agent system based on PANGEA that coordinates the different parts of the architecture using techniques based on ubiquitous computing. The results obtained by means of the customization of the You Only Look Once (YOLO) v4 classifier are promising, reaching an accuracy of more than 95%. The images used have been published in a dataset for use by the scientific community.
Collapse
|
42
|
Miao L, Gao B, Li H, Tian G. Resonant frequency tracking mode on eddy current pulsed thermography non-destructive testing. Philos Trans A Math Phys Eng Sci 2020; 378:20190607. [PMID: 32921235 PMCID: PMC7536017 DOI: 10.1098/rsta.2019.0607] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 06/26/2020] [Indexed: 06/11/2023]
Abstract
Eddy current pulsed thermography (ECPT) has been widely used in the field of non-destructive testing due to its safety, non-contact detection, high spatial resolution and intuitive results. Inductive excitation source is an important component of ECPT and provides high-frequency alternating current to drive the excitation coil. However, a resonant frequency distortion phenomenon exists in the excitation source during the detection process, which seriously affects the output power of the excitation source and the sample detection effect. This paper presents a fast resonant frequency tracking loop for full bridge series resonant inverter which is used to search the resonance frequency in real time through direct digital synthesizer (DDS) and all-digital phase-locked loop. Theoretical analysis and simulation are presented to explain the working principle of the loop. Then, an experimental prototype is manufactured which serves as an excitation source for the ECPT experimental system. Compared with traditional excitation sources, the prototype does not need a water-cooled device and the tracking speed can be adjusted by modifying the parameters of DDS. Finally, experiments have been conducted on both artificial slot of 45# steel and natural cracks of rail and stainless steel to investigate the influence of resonant frequency tracking speed on the crack detection. The results revealed that reducing the resonant frequency tracking time can efficiently improve defect detectability and the manufactured prototype showed more application potential. This article is part of the theme issue 'Advanced electromagnetic non-destructive evaluation and smart monitoring'.
Collapse
Affiliation(s)
- Ling Miao
- School of Automation Engineering, University of Electronic Science and Technology of China, Chengdu, People’s Republic of China
| | - Bin Gao
- School of Automation Engineering, University of Electronic Science and Technology of China, Chengdu, People’s Republic of China
| | - Haoran Li
- School of Automation Engineering, University of Electronic Science and Technology of China, Chengdu, People’s Republic of China
| | - Guiyun Tian
- School of Automation Engineering, University of Electronic Science and Technology of China, Chengdu, People’s Republic of China
- School of Electrical and Electronic Engineering, Newcastle University, England, UK
| |
Collapse
|
43
|
Oesch T, Weise F, Bruno G. Detection and Quantification of Cracking in Concrete Aggregate through Virtual Data Fusion of X-ray Computed Tomography Images. Materials (Basel) 2020; 13:ma13183921. [PMID: 32899859 PMCID: PMC7559878 DOI: 10.3390/ma13183921] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/24/2020] [Revised: 08/31/2020] [Accepted: 09/03/2020] [Indexed: 11/16/2022]
Abstract
In this work, which is part of a larger research program, a framework called "virtual data fusion" was developed to provide an automated and consistent crack detection method that allows for the cross-comparison of results from large quantities of X-ray computed tomography (CT) data. A partial implementation of this method in a custom program was developed for use in research focused on crack quantification in alkali-silica reaction (ASR)-sensitive concrete aggregates. During the CT image processing, a series of image analyses tailored for detecting specific, individual crack-like characteristics were completed. The results of these analyses were then "fused" in order to identify crack-like objects within the images with much higher accuracy than that yielded by any individual image analysis procedure. The results of this strategy demonstrated the success of the program in effectively identifying crack-like structures and quantifying characteristics, such as surface area and volume. The results demonstrated that the source of aggregate has a very significant impact on the amount of internal cracking, even when the mineralogical characteristics remain very similar. River gravels, for instance, were found to contain significantly higher levels of internal cracking than quarried stone aggregates of the same mineralogical type.
Collapse
Affiliation(s)
- Tyler Oesch
- Bundesanstalt für Materialforschung und–prüfung, BAM (Federal Institute for Materials Research and Testing), 12205 Berlin, Germany; (F.W.); (G.B.)
- Correspondence:
| | - Frank Weise
- Bundesanstalt für Materialforschung und–prüfung, BAM (Federal Institute for Materials Research and Testing), 12205 Berlin, Germany; (F.W.); (G.B.)
| | - Giovanni Bruno
- Bundesanstalt für Materialforschung und–prüfung, BAM (Federal Institute for Materials Research and Testing), 12205 Berlin, Germany; (F.W.); (G.B.)
- Institute of Physics and Astronomy, University of Potsdam, Karl-Liebknecht-Str.24-25, 14476 Potsdam, Germany
| |
Collapse
|
44
|
Xu X, Yang H. Vision Measurement of Tunnel Structures with Robust Modelling and Deep Learning Algorithms. Sensors (Basel) 2020; 20:E4945. [PMID: 32882882 DOI: 10.3390/s20174945] [Citation(s) in RCA: 33] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/13/2020] [Revised: 08/24/2020] [Accepted: 08/25/2020] [Indexed: 11/17/2022]
Abstract
The health monitoring of tunnel structures is vital to the safe operation of railway transportation systems. With the increasing mileage of tunnels, regular inspection and health monitoring are urgently demanded for the tunnel structures, especially for information regarding deformation and damage. However, traditional methods of tunnel inspection are time-consuming, expensive and highly dependent on human subjectivity. In this paper, an automatic tunnel monitoring method is investigated based on image data which is collected through the moving vision measurement unit consisting of camera array. Furthermore, geometric modelling and crack inspection algorithms are proposed where a robust three-dimensional tunnel model is reconstructed utilizing a B-spline method and crack identification is conducted by means of a Mask R-CNN network. The innovation of this investigation is that we combine the robust modelling which could be applied for the deformation analysis and the crack detection where a deep learning method is employed to recognize the tunnel cracks intelligently based on image sensors. In this study, experiments were conducted on a subway tunnel structure several kilometers long, and a robust three-dimensional model is generated and the cracks are identified automatically with the image data. The superiority of this proposal is that the comprehensive information of geometry deformation and crack damage can ensure the reliability and improve the accuracy of health monitoring.
Collapse
|
45
|
Wang Z, Yang J, Jiang H, Fan X. CNN Training with Twenty Samples for Crack Detection via Data Augmentation. Sensors (Basel) 2020; 20:E4849. [PMID: 32867223 DOI: 10.3390/s20174849] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/01/2020] [Revised: 08/20/2020] [Accepted: 08/24/2020] [Indexed: 11/17/2022]
Abstract
The excellent generalization ability of deep learning methods, e.g., convolutional neural networks (CNNs), depends on a large amount of training data, which is difficult to obtain in industrial practices. Data augmentation is regarded commonly as an effective strategy to address this problem. In this paper, we attempt to construct a crack detector based on CNN with twenty images via a two-stage data augmentation method. In detail, nine data augmentation methods are compared for crack detection in the model training, respectively. As a result, the rotation method outperforms these methods for augmentation, and by an in-depth exploration of the rotation method, the performance of the detector is further improved. Furthermore, data augmentation is also applied in the inference process to improve the recall of trained models. The identical object has more chances to be detected in the series of augmented images. This trick is essentially a performance–resource trade-off. For more improvement with limited resources, the greedy algorithm is adopted for searching a better combination of data augmentation. The results show that the crack detectors trained on the small dataset are significantly improved via the proposed two-stage data augmentation. Specifically, using 20 images for training, recall in detecting the cracks achieves 96% and Fext(0.8), which is a variant of F-score for crack detection, achieves 91.18%.
Collapse
|
46
|
Billah UH, La HM, Tavakkoli A. Deep Learning-Based Feature Silencing for Accurate Concrete Crack Detection. Sensors (Basel) 2020; 20:E4403. [PMID: 32784557 PMCID: PMC7472489 DOI: 10.3390/s20164403] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/20/2020] [Revised: 08/02/2020] [Accepted: 08/05/2020] [Indexed: 11/30/2022]
Abstract
An autonomous concrete crack inspection system is necessary for preventing hazardous incidents arising from deteriorated concrete surfaces. In this paper, we present a concrete crack detection framework to aid the process of automated inspection. The proposed approach employs a deep convolutional neural network architecture for crack segmentation, while addressing the effect of gradient vanishing problem. A feature silencing module is incorporated in the proposed framework, capable of eliminating non-discriminative feature maps from the network to improve performance. Experimental results support the benefit of incorporating feature silencing within a convolutional neural network architecture for improving the network's robustness, sensitivity, and specificity. An added benefit of the proposed architecture is its ability to accommodate for the trade-off between specificity (positive class detection accuracy) and sensitivity (negative class detection accuracy) with respect to the target application. Furthermore, the proposed framework achieves a high precision rate and processing time than the state-of-the-art crack detection architectures.
Collapse
|
47
|
Sawicki B, Bassil A, Brühwiler E, Chapeleau X, Leduc D. Detection and Measurement of Matrix Discontinuities in UHPFRC by Means of Distributed Fiber Optics Sensing. Sensors (Basel) 2020; 20:s20143883. [PMID: 32664707 PMCID: PMC7412061 DOI: 10.3390/s20143883] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/13/2020] [Revised: 07/06/2020] [Accepted: 07/07/2020] [Indexed: 11/22/2022]
Abstract
Following the significant improvement in their properties during the last decade, Distributed Fiber Optics sensing (DFOs) techniques are nowadays implemented for industrial use in the context of Structural Health Monitoring (SHM). While these techniques have formed an undeniable asset for the health monitoring of concrete structures, their performance should be validated for novel structural materials including Ultra High Performance Fiber Reinforced Cementitious composites (UHPFRC). In this study, a full scale UHPFRC beam was instrumented with DFOs, Digital Image Correlation (DIC) and extensometers. The performances of these three measurement techniques in terms of strain measurement as well as crack detection and localization are compared. A method for the measurement of opening and closing of localized fictitious cracks in UHPFRC using the Optical Backscattering Reflectometry (OBR) technique is verified. Moreover, the use of correct combination of DFO sensors allows precise detection of microcracks as well as monitoring of fictitious cracks’ opening. The recommendations regarding use of various SHM methods for UHPFRC structures are given.
Collapse
Affiliation(s)
- Bartłomiej Sawicki
- Laboratory of Maintenance and Safety of Structures, Structural Engineering Institute, Swiss Federal Institute of Technology (EPFL), CH-1015 Lausanne, Switzerland;
- Correspondence:
| | - Antoine Bassil
- COSYS-SII, I4S Team (Inria), Univ Gustave Eiffel, IFSTTAR, F-44344 Bouguenais, France; (A.B.); (X.C.)
- Quadric, Artelia Group, 14 Porte de Grand Lyon, F-01700 Neyron, France
| | - Eugen Brühwiler
- Laboratory of Maintenance and Safety of Structures, Structural Engineering Institute, Swiss Federal Institute of Technology (EPFL), CH-1015 Lausanne, Switzerland;
| | - Xavier Chapeleau
- COSYS-SII, I4S Team (Inria), Univ Gustave Eiffel, IFSTTAR, F-44344 Bouguenais, France; (A.B.); (X.C.)
| | | |
Collapse
|
48
|
Azimi M, Eslamlou AD, Pekcan G. Data-Driven Structural Health Monitoring and Damage Detection through Deep Learning: State-of-the-Art Review. Sensors (Basel) 2020; 20:E2778. [PMID: 32414205 DOI: 10.3390/s20102778] [Citation(s) in RCA: 122] [Impact Index Per Article: 30.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/14/2020] [Revised: 05/06/2020] [Accepted: 05/08/2020] [Indexed: 11/16/2022]
Abstract
Data-driven methods in structural health monitoring (SHM) is gaining popularity due to recent technological advancements in sensors, as well as high-speed internet and cloud-based computation. Since the introduction of deep learning (DL) in civil engineering, particularly in SHM, this emerging and promising tool has attracted significant attention among researchers. The main goal of this paper is to review the latest publications in SHM using emerging DL-based methods and provide readers with an overall understanding of various SHM applications. After a brief introduction, an overview of various DL methods (e.g., deep neural networks, transfer learning, etc.) is presented. The procedure and application of vibration-based, vision-based monitoring, along with some of the recent technologies used for SHM, such as sensors, unmanned aerial vehicles (UAVs), etc. are discussed. The review concludes with prospects and potential limitations of DL-based methods in SHM applications.
Collapse
|
49
|
Pfingstl S, Steiner M, Tusch O, Zimmermann M. Crack Detection Zones: Computation and Validation. Sensors (Basel) 2020; 20:s20092568. [PMID: 32366002 PMCID: PMC7249158 DOI: 10.3390/s20092568] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/13/2020] [Revised: 04/17/2020] [Accepted: 04/29/2020] [Indexed: 11/17/2022]
Abstract
During the development of aerospace structures, typically many fatigue tests are conducted. During these tests, much effort is put into inspections in order to detect the onset of failure before complete failure. Strain sensor data may be used to reduce inspection effort. For this, a sufficient number of sensors need to be positioned appropriately to collect the relevant data. In order to minimize cost and effort associated with sensor positioning, the method proposed here aims at minimizing the number of necessary strain sensors while positioning them such that fatigue-induced damage can still be detected before complete failure. A suitable detection criterion is established as the relative change of strain amplitudes under cyclic loading. Then, the space of all possible crack lengths is explored. The regions where the detection criterion is satisfied before complete failure occurs are assembled into so-called detection zones. One sensor in this zone is sufficient to detect criticality. The applicability of the approach is demonstrated on a representative airplane structure that resembles a lower wing section. The method shows that four fatigue critical spots can be monitored using only one strain sensor in a non-intuitive position. Furthermore, we discuss two different strain measures for crack detection. The results of this paper can be used for reliable structural health monitoring using a minimum number of sensors.
Collapse
Affiliation(s)
- Simon Pfingstl
- Laboratory for Product Development and Lightweight Design, Technical University of Munich, Boltzmannstr. 15, 85748 Garching, Germany; (M.S.); (M.Z.)
- Correspondence:
| | - Martin Steiner
- Laboratory for Product Development and Lightweight Design, Technical University of Munich, Boltzmannstr. 15, 85748 Garching, Germany; (M.S.); (M.Z.)
| | - Olaf Tusch
- iABG, Einsteinstr. 20, 85521 Ottobrunn, Germany;
| | - Markus Zimmermann
- Laboratory for Product Development and Lightweight Design, Technical University of Munich, Boltzmannstr. 15, 85748 Garching, Germany; (M.S.); (M.Z.)
| |
Collapse
|
50
|
Feng C, Zhang H, Wang H, Wang S, Li Y. Automatic Pixel-Level Crack Detection on Dam Surface Using Deep Convolutional Network. Sensors (Basel) 2020; 20:s20072069. [PMID: 32272652 PMCID: PMC7180706 DOI: 10.3390/s20072069] [Citation(s) in RCA: 35] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/17/2020] [Revised: 03/13/2020] [Accepted: 04/02/2020] [Indexed: 11/16/2022]
Abstract
Crack detection on dam surfaces is an important task for safe inspection of hydropower stations. More and more object detection methods based on deep learning are being applied to crack detection. However, most of the methods can only achieve the classification and rough location of cracks. Pixel-level crack detection can provide more intuitive and accurate detection results for dam health assessment. To realize pixel-level crack detection, a method of crack detection on dam surface (CDDS) using deep convolution network is proposed. First, we use an unmanned aerial vehicle (UAV) to collect dam surface images along a predetermined trajectory. Second, raw images are cropped. Then crack regions are manually labelled on cropped images to create the crack dataset, and the architecture of CDDS network is designed. Finally, the CDDS network is trained, validated and tested using the crack dataset. To validate the performance of the CDDS network, the predicted results are compared with ResNet152-based, SegNet, UNet and fully convolutional network (FCN). In terms of crack segmentation, the recall, precision, F-measure and IoU are 80.45%, 80.31%, 79.16%, and 66.76%. The results on test dataset show that the CDDS network has better performance for crack detection of dam surfaces.
Collapse
Affiliation(s)
- Chuncheng Feng
- School of Information Engineering, Southwest University of Science and Technology, Mianyang 621000, China; (C.F.); (H.Z.)
| | - Hua Zhang
- School of Information Engineering, Southwest University of Science and Technology, Mianyang 621000, China; (C.F.); (H.Z.)
| | - Haoran Wang
- State Key Laboratory of Hydroscience and Engineering, Tsinghua University, Beijing 100084, China
- Correspondence:
| | - Shuang Wang
- Sichuan Energy Internet Research Institute, Tsinghua University, Chengdu 610000, China; (S.W.); (Y.L.)
| | - Yonglong Li
- Sichuan Energy Internet Research Institute, Tsinghua University, Chengdu 610000, China; (S.W.); (Y.L.)
| |
Collapse
|