1
|
Saini A, Greenhall JJ, Davis ES, Pantea C. On the Generalizability of Time-of-Flight Convolutional Neural Networks for Noninvasive Acoustic Measurements. SENSORS (BASEL, SWITZERLAND) 2024; 24:3580. [PMID: 38894370 PMCID: PMC11175346 DOI: 10.3390/s24113580] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/08/2024] [Revised: 05/29/2024] [Accepted: 05/31/2024] [Indexed: 06/21/2024]
Abstract
Bulk wave acoustic time-of-flight (ToF) measurements in pipes and closed containers can be hindered by guided waves with similar arrival times propagating in the container wall, especially when a low excitation frequency is used to mitigate sound attenuation from the material. Convolutional neural networks (CNNs) have emerged as a new paradigm for obtaining accurate ToF in non-destructive evaluation (NDE) and have been demonstrated for such complicated conditions. However, the generalizability of ToF-CNNs has not been investigated. In this work, we analyze the generalizability of the ToF-CNN for broader applications, given limited training data. We first investigate the CNN performance with respect to training dataset size and different training data and test data parameters (container dimensions and material properties). Furthermore, we perform a series of tests to understand the distribution of data parameters that need to be incorporated in training for enhanced model generalizability. This is investigated by training the model on a set of small- and large-container datasets regardless of the test data. We observe that the quantity of data partitioned for training must be of a good representation of the entire sets and sufficient to span through the input space. The result of the network also shows that the learning model with the training data on small containers delivers a sufficiently stable result on different feature interactions compared to the learning model with the training data on large containers. To check the robustness of the model, we tested the trained model to predict the ToF of different sound speed mediums, which shows excellent accuracy. Furthermore, to mimic real experimental scenarios, data are augmented by adding noise. We envision that the proposed approach will extend the applications of CNNs for ToF prediction in a broader range.
Collapse
Affiliation(s)
- Abhishek Saini
- Los Alamos National Laboratory, Los Alamos, NM 87544, USA (E.S.D.)
| | | | | | | |
Collapse
|
2
|
Liu L, Liu W, Teng D, Xiang Y, Xuan FZ. A multiscale residual U-net architecture for super-resolution ultrasonic phased array imaging from full matrix capture data. THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2023; 154:2044-2054. [PMID: 37782121 DOI: 10.1121/10.0021171] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Accepted: 09/12/2023] [Indexed: 10/03/2023]
Abstract
Ultrasonic phased array imaging using full-matrix capture (FMC) has raised great interest among various communities, including the nondestructive testing community, as it makes full use of the echo space to provide preferable visualization performance of inhomogeneities. The conventional way of FMC data postprocessing for imaging is through beamforming approaches, such as delay-and-sum, which suffers from limited imaging resolution and contrast-to-noise ratio. To tackle these difficulties, we propose a deep learning (DL)-based image forming approach, termed FMC-Net, to reconstruct high-quality ultrasonic images directly from FMC data. Benefitting from the remarkable capability of DL to approximate nonlinear mapping, the developed FMC-Net automatically models the underlying nonlinear wave-matter interactions; thus, it is trained end-to-end to link the FMC data to the spatial distribution of the acoustic scattering coefficient of the inspected object. Specifically, the FMC-Net is an encoder-decoder architecture composed of multiscale residual modules that make local perception at different scales for the transmitter-receiver pair combinations in the FMC data. We numerically and experimentally compared the DL imaging results to the total focusing method and wavenumber algorithm and demonstrated that the proposed FMC-Net remarkably outperforms conventional methods in terms of exceeding resolution limit and visualizing subwavelength defects. It is expected that the proposed DL approach can benefit a variety of ultrasonic array imaging applications.
Collapse
Affiliation(s)
- Lishuai Liu
- Shanghai Key Laboratory of Intelligent Sensing and Detection Technology, School of Mechanical and Power Engineering, East China University of Science and Technology, Shanghai 200237, China
| | - Wen Liu
- Shanghai Key Laboratory of Intelligent Sensing and Detection Technology, School of Mechanical and Power Engineering, East China University of Science and Technology, Shanghai 200237, China
| | - Da Teng
- Shanghai Key Laboratory of Intelligent Sensing and Detection Technology, School of Mechanical and Power Engineering, East China University of Science and Technology, Shanghai 200237, China
| | - Yanxun Xiang
- Shanghai Key Laboratory of Intelligent Sensing and Detection Technology, School of Mechanical and Power Engineering, East China University of Science and Technology, Shanghai 200237, China
| | - Fu-Zhen Xuan
- Shanghai Key Laboratory of Intelligent Sensing and Detection Technology, School of Mechanical and Power Engineering, East China University of Science and Technology, Shanghai 200237, China
| |
Collapse
|
3
|
Sun H, Ramuhalli P, Jacob RE. Machine learning for ultrasonic nondestructive examination of welding defects: A systematic review. ULTRASONICS 2023; 127:106854. [PMID: 36215762 DOI: 10.1016/j.ultras.2022.106854] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/22/2022] [Revised: 08/29/2022] [Accepted: 09/20/2022] [Indexed: 06/16/2023]
Abstract
Recent years have seen a substantial increase in the application of machine learning (ML) for automated analysis of nondestructive examination (NDE) data. One of the applications of interest is the use of ML for the analysis of data from in-service inspection of welds in nuclear power and other industries. These types of inspections are performed in accordance with criteria described in the ASME Boiler and Pressure Vessel Code and require the use of reliable NDE techniques. The rapid growth in ML methods and the diversity of possible approaches indicate a need to assess the current capabilities of ML and automated data analysis for NDE and identify any gaps or shortcomings in current ML technologies as applied to the automated analysis of NDE data. In particular, there is a need to determine the impact of ML on the NDE reliability. This paper discusses the findings from a literature survey on the current state of ML for the automated analysis of data from ultrasonic NDE of weld flaws. It discusses an overview of ultrasonic NDE as used for weld inspections in nuclear power and other industries. Data sets and ML models used in the literature are summarized, along with a generally applicable workflow for ML. Findings on the capabilities, limitations and potential gaps in feature selection, data selection, and ML model optimization are discussed. The paper identified several needs for quantifying and validating the performance of ML methods for ultrasonic NDE, including the need for common data sets.
Collapse
Affiliation(s)
- Hongbin Sun
- Oak Ridge National Laboratory, 1 Bethel Valley Rd, Oak Ridge, TN 37830, USA.
| | - Pradeep Ramuhalli
- Oak Ridge National Laboratory, 1 Bethel Valley Rd, Oak Ridge, TN 37830, USA.
| | - Richard E Jacob
- Pacific Northwest National Laboratory, Richland, WA 99352, USA.
| |
Collapse
|
4
|
Bowler AL, Pound MP, Watson NJ. A review of ultrasonic sensing and machine learning methods to monitor industrial processes. ULTRASONICS 2022; 124:106776. [PMID: 35653984 DOI: 10.1016/j.ultras.2022.106776] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/18/2022] [Revised: 04/29/2022] [Accepted: 05/26/2022] [Indexed: 06/15/2023]
Abstract
Supervised machine learning techniques are increasingly being combined with ultrasonic sensor measurements owing to their strong performance. These techniques also offer advantages over calibration procedures of more complex fitting, improved generalisation, reduced development time, ability for continuous retraining, and the correlation of sensor data to important process information. However, their implementation requires expertise to extract and select appropriate features from the sensor measurements as model inputs, select the type of machine learning algorithm to use, and find a suitable set of model hyperparameters. The aim of this article is to facilitate implementation of machine learning techniques in combination with ultrasonic measurements for in-line and on-line monitoring of industrial processes and other similar applications. The article first reviews the use of ultrasonic sensors for monitoring processes, before reviewing the combination of ultrasonic measurements and machine learning. We include literature from other sectors such as structural health monitoring. This review covers feature extraction, feature selection, algorithm choice, hyperparameter selection, data augmentation, domain adaptation, semi-supervised learning and machine learning interpretability. Finally, recommendations for applying machine learning to the reviewed processes are made.
Collapse
Affiliation(s)
- Alexander L Bowler
- Food, Water, Waste Research Group, Faculty of Engineering, University of Nottingham, University Park, Nottingham NG7 2RD, UK
| | - Michael P Pound
- School of Computer Science, Jubilee Campus, University of Nottingham, Nottingham NG8 1BB, UK
| | - Nicholas J Watson
- Food, Water, Waste Research Group, Faculty of Engineering, University of Nottingham, University Park, Nottingham NG7 2RD, UK.
| |
Collapse
|
5
|
Perioperative Nursing Management of Patients Undergoing Laparoscopic Ovarian Cystectomy Guided by Ultrasound Imaging under Intelligent Algorithm. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2022; 2022:7193005. [PMID: 35572836 PMCID: PMC9095400 DOI: 10.1155/2022/7193005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/14/2022] [Revised: 04/03/2022] [Accepted: 04/05/2022] [Indexed: 11/18/2022]
Abstract
This study was aimed at exploring the application value of ultrasonic imaging-guided laparoscopic ovarian cystectomy after denoising by intelligent algorithms in perioperative nursing intervention of patients. In this study, convolutional downsampling was introduced to the UNet model, based on which the residual structure and Recon module were added to improve the UNet denoising model, which was applied to 100 patients who underwent ultrasound imaging-guided laparoscopic ovarian cystectomy. The patients were grouped into a control group receiving conventional nursing and an experimental group receiving perioperative nursing management. The various experimental indicators were comprehensively evaluated. The results revealed that after denoising using the improved UNet model, the ultrasound image showed no unnecessary interference noise, and the image clarity was significantly improved. In the experimental group, the operation time was 55.45 ± 6.13 days, the intraoperative blood loss was 71.52 ± 9.87 days, the postoperative exhaust time was 1.9 ± 0.73 days, the time to get out of bed was 1.2 ± 0.85 days, the complication rate was 8%, the hospitalization time was 7.3 ± 2.6 days, and the nursing satisfaction rate reached 98%. All above aspects were significantly better than those of the control group, and the differences were statistically significant (P < 0.05). In short, the improved UNet denoising model can effectively eliminate the interference noise in ultrasound and restore high-quality ultrasound images. Perioperative nursing intervention can accelerate the recovery speed of patients, reduce the complication rate, and shorten the length of stay in hospital. Therefore, it was worthy of being widely used in clinical nursing.
Collapse
|
6
|
Ha JM, Seung HM, Choi W. Autoencoder-based detection of near-surface defects in ultrasonic testing. ULTRASONICS 2022; 119:106637. [PMID: 34798565 DOI: 10.1016/j.ultras.2021.106637] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/15/2021] [Revised: 10/19/2021] [Accepted: 11/01/2021] [Indexed: 06/13/2023]
Abstract
Defect detection during pulse-echo ultrasonic testing (UT) is challenging when defects are located in a dead zone where the echoes from the defects are overshadowed by disturbances from the initial ringing signal of the UT transducer. The time-gate method is one of the most widely used approaches in UT to filter out such unwanted components, but defects in the dead zone are virtually impossible to detect using conventional methods. This paper proposes an autoencoder-based end-to-end ultrasonic testing method to detect defects within the dead zone of a transducer. The autoencoder is designed to predict the normal behavior of ultrasonic signals including disturbances, thus enabling the identification of even subtle deviations made by defects. To advance the performance of the autoencoder further with a limited amount of training data, a two-step training procedure is presented, involving training using pure normal signals measured from a defect-free specimen and re-training using pseudo-normal samples identified by the autoencoder with a smart thresholding strategy. This two-step procedure enables us to develop an adaptive autoencoder model that can be effectively employed to process the newly measured ultrasonic signals. For a demonstration of the proposed method, UT-based B-scan inspections of aluminum blocks with near-surface defects are conducted. The results suggest that the proposed method outperforms the conventional gate-based inspection approach with regard to its ability to identify the sizes and locations of near-surface defects.
Collapse
Affiliation(s)
- Jong Moon Ha
- AI Metamaterial Research Team, Korea Research Institute of Standards and Science (KRISS), Gajeong-ro 267, Daejeon 34113, Republic of Korea
| | - Hong Min Seung
- AI Metamaterial Research Team, Korea Research Institute of Standards and Science (KRISS), Gajeong-ro 267, Daejeon 34113, Republic of Korea; Department of Science of Measurement, University of Science and Technology (UST), Gajeong-ro 217, Yuseong-gu, Daejeon 34113, Republic of Korea
| | - Wonjae Choi
- AI Metamaterial Research Team, Korea Research Institute of Standards and Science (KRISS), Gajeong-ro 267, Daejeon 34113, Republic of Korea; Department of Science of Measurement, University of Science and Technology (UST), Gajeong-ro 217, Yuseong-gu, Daejeon 34113, Republic of Korea.
| |
Collapse
|
7
|
Deep Learning-Based Ultrasonic Testing to Evaluate the Porosity of Additively Manufactured Parts with Rough Surfaces. METALS 2021. [DOI: 10.3390/met11020290] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Ultrasonic testing (UT) has been actively studied to evaluate the porosity of additively manufactured parts. Currently, ultrasonic measurements of as-deposited parts with a rough surface remain problematic because the surface lowers the signal-to-noise ratio (SNR) of ultrasonic signals, which degrades the UT performance. In this study, various deep learning (DL) techniques that can effectively extract the features of defects, even from signals with a low SNR, were applied to UT, and their performance in terms of the porosity evaluation of additively manufactured parts with rough surfaces was investigated. Experimentally, the effects of the processing conditions of additive manufacturing on the resulting porosity were first analyzed using both optical and scanning acoustic microscopy. Second, convolutional neural network (CNN), deep neural network, and multi-layer perceptron models were trained using time-domain ultrasonic signals obtained from additively manufactured specimens with various levels of porosity and surface roughness. The experimental results showed that all the models could evaluate porosity accurately, even that of the as-deposited specimens. In particular, the CNN delivered the best performance at 94.5%. However, conventional UT could not be applied because of the low SNR. The generalization performance when using newly manufactured as-deposited specimens was high at 90%.
Collapse
|