Data-Driven Structural Health Monitoring and Damage Detection through Deep Learning: State-of-the-Art Review

Optimal Sensor Placement for Enhanced Efficiency in Structural Health Monitoring of Medium-Rise Buildings

Output-only modal analysis using ambient vibration testing is ubiquitous for the monitoring of structural systems, especially for civil engineering structures such as buildings and bridges. Nonetheless, the instrumented nodes for large-scale structural systems need to cover a significant portion of the spatial volume of the test structure to obtain accurate global modal information. This requires considerable time and resources, which can be challenging in large-scale projects, such as the seismic vulnerability assessment over a large number of facilities. In many instances, a simple center-line (stairwell case) topology is generally used due to time, logistical, and economic constraints. The latter, though a fast technique, cannot provide complete modal information, especially for torsional modes. In this research, corner-line instrumented nodes layouts using only a reference and a roving sensor are proposed, which overcome this issue and can provide maximum modal information similar to that from 3D topologies for medium-rise buildings. Parametric studies are performed to identify the most appropriate locations for sensor placement at each floor of a medium-rise building. The results indicate that corner locations at each floor are optimal. The proposed procedure is validated through field experiments on two medium-rise buildings.

Graph Feature Refinement and Fusion in Transformer for Structural Damage Detection

Structural damage detection is of significance for maintaining the structural health. Currently, data-driven deep learning approaches have emerged as a highly promising research field. However, little progress has been made in studying the relationship between the global and local information of structural response data. In this paper, we have presented an innovative Convolutional Enhancement and Graph Features Fusion in Transformer (CGsformer) network for structural damage detection. The proposed CGsformer network introduces an innovative approach for hierarchical learning from global to local information to extract acceleration response signal features for structural damage representation. The key advantage of this network is the integration of a graph convolutional network in the learning process, which enables the construction of a graph structure for global features. By incorporating node learning, the graph convolutional network filters out noise in the global features, thereby facilitating the extraction to more effective local features. In the verification based on the experimental data of four-story steel frame model experiment data and IASC-ASCE benchmark structure simulated data, the CGsformer network achieved damage identification accuracies of 92.44% and 96.71%, respectively. It surpassed the existing traditional damage detection methods based on deep learning. Notably, the model demonstrates good robustness under noisy conditions.

Bridging Convolutional Neural Networks and Transformers for Efficient Crack Detection in Concrete Building Structures

Detecting cracks in building structures is an essential practice that ensures safety, promotes longevity, and maintains the economic value of the built environment. In the past, machine learning (ML) and deep learning (DL) techniques have been used to enhance classification accuracy. However, the conventional CNN (convolutional neural network) methods incur high computational costs owing to their extensive number of trainable parameters and tend to extract only high-dimensional shallow features that may not comprehensively represent crack characteristics. We proposed a novel convolution and composite attention transformer network (CCTNet) model to address these issues. CCTNet enhances crack identification by processing more input pixels and combining convolution channel attention with window-based self-attention mechanisms. This dual approach aims to leverage the localized feature extraction capabilities of CNNs with the global contextual understanding afforded by self-attention mechanisms. Additionally, we applied an improved cross-attention module within CCTNet to increase the interaction and integration of features across adjacent windows. The performance of CCTNet on the Historical Building Crack2019, SDTNET2018, and proposed DS3 has a precision of 98.60%, 98.93%, and 99.33%, respectively. Furthermore, the training validation loss of the proposed model is close to zero. In addition, the AUC (area under the curve) is 0.99 and 0.98 for the Historical Building Crack2019 and SDTNET2018, respectively. CCTNet not only outperforms existing methodologies but also sets a new standard for the accurate, efficient, and reliable detection of cracks in building structures.

Smartphone Prospects in Bridge Structural Health Monitoring, a Literature Review

Bridges are critical components of transportation networks, and their conditions have effects on societal well-being, the economy, and the environment. Automation needs in inspections and maintenance have made structural health monitoring (SHM) systems a key research pillar to assess bridge safety/health. The last decade brought a boom in innovative bridge SHM applications with the rise in next-generation smart and mobile technologies. A key advancement within this direction is smartphones with their sensory usage as SHM devices. This focused review reports recent advances in bridge SHM backed by smartphone sensor technologies and provides case studies on bridge SHM applications. The review includes model-based and data-driven SHM prospects utilizing smartphones as the sensing and acquisition portal and conveys three distinct messages in terms of the technological domain and level of mobility: (i) vibration-based dynamic identification and damage-detection approaches; (ii) deformation and condition monitoring empowered by computer vision-based measurement capabilities; (iii) drive-by or pedestrianized bridge monitoring approaches, and miscellaneous SHM applications with unconventional/emerging technological features and new research domains. The review is intended to bring together bridge engineering, SHM, and sensor technology audiences with decade-long multidisciplinary experience observed within the smartphone-based SHM theme and presents exemplary cases referring to a variety of levels of mobility.

YOLOX-DG robotic detection systems for large-scale underwater concrete structures

Large-scale complex underwater concrete structures have structural damage and the traditional damage detection method mostly uses manual identification, which is inaccurate and inefficient. Therefore, robotic detection systems have been proposed to replace manual identification for underwater concrete structures in ocean engineering. However, the highly corrosive and disruptive environment of the ocean poses great difficulties for the application. Here, we develop a manta ray-inspired underwater robot with well controllability to establish the damage datasets of underwater concrete structures, proposing the YOLOX-DG algorithm to improve the damage detection accuracy, and integrating the model into the robotic detection systems for underwater concrete damages. Eventually, the system is used for ocean testing in real applications (i.e., underwater marine harbors around the East China Sea), and satisfactory detection performance is obtained. The reported manta ray-inspired robotic detection system can be used to accurately monitor and analyze the underwater regions.

Physics-informed deep learning for structural vibration identification and its application on a benchmark structure

Structural vibration identification is an important task in civil engineering that is based on processing measured data from structural monitoring. However, predicting the response at unsensed locations based on limited sensor data can be challenging. Deep learning (DL) methods have shown promise in vibration data feature extraction and generation, but they struggle to capture the underlying physics laws and dynamic equations that govern vibration identification. This paper presents a novel framework called physics-informed deep learning (PIDL) that combines deep generative networks with structural dynamics knowledge to address these challenges. The PIDL framework consists of a data-driven convolutional neural network for structural excitation identification and a physics-informed variational autoencoder for explicit time-domain (ETD) vibration analysis with the generated unit impulse response (UIR) signal of the measured structure. The proposed framework is evaluated on a benchmark structure for structural health monitoring, demonstrating its effectiveness in extracting physics-related dynamics features and accurately identifying excitation signals and latent physics parameters across different damage patterns. Additionally, the incorporation of an ETD method-aided convolution function in the loss function aligns the generated UIR signals with the dynamic properties of the measured structure. Compared with conventional DL-based vibration analysis methods, the PIDL framework offers improved accuracy and reliability by integrating structural dynamics knowledge. This study contributes to the advancement of structural vibration identification and showcases the potential of the PIDL framework in civil structure monitoring applications. This article is part of the theme issue 'Physics-informed machine learning and its structural integrity applications (Part 2)'.

Seismic assessment of bridges through structural health monitoring: a state-of-the-art review

The present work offers a comprehensive overview of methods related to condition assessment of bridges through Structural Health Monitoring (SHM) procedures, with a particular interest on aspects of seismic assessment. Established techniques pertaining to different levels of the SHM hierarchy, reflecting increasing detail and complexity, are first outlined. A significant portion of this review work is then devoted to the overview of computational intelligence schemes across various aspects of bridge condition assessment, including sensor placement and health tracking. The paper concludes with illustrative examples of two long-span suspension bridges, in which several instrumentation aspects and assessments of seismic response issues are discussed.

A New Method to Predict Damage to Composite Structures Using Convolutional Neural Networks

To reduce the cost of developing composite aeronautical structures, manufacturers and university researchers are increasingly using "virtual testing" methods. Then, finite element methods (FEMs) are intensively used to calculate mechanical behavior and to predict the damage to fiber-reinforced polymer (FRP) composites under impact loading, which is a crucial design aspect for aeronautical composite structures. But these FEMs require a lot of knowledge and a significant number of IT resources to run. Therefore, artificial intelligence could be an interesting way of sizing composites in terms of impact damage tolerance. In this research, the authors propose a methodology and deep learning-based approach to predict impact damage to composites. The data are both collected from the literature and created using an impact simulation performed using an FEM. The data augmentation method is also proposed to increase the data number from 149 to 2725. Firstly, a CNN model is built and optimized, and secondly, an aggregation of two CNN architectures is proposed. The results show that the use of an aggregation of two CNNs provides better performance than a single CNN. Finally, the aggregated CNN model prediction demonstrates the potential for CNN models to accelerate composite design by showing a 0.15 mm precision for all the length measurements, an average delaminated surface error of 56 mm2, and an error rate of 7% for the prediction of the presence of delamination.

Special Issue: Emerging Approaches for the Performance Assessment and Prediction of Cement-Based Materials

The current Special Issue, entitled "Emerging Approaches for Performance Assessment and Prediction of Cement-Based Materials", aims to showcase cutting-edge research into the technologies, smart sensing systems, and tools for assessing and predicting the performance of cement-based materials [...].

Deep Learning for Structural Health Monitoring: Data, Algorithms, Applications, Challenges, and Trends

Environmental effects may lead to cracking, stiffness loss, brace damage, and other damages in bridges, frame structures, buildings, etc. Structural Health Monitoring (SHM) technology could prevent catastrophic events by detecting damage early. In recent years, Deep Learning (DL) has developed rapidly and has been applied to SHM to detect, localize, and evaluate diverse damages through efficient feature extraction. This paper analyzes 337 articles through a systematic literature review to investigate the application of DL for SHM in the operation and maintenance phase of facilities from three perspectives: data, DL algorithms, and applications. Firstly, the data types in SHM and the corresponding collection methods are summarized and analyzed. The most common data types are vibration signals and images, accounting for 80% of the literature studied. Secondly, the popular DL algorithm types and application areas are reviewed, of which CNN accounts for 60%. Then, this article carefully analyzes the specific functions of DL application for SHM based on the facility's characteristics. The most scrutinized study focused on cracks, accounting for 30 percent of research papers. Finally, challenges and trends in applying DL for SHM are discussed. Among the trends, the Structural Health Monitoring Digital Twin (SHMDT) model framework is suggested in response to the trend of strong coupling between SHM technology and Digital Twin (DT), which can advance the digitalization, visualization, and intelligent management of SHM.

Automated Prediction of Crack Propagation Using H2O AutoML

Crack propagation is a critical phenomenon in materials science and engineering, significantly impacting structural integrity, reliability, and safety across various applications. The accurate prediction of crack propagation behavior is paramount for ensuring the performance and durability of engineering components, as extensively explored in prior research. Nevertheless, there is a pressing demand for automated models capable of efficiently and precisely forecasting crack propagation. In this study, we address this need by developing a machine learning-based automated model using the powerful H2O library. This model aims to accurately predict crack propagation behavior in various materials by analyzing intricate crack patterns and delivering reliable predictions. To achieve this, we employed a comprehensive dataset derived from measured instances of crack propagation in Acrylonitrile Butadiene Styrene (ABS) specimens. Rigorous evaluation metrics, including Mean Absolute Error (MAE), Root Mean Square Error (RMSE), and R-squared (R2) values, were applied to assess the model's predictive accuracy. Cross-validation techniques were utilized to ensure its robustness and generalizability across diverse datasets. Our results underscore the automated model's remarkable accuracy and reliability in predicting crack propagation. This study not only highlights the immense potential of the H2O library as a valuable tool for structural health monitoring but also advocates for the broader adoption of Automated Machine Learning (AutoML) solutions in engineering applications. In addition to presenting these findings, we define H2O as a powerful machine learning library and AutoML as Automated Machine Learning to ensure clarity and understanding for readers unfamiliar with these terms. This research not only demonstrates the significance of AutoML in future-proofing our approach to structural integrity and safety but also emphasizes the need for comprehensive reporting and understanding in scientific discourse.

Influence of Smart Sensors on Structural Health Monitoring Systems and Future Asset Management Practices

Recent developments in networked and smart sensors have significantly changed the way Structural Health Monitoring (SHM) and asset management are being carried out. Since the sensor networks continuously provide real-time data from the structure being monitored, they constitute a more realistic image of the actual status of the structure where the maintenance or repair work can be scheduled based on real requirements. This review is aimed at providing a wealth of knowledge from the working principles of sensors commonly used in SHM, to artificial-intelligence-based digital twin systems used in SHM and proposes a new asset management framework. The way this paper is structured suits researchers and practicing experts both in the fields of sensors as well as in asset management equally.

A brief introductory review to deep generative models for civil structural health monitoring

The use of deep generative models (DGMs) such as variational autoencoders, autoregressive models, flow-based models, energy-based models, generative adversarial networks, and diffusion models has been advantageous in various disciplines due to their high data generative skills. Using DGMs has become one of the most trending research topics in Artificial Intelligence in recent years. On the other hand, the research and development endeavors in the civil structural health monitoring (SHM) area have also been very progressive owing to the increasing use of Machine Learning techniques. As such, some of the DGMs have also been used in the civil SHM field lately. This short review communication paper aims to assist researchers in the civil SHM field in understanding the fundamentals of DGMs and, consequently, to help initiate their use for current and possible future engineering applications. On this basis, this study briefly introduces the concept and mechanism of different DGMs in a comparative fashion. While preparing this short review communication, it was observed that some DGMs had not been utilized or exploited fully in the SHM area. Accordingly, some representative studies presented in the civil SHM field that use DGMs are briefly overviewed. The study also presents a short comparative discussion on DGMs, their link to the SHM, and research directions.

Modification and Evaluation of Attention-Based Deep Neural Network for Structural Crack Detection

Cracks are one of the safety-evaluation indicators for structures, providing a maintenance basis for the health and safety of structures in service. Most structural inspections rely on visual observation, while bridges rely on traditional methods such as bridge inspection vehicles, which are inefficient and pose safety risks. To alleviate the problem of low efficiency and the high cost of structural health monitoring, deep learning, as a new technology, is increasingly being applied to crack detection and recognition. Focusing on this, the current paper proposes an improved model based on the attention mechanism and the U-Net network for crack-identification research. First, the training results of the two original models, U-Net and lrassp, were compared in the experiment. The results showed that U-Net performed better than lrassp according to various indicators. Therefore, we improved the U-Net network with the attention mechanism. After experimenting with the improved network, we found that the proposed ECA-UNet network increased the Intersection over Union (IOU) and recall indicators compared to the original U-Net network by 0.016 and 0.131, respectively. In practical large-scale structural crack recognition, the proposed model had better recognition performance than the other two models, with almost no errors in identifying noise under the premise of accurately identifying cracks, demonstrating a stronger capacity for crack recognition.

Machine Learning Electrocardiogram for Mobile Cardiac Pattern Extraction

BACKGROUND

Internet-of-things technologies are reshaping healthcare applications. We take a special interest in long-term, out-of-clinic, electrocardiogram (ECG)-based heart health management and propose a machine learning framework to extract crucial patterns from noisy mobile ECG signals.

METHODS

A three-stage hybrid machine learning framework is proposed for estimating heart-disease-related ECG QRS duration. First, raw heartbeats are recognized from the mobile ECG using a support vector machine (SVM). Then, the QRS boundaries are located using a novel pattern recognition approach, multiview dynamic time warping (MV-DTW). To enhance robustness with motion artifacts in the signal, the MV-DTW path distance is also used to quantize heartbeat-specific distortion conditions. Finally, a regression model is trained to transform the mobile ECG QRS duration into the commonly used standard chest ECG QRS durations.

RESULTS

With the proposed framework, the performance of ECG QRS duration estimation is very encouraging, and the correlation coefficient, mean error/standard deviation, mean absolute error, and root mean absolute error are 91.2%, 0.4 ± 2.6, 1.7, and 2.6 ms, respectively, compared with the traditional chest ECG-based measurements.

CONCLUSIONS

Promising experimental results are demonstrated to indicate the effectiveness of the framework. This study will greatly advance machine-learning-enabled ECG data mining towards smart medical decision support.

Automated Road Defect and Anomaly Detection for Traffic Safety: A Systematic Review

Recently, there has been a substantial increase in the development of sensor technology. As enabling factors, computer vision (CV) combined with sensor technology have made progress in applications intended to mitigate high rates of fatalities and the costs of traffic-related injuries. Although past surveys and applications of CV have focused on subareas of road hazards, there is yet to be one comprehensive and evidence-based systematic review that investigates CV applications for Automated Road Defect and Anomaly Detection (ARDAD). To present ARDAD's state-of-the-art, this systematic review is focused on determining the research gaps, challenges, and future implications from selected papers (N = 116) between 2000 and 2023, relying primarily on Scopus and Litmaps services. The survey presents a selection of artefacts, including the most popular open-access datasets (D = 18), research and technology trends that with reported performance can help accelerate the application of rapidly advancing sensor technology in ARDAD and CV. The produced survey artefacts can assist the scientific community in further improving traffic conditions and safety.

Advances in Wearable Piezoelectric Sensors for Hazardous Workplace Environments

Recent advances in wearable energy harvesting technology as solutions to occupational health and safety programs are presented. Workers are often exposed to harmful conditions-especially in the mining and construction industries-where chronic health issues can emerge over time. While wearable sensors technology can aid in early detection and long-term exposure tracking, powering them and the associated risks are often an impediment for their widespread use, such as the need for frequent charging and battery safety. Repetitive vibration exposure is one such hazard, e.g., whole body vibration, yet it can also provide parasitic energy that can be harvested to power wearable sensors and overcome the battery limitations. This review can critically analyze the vibration effect on workers' health, the limitations of currently available devices, explore new options for powering different personal protective equipment devices, and discuss opportunities and directions for future research. The recent progress in self-powered vibration sensors and systems from the perspective of the underlying materials, applications, and fabrication techniques is reviewed. Lastly, the challenges and perspectives are discussed for reference to the researchers who are interested in self-powered vibration sensors.

Development and Validation of a Low-Cost Device for Real-Time Detection of Fatigue Damage of Structures Subjected to Vibrations

This paper presents the development and validation of a low-cost device for real-time detection of fatigue damage of structures subjected to vibrations. The device consists of an hardware and signal processing algorithm to detect and monitor variations in the structural response due to damage accumulation. The effectiveness of the device is demonstrated through experimental validation on a simple Y-shaped specimen subjected to fatigue loading. The results show that the device can accurately detect structural damage and provide real-time feedback on the health status of the structure. The low-cost and easy-to-implement nature of the device makes it promising for use in structural health monitoring applications in various industrial sectors.

Fiber Optic Sensing Technology and Vision Sensing Technology for Structural Health Monitoring

Structural health monitoring is currently a crucial measure for the analysis of structural safety. As a structural asset management approach, it can provide a cost-effective measure and has been used successfully in a variety of structures. In recent years, the development of fiber optic sensing technology and vision sensing technology has led to further advances in structural health monitoring. This paper focuses on the basic principles, recent advances, and current status of applications of these two sensing technologies. It provides the reader with a broad review of the literature. It introduces the advantages, limitations, and future directions of these two sensing technologies. In addition, the main contribution of this paper is that the integration of fiber optic sensing technology and vision sensing technology is discussed. This paper demonstrates the feasibility and application potential of this integration by citing numerous examples. The conclusions show that this new integrated sensing technology can effectively utilize the advantages of both fields.

Unsupervised Learning Methods for Data-Driven Vibration-Based Structural Health Monitoring: A Review

Structural damage detection using unsupervised learning methods has been a trending topic in the structural health monitoring (SHM) research community during the past decades. In the context of SHM, unsupervised learning methods rely only on data acquired from intact structures for training the statistical models. Consequently, they are often seen as more practical than their supervised counterpart in implementing an early-warning damage detection system in civil structures. In this article, we review publications on data-driven structural health monitoring from the last decade that relies on unsupervised learning methods with a focus on real-world application and practicality. Novelty detection using vibration data is by far the most common approach for unsupervised learning SHM and is, therefore, given more attention in this article. Following a brief introduction, we present the state-of-the-art studies in unsupervised-learning SHM, categorized by the types of used machine-learning methods. We then examine the benchmarks that are commonly used to validate unsupervised-learning SHM methods. We also discuss the main challenges and limitations in the existing literature that make it difficult to translate SHM methods from research to practical applications. Accordingly, we outline the current knowledge gaps and provide recommendations for future directions to assist researchers in developing more reliable SHM methods.

A Systematic Review of Optimization Algorithms for Structural Health Monitoring and Optimal Sensor Placement

In recent decades, structural health monitoring (SHM) has gained increased importance for ensuring the sustainability and serviceability of large and complex structures. To design an SHM system that delivers optimal monitoring outcomes, engineers must make decisions on numerous system specifications, including the sensor types, numbers, and placements, as well as data transfer, storage, and data analysis techniques. Optimization algorithms are employed to optimize the system settings, such as the sensor configuration, that significantly impact the quality and information density of the captured data and, hence, the system performance. Optimal sensor placement (OSP) is defined as the placement of sensors that results in the least amount of monitoring cost while meeting predefined performance requirements. An optimization algorithm generally finds the "best available" values of an objective function, given a specific input (or domain). Various optimization algorithms, from random search to heuristic algorithms, have been developed by researchers for different SHM purposes, including OSP. This paper comprehensively reviews the most recent optimization algorithms for SHM and OSP. The article focuses on the following: (I) the definition of SHM and all its components, including sensor systems and damage detection methods, (II) the problem formulation of OSP and all current methods, (III) the introduction of optimization algorithms and their types, and (IV) how various existing optimization methodologies can be applied to SHM systems and OSP methods. Our comprehensive comparative review revealed that applying optimization algorithms in SHM systems, including their use for OSP, to derive an optimal solution, has become increasingly common and has resulted in the development of sophisticated methods tailored to SHM. This article also demonstrates that these sophisticated methods, using artificial intelligence (AI), are highly accurate and fast at solving complex problems.

Towards Automated Inspections of Tunnels: A Review of Optical Inspections and Autonomous Assessment of Concrete Tunnel Linings

In recent decades, many cities have become densely populated due to increased urbanization, and the transportation infrastructure system has been heavily used. The downtime of important parts of the infrastructure, such as tunnels and bridges, seriously affects the transportation system's efficiency. For this reason, a safe and reliable infrastructure network is necessary for the economic growth and functionality of cities. At the same time, the infrastructure is ageing in many countries, and continuous inspection and maintenance are necessary. Nowadays, detailed inspections of large infrastructure are almost exclusively performed by inspectors on site, which is both time-consuming and subject to human errors. However, the recent technological advancements in computer vision, artificial intelligence (AI), and robotics have opened up the possibilities of automated inspections. Today, semiautomatic systems such as drones and other mobile mapping systems are available to collect data and reconstruct 3D digital models of infrastructure. This significantly decreases the downtime of the infrastructure, but both damage detection and assessments of the structural condition are still manually performed, with a high impact on the efficiency and accuracy of the procedure. Ongoing research has shown that deep-learning methods, especially convolutional neural networks (CNNs) combined with other image processing techniques, can automatically detect cracks on concrete surfaces and measure their metrics (e.g., length and width). However, these techniques are still under investigation. Additionally, to use these data for automatically assessing the structure, a clear link between the metrics of the cracks and the structural condition must be established. This paper presents a review of the damage of tunnel concrete lining that is detectable with optical instruments. Thereafter, state-of-the-art autonomous tunnel inspection methods are presented with a focus on innovative mobile mapping systems for optimizing data collection. Finally, the paper presents an in-depth review of how the risk associated with cracks is assessed today in concrete tunnel lining.

An efficient edge/cloud medical system for rapid detection of level of consciousness in emergency medicine based on explainable machine learning models

Emergency medicine (EM) is one of the attractive research fields in which researchers investigate their efforts to diagnose and treat unforeseen illnesses or injuries. There are many tests and observations are involved in EM. Detection of the level of consciousness is one of these observations, which can be detected using several methods. Among these methods, the automatic estimation of the Glasgow coma scale (GCS) is studied in this paper. The GCS is a medical score used to describe a patient’s level of consciousness. This type of scoring system requires medical examination that may not be available with the shortage of the medical expert. Therefore, the automatic medical calculation for a patient’s level of consciousness is highly needed. Artificial intelligence has been deployed in several applications and appears to have a high performance regarding providing automatic solutions. The main objective of this work is to introduce the edge/cloud system to improve the efficiency of the consciousness measurement through efficient local data processing. Moreover, an efficient machine learning (ML) model to predict the level of consciousness of a certain patient based on the patient’s demographic, vital signs, and laboratory tests is proposed, as well as maintaining the explainability issue using Shapley additive explanations (SHAP) that provides natural language explanation in a form that helps the medical expert to understand the final prediction. The developed ML model is validated using vital signs and laboratory tests extracted from the MIMIC III dataset, and it achieves superior performance (mean absolute error (MAE) = 0.269, mean square error (MSE) = 0.625, R² score = 0.964). The resulting model is accurate, medically intuitive, and trustworthy.

Adversarial Auxiliary Weighted Subdomain Adaptation for Open-Set Deep Transfer Bridge Damage Diagnosis

Deep learning models have been widely used in data-driven bridge structural damage diagnosis methods in recent years. However, these methods require training and test datasets to satisfy the same distribution, which is difficult to satisfy in practice. Domain adaptation transfer learning is an efficient method to solve this problem. Most of the current domain adaptation methods focus on close-set scenarios with the same classes in the source and target domains. However, in practical applications, new damage caused by long-term degradation often makes the target and source domains dissimilar in the class space. For such challenging open-set scenarios, existing domain adaptation methods will be powerless. To effectively solve the above problems, an adversarial auxiliary weighted subdomain adaptation algorithm is proposed for open-set scenarios. Adversarial learning is introduced to proposed an adversarial auxiliary weighting scheme to reflect the similarity of target samples with source classes. It effectively distinguishes unknown damage from known states. This paper further proposes a multi-channel multi-kernel weighted local maximum mean discrepancy metric (MCMK-WLMMD) to capture the fine-grained transferable information for conditional distribution alignment (sub-domain alignment). Extensive experiments on transfer tasks between three bridges verify the effectiveness of the algorithm in open-set scenarios.

Parametric Damage Mechanics Empowering Structural Health Monitoring of 3D Woven Composites

This paper presents a data-driven structural health monitoring (SHM) method by the use of so-called reduced-order models relying on an offline training/online use for unidirectional fiber and matrix failure detection in a 3D woven composite plate. During the offline phase (or learning) a dataset of possible damage localization, fiber and matrix failure ratios is generated through high-fidelity simulations (ABAQUS software). Then, a reduced model in a lower-dimensional approximation subspace based on the so-called sparse proper generalized decomposition (sPGD) is constructed. The parametrized approach of the sPGD method reduces the computational burden associated with a high-fidelity solver and allows a faster evaluation of all possible failure configurations. However, during the testing phase, it turns out that classical sPGD fails to capture the influence of the damage localization on the solution. To alleviate the just-referred difficulties, the present work proposes an adaptive sPGD. First, a change of variable is carried out to place all the damage areas on the same reference region, where an adapted interpolation can be done. During the online use, an optimization algorithm is employed with numerical experiments to evaluate the damage localization and damage ratio which allow us to define the health state of the structure.

An Impact Localization Solution Using Embedded Intelligence-Methodology and Experimental Verification via a Resource-Constrained IoT Device

Recent advances both in hardware and software have facilitated the embedded intelligence (EI) research field, and enabled machine learning and decision-making integration in resource-scarce IoT devices and systems, realizing "conscious" and self-explanatory objects (smart objects). In the context of the broad use of WSNs in advanced IoT applications, this is the first work to provide an extreme-edge system, to address structural health monitoring (SHM) on polymethyl methacrylate (PPMA) thin-plate. To the best of our knowledge, state-of-the-art solutions primarily utilize impact positioning methods based on the time of arrival of the stress wave, while in the last decade machine learning data analysis has been performed, by more expensive and resource-abundant equipment than general/development purpose IoT devices, both for the collection and the inference stages of the monitoring system. In contrast to the existing systems, we propose a methodology and a system, implemented by a low-cost device, with the benefit of performing an online and on-device impact localization service from an agnostic perspective, regarding the material and the sensors' location (as none of those attributes are used). Thus, a design of experiments and the corresponding methodology to build an experimental time-series dataset for impact detection and localization is proposed, using ceramic piezoelectric transducers (PZTs). The system is excited with a steel ball, varying the height from which it is released. Based on TinyML technology for embedding intelligence in low-power devices, we implement and validate random forest and shallow neural network models to localize in real-time (less than 400 ms latency) any occurring impacts on the structure, achieving higher than 90% accuracy.

Integrated Damage Location Diagnosis of Frame Structure Based on Convolutional Neural Network with Inception Module

Accurate damage location diagnosis of frame structures is of great significance to the judgment of damage degree and subsequent maintenance of frame structures. However, the similarity characteristics of vibration data at different damage locations and noise interference bring great challenges. In order to overcome the above problems and realize accurate damage location diagnosis of the frame structure, the existing convolutional neural network with training interference (TICNN) is improved in this paper, and a high-precision neural network model named convolutional neural network based on Inception (BICNN) for fault diagnosis with strong anti-noise ability is proposed by adding the Inception module to TICNN. In order to effectively avoid the overall misjudgment problem caused by using single sensor data for damage location diagnosis, an integrated damage location diagnosis method is proposed. Taking the four-story steel frame model of the University of British Columbia as the research object, the method proposed in this paper is tested and compared with other methods. The experimental results show that the diagnosis accuracy of the proposed method is 97.38%, which is higher than other methods; at the same time, it has greater advantages in noise resistance. Therefore, the method proposed in this paper not only has high accuracy, but also has strong anti-noise ability, which can solve the problem of accurate damage location diagnosis of complex frame structures under a strong noise environment.

BdSLW-11: Dataset of Bangladeshi sign language words for recognizing 11 daily useful BdSL words

The dataset of Bangladeshi sign language words (BdSLW) is rare. Though there are lots of datasets of BdSL sign alphabets, numbers, or characters, there are not enough datasets of sign words. This is the first dataset about sign words of BdSL according to the author(s) knowledge. So, this dataset is developed by collecting data from people. This is an image dataset. This dataset is a collection of 1105 images of sign words. A total of 11 sign word categories are selected which are important and daily use in our life. As this is an image dataset, so the images of sign words are taken by camera from the sign users of Bangladesh. Authors have gone to the individuals of sign users and captured images from them with their permission. Then the images are analyzed and segmented into the images which have quality such as no background, clear, bright, etc. This dataset is used for recognizing BdSL sign words.

Deep neural network-based structural health monitoring technique for real-time crack detection and localization using strain gauge sensors

Structural health monitoring (SHM) techniques often require a large number of sensors to evaluate and monitor the structural health. In this paper, we propose a deep neural network (DNN)-based SHM method for accurate crack detection and localization in real time using a small number of strain gauge sensors and confirm its feasibility based on experimental data. The proposed method combines a DNN model with principal component analysis (PCA) to predict the strain field based on the local strains measured by strain gauge sensors located rather sparsely. We demonstrate the potential of the proposed technique via a cyclic 4-point bending test performed on a composite material specimen without cracks and seven specimens with different lengths of cracks. A dataset containing local strains measured with 12 strain gauge sensors and strain field measured with a digital image correlation (DIC) device was prepared. The strain field dataset from DIC is converted to a smaller dimension latent space with a few eigen basis via PCA, and a DNN model is trained to predict principal component values of each image with 12 strain gauge sensor measurements as input. The proposed method turns out to accurately predict the strain field for all specimens considered in the study.

Performance Comparison of Multiple Convolutional Neural Networks for Concrete Defects Classification

Periodical vision-based inspection is a principal form of structural health monitoring (SHM) technique. Over the last decades, vision-based artificial intelligence (AI) has successfully facilitated an effortless inspection system owing to its exceptional ability of accuracy of defects' pattern recognition. However, most deep learning (DL)-based methods detect one specific type of defect, whereas DL has a high proficiency in multiple object detection. This study developed a dataset of two types of defects, i.e., concrete crack and spalling, and applied various pre-built convolutional neural network (CNN) models, i.e., VGG-19, ResNet-50, InceptionV3, Xception, and MobileNetV2 to classify these concrete defects. The dataset developed for this study has one of the largest collections of original images of concrete crack and spalling and avoided the augmentation process to replicate a more real-world condition, which makes the dataset one of a kind. Moreover, a detailed sensitivity analysis of hyper-parameters (i.e., optimizers, learning rate) was conducted to compare the classification models' performance and identify the optimal image classification condition for the best-performed CNN model. After analyzing all the models, InceptionV3 outperformed all the other models with an accuracy of 91%, precision of 83%, and recall of 100%. The InceptionV3 model performed best with optimizer stochastic gradient descent (SGD) and a learning rate of 0.001.

Analysis of Structural Health Monitoring Data with Correlated Measurement Error by Bayesian System Identification: Theory and Application

Measurement error is non-negligible and crucial in SHM data analysis. In many applications of SHM, measurement errors are statistically correlated in space and/or in time for data from sensor networks. Existing works solely consider spatial correlation for measurement error. When both spatial and temporal correlation are considered simultaneously, the existing works collapse, as they do not possess a suitable form describing spatially and temporally correlated measurement error. In order to tackle this burden, this paper generalizes the form of correlated measurement error from spatial correlation only or temporal correlation only to spatial-temporal correlation. A new form of spatial-temporal correlation and the corresponding likelihood function are proposed, and multiple candidate model classes for the measurement error are constructed, including no correlation, spatial correlation, temporal correlation, and the proposed spatial-temporal correlation. Bayesian system identification is conducted to achieve not only the posterior probability density function (PDF) for the model parameters, but also the posterior probability of each candidate model class for selecting the most suitable/plausible model class for the measurement error. Examples are presented with applications to model updating and modal frequency prediction under varying environmental conditions, ensuring the necessity of considering correlated measurement error and the capability of the proposed Bayesian system identification in the uncertainty quantification at the parameter and model levels.

Analysis of Force Sensing Accuracy by Using SHM Methods on Conventionally Manufactured and Additively Manufactured Small Polymer Parts

Fabricating complex parts using additive manufacturing is becoming more popular in diverse engineering sectors. Structural Health Monitoring (SHM) methods can be implemented to reduce inspection costs and ensure structural integrity and safety in these parts. In this study, the Surface Response to Excitation (SuRE) method was used to investigate the wave propagation characteristics and load sensing capability in conventionally and additively manufactured ABS parts. For the first set of the test specimens, one conventionally manufactured and three additively manufactured rectangular bar-shaped specimens were prepared. Moreover, four additional parts were also additively manufactured with 30% and 60% infill ratios and 1 mm and 2 mm top surface thicknesses. The external geometry of all parts was the same. Ultrasonic surface waves were generated using three different signals via a piezoelectric actuator bonded to one end of the part. At the other end of each part, a piezoelectric disk was bonded to monitor the response to excitation. It was found that hollow sections inside the 3D printed part slowed down the wave travel. The Continuous Wavelet Transform (CWT) and Short-Time Fourier Transform (STFT) were implemented for converting the recorded sensory data into time–frequency images. These image datasets were fed into a convolutional neural network for the estimation of the compressive loading when the load was applied at the center of specimens at five different levels (0 N, 50 N, 100 N, 150 N, and 200 N). The results showed that the classification accuracy was improved when the CWT scalograms were used.

A review of ultrasonic sensing and machine learning methods to monitor industrial processes

Supervised machine learning techniques are increasingly being combined with ultrasonic sensor measurements owing to their strong performance. These techniques also offer advantages over calibration procedures of more complex fitting, improved generalisation, reduced development time, ability for continuous retraining, and the correlation of sensor data to important process information. However, their implementation requires expertise to extract and select appropriate features from the sensor measurements as model inputs, select the type of machine learning algorithm to use, and find a suitable set of model hyperparameters. The aim of this article is to facilitate implementation of machine learning techniques in combination with ultrasonic measurements for in-line and on-line monitoring of industrial processes and other similar applications. The article first reviews the use of ultrasonic sensors for monitoring processes, before reviewing the combination of ultrasonic measurements and machine learning. We include literature from other sectors such as structural health monitoring. This review covers feature extraction, feature selection, algorithm choice, hyperparameter selection, data augmentation, domain adaptation, semi-supervised learning and machine learning interpretability. Finally, recommendations for applying machine learning to the reviewed processes are made.

A Score-Guided Regularization Strategy-Based Unsupervised Structural Damage Detection Method

It is critical to use scientific methods to track the performance degradation of in-service buildings over time and avoid accidents. In recent years, both supervised and unsupervised learning methods have yielded positive results in structural health monitoring (SHM). Supervised learning approaches require data from the entire structure and various damage scenarios for training. However, it is impractical to obtain adequate training data from various damage situations in service facilities. In addition, most known unsupervised approaches for training only take response data from the entire structure. In these situations, contaminated data containing both undamaged and damaged samples, typical in real-world applications, prevent the models from fitting undamaged data, resulting in performance loss. This work provides an unsupervised technique for detecting structural damage for the reasons stated above. This approach trains on contaminated data, with the anomaly score of the data serving as the model’s output. First, we devised a score-guided regularization approach for damage detection to expand the score difference between undamaged and damaged data. Then, multi-task learning is incorporated to make parameter adjustment easier. The experimental phase II of the SHM benchmark data and data from the Qatar University grandstand simulator are used to validate this strategy. The suggested algorithm has the most excellent mean AUC of 0.708 and 0.998 on the two datasets compared to the classical algorithm.

The Need for Multi-Sensor Data Fusion in Structural Health Monitoring of Composite Aircraft Structures

With the increased use of composites in aircraft, many new successful contributions to the advancement of the structural health monitoring (SHM) field for composite aerospace structures have been achieved. Yet its application is still not often seen in operational conditions in the aircraft industry, mostly due to a gap between research focus and application, which constraints the shift towards improved aircraft maintenance strategies such as condition-based maintenance (CBM). In this work, we identify and highlight two key facets involved in the maturing of the SHM field for composite aircraft structures: (1) the aircraft maintenance engineer who requires a holistic damage assessment for the aircraft’s structural health management, and (2) the upscaling of the SHM application to realistic composite aircraft structures under in-service conditions. Multi-sensor data fusion concepts can aid in addressing these aspects and we formulate its benefits, opportunities, and challenges. Additionally, for demonstration purposes, we show a conceptual design study for a fusion-based SHM system for multi-level damage monitoring of a representative composite aircraft wing structure. In this manner, we present how multi-sensor data fusion concepts can be of benefit to the community in advancing the field of SHM for composite aircraft structures towards an operational CBM application in the aircraft industry.

An Unsupervised Tunnel Damage Identification Method Based on Convolutional Variational Auto-Encoder and Wavelet Packet Analysis

Finding a low-cost and highly efficient method for identifying subway tunnel damage can greatly reduce catastrophic accidents. At present, tunnel health monitoring is mainly based on the observation of apparent diseases and vibration monitoring, which is combined with a manual inspection to perceive the tunnel health status. However, these methods have disadvantages such as high cost, short working time, and low identification efficiency. Thus, in this study, a tunnel damage identification algorithm based on the vibration response of in-service train and WPE-CVAE is proposed, which can automatically identify tunnel damage and give the damage location. The method is an unsupervised novelty detection that requires only sufficient normal data on healthy structure for training. This study introduces the theory and implementation process of this method in detail. Through laboratory model tests, the damage of the void behind the tunnel wall is designed to verify the performance of the algorithm. In the test case, the proposed method achieves the damage identification performance with a 96.25% recall rate, 86.75% hit rate, and 91.5% accuracy. Furthermore, compared with the other unsupervised methods, the method performance and noise immunity are better than others, so it has a certain practical value.

Effective Jet-Grouting Application for Improving the State of Deformation of Landmarks

The problem of improving the state of deformation of landmarks is an important aspect when performing civil services, because they have a historical interest and bring symbolisms which relate to an event of particular interest for the community. The engineering–geological surveys, technical evaluation and operational suitability of landmarks of national significance are performed to improve the state of deformation. The conducted analytical assessment of landslide hazard slope stability in the RocScience Slide computational complex shows that in the presence of landslide prevention works, and the stability coefficient is increased by a factor of 1.21–1.37. The regularities of deformation and strength parameters of the soil–cement obtained during the jet-grouting application indicated an increase in strength gain of amplifier elements by an average of 1.6–4.0 times. This proves the effectiveness of the jet-grouting application for improving the state of deformation of landmarks of national significance.

Machine Learning Meets Compressed Sensing in Vibration-Based Monitoring

Artificial Intelligence applied to Structural Health Monitoring (SHM) has provided considerable advantages in the accuracy and quality of the estimated structural integrity. Nevertheless, several challenges still need to be tackled in the SHM field, which extended the monitoring process beyond the mere data analytics and structural assessment task. Besides, one of the open problems in the field relates to the communication layer of the sensor networks since the continuous collection of long time series from multiple sensing units rapidly consumes the available memory resources, and requires complicated protocol to avoid network congestion. In this scenario, the present work presents a comprehensive framework for vibration-based diagnostics, in which data compression techniques are firstly introduced as a means to shrink the dimension of the data to be managed through the system. Then, neural network models solving binary classification problems were implemented for the sake of damage detection, also encompassing the influence of environmental factors in the evaluation of the structural status. Moreover, the potential degradation induced by the usage of low cost sensors on the adopted framework was evaluated: Additional analyses were performed in which experimental data were corrupted with the noise characterizing MEMS sensors. The proposed solutions were tested with experimental data from the Z24 bridge use case, proving that the amalgam of data compression, optimized (i.e., low complexity) machine learning architectures and environmental information allows to attain high classification scores, i.e., accuracy and precision greater than 96% and 95%, respectively.

Deep Learning in Healthcare System for Quality of Service

Deep learning (DL) and machine learning (ML) have a pivotal role in logistic supply chain management and smart manufacturing with proven records. The ability to handle large complex data with minimal human intervention made DL and ML a success in the healthcare systems. In the present healthcare system, the implementation of ML and DL is extensive to achieve a higher quality of service and quality of health to patients, doctors, and healthcare professionals. ML and DL were found to be effective in disease diagnosis, acute disease detection, image analysis, drug discovery, drug delivery, and smart health monitoring. This work presents a state-of-the-art review on the recent advancements in ML and DL and their implementation in the healthcare systems for achieving multi-objective goals. A total of 10 papers have been thoroughly reviewed that presented novel works of ML and DL integration in the healthcare system for achieving various targets. This will help to create reference data that can be useful for future implementation of ML and DL in other sectors of healthcare system.

Damage Detection in Largely Unobserved Structures under Varying Environmental Conditions: An AutoRegressive Spectrum and Multi-Level Machine Learning Methodology

Vibration-based damage detection in civil structures using data-driven methods requires sufficient vibration responses acquired with a sensor network. Due to technical and economic reasons, it is not always possible to deploy a large number of sensors. This limitation may lead to partial information being handled for damage detection purposes, under environmental variability. To address this challenge, this article proposes an innovative multi-level machine learning method by employing the autoregressive spectrum as the main damage-sensitive feature. The proposed method consists of three levels: (i) distance calculation by the log-spectral distance, to increase damage detectability and generate distance-based training and test samples; (ii) feature normalization by an improved factor analysis, to remove environmental variations; and (iii) decision-making for damage localization by means of the Jensen-Shannon divergence. The major contributions of this research are represented by the development of the aforementioned multi-level machine learning method, and by the proposal of the new factor analysis for feature normalization. Limited vibration datasets relevant to a truss structure and consisting of acceleration time histories induced by shaker excitation in a passive system, have been used to validate the proposed method and to compare it with alternate, state-of-the-art strategies.

Stretching Method-Based Damage Detection Using Neural Networks

We present in this paper a framework for damage detection and localization using neural networks. The data we use to train the network are m×d pixel images consisting of measurements of the relative variations of m natural frequencies of the structure under monitoring over a period of d-days. To measure the relative variations of the natural frequencies, we use the stretching method, which allows us to obtain reliable measurements amidst fluctuations induced by environmental factors such as temperature variations. We show that even by monitoring a single natural frequency over a few days, accurate damage detection can be achieved. The accuracy for damage detection significantly improves when a small number of natural frequencies is monitored instead of a single one. More importantly, monitoring multiple natural frequencies allows for damage localization provided that the network can be trained for both healthy and damaged scenarios. This is feasible under the assumption that damage occurs at a finite number of damage-prone locations. Several results obtained with numerically simulated data illustrate the effectiveness of the proposed approach.

UAV Obstacle Avoidance Algorithm to Navigate in Dynamic Building Environments

In this work, a real-time collision avoidance algorithm was presented for autonomous navigation in the presence of fixed and moving obstacles in building environments. The current implementation is designed for autonomous navigation between waypoints of a predefined flight trajectory that would be performed by an UAV during tasks such as inspections or construction progress monitoring. It uses a simplified geometry generated from a point cloud of the scenario. In addition, it also employs information from 3D sensors to detect and position obstacles such as people or other UAVs, which are not registered in the original cloud. If an obstacle is detected, the algorithm estimates its motion and computes an evasion path considering the geometry of the environment. The method has been successfully tested in different scenarios, offering robust results in all avoidance maneuvers. Execution times were measured, demonstrating that the algorithm is computationally feasible to be implemented onboard an UAV.

Towards Interpretable Machine Learning for Automated Damage Detection Based on Ultrasonic Guided Waves

Data-driven analysis for damage assessment has a large potential in structural health monitoring (SHM) systems, where sensors are permanently attached to the structure, enabling continuous and frequent measurements. In this contribution, we propose a machine learning (ML) approach for automated damage detection, based on an ML toolbox for industrial condition monitoring. The toolbox combines multiple complementary algorithms for feature extraction and selection and automatically chooses the best combination of methods for the dataset at hand. Here, this toolbox is applied to a guided wave-based SHM dataset for varying temperatures and damage locations, which is freely available on the Open Guided Waves platform. A classification rate of 96.2% is achieved, demonstrating reliable and automated damage detection. Moreover, the ability of the ML model to identify a damaged structure at untrained damage locations and temperatures is demonstrated.

Fatigue Crack Evaluation with the Guided Wave-Convolutional Neural Network Ensemble and Differential Wavelet Spectrogram

On-line fatigue crack evaluation is crucial for ensuring the structural safety and reducing the maintenance costs of safety-critical systems. Among structural health monitoring (SHM), guided wave (GW)-based SHM has been deemed as one of the most promising techniques. However, the traditional damage index-based method and machine learning methods require manual processing and selection of GW features, which depend highly on expert knowledge and are easily affected by complicated uncertainties. Therefore, this paper proposes a fatigue crack evaluation framework with the GW–convolutional neural network (CNN) ensemble and differential wavelet spectrogram. The differential time–frequency spectrogram between the baseline signal and the monitoring signal is processed as the CNN input with the complex Gaussian wavelet transform. Then, an ensemble of CNNs is trained to jointly determine the crack length. Real fatigue tests on complex lap joint structures were carried out to validate the proposed method, in which several structures were tested preliminarily for collecting the training dataset and a new structure was adopted for testing. The root mean square error of the training dataset is 1.4 mm. Besides, the root mean square error of the evaluated crack length in the testing lap joint structure was 1.7 mm, showing the effectiveness of the proposed method.

Application of region-based video surveillance in smart cities using deep learning

Smart video surveillance helps to build more robust smart city environment. The varied angle cameras act as smart sensors and collect visual data from smart city environment and transmit it for further visual analysis. The transmitted visual data is required to be in high quality for efficient analysis which is a challenging task while transmitting videos on low capacity bandwidth communication channels. In latest smart surveillance cameras, high quality of video transmission is maintained through various video encoding techniques such as high efficiency video coding. However, these video coding techniques still provide limited capabilities and the demand of high-quality based encoding for salient regions such as pedestrians, vehicles, cyclist/motorcyclist and road in video surveillance systems is still not met. This work is a contribution towards building an efficient salient region-based surveillance framework for smart cities. The proposed framework integrates a deep learning-based video surveillance technique that extracts salient regions from a video frame without information loss, and then encodes it in reduced size. We have applied this approach in diverse case studies environments of smart city to test the applicability of the framework. The successful result in terms of bitrate 56.92%, peak signal to noise ratio 5.35 bd and SR based segmentation accuracy of 92% and 96% for two different benchmark datasets is the outcome of proposed work. Consequently, the generation of less computational region-based video data makes it adaptable to improve surveillance solution in Smart Cities.

Identification of Grain Oriented SiFe Steels Based on Imaging the Instantaneous Dynamics of Magnetic Barkhausen Noise Using Short-Time Fourier Transform and Deep Convolutional Neural Network

This paper presents a new approach to the extraction and analysis of information contained in magnetic Barkhausen noise (MBN) for evaluation of grain oriented (GO) electrical steels. The proposed methodology for MBN analysis is based on the combination of the Short-Time Fourier Transform for the observation of the instantaneous dynamics of the phenomenon and deep convolutional neural networks (DCNN) for the extraction of hidden information and building the knowledge. The use of DCNN makes it possible to find even complex and convoluted rules of the Barkhausen phenomenon course, difficult to determine based solely on the selected features of MBN signals. During the tests, several samples made of conventional and high permeability GO steels were tested at different angles between the rolling and transverse directions. The influences of the angular resolution and the proposed additional prediction update algorithm on the DCNN accuracy were investigated, obtaining the highest gain for the angle of 3.6°, for which the overall accuracy exceeded 80%. The obtained results indicate that the proposed new solution combining time-frequency analysis and DCNN for the quantification of information from MBN having stochastic nature may be a very effective tool in the characterization of the magnetic materials.

Detection and Identification of Expansion Joint Gap of Road Bridges by Machine Learning Using Line-Scan Camera Images

Recently, the lack of expansion joint gaps on highway bridges in Korea has been increasing. In particular, with the increase in the number of days during the summer heatwave, the narrowing of the expansion joint gap causes symptoms such as expansion joint damage and pavement blow-up, which threaten traffic safety and structural safety. Therefore, in this study, we developed a machine vision (M/V)-technique-based inspection system that can monitor the expansion joint gap through image analysis while driving at high speed (100 km/h), replacing the current manual method that uses an inspector to inspect the expansion joint gap. To fix the error factors of image analysis that happened during the trial application, a machine learning method was used to improve the accuracy of measuring the gap between the expansion joint device. As a result, the expansion gap identification accuracy was improved by 27.5%, from 67.5% to 95.0%, and the use of the system reduces the survey time by more than 95%, from an average of approximately 1 h/bridge (existing manual inspection method) to approximately 3 min/bridge. We assume, in the future, maintenance practitioners can contribute to preventive maintenance that prepares countermeasures before problems occur.

Modelling and Validation of a Guided Acoustic Wave Temperature Monitoring System

The computer modelling of condition monitoring sensors can aide in their development, improve their performance, and allow for the analysis of sensor impact on component operation. This article details the development of a COMSOL model for a guided wave-based temperature monitoring system, with a view to using the technology in the future for the temperature monitoring of nozzle guide vanes, found in the hot section of aeroengines. The model is based on an experimental test system that acts as a method of validation for the model. Piezoelectric wedge transducers were used to excite the S0 Lamb wave mode in an aluminium plate, which was temperature controlled using a hot plate. Time of flight measurements were carried out in MATLAB and used to calculate group velocity. The results were compared to theoretical wave velocities extracted from dispersion curves. The assembly and validation of such a model can aide in the future development of guided wave based sensor systems, and the methods provided can act as a guide for building similar COMSOL models. The results show that the model is in good agreement with the experimental equivalent, which is also in line with theoretical predictions.