Road Condition Monitoring Using Smart Sensing and Artificial Intelligence: A Review

A Review of Vision-Based Pothole Detection Methods Using Computer Vision and Machine Learning

Potholes and other road surface damages pose significant risks to vehicles and traffic safety. The current methods of in situ visual inspection for potholes or cracks are inefficient, costly, and hazardous. Therefore, there is a pressing need to develop automated systems for assessing road surface conditions, aiming to efficiently and accurately reconstruct, recognize, and locate potholes. In recent years, various methods utilizing (a) computer vision, (b) three-dimensional (3D) point clouds, or (c) smartphone data have been employed to map road surface quality conditions. Machine learning and deep learning techniques have increasingly enhanced the performance of these methods. This review aims to provide a comprehensive overview of cutting-edge computer vision and machine learning algorithms for pothole detection. It covers topics such as sensing systems for acquiring two-dimensional (2D) and 3D road data, classical algorithms based on 2D image processing, segmentation-based algorithms using 3D point cloud modeling, machine learning, deep learning algorithms, and hybrid approaches. The review highlights that hybrid methods combining traditional image processing and advanced machine learning techniques offer the highest accuracy in pothole detection. Machine learning approaches, particularly deep learning, demonstrate superior adaptability and detection rates, while traditional 2D and 3D methods provide valuable baseline techniques. By reviewing and evaluating existing vision-based methods, this paper clarifies the current landscape of pothole detection technologies and identifies opportunities for future research and development. Additionally, insights provided by this review can inform the design and implementation of more robust and effective systems for automated road surface condition assessment, thereby contributing to enhanced roadway safety and infrastructure management.

Evaluation of data representation techniques for vibration based road surface condition classification

The accurate classification of road surface conditions plays a vital role in ensuring road safety and effective maintenance. Vibration-based techniques have shown promise in this domain, leveraging the unique vibration signatures generated by vehicles to identify different road conditions. In this study, we focus on utilizing vehicle-mounted vibration sensors to collect road surface vibrations and comparing various data representation techniques for classifying road surface conditions into four classes: normal road surface, potholes, bad road surface, and speedbumps. Our experimental results reveal that the combination of multiple data representation techniques results in higher performance, with an average accuracy of 93.4%. This suggests that the integration of deep neural networks and signal processing techniques can produce a high-level representation better suited for challenging multivariate time series classification issues.

Research on distributed strain monitoring of a bridge based on a strained optical cable with weak fiber Bragg grating array

The foundation of an intelligent highway network is the construction of a high-density distributed strain monitoring system, which is based on sensing elements that can sensitively capture external information. In this research, the development and application for the structure of a novel strained optical fiber cable based on the weak fiber Bragg grating (wFBG) arrays are discussed. A modulation and demodulation solution of wavelength division multiplexing combined with time division multiplexing is developed by utilizing the property by which the wavelength of the strained optical fiber cable is periodically switched. Further, the strain transfer model of the optical cable is analyzed hierarchically using the theory of elasticity. The strain transfer coefficients of the overhanging region and the gluing region are combined to deduce the sensitivity model of the strained optical fiber cable. Moreover, the finite element technique is integrated to optimize the structural parameters of the optical cable for high-sensitivity or large-scale range. The strained optical fiber cable based on wFBG arrays is applied to a steel-concrete composite bridge. The static and dynamic loading tests show that the sensing optical cable can be monitored for strain variation in order to realize the functions of lane identification, weighing vehicle tonnage as well as velocity discrimination.

A Vibration-Based Methodology to Monitor Road Surface: A Process to Overcome the Speed Effect

Road pavement monitoring represents the starting point for the pavement maintenance process. To quickly fix a damaged road, relevant authorities need a high-efficiency methodology that allows them to obtain data describing the current conditions of a road network. In urban areas, large-scale monitoring campaigns may be more expensive and not fast enough to describe how pavement degradation has evolved over time. Furthermore, at low speeds, many technologies are inadequate for monitoring the streets. In such a context, employing black-box-equipped vehicles to perform a routine inspection could be an excellent starting point. However, the vibration-based methodologies used to detect road anomalies are strongly affected by the speed of the monitoring vehicles. This study uses a statistical method to analyze the effects of speed on road pavement conditions at different severity levels, through data recorded by taxi vehicles. Likewise, the study introduces a process to overcome the speed effect in the measurements. The process relies on a machine learning approach to define the decision boundaries to predict the severity level of the road surface condition based on two recorded parameters only: speed and pavement deterioration index. The methodology has succeeded in predicting the correct damage severity level in more than 80% of the dataset, through a user-friendly real-time method.

Sensor Fusion in Autonomous Vehicle with Traffic Surveillance Camera System: Detection, Localization, and AI Networking

Complete autonomous systems such as self-driving cars to ensure the high reliability and safety of humans need the most efficient combination of four-dimensional (4D) detection, exact localization, and artificial intelligent (AI) networking to establish a fully automated smart transportation system. At present, multiple integrated sensors such as light detection and ranging (LiDAR), radio detection and ranging (RADAR), and car cameras are frequently used for object detection and localization in the conventional autonomous transportation system. Moreover, the global positioning system (GPS) is used for the positioning of autonomous vehicles (AV). These individual systems' detection, localization, and positioning efficiency are insufficient for AV systems. In addition, they do not have any reliable networking system for self-driving cars carrying us and goods on the road. Although the sensor fusion technology of car sensors came up with good efficiency for detection and location, the proposed convolutional neural networking approach will assist to achieve a higher accuracy of 4D detection, precise localization, and real-time positioning. Moreover, this work will establish a strong AI network for AV far monitoring and data transmission systems. The proposed networking system efficiency remains the same on under-sky highways as well in various tunnel roads where GPS does not work properly. For the first time, modified traffic surveillance cameras have been exploited in this conceptual paper as an external image source for AV and anchor sensing nodes to complete AI networking transportation systems. This work approaches a model that solves AVs' fundamental detection, localization, positioning, and networking challenges with advanced image processing, sensor fusion, feathers matching, and AI networking technology. This paper also provides an experienced AI driver concept for a smart transportation system with deep learning technology.

The Use of Terrestrial and Maritime Autonomous Vehicles in Nonintrusive Object Inspection

Traditional nonintrusive object inspection methods are complex or extremely expensive to apply in certain cases, such as inspection of enormous objects, underwater or maritime inspection, an unobtrusive inspection of a crowded place, etc. With the latest advances in robotics, autonomous self-driving vehicles could be applied for this task. The present study is devoted to a review of the existing and novel technologies and methods of using autonomous self-driving vehicles for nonintrusive object inspection. Both terrestrial and maritime self-driving vehicles, their typical construction, sets of sensors, and software algorithms used for implementing self-driving motion were analyzed. The standard types of sensors used for nonintrusive object inspection in security checks at the control points, which could be successfully implemented at self-driving vehicles, along with typical areas of implementation of such vehicles, were reviewed, analyzed, and classified.

IoT for measuring road network quality index

Egypt has been fighting the issue of ensuring road safety‚ reducing accidents‚ preserving the lives of citizens since its inception. For these reasons‚ precisely identifying the road condition‚ followed by effective and timely maintenance and rehabilitation measures‚ leads to an increase in the road network's safety level and lifespan. This paper presents a multi-input deep learning framework that combines BiLSTM and Depthwise separable convolution to work in parallel for automatic recognition of road surface quality and different road anomalies. Furthermore, we performed an investigation to compare deep networks approaches against other traditional approaches using real-time data sensed and collected from the Egyptian road network. The proposed deep model has achieved an average accuracy of 93.1%‚ which is superior compared to other evaluated approaches. Finally, we utilized the proposed model to estimate a road quality index in the Egyptian cities.

Data Augmentation for Deep-Learning-Based Multiclass Structural Damage Detection Using Limited Information

The deterioration of infrastructure's health has become more predominant on a global scale during the 21st century. Aging infrastructure as well as those structures damaged by natural disasters have prompted the research community to improve state-of-the-art methodologies for conducting Structural Health Monitoring (SHM). The necessity for efficient SHM arises from the hazards damaged infrastructure imposes, often resulting in structural collapse, leading to economic loss and human fatalities. Furthermore, day-to-day operations in these affected areas are limited until an inspection is performed to assess the level of damage experienced by the structure and the required rehabilitation determined. However, human-based inspections are often labor-intensive, inefficient, subjective, and restricted to accessible site locations, which ultimately negatively impact our ability to collect large amounts of data from inspection sites. Though Deep-Learning (DL) methods have been heavily explored in the past decade to rectify the limitations of traditional methods and automate structural inspection, data scarcity continues to remain prevalent within the field of SHM. The absence of sufficiently large, balanced, and generalized databases to train DL-based models often results in inaccurate and biased damage predictions. Recently, Generative Adversarial Networks (GANs) have received attention from the SHM community as a data augmentation tool by which a training dataset can be expanded to improve the damage classification. However, there are no existing studies within the SHM field which investigate the performance of DL-based multiclass damage identification using synthetic data generated from GANs. Therefore, this paper investigates the performance of a convolutional neural network architecture using synthetic images generated from a GAN for multiclass damage detection of concrete surfaces. Through this study, it was determined the average classification performance of the proposed CNN on hybrid datasets decreased by 10.6% and 7.4% for validation and testing datasets when compared to the same model trained entirely on real samples. Moreover, each model's performance decreased on average by 1.6% when comparing a singular model trained with real samples and the same model trained with both real and synthetic samples for a given training configuration. The correlation between classification accuracy and the amount and diversity of synthetic data used for data augmentation is quantified and the effect of using limited data to train existing GAN architectures is investigated. It was observed that the diversity of the samples decreases and correlation increases with the increase in the number of synthetic samples.

Dissecting Latency in 360° Video Camera Sensing Systems

360° video camera sensing is an increasingly popular technology. Compared with traditional 2D video systems, it is challenging to ensure the viewing experience in 360° video camera sensing because the massive omnidirectional data introduce adverse effects on start-up delay, event-to-eye delay, and frame rate. Therefore, understanding the time consumption of computing tasks in 360° video camera sensing becomes the prerequisite to improving the system's delay performance and viewing experience. Despite the prior measurement studies on 360° video systems, none of them delves into the system pipeline and dissects the latency at the task level. In this paper, we perform the first in-depth measurement study of task-level time consumption for 360° video camera sensing. We start with identifying the subtle relationship between the three delay metrics and the time consumption breakdown across the system computing task. Next, we develop an open research prototype Zeus to characterize this relationship in various realistic usage scenarios. Our measurement of task-level time consumption demonstrates the importance of the camera CPU-GPU transfer and the server initialization, as well as the negligible effect of 360° video stitching on the delay metrics. Finally, we compare Zeus with a commercial system to validate that our results are representative and can be used to improve today's 360° video camera sensing systems.

LiDAR-Based Structural Health Monitoring: Applications in Civil Infrastructure Systems

As innovative technologies emerge, extensive research has been undertaken to develop new structural health monitoring procedures. The current methods, involving on-site visual inspections, have proven to be costly, time-consuming, labor-intensive, and highly subjective for assessing the safety and integrity of civil infrastructures. Mobile and stationary LiDAR (Light Detection and Ranging) devices have significant potential for damage detection, as the scans provide detailed geometric information about the structures being evaluated. This paper reviews the recent developments for LiDAR-based structural health monitoring, in particular, for detecting cracks, deformation, defects, or changes to structures over time. In this regard, mobile laser scanning (MLS) and terrestrial laser scanning (TLS), specific to structural health monitoring, were reviewed for a wide range of civil infrastructure systems, including bridges, roads and pavements, tunnels and arch structures, post-disaster reconnaissance, historical and heritage structures, roofs, and retaining walls. Finally, the existing limitations and future research directions of LiDAR technology for structural health monitoring are discussed in detail.