Application of deep learning models to detect coastlines and shorelines

STIRUnet: SwinTransformer and inverted residual convolution embedding in unet for Sea-Land segmentation

Extraction of coastline from optical remote sensing images is of paramount importance for coastal zone management, erosion monitoring, and intelligent ocean construction. However, nearshore marine environment complexity presents a challenge when capturing small-scale and detailed information regarding coastlines. Furthermore, the presence of numerous tidal flats, suspended sediments, and coastal biological communities exacerbates the reduction in segmentation accuracy, which is particularly noticeable in medium-high-resolution remote sensing image segmentation tasks. Most previous related studies, based primarily on convolutional neural networks (CNNs) or traditional feature extraction methods, faced challenges in detailed pixel-level refinement and lacked comprehensive understanding of the studied images. Therefore, we proposed a new U-shaped deep learning model (STIRUnet) that combines the excellent global modeling ability of SwinTransformer with an improved CNN using an inverted residual module. The proposed method has the capability of global supervised feature learning and layer-by-layer feature extraction, and we conducted sea-land segmentation experiments using GF-HNCD and BSD remote sensing image datasets to validate the performance of the proposed model. The results indicate the following: 1) suspended sediments and coastal biological communities are major contributors to coastline blurring, and 2) the recovery of minute features (e.g., narrow watercourses and microscale artificial structures) effectively enhances edge details and leads to more realistic segmentation outcomes. The findings of this study are highly important in relation of accurate extraction of sea-land information in complex marine environments, and they offer novel insights regarding mixed-pixel identification.

Deep learning models for monitoring landscape changes in a UNESCO Global Geopark

By identifying Earth heritage sites, UNESCO Global Geoparks (UGGps) have promoted geo-tourism and regional economic prosperity. However, commercial and tourism development has altered the natural contexts of these geoparks, diminishing their initial value. Before implementing land use policies, spatial landscape parameters should be monitored in multiple dimensions and in real time. This study aims to develop Bilateral Segmentation Network (BiSeNet) models employing an upgraded U-structured neural network in order to monitor land use/cover changes and landscape indicators in a Vietnamese UGGp. This network has proven effective at preserving input image data and restricting the loss of spatial information in decoding data. To demonstrate the utility of deep learning, eight trained BiSeNet models were evaluated against Maximum Likelihood, Support Vector Machine, and Random Forest. The trained BSN-Nadam model (128x128), with a precision of 94% and an information loss of 0.1, can become a valuable instrument for analyzing and monitoring monthly changes in land uses/covers once tourism activities have been rapidly expanded. Three tourist routes and 41 locations in the Dak Nong UGGp were monitored for 30 years using three landscape indices: Disjunct Core Area Density (DCAD), Total Edge Contrast Index (TECI), Shannon's Diversity Index (SHDI), based on the results of the model. As a result, 18 identified geo-sites in the Daknong Geopark have been influenced significantly by agricultural and tourist activities since 2010, making these sites less uniform and unsustainable management. It promptly alerts UNESCO management to the deterioration of geological sites caused by urbanization and tourist development.

Comparison between U-shaped structural deep learning models to detect landslide traces

Landslides endanger lives and public infrastructure in mountainous areas. Monitoring landslide traces in real-time is difficult for scientists, sometimes costly and risky because of the harsh terrain and instability. Nowadays, modern technology may be able to identify landslide-prone locations and inform locals for hours or days when the weather worsens. This study aims to propose indicators to detect landslide traces on the fields and remote sensing images; build deep learning (DL) models to identify landslides from Sentinel-2 images automatically; and apply DL-trained models to detect this natural hazard in some particular areas of Vietnam. Nine DL models were trained based on three U-shaped architectures, including U-Net, U2-Net, and U-Net3+, and three options of input sizes. The multi-temporal Sentinel-2 images were chosen as input data for training all models. As a result, the U-Net, using an input image size of 32 × 32 and a performance of 97 % with a loss function of 0.01, can detect typical landslide traces in Vietnam. Meanwhile, the U-Net (64 × 64) can detect more considerable landslide traces. Based on multi-temporal remote sensing data, a different case study in Vietnam was chosen to see landslide traces over time based on the trained U-Net (32 × 32) model. The trained model allows mountain managers to track landslide occurrences during wet seasons. Thus, landslide incidents distant from residential areas may be discovered early to warn of flash floods.

Deep learning-based models for environmental management: Recognizing construction, renovation, and demolition waste in-the-wild

The construction industry generates a substantial volume of solid waste, often destinated for landfills, causing significant environmental pollution. Waste recycling is decisive in managing waste yet challenging due to labor-intensive sorting processes and the diverse forms of waste. Deep learning (DL) models have made remarkable strides in automating domestic waste recognition and sorting. However, the application of DL models to recognize the waste derived from construction, renovation, and demolition (CRD) activities remains limited due to the context-specific studies conducted in previous research. This paper aims to realistically capture the complexity of waste streams in the CRD context. The study encompasses collecting and annotating CRD waste images in real-world, uncontrolled environments. It then evaluates the performance of state-of-the-art DL models for automatically recognizing CRD waste in-the-wild. Several pre-trained networks are utilized to perform effectual feature extraction and transfer learning during DL model training. The results demonstrated that DL models, whether integrated with larger or lightweight backbone networks can recognize the composition of CRD waste streams in-the-wild which is useful for automated waste sorting. The outcome of the study emphasized the applicability of DL models in recognizing and sorting solid waste across various industrial domains, thereby contributing to resource recovery and encouraging environmental management efforts.

Coastal landscape classification using convolutional neural network and remote sensing data in Vietnam

The length of global coastline is about 356 thousand kilometers with various dynamic natural and anthropogenic. Although the number of studies on coastal landscape categorization has been increasing, it is still difficult to distinguish precisely them because the used methods commonly are traditional qualitative ones. With the leverage of remote sensing data and GIS tools, it helps categorize and identify a variety of features on land and water based on multi-source data. The aim of study is using different natural - social profile data obtained from ALOS, NOAA, and multi-temporal Landsat satellite images as input data of the convolutional-neural-network (CvNet) models for coastal landscape classification. Studies used 900 cut-line samples which represent coastal landscapes in Vietnam for training and optimizing CvNet models. As a result, nine coastal landscapes were identified including: deltas, alluvial, mature and young sand dunes, cliff, lagoon, tectonic, karst, and transitional landscapes. Three CvNet models using three different optimizer types classified the landscapes of other 1150 cut-lines in Vietnam with the accuracies about 98% and low loss function value. Excepting dalmatian, karst and delta coastal landscapes, five others distribute heterogeneous along the coasts in Vietnam. Therefore, the evaluation of additional natural components is necessary and CvNet model have ability to update new landscape types in variety of tropical nation as a step toward coastal landscape classification at both national and global scales.

AI explainability framework for environmental management research

Deep learning networks powered by AI are essential predictive tools relying on image data availability and processing hardware advancements. However, little attention has been paid to explainable AI (XAI) in application fields, including environmental management. This study develops an explainability framework with a triadic structure to focus on input, AI model and output. The framework provides three main contributions. (1) A context-based augmentation of input data to maximize generalizability and minimize overfitting. (2) A direct monitoring of AI model layers and parameters to use leaner (lighter) networks suitable for edge device deployment, (3) An output explanation procedure focusing on interpretability and robustness of predictive decisions by AI networks. These contributions significantly advance state of the art in XAI for environmental management research, offering implications for improved understanding and utilization of AI networks in this field.

SNOWED: Automatically Constructed Dataset of Satellite Imagery for Water Edge Measurements

Monitoring the shoreline over time is essential to quickly identify and mitigate environmental issues such as coastal erosion. Monitoring using satellite images has two great advantages, i.e., global coverage and frequent measurement updates; but adequate methods are needed to extract shoreline information from such images. To this purpose, there are valuable non-supervised methods, but more recent research has concentrated on deep learning because of its greater potential in terms of generality, flexibility, and measurement accuracy, which, in contrast, derive from the information contained in large datasets of labeled samples. The first problem to solve, therefore, lies in obtaining large datasets suitable for this specific measurement problem, and this is a difficult task, typically requiring human analysis of a large number of images. In this article, we propose a technique to automatically create a dataset of labeled satellite images suitable for training machine learning models for shoreline detection. The method is based on the integration of data from satellite photos and data from certified, publicly accessible shoreline data. It involves several automatic processing steps, aimed at building the best possible dataset, with images including both sea and land regions, and correct labeling also in the presence of complicated water edges (which can be open or closed curves). The use of independently certified measurements for labeling the satellite images avoids the great work required to manually annotate them by visual inspection, as is done in other works in the literature. This is especially true when convoluted shorelines are considered. In addition, possible errors due to the subjective interpretation of satellite images are also eliminated. The method is developed and used specifically to build a new dataset of Sentinel-2 images, denoted SNOWED; but is applicable to different satellite images with trivial modifications. The accuracy of labels in SNOWED is directly determined by the uncertainty of the shoreline data used, which leads to sub-pixel errors in most cases. Furthermore, the quality of the SNOWED dataset is assessed through the visual comparison of a random sample of images and their corresponding labels, and its functionality is shown by training a neural model for sea-land segmentation.

Deep learning-assisted automated sewage pipe defect detection for urban water environment management

A healthy sewage pipe system plays a significant role in urban water management by collecting and transporting wastewater and stormwater, which can be assessed by hydraulic model. However, sewage pipe defects have been observed frequently in recent years during regular pipe maintenance according to the captured interior videos of underground pipes by closed-circuit television (CCTV) robots. In this case, hydraulic model constructed based on a healthy pipe would produce large deviations with that in real hydraulic performance and even be out of work, which can result in unanticipated damages such as blockage collapse or stormwater overflows. Quick defect evaluation and defect quantification are the precondition to achieve risk assessment and model calibration of urban water management, but currently pipe defects assessment still largely relies on technicians to check the CCTV videos/images. An automated sewage pipe defect detection system is necessary to timely determine pipe issues and then rehabilitate or renew sewage pipes, while the rapid development of deep learning especially in recent five years provides a fantastic opportunity to construct automated pipe defect detection system by image recognition. Given the initial success of deep learning application in CCTV interpretation, the review (i) integrated the methodological framework of automated sewage pipe defect detection, including data acquisition, image pre-processing, feature extraction, model construction and evaluation metrics, (ii) discussed the state-of-the-art performance of deep learning in pipe defects classification, location, and severity rating evaluation (e.g., up to ~96 % of accuracy and 140 FPS of processing speed), and (iii) proposed risk assessment and model calibration in urban water management by considering pipe defects. This review introduces a novel practical application-oriented methodology including defect data acquisition by CCTV, model construction by deep learning, and model application, provides references for further improving accuracy and generalization ability of urban water management models in practical application.