Detecting stranded macro-litter categories on drone orthophoto by a multi-class Neural Network

The use of artificial intelligence algorithms to detect macroplastics in aquatic environments: A critical review

The presence of macroplastic (MP) is having serious consequences on natural ecosystems, directly affecting biota and human wellbeing. Given this scenario, estimating MPs' abundance is crucial for assessing the issue and formulating effective waste management strategies. In this context, the main objective of this critical review is to analyze the use of machine learning (ML) techniques, with a particular interest in deep learning (DL) approaches, to detect, classify and quantify MPs in aquatic environments, supported by datasets such as satellite or aerial images and video recordings taken by unmanned aerial vehicles. This article provides a concise overview of artificial intelligence concepts, followed by a bibliometric analysis and a critical review. The search methodology aimed to categorize the scientific contributions through temporal and spatial criteria for bibliometric analysis, whereas the critical review was based on generating homogeneous groups according to the complexity of ML and DL methods, as well as the type of dataset. In light of the review carried out, classical ML techniques, such as random forest or support vector machines, showed robustness in MPs detection. However, it seems that achieving optimal efficiencies in multiclass classification is a limitation for these methods. Consequently, more advanced techniques such as DL approaches are taking the lead for the detection and multiclass classification of MPs. A series of architectures based on convolutional neural networks, and the use of complex pre-trained models through the transfer learning, are currently being explored (e.g., VGG16 and YOLO models), although currently the computational expense is high due to the need for processing large volumes of data. Additionally, there seems to be a trend towards detecting smaller plastic, which need higher resolution images. Finally, it is important to stress that since 2020 there has been a significant increase in scientific research focusing on transformer-based architectures for object detection. Although this can be considered the current state of the art, no studies have been identified that utilize these architectures for MP detection.

Application of improved machine learning in large-scale investigation of plastic waste distribution in tourism Intensive artificial coastlines

Oceans are ultimately a sink of plastic waste. Complex artificial coastlines pose remarkable challenges for coastal plastic waste monitoring. With the development of machine learning methods, high detection accuracy can be achieved; however, many false positives have been noted in various network models used for plastic waste investigation. In this study, extensive surveys of artificial coastlines were conducted using drones along the Dongjiang Port artificial coastline in the Binhai District, Tianjin, China. The deep learning model YOLOv8 was enhanced by integrating the InceptionNeXt and LSK modules into the network to improve its detection accuracy for plastic waste and reduce instances of tourists being misidentified as plastic. In total, 553 high-resolution coastline images with 3488 items of detected plastic waste were compared using the original and improved YOLOv8 models. The improved YOLOv8s-IL model achieved a detection rate of 64.9%, a notable increase of 11.5% compared with that of the original model. The number of false positives in the improved YOLOv8s-IL model was reduced to 32.3%, the multi-class F-score reached 76.5%, and the average detection time per image was only 2.7 s. The findings of this study provide technical support for future large-scale monitoring of plastic waste on artificial coastlines.

Drones for litter monitoring on coasts and rivers: suitable flight altitude and image resolution

Multirotor drones can be efficiently used to monitor macro-litter in coastal and riverine environments. Litter on beaches, dunes and riverbanks, along with floating litter on coastal and river waters, can be spotted and mapped from aerial drone images. Items detection and classification are prone to image resolution, which is expressed in terms of Ground Sampling Distance (GSD). The GSD is determined by drone flight altitude and camera properties. This paper investigates what is a suitable GSD value for litter survey. Drone flight altitude and camera setup should be chosen to obtain a GSD between 0.5 cm/px and 1.25 cm/px. Within this range, the lowest GSD allows litter categorization and classification, whereas the highest value should be adopted for a coarser litter census. In the vision of drawing up a global protocol for drone-based litter surveys, this work sets the ground for homogenizing data collection and litter assessments.

The octopus pot on the North Atlantic Iberian coast: A plague of plastic on beaches and dunes

This baseline focuses on the octopus pot, a litter item found on the North Atlantic Iberian coast. Octopus pots are deployed from vessels in ropes, with several hundred units, and placed on the seabed, to capture mostly Octopus Vulgaris. The loss of gears due to extreme seas state, bad weather and/or fishing-related unforeseen circumstances, cause the octopus pots contaminating beaches and dunes, where they are transported by sea current, waves and wind actions. This work i) gives an overview of the use of octopus pot on fisheries, ii) analyses the spatial distribution of this item on the coast, and iii) discusses the potential measures for tackling the octopus pot plague on the North Atlantic Iberian coast. Overall, it is urgent to promote conducive policies and strategies for a sustainable waste management of octopus pots, based on Reduce, Reuse and Recycle hierarchical framework.

Impacts of a massive beach music festival on a coastal ecosystem - A showcase in Portugal

Beach music festivals are numerous and popular worldwide. The concerns about the environmental sustainability of these events have been increasing among scientists, coastal managers and local communities. Nevertheless, the negative effects of beach music festivals on the coastal environment have been poorly studied. This work identified, analysed and discussed the eco-geomorphological impacts of a massive beach music festival held on a Portuguese beach-dune system over three days in July 2022. Drone-based orthophotos and pictures collected in the field were analysed to evaluate the impact of pre- and post-festival works, which turned the beach into a construction site over about twenty days. Digital Surface Model (DSM) analysis showed that beach configuration was approximately restored to the pre-festival configuration after the event. In contrast, the comparison of Normalized Difference Vegetation Index (NDVI) maps revealed that 18,500 m² of embryonic dune vegetation, which represented 35 % of the existing plant community, was removed by works on the beach and by trampling of festival attendees. To authors' knowledge, this is the first work that evaluates the eco-geomorphological impact of a massive beach music festival on the delicate coastal ecosystem. Overall, it contributes in raising awareness for making these events more respectful of the coastal environment.

'Eye in the sky': Off-the-shelf unmanned aerial vehicle (UAV) highlights exposure of marine turtles to floating litter (FML) in nearshore waters of Mayo Bay, Philippines

Litter is a serious threat to the marine environment, with detrimental effects on wildlife and marine biodiversity. Limited data as a result of funding and logistical challenges in developing countries hamper our understanding of the problem. Here, we employed commercial unmanned aerial vehicle (UAV) as a cost-effective tool to study the exposure of marine turtles to floating marine litter (FML) in waters of Mayo Bay, Philippines. A quadcopter UAV was flown autonomously with on-board camera capturing videos during the flight. Still frames were extracted when either turtle or litter were detected in post-flight processing. The extracted frames were georeferenced and mapped using QGIS software. Results showed that turtles are highly exposed to FML in nearshore waters. Moreover, spatial dependence between FML and turtles was also observed. The study highlights the effectiveness of UAVs in marine litter research and underscores the threat of FML to turtles in nearshore waters.

Beach litter survey by drones: Mini-review and discussion of a potential standardization

The abundance of beach litter has been increasing globally during the last decades, and it is an issue of global concern. A new survey strategy, based on uncrewed aerial vehicles (UAV, aka drones), has been recently adopted to improve the monitoring of beach macro-litter items abundance and distribution. This work identified and analysed the 15 studies that used drone for beach litter surveys on an operational basis. The analysis of technical parameters for drone flight deployment revealed that flight altitude varied between 5 and 40 m. The analysis of final assessments showed that, through manual and/or automated items detection on images, most of studies provided litter bulk characteristics (type, material and size), along with litter distribution maps. The potential standardization of drone-based litter survey would allow a comparison among surveys, however it seems difficult to propose a standard set of flight parameters, given the wide variety of coastal environments, the different devices available, and the diverse objectives of drone-based litter surveys. On the other hand, in our view, a set of common outcomes can be proposed, based on the grid mapping process, which can be easily generated following the procedure indicated in the paper. This work sets the ground for the development of a standardized protocol for drone litter data collection, analysis and assessments. This would allow the provision of broad scale comparative studies to support coastal management at both national and international scales.

UAV remote sensing applications in marine monitoring: Knowledge visualization and review

With the booming development of information technology and the growing demand for remote sensing data, unmanned aerial vehicle (UAV) remote sensing technology has emerged. In recent years, UAV remote sensing technology has developed rapidly and has been widely used in the fields of military defense, agricultural monitoring, surveying and mapping management, and disaster and emergency response and management. Currently, increasingly serious marine biological and environmental problems are raising the need for effective and timely monitoring. Compared with traditional marine monitoring technologies, UAV remote sensing is becoming an important means for marine monitoring thanks to its flexibility, efficiency and low cost, while still producing systematic data with high spatial and temporal resolutions. This study visualizes the knowledge domain of the application and research advances of UAV remote sensing in marine monitoring by analyzing 1130 articles (from 1993 to early 2022) using a bibliometric approach and provides a review of the application of UAVs in marine management mapping, marine disaster and environmental monitoring, and marine wildlife monitoring. It aims to promote the extensive application of UAV remote sensing in the field of marine research.

Close-range remote sensing-based detection and identification of macroplastics on water assisted by artificial intelligence: A review

Detection and identification of macroplastic debris in aquatic environments is crucial to understand and counter the growing emergence and current developments in distribution and deposition of macroplastics. In this context, close-range remote sensing approaches revealing spatial and spectral properties of macroplastics are very beneficial. To date, field surveys and visual census approaches are broadly acknowledged methods to acquire information, but since 2018 techniques based on remote sensing and artificial intelligence are advancing. Despite their proven efficiency, speed and wide applicability, there are still obstacles to overcome, especially when looking at the availability and accessibility of data. Thus, our review summarizes state-of-the-art research about the visual recognition and identification of different sorts of macroplastics. The focus is on both data acquisition techniques and evaluation methods, including Machine Learning and Deep Learning, but resulting products and published data will also be taken into account. Our aim is to provide a critical overview and outlook in a time where this research direction is thriving fast. This study shows that most Machine Learning and Deep Learning approaches are still in an infancy state regarding accuracy and detail when compared to visual monitoring, even though their results look very promising.

Detection of River Plastic Using UAV Sensor Data and Deep Learning

Plastic pollution is a critical global issue. Increases in plastic consumption have triggered increased production, which in turn has led to increased plastic disposal. In situ observation of plastic litter is tedious and cumbersome, especially in rural areas and around transboundary rivers. We therefore propose automatic mapping of plastic in rivers using unmanned aerial vehicles (UAVs) and deep learning (DL) models that require modest compute resources. We evaluate the method at two different sites: the Houay Mak Hiao River, a tributary of the Mekong River in Vientiane, Laos, and Khlong Nueng canal in Talad Thai, Khlong Luang, Pathum Thani, Thailand. Detection models in the You Only Look Once (YOLO) family are evaluated in terms of runtime resources and mean average Precision (mAP) at an Intersection over Union (IoU) threshold of 0.5. YOLOv5s is found to be the most effective model, with low computational cost and a very high mAP of 0.81 without transfer learning for the Houay Mak Hiao dataset. The performance of all models is improved by transfer learning from Talad Thai to Houay Mak Hiao. Pre-trained YOLOv4 with transfer learning obtains the overall highest accuracy, with a 3.0% increase in mAP to 0.83, compared to the marginal increase of 2% in mAP for pre-trained YOLOv5s. YOLOv3, when trained from scratch, shows the greatest benefit from transfer learning, with an increase in mAP from 0.59 to 0.81 after transfer learning from Talad Thai to Houay Mak Hiao. The pre-trained YOLOv5s model using the Houay Mak Hiao dataset is found to provide the best tradeoff between accuracy and computational complexity, requiring model resources yet providing reliable plastic detection with or without transfer learning. Various stakeholders in the effort to monitor and reduce plastic waste in our waterways can utilize the resulting deep learning approach irrespective of location.

Beached and Floating Litter Surveys by Unmanned Aerial Vehicles: Operational Analogies and Differences

The abundance of litter pollution in the marine environment has been increasing globally. Remote sensing techniques are valuable tools to advance knowledge on litter abundance, distribution and dynamics. Images collected by Unmanned Aerial Vehicles (UAV, aka drones) are highly efficient to map and monitor local beached (BL) and floating (FL) marine litter items. In this work, the operational insights to carry out both BL and FL surveys using UAVs are detailly described. In particular, flight planning and deployment, along with image products processing and analysis, are reported and compared. Furthermore, analogies and differences between UAV-based BL and FL mapping are discussed, with focus on the challenges related to BL and FL item detection and recognition. Given the efficiency of UAV to map BL and FL, this remote sensing technique can replace traditional methods for litter monitoring, further improving the knowledge of marine litter dynamics in the marine environment. This communication aims at helping researchers in planning and performing optimized drone-based BL and FL surveys.

Operational use of multispectral images for macro-litter mapping and categorization by Unmanned Aerial Vehicle

The use of Unmanned Aerial Systems (UAS, aka drones) has shown to be feasible to perform marine litter surveys. We operationally tested the use of multispectral images (5 bands) to classify litter type and material on a beach-dune system. For litter categorization by their multispectral characteristics, the Spectral Angle Mapping (SAM) technique was adopted. The SAM-based categorization of litter agreed with the visual classification, thus multispectral images can be used to fasten and/or making more robust the manual RGB image screening. Fully automated detection returned an F-score of 0.64, and a reasonable categorization of litter. Overall, the image-based litter density maps were in line with the manual detection. Assessments were promising given the complexity of the study area, where different dunes plants and partially-buried items challenged the UAS-based litter detection. The method can be easily implemented for both floating and beached litter, to advance litter survey in the environment.

Is coastal erosion a source of marine litter pollution? Evidence of coastal dunes being a reservoir of plastics

This baseline reports scientific evidence of marine litter items embedded in the dune volume at two study sites on the North Atlantic Portuguese coast. We described how stranded litter participate in the sand dune growth/erosion processes on a natural beach-dune system. From the storm-eroded foredunes on the urbanized beach, we documented exhumed plastics with age up to 38 years. Whether litter burial was due to beach-dune morphodynamic processes, or to irresponsible and/or illegal dumping in the past, this work emphasises the need of improving buried litter census and monitoring on coastal dunes. Coastal erosion processes may further exhume litter buried in dune volumes and on other coastal environments over short- and long-term, re-exposing items into the marine environment. Thus, coastal erosion can be accounted as a secondary diffuse source of littering pollution, beside the multiple sources already identified in the environment.

Citizen Science for Marine Litter Detection and Classification on Unmanned Aerial Vehicle Images

Unmanned aerial vehicles (UAV, aka drones) are being used for mapping macro-litter in the environment. As drone images require a manual processing task for detecting marine litter, it is of interest to evaluate the accuracy of non-expert citizen science operators (CSO) in performing this task. Students from Italian secondary schools (in this work, the CSO) were invited to identify, mark, and classify stranded litter items on a UAV orthophoto collected on an Italian beach. A specific training program and working tools were developed for the aim. The comparison with the standard in situ visual census survey returned a general underestimation (50%) of items. However, marine litter bulk categorisation was fairly in agreement with the in situ survey, especially for sources classification. The concordance level among CSO ranged between 60% and 91%, depending on the item properties considered (type, material, and colour). As the assessment accuracy was in line with previous works developed by experts, remote detection of marine litter on UAV images can be improved through citizen science programs, upon an appropriate training plan and provision of specific tools.

UAV Approach for Detecting Plastic Marine Debris on the Beach: A Case Study in the Po River Delta (Italy)

Anthropogenic marine debris (AMD) represent a global threat for aquatic environments. It is important to locate and monitor the distribution and presence of macroplastics along beaches to prevent degradation into microplastics (MP), which are potentially more harmful and more difficult to remove. UAV imaging represents a quick method for acquiring pictures with a ground spatial resolution of a few centimeters. In this work, we investigate strategies for AMD mapping on beaches with different ground resolutions and with elevation and multispectral data in support of RGB orthomosaics. Operators with varying levels of expertise and knowledge of the coastal environment map the AMD on four to five transects manually, using a range of photogrammetric tools. The initial survey was repeated after one year; in both surveys, beach litter was collected and further analyzed in the laboratory. Operators assign three levels of confidence when recognizing and describing AMD. Preliminary validation of results shows that items identified with high confidence were almost always classified properly. Approaching the detected items in terms of surface instead of a simple count increased the percentage of mapped litter significantly when compared to those collected. Multispectral data in near-infrared (NIR) wavelengths and digital surface models (DSMs) did not significantly improve the efficiency of manual mapping, even if vegetation features were removed using NDVI maps. In conclusion, this research shows that a good solution for performing beach AMD mapping can be represented by using RGB imagery with a spatial resolution of about 200 pix/m for detecting macroplastics and, in particular, focusing on the largest items. From the point of view of assessing and monitoring potential sources of MP, this approach is not only feasible but also quick, practical, and sustainable.

Quantifying Floating Plastic Debris at Sea Using Vessel-Based Optical Data and Artificial Intelligence

Despite recent advances in remote sensing of large accumulations of floating plastic debris, mainly in coastal regions, the quantification of individual macroplastic objects (>50 cm) remains challenging. Here, we have trained an object-detection algorithm by selecting and labeling footage of floating plastic debris recorded offshore with GPS-enabled action cameras aboard vessels of opportunity. Macroplastic numerical concentrations are estimated by combining the object detection solution with bulk processing of the optical data. Our results are consistent with macroplastic densities predicted by global plastic dispersal models, and reveal first insights into how camera recorded offshore macroplastic densities compare to micro- and mesoplastic concentrations collected with neuston trawls.