Beached and Floating Litter Surveys by Unmanned Aerial Vehicles: Operational Analogies and Differences

The use of artificial intelligence algorithms to detect macroplastics in aquatic environments: A critical review

The presence of macroplastic (MP) is having serious consequences on natural ecosystems, directly affecting biota and human wellbeing. Given this scenario, estimating MPs' abundance is crucial for assessing the issue and formulating effective waste management strategies. In this context, the main objective of this critical review is to analyze the use of machine learning (ML) techniques, with a particular interest in deep learning (DL) approaches, to detect, classify and quantify MPs in aquatic environments, supported by datasets such as satellite or aerial images and video recordings taken by unmanned aerial vehicles. This article provides a concise overview of artificial intelligence concepts, followed by a bibliometric analysis and a critical review. The search methodology aimed to categorize the scientific contributions through temporal and spatial criteria for bibliometric analysis, whereas the critical review was based on generating homogeneous groups according to the complexity of ML and DL methods, as well as the type of dataset. In light of the review carried out, classical ML techniques, such as random forest or support vector machines, showed robustness in MPs detection. However, it seems that achieving optimal efficiencies in multiclass classification is a limitation for these methods. Consequently, more advanced techniques such as DL approaches are taking the lead for the detection and multiclass classification of MPs. A series of architectures based on convolutional neural networks, and the use of complex pre-trained models through the transfer learning, are currently being explored (e.g., VGG16 and YOLO models), although currently the computational expense is high due to the need for processing large volumes of data. Additionally, there seems to be a trend towards detecting smaller plastic, which need higher resolution images. Finally, it is important to stress that since 2020 there has been a significant increase in scientific research focusing on transformer-based architectures for object detection. Although this can be considered the current state of the art, no studies have been identified that utilize these architectures for MP detection.

How much does marine litter weigh? A literature review to improve monitoring, support modelling and optimize clean-up activities

The weight of marine litter has been marginally considered in comparison to counting and categorizing items. However, weight determines litter dynamics on water and coasts, and it is an essential parameter for planning and optimizing clean-up activities. This work reviewed 80 publications that reported both the number and weight of beached macro-litter worldwide. On average, a litter item weighed 19.5 ± 20.3 g, with a median weight of 13.4 g. Plastics composed 80% by number and 51% by weight of the global litter bulk. A plastic item weighed 12.9 ± 13.8 g on average, with a median weight of 9 g. The analysis based on continents and on water bodies returned similar values, which can be used to estimate litter weight on beaches from past and future visual census surveys, and from remote sensing imagery. Overall, this work can improve litter monitoring reports and support dynamics modelling, thereby contributing for environmental protection and mitigation efforts.

Development of a trash classification system to map potential Aedes aegypti breeding grounds using unmanned aerial vehicle imaging

Aedes aegypti mosquitos are the primary vector for dengue, chikungunya, and Zika viruses and tend to breed in small containers of water, with a propensity to breed in small piles of trash and abandoned tires. This study piloted the use of aerial imaging to map and classify potential Ae. aegypti breeding sites with a specific focus on trash, including discarded tires. Aerial images of coastal and inland sites in Kenya were obtained using an unmanned aerial vehicle. Aerial images were reviewed for identification of trash and suspected trash mimics, followed by extensive community walk-throughs to identify trash types and mimics by description and ground photography. An expert panel reviewed aerial images and ground photos to develop a classification scheme and evaluate the advantages and disadvantages of aerial imaging versus walk-through trash mapping. A trash classification scheme was created based on trash density, surface area, potential for frequent disturbance, and overall likelihood of being a productive Ae. aegypti breeding site. Aerial imaging offers a novel strategy to characterize, map, and quantify trash at risk of promoting Ae. aegypti proliferation, generating opportunities for further research on trash associations with disease and trash interventions.

Marine litter weight estimation from UAV imagery: Three potential methodologies to advance macrolitter reports

In the context of marine litter monitoring, reporting the weight of beached litter can contribute to a better understanding of pollution sources and support clean-up activities. However, the litter scaling task requires considerable effort and specific equipment. This experimental study proposes and evaluates three methods to estimate beached litter weight from aerial images, employing different levels of litter categorization. The most promising approach (accuracy of 80 %) combined the outcomes of manual image screening with a generalized litter mean weight (14 g) derived from studies in the literature. Although the other two methods returned values of the same magnitude as the ground-truth, they were found less feasible for the aim. This study represents the first attempt to assess marine litter weight using remote sensing technology. Considering the exploratory nature of this study, further research is needed to enhance the reliability and robustness of the methods.

Assessment of beach macrolitter using unmanned aerial systems: A study along the Bulgarian Black Sea Coast

Over the years, the Black Sea has been impacted by the issue of marine litter, which poses ecological and health threats. A mid-term monitoring program initiated in 2018 assessed the abundance, density, and composition of beach litter (BL) on 40 frequently visited beaches. From 2018 to 2022, there was a significant increase in average abundance, rising by 261 %. Artificial polymer materials accounted for the majority (84 %) of the litter. Land-based sources dominated 77 % of the litter. The Clean Coast Index (CCI) categorized the beaches as "moderate" with an average value of 8.9 for the period between 2018 and 2022. However, the years 2021 and 2022, during the COVID-19 epidemic, were identified as the "dirtiest period" with 11 beaches classified as "extremely dirty" due to high domestic tourist pressure. The study demonstrates a successful combination of standard in situ visual assessment supported by unmanned aerial systems for beach litter surveys.

Drones for litter monitoring on coasts and rivers: suitable flight altitude and image resolution

Multirotor drones can be efficiently used to monitor macro-litter in coastal and riverine environments. Litter on beaches, dunes and riverbanks, along with floating litter on coastal and river waters, can be spotted and mapped from aerial drone images. Items detection and classification are prone to image resolution, which is expressed in terms of Ground Sampling Distance (GSD). The GSD is determined by drone flight altitude and camera properties. This paper investigates what is a suitable GSD value for litter survey. Drone flight altitude and camera setup should be chosen to obtain a GSD between 0.5 cm/px and 1.25 cm/px. Within this range, the lowest GSD allows litter categorization and classification, whereas the highest value should be adopted for a coarser litter census. In the vision of drawing up a global protocol for drone-based litter surveys, this work sets the ground for homogenizing data collection and litter assessments.

The octopus pot on the North Atlantic Iberian coast: A plague of plastic on beaches and dunes

This baseline focuses on the octopus pot, a litter item found on the North Atlantic Iberian coast. Octopus pots are deployed from vessels in ropes, with several hundred units, and placed on the seabed, to capture mostly Octopus Vulgaris. The loss of gears due to extreme seas state, bad weather and/or fishing-related unforeseen circumstances, cause the octopus pots contaminating beaches and dunes, where they are transported by sea current, waves and wind actions. This work i) gives an overview of the use of octopus pot on fisheries, ii) analyses the spatial distribution of this item on the coast, and iii) discusses the potential measures for tackling the octopus pot plague on the North Atlantic Iberian coast. Overall, it is urgent to promote conducive policies and strategies for a sustainable waste management of octopus pots, based on Reduce, Reuse and Recycle hierarchical framework.

Impacts of a massive beach music festival on a coastal ecosystem - A showcase in Portugal

Beach music festivals are numerous and popular worldwide. The concerns about the environmental sustainability of these events have been increasing among scientists, coastal managers and local communities. Nevertheless, the negative effects of beach music festivals on the coastal environment have been poorly studied. This work identified, analysed and discussed the eco-geomorphological impacts of a massive beach music festival held on a Portuguese beach-dune system over three days in July 2022. Drone-based orthophotos and pictures collected in the field were analysed to evaluate the impact of pre- and post-festival works, which turned the beach into a construction site over about twenty days. Digital Surface Model (DSM) analysis showed that beach configuration was approximately restored to the pre-festival configuration after the event. In contrast, the comparison of Normalized Difference Vegetation Index (NDVI) maps revealed that 18,500 m² of embryonic dune vegetation, which represented 35 % of the existing plant community, was removed by works on the beach and by trampling of festival attendees. To authors' knowledge, this is the first work that evaluates the eco-geomorphological impact of a massive beach music festival on the delicate coastal ecosystem. Overall, it contributes in raising awareness for making these events more respectful of the coastal environment.

Understanding through drone image analysis the interactions between geomorphology, vegetation and marine debris along a sandy spit

Marine litter (ML) is recognized as one of the main socio-economic and environmental concerns and monitoring operations have been realized worldwide in order to collect information on the types, quantities and distribution of marine debris. In this study, we used Unmanned Aerial Vehicle (UAV) images to map the presence of ML on a coastal spit in relation to geomorphological aspects and vegetation. Our results show that ML is present everywhere, but concentrates in the beach wrack, dunes, and saltmarshes, highlighting the role of the vegetation in trapping ML. Moreover, ML will most probably remain trapped by the saltmarsh vegetation, since they are not visible and easily accessible to allow cleaning operations. On the contrary, cleaning operations may remove the ML present in the beach wrack. Finally, our results provide useful information to support decision-makers for improving beach cleaning activities in the Po river Delta areas (Italy).

'Eye in the sky': Off-the-shelf unmanned aerial vehicle (UAV) highlights exposure of marine turtles to floating litter (FML) in nearshore waters of Mayo Bay, Philippines

Litter is a serious threat to the marine environment, with detrimental effects on wildlife and marine biodiversity. Limited data as a result of funding and logistical challenges in developing countries hamper our understanding of the problem. Here, we employed commercial unmanned aerial vehicle (UAV) as a cost-effective tool to study the exposure of marine turtles to floating marine litter (FML) in waters of Mayo Bay, Philippines. A quadcopter UAV was flown autonomously with on-board camera capturing videos during the flight. Still frames were extracted when either turtle or litter were detected in post-flight processing. The extracted frames were georeferenced and mapped using QGIS software. Results showed that turtles are highly exposed to FML in nearshore waters. Moreover, spatial dependence between FML and turtles was also observed. The study highlights the effectiveness of UAVs in marine litter research and underscores the threat of FML to turtles in nearshore waters.

Beach litter survey by drones: Mini-review and discussion of a potential standardization

The abundance of beach litter has been increasing globally during the last decades, and it is an issue of global concern. A new survey strategy, based on uncrewed aerial vehicles (UAV, aka drones), has been recently adopted to improve the monitoring of beach macro-litter items abundance and distribution. This work identified and analysed the 15 studies that used drone for beach litter surveys on an operational basis. The analysis of technical parameters for drone flight deployment revealed that flight altitude varied between 5 and 40 m. The analysis of final assessments showed that, through manual and/or automated items detection on images, most of studies provided litter bulk characteristics (type, material and size), along with litter distribution maps. The potential standardization of drone-based litter survey would allow a comparison among surveys, however it seems difficult to propose a standard set of flight parameters, given the wide variety of coastal environments, the different devices available, and the diverse objectives of drone-based litter surveys. On the other hand, in our view, a set of common outcomes can be proposed, based on the grid mapping process, which can be easily generated following the procedure indicated in the paper. This work sets the ground for the development of a standardized protocol for drone litter data collection, analysis and assessments. This would allow the provision of broad scale comparative studies to support coastal management at both national and international scales.

Aerial and underwater drones for marine litter monitoring in shallow coastal waters: factors influencing item detection and cost-efficiency

Although marine litter monitoring has increased over the years, the pollution of coastal waters is still understudied and there is a need for spatial and temporal data. Aerial (UAV) and underwater (ROV) drones have demonstrated their potential as monitoring tools at coastal sites; however, suitable conditions for use and cost-efficiency of the methods still need attention. This study tested UAVs and ROVs for the monitoring of floating, submerged, and seafloor items using artificial plastic plates and assessed the influence of water conditions (water transparency, color, depth, bottom substrate), item characteristics (color and size), and method settings (flight/dive height) on detection accuracy. A cost-efficiency analysis suggests that both UAV and ROV methods lie within the same cost and efficiency category as current on-boat observation and scuba diving methods and shall be considered for further testing in real scenarios for official marine litter monitoring methods.

Close-range remote sensing-based detection and identification of macroplastics on water assisted by artificial intelligence: A review

Detection and identification of macroplastic debris in aquatic environments is crucial to understand and counter the growing emergence and current developments in distribution and deposition of macroplastics. In this context, close-range remote sensing approaches revealing spatial and spectral properties of macroplastics are very beneficial. To date, field surveys and visual census approaches are broadly acknowledged methods to acquire information, but since 2018 techniques based on remote sensing and artificial intelligence are advancing. Despite their proven efficiency, speed and wide applicability, there are still obstacles to overcome, especially when looking at the availability and accessibility of data. Thus, our review summarizes state-of-the-art research about the visual recognition and identification of different sorts of macroplastics. The focus is on both data acquisition techniques and evaluation methods, including Machine Learning and Deep Learning, but resulting products and published data will also be taken into account. Our aim is to provide a critical overview and outlook in a time where this research direction is thriving fast. This study shows that most Machine Learning and Deep Learning approaches are still in an infancy state regarding accuracy and detail when compared to visual monitoring, even though their results look very promising.

Detection of River Plastic Using UAV Sensor Data and Deep Learning

Plastic pollution is a critical global issue. Increases in plastic consumption have triggered increased production, which in turn has led to increased plastic disposal. In situ observation of plastic litter is tedious and cumbersome, especially in rural areas and around transboundary rivers. We therefore propose automatic mapping of plastic in rivers using unmanned aerial vehicles (UAVs) and deep learning (DL) models that require modest compute resources. We evaluate the method at two different sites: the Houay Mak Hiao River, a tributary of the Mekong River in Vientiane, Laos, and Khlong Nueng canal in Talad Thai, Khlong Luang, Pathum Thani, Thailand. Detection models in the You Only Look Once (YOLO) family are evaluated in terms of runtime resources and mean average Precision (mAP) at an Intersection over Union (IoU) threshold of 0.5. YOLOv5s is found to be the most effective model, with low computational cost and a very high mAP of 0.81 without transfer learning for the Houay Mak Hiao dataset. The performance of all models is improved by transfer learning from Talad Thai to Houay Mak Hiao. Pre-trained YOLOv4 with transfer learning obtains the overall highest accuracy, with a 3.0% increase in mAP to 0.83, compared to the marginal increase of 2% in mAP for pre-trained YOLOv5s. YOLOv3, when trained from scratch, shows the greatest benefit from transfer learning, with an increase in mAP from 0.59 to 0.81 after transfer learning from Talad Thai to Houay Mak Hiao. The pre-trained YOLOv5s model using the Houay Mak Hiao dataset is found to provide the best tradeoff between accuracy and computational complexity, requiring model resources yet providing reliable plastic detection with or without transfer learning. Various stakeholders in the effort to monitor and reduce plastic waste in our waterways can utilize the resulting deep learning approach irrespective of location.

On the 3D Reconstruction of Coastal Structures by Unmanned Aerial Systems with Onboard Global Navigation Satellite System and Real-Time Kinematics and Terrestrial Laser Scanning

A wide variety of hard structures protect coastal activities and communities from the action of tides and waves worldwide. It is fundamental to monitor the integrity of coastal structures, as interventions and repairs may be needed in case of damages. This work compares the effectiveness of an Unmanned Aerial System (UAS) and a Terrestrial Laser Scanner (TLS) to reproduce the 3D geometry of a rocky groin. The Structure-from-Motion (SfM) photogrammetry technique applied on drone images generated a 3D point cloud and a Digital Surface Model (DSM) without data gaps. Even though the TLS returned a 3D point cloud four times denser than the drone one, the TLS returned a DSM which was not representing about 16% of the groin (data gaps). This was due to the occlusions encountered by the low-lying scans determined by the displaced rocks composing the groin. Given also that the survey by UAS was about eight time faster than the TLS, the SFM-MV applied on UAS images was the most suitable technique to reconstruct the rocky groin. The UAS remote sensing technique can be considered a valid alternative to monitor all types of coastal structures, to improve the inspection of likely damages, and to support coastal structure management.