1
|
Ling W, Feng X, Wang L, Zhu Z, Wang S, Fu H, Zhang S, Zhao Y. Prediction method of surface subsidence induced by block caving method based on UAV oblique photogrammetry. Sci Rep 2024; 14:24630. [PMID: 39428408 PMCID: PMC11491491 DOI: 10.1038/s41598-024-74864-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2024] [Accepted: 09/30/2024] [Indexed: 10/22/2024] Open
Abstract
Unmanned Aerial Vehicle (UAV) oblique photogrammetry has been extensively employed in mining, albeit predominantly for reconstructing three-dimensional scenes and detecting changes within mining sites, lacking predictive capabilities. Leveraging 3D real scene model data, this study presents a two-stage prediction model, merging the probabilistic integral method with recurrent neural network (PIMF-RNN), to mitigate the impact of internal and external factors on surface subsidence, thereby enhancing predictive accuracy. Building upon this framework, a methodology was developed to forecast the maximum surface subsidence height and affected area under the block caving method, offering crucial data support for mitigating hazards associated with this mining technique. Analysis of surface data from Pulang copper mine during 2018-2020 demonstrates a prediction accuracy of 91.47% for maximum surface subsidence height and 87.52% for subsidence area. This research expands the potential applications of UAV oblique photogrammetry techniques within mining contexts. Furthermore, it establishes a cost-effective and efficient operational procedure for predicting mine surface subsidence.
Collapse
Affiliation(s)
- Weijia Ling
- School of Resources and Environment and Safety Engineering, University of South China, Hengyang, 421001, China
| | - Xinglong Feng
- School of Resources and Safety Engineering, Central South University, Changsha, 410083, China
- Yunnan Diqing Non-Ferrous Metal Limited Liability Company, Shangri-La, 674400, China
| | - Liguan Wang
- School of Resources and Safety Engineering, Central South University, Changsha, 410083, China
- Changsha Digital Mine Co. LTD, Changsha, 410083, China
| | - Zhonghua Zhu
- School of Resources and Environment and Safety Engineering, University of South China, Hengyang, 421001, China.
- Changsha Digital Mine Co. LTD, Changsha, 410083, China.
| | - Shiwen Wang
- Yunnan Diqing Non-Ferrous Metal Limited Liability Company, Shangri-La, 674400, China
| | - Haiying Fu
- School of Resources and Environment and Safety Engineering, University of South China, Hengyang, 421001, China
| | - Shuwen Zhang
- School of Resources and Environment and Safety Engineering, University of South China, Hengyang, 421001, China
| | - Ying Zhao
- School of Resources and Environment and Safety Engineering, University of South China, Hengyang, 421001, China
| |
Collapse
|
2
|
Román A, Navarro G, Tovar-Sánchez A, Zarandona P, Roque-Atienza D, Barbero L. ShetlandsUAVmetry: unmanned aerial vehicle-based photogrammetric dataset for Antarctic environmental research. Sci Data 2024; 11:202. [PMID: 38355698 PMCID: PMC10866955 DOI: 10.1038/s41597-024-03045-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2023] [Accepted: 02/05/2024] [Indexed: 02/16/2024] Open
Abstract
The study of the functioning and responses of Antarctica to the current climate change scenario is a priority and a challenge for the scientific community aiming to predict and mitigate impacts at a regional and global scale. Due to the difficulty of obtaining aerial data in such extreme, remote, and difficult-to-reach region of the planet, the development of remote sensing techniques with Unmanned Aerial Vehicles (UAVs) has revolutionized polar research. ShetlandsUAVmetry comprises original datasets collected by UAVs during the Spanish Antarctic Campaign 2021-2022 (January to March 2022), along with the photogrammetric products resulting from their processing. It includes data recorded during twenty-eight distinct UAV flights at various study sites on Deception and Livingston islands (South Shetland Islands, Antarctica) and consists of a total of 15,691 high-resolution optical RGB captures. In addition, this dataset is accompanied by additional associated files that facilitate its use and accessibility. It is publicly accessible and can be downloaded from the figshare data repository.
Collapse
Affiliation(s)
- Alejandro Román
- Institute of Marine Sciences of Andalusia (ICMAN), Spanish National Research Council (CSIC), Department of Ecology and Coastal Management, 11510, Puerto Real, Spain.
| | - Gabriel Navarro
- Institute of Marine Sciences of Andalusia (ICMAN), Spanish National Research Council (CSIC), Department of Ecology and Coastal Management, 11510, Puerto Real, Spain
| | - Antonio Tovar-Sánchez
- Institute of Marine Sciences of Andalusia (ICMAN), Spanish National Research Council (CSIC), Department of Ecology and Coastal Management, 11510, Puerto Real, Spain
| | - Pedro Zarandona
- University of Cádiz, Department of Earth Sciences, International Campus of Excellence in Marine Science (CEIMAR), 11510, Puerto Real, Spain
| | - David Roque-Atienza
- King Abdullah University of Science and Technology (KAUST), 23955, Thuwal, Saudi Arabia
| | - Luis Barbero
- University of Cádiz, Department of Earth Sciences, International Campus of Excellence in Marine Science (CEIMAR), 11510, Puerto Real, Spain
| |
Collapse
|
3
|
Karthigesu J, Owari T, Tsuyuki S, Hiroshima T. UAV Photogrammetry for Estimating Stand Parameters of an Old Japanese Larch Plantation Using Different Filtering Methods at Two Flight Altitudes. SENSORS (BASEL, SWITZERLAND) 2023; 23:9907. [PMID: 38139752 PMCID: PMC10747785 DOI: 10.3390/s23249907] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/23/2023] [Revised: 12/08/2023] [Accepted: 12/14/2023] [Indexed: 12/24/2023]
Abstract
Old plantations are iconic sites, and estimating stand parameters is crucial for valuation and management. This study aimed to estimate stand parameters of a 115-year-old Japanese larch (Larix kaempferi (Lamb.) Carrière) plantation at the University of Tokyo Hokkaido Forest (UTHF) in central Hokkaido, northern Japan, using unmanned aerial vehicle (UAV) photogrammetry. High-resolution RGB imagery was collected using a DJI Matrice 300 real-time kinematic (RTK) at altitudes of 80 and 120 m. Structure from motion (SfM) technology was applied to generate 3D point clouds and orthomosaics. We used different filtering methods, search radii, and window sizes for individual tree detection (ITD), and tree height (TH) and crown area (CA) were estimated from a canopy height model (CHM). Additionally, a freely available shiny R package (SRP) and manually digitalized CA were used. A multiple linear regression (MLR) model was used to estimate the diameter at breast height (DBH), stem volume (V), and carbon stock (CST). Higher accuracy was obtained for ITD (F-score: 0.8-0.87) and TH (R2: 0.76-0.77; RMSE: 1.45-1.55 m) than for other stand parameters. Overall, the flying altitude of the UAV and selected filtering methods influenced the success of stand parameter estimation in old-aged plantations, with the UAV at 80 m generating more accurate results for ITD, CA, and DBH, while the UAV at 120 m produced higher accuracy for TH, V, and CST with Gaussian and mean filtering.
Collapse
Affiliation(s)
- Jeyavanan Karthigesu
- Department of Global Agricultural Sciences, Graduate School of Agricultural and Life Sciences, The University of Tokyo, Tokyo 113-8657, Japan; (J.K.); (S.T.); (T.H.)
- Department of Agronomy, Faculty of Agriculture, University of Jaffna, Jaffna 40000, Sri Lanka
| | - Toshiaki Owari
- The University of Tokyo Hokkaido Forest, Graduate School of Agricultural and Life Sciences, The University of Tokyo, Furano 079-1563, Hokkaido, Japan
| | - Satoshi Tsuyuki
- Department of Global Agricultural Sciences, Graduate School of Agricultural and Life Sciences, The University of Tokyo, Tokyo 113-8657, Japan; (J.K.); (S.T.); (T.H.)
| | - Takuya Hiroshima
- Department of Global Agricultural Sciences, Graduate School of Agricultural and Life Sciences, The University of Tokyo, Tokyo 113-8657, Japan; (J.K.); (S.T.); (T.H.)
| |
Collapse
|
4
|
Integrating Post-Processing Kinematic (PPK)–Structure-from-Motion (SfM) with Unmanned Aerial Vehicle (UAV) Photogrammetry and Digital Field Mapping for Structural Geological Analysis. ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION 2022. [DOI: 10.3390/ijgi11080437] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
We studied some exposures of the Roccacaramanico Conglomerate (RCC), a calcareous-clastic mega-bed intercalated within the Late Messinian–Early Pliocene pelitic succession of the La Queglia and Maiella tectonic units (central Apennines). The outcrops, localized in the overturned limb of a kilometric-scale syncline, show a complex array of fractures, including multiple systems of closely spaced cleavages, joints, and mesoscopic faults, which record the progressive deformation associated with the Late Pliocene thrusting. Due to the extent of the investigated sites and a large amount of data to collect, we applied a multi-methodology survey technique integrating unmanned aerial vehicle (UAV) technologies and digital mapping in the field. We reconstructed the 3D digital outcrop model of the RCC in the type area and defined the 3D pattern of fractures and their time–space relationships. The field survey played a pivotal role in determining the various sets of structures, their kinematics, the associated displacements, and relative chronology. The results unveiled the investigated area’s tectonic evolution and provide a deformation model that could be generalized in similar tectonic contexts. Furthermore, the methodology allows for evaluating the reliability of the applied remote survey techniques (i.e., using UAV) compared to those based on the direct measurements of structures using classic devices. Our purpose was to demonstrate that our multi-methodology approach can describe the tectonic evolution of the study area, providing consistent 3D data and using a few ground control points. Finally, we propose two alternative working methods and discuss their different fields of application.
Collapse
|
5
|
Unmanned Aircraft System (UAS) Structure-From-Motion (SfM) for Monitoring the Changed Flow Paths and Wetness in Minerotrophic Peatland Restoration. REMOTE SENSING 2022. [DOI: 10.3390/rs14133169] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
Peatland restoration aims to achieve pristine water pathway conditions to recover dispersed wetness, water quality, biodiversity and carbon sequestration. Restoration monitoring needs new methods for understanding the spatial effects of restoration in peatlands. We introduce an approach using high-resolution data produced with an unmanned aircraft system (UAS) and supported by the available light detection and ranging (LiDAR) data to reveal the hydrological impacts of elevation changes in peatlands due to restoration. The impacts were assessed by analyzing flow accumulation and the SAGA Wetness Index (SWI). UAS campaigns were implemented at two boreal minerotrophic peatland sites in degraded and restored states. Simultaneously, the control campaigns mapped pristine sites to reveal the method sensitivity of external factors. The results revealed that the data accuracy is sufficient for describing the primary elevation changes caused by excavation. The cell-wise root mean square error in elevation was on average 48 mm when two pristine UAS campaigns were compared with each other, and 98 mm when each UAS campaign was compared with the LiDAR data. Furthermore, spatial patterns of more subtle peat swelling and subsidence were found. The restorations were assessed as successful, as dispersing the flows increased the mean wetness by 2.9–6.9%, while the absolute changes at the pristine sites were 0.4–2.4%. The wetness also became more evenly distributed as the standard deviation decreased by 13–15% (a 3.1–3.6% change for pristine). The total length of the main flow routes increased by 25–37% (a 3.1–8.1% change for pristine), representing the increased dispersion and convolution of flow. The validity of the method was supported by the field-determined soil water content (SWC), which showed a statistically significant correlation (R2 = 0.26–0.42) for the restoration sites but not for the control sites, possibly due to their upslope catchment areas being too small. Despite the uncertainties related to the heterogenic soil properties and complex groundwater interactions, we conclude the method to have potential for estimating changed flow paths and wetness following peatland restoration.
Collapse
|
6
|
UAV-Based Multitemporal Remote Sensing Surveys of Volcano Unstable Flanks: A Case Study from Stromboli. REMOTE SENSING 2022. [DOI: 10.3390/rs14102489] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/10/2022]
Abstract
UAV-based photogrammetry is becoming increasingly popular even in application fields that, until recently, were deemed unsuitable for this technique. Depending on the characteristics of the investigated scenario, the generation of three-dimensional (3D) topographic models may in fact be affected by significant inaccuracies unless site-specific adaptations are implemented into the data collection and processing routines. In this paper, an ad hoc procedure to exploit high-resolution aerial photogrammetry for the multitemporal analysis of the unstable Sciara del Fuoco (SdF) slope at Stromboli Island (Italy) is presented. Use of the technique is inherently problematic because of the homogeneous aspect of the gray ash slope, which prevents a straightforward identification of match points in continuous frames. Moreover, due to site accessibility restrictions enforced by local authorities after the volcanic paroxysm in July 2019, Ground Control Points (GCPs) cannot be positioned to constrain georeferencing. Therefore, all 3D point clouds were georeferenced using GCPs acquired in a 2019 (pre-paroxysm) survey, together with stable Virtual Ground Control Points (VGCPs) belonging to a LiDAR survey carried out in 2012. Alignment refinement was then performed by means of an iterative algorithm based on the closest points. The procedure succeeded in correctly georeferencing six high-resolution point clouds acquired from April 2017 to July 2021, whose time-focused analysis made it possible to track several geomorphological structures associated with the continued volcanic activity. The procedure can be further extended to smaller-scale analyses such as the estimation of locally eroded/accumulated volumes and pave the way for rapid UAV-based georeferenced surveys in emergency conditions at the SdF.
Collapse
|
7
|
Potential of Ultra-High-Resolution UAV Images with Centimeter GNSS Positioning for Plant Scale Crop Monitoring. REMOTE SENSING 2022. [DOI: 10.3390/rs14102391] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/28/2022]
Abstract
To implement agricultural practices that are more respectful of the environment, precision agriculture methods for monitoring crop heterogeneity are becoming more and more spatially detailed. The objective of this study was to evaluate the potential of Ultra-High-Resolution UAV images with centimeter GNSS positioning for plant-scale monitoring. A Dji Phantom 4 RTK UAV with a 20 MPixel RGB camera was used, flying at an altitude of 25 m (0.7 cm resolution). This study was conducted on an experimental plot sown with maize. A centimeter-precision Trimble Geo7x GNSS receiver was used for the field measurements. After evaluating the precision of the UAV’s RTK antenna in static mode on the ground, the positions of 17 artificial targets and 70 maize plants were measured during a series of flights in different RTK modes. Agisoft Metashape software was used. The error in position of the UAV RTK antenna in static mode on the ground was less than one centimeter, in terms of both planimetry and elevation. The horizontal position error measured in flight on the 17 targets was less than 1.5 cm, while it was 2.9 cm in terms of elevation. Finally, according to the RTK modes, at least 81% of the corn plants were localized to within 5 cm of their position, and 95% to within 10 cm.
Collapse
|
8
|
UAV-Based Landfill Land Cover Mapping: Optimizing Data Acquisition and Open-Source Processing Protocols. DRONES 2022. [DOI: 10.3390/drones6050123] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/10/2022]
Abstract
Earth observation technologies offer non-intrusive solutions for monitoring complex and risky sites, such as landfills. In particular, unmanned aerial vehicles (UAVs) offer the ability to acquire data at very high spatial resolution, with full control of the temporality required for the desired application. The versatility of UAVs, both in terms of flight characteristics and on-board sensors, makes it possible to generate relevant geodata for a wide range of landfill monitoring activities. This study aims to propose a robust tool and to provide data acquisition guidelines for the land cover mapping of complex sites using UAV multispectral imagery. For this purpose, the transferability of a state-of-the-art object-based image analysis open-source processing chain was assessed and its sensitivity to the segmentation approach, textural and contextual information, spectral and spatial resolution was tested over the landfill site of Hallembaye (Wallonia, Belgium). This study proposes a consistent open-source processing chain for the land cover mapping using UAV data with accuracies of at least 85%. It shows that low-cost red-green-blue standard sensors are sufficient to reach such accuracies and that spatial resolution of up to 10 cm can be adopted with limited impact on the performance of the processing chain. This study also results in the creation of a new operational service for the monitoring of the active landfill sites of Wallonia.
Collapse
|
9
|
An AR Geo-Registration Algorithm for UAV TIR Video Streams Based on Dual-Antenna RTK-GPS. REMOTE SENSING 2022. [DOI: 10.3390/rs14092205] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
In emergency response and disaster rescue, unmanned aerial vehicles (UAVs) onboard thermal infrared (TIR) sensors are an essential means of acquiring ground information in the nighttime working environment. To enable field personnel to make better decisions based on TIR video streams returned from a UAV, the geographic information enhancement of TIR video streams is required. At present, it is difficult for low-cost UAVs to carry high-precision attitude sensors and thus obtain high-precision camera attitude information to meet the enhanced processing requirements of UAV TIR video streams. To this end, this paper proposes an improved Kalman filter algorithm to improve the geographic registration (geo-registration) accuracy by fusing the positioning and heading data from the dual-antenna real-time kinematic global positioning system (RTK-GPS) with onboard internal measurement unit (IMU) data. This method can yield high-precision position and attitude data in real time based on low-cost UAV hardware, based on which high-precision geo-registration results can be obtained. The computational complexity can be reduced compared with video stream feature tracking algorithms. Furthermore, the problem of unstable matching due to the low resolution and texture level of TIR video streams can be avoided. The experimental results prove that the proposed method can reduce the registration error by 66.15%, and significantly improve the geo-registration accuracy of UAV TIR video streams. Thus, it can strongly support the popularization and practicality of the application of augmented reality (AR) technology to low-cost UAV platforms.
Collapse
|
10
|
Developing a Guideline of Unmanned Aerial Vehicle’s Acquisition Geometry for Landslide Mapping and Monitoring. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12094598] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
Remote sensing data and techniques are widely used for monitoring and managing natural or man-made disasters, due to their timeliness and their satisfactory accuracy. A key stage in disaster research is the detailed and precise mapping of an affected area. The current work examines the relationship that may exist between the acquisition geometry of Unmanned Aerial Vehicle (UAV) campaigns and the topographic characteristics of an investigated area, toward landslide mapping and monitoring that is as accurate as possible. In fact, this work, concerning the systematic research of the acquisition geometry of UAV flights over multiple active landslides, is conducted for the first time and is focused on creating a guideline for any researcher trying to follow the UAV photogrammetric survey during landslide mapping and monitoring. In particular, UAV flights were executed over landslide areas with different characteristics (land cover, slope, etc.) and the collected data from each area were classified into three groups depending on UAV acquisition geometry, i.e., nadir imagery, oblique imagery, and an integration of nadir and oblique imagery. High-resolution orthophotos and Digital Surface Models (DSMs) emerged from the processing of the UAV imagery of each group through structure-from-motion photogrammetry (SfM). Accuracy assessment was carried out using quantitative and qualitative comparative approaches, such as root mean square error calculation, length comparison, and mean center estimation. The evaluation of the results revealed that there is a strong relationship between UAV acquisition geometry and landslide characteristics, which is evident in the accuracy of the generated photogrammetric products (orthophotos, DSMs). In addition, it was proved that the synergistic processing of nadir and oblique imagery increased overall centimeter accuracy.
Collapse
|
11
|
The Potential of Widespread UAV Cameras in the Identification of Conifers and the Delineation of Their Crowns. FORESTS 2022. [DOI: 10.3390/f13050710] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/10/2022]
Abstract
With the ever-improving advances in computer vision and Earth observation capabilities, Unmanned Aerial Vehicles (UAVs) allow extensive forest inventory and the description of stand structure indirectly. We performed several flights with different UAVs and popular sensors over two sites with coniferous forests of various ages and flight levels using the custom settings preset by solution suppliers. The data were processed using image-matching techniques, yielding digital surface models, which were further analyzed using the lidR package in R. Consumer-grade RGB cameras were consistently more successful in the identification of individual trees at all of the flight levels (84–77% for Phantom 4), compared to the success of multispectral cameras, which decreased with higher flight levels and smaller crowns (77–54% for RedEdge-M). Regarding the accuracy of the measured crown diameters, RGB cameras yielded satisfactory results (Mean Absolute Error—MAE of 0.79–0.99 m and 0.88–1.16 m for Phantom 4 and Zenmuse X5S, respectively); multispectral cameras overestimated the height, especially in the full-grown forests (MAE = 1.26–1.77 m). We conclude that widely used low-cost RGB cameras yield very satisfactory results for the description of the structural forest information at a 150 m flight altitude. When (multi)spectral information is needed, we recommend reducing the flight level to 100 m in order to acquire sufficient structural forest information. The study contributes to the current knowledge by directly comparing widely used consumer-grade UAV cameras and providing a clear elementary workflow for inexperienced users, thus helping entry-level users with the initial steps and supporting the usability of such data in practice.
Collapse
|
12
|
New Supplementary Photography Methods after the Anomalous of Ground Control Points in UAV Structure-from-Motion Photogrammetry. DRONES 2022. [DOI: 10.3390/drones6050105] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
Recently, multirotor UAVs have been widely used in high-precision terrain mapping, cadastral surveys and other fields due to their low cost, flexibility, and high efficiency. Indirect georeferencing of ground control points (GCPs) is often required to obtain highly accurate topographic products such as orthoimages and digital surface models. However, in practical projects, GCPs are susceptible to anomalies caused by external factors (GCPs covered by foreign objects such as crops and cars, vandalism, etc.), resulting in a reduced availability of UAV images. The errors associated with the loss of GCPs are apparent. The widely used solution of using natural feature points as ground control points often fails to meet the high accuracy requirements. For the problem of control point anomalies, this paper innovatively presents two new methods of completing data fusion by supplementing photos via UAV at a later stage. In this study, 72 sets of experiments were set up, including three control experiments for analysis. Two parameters were used for accuracy assessment: Root Mean Square Error (RMSE) and Multiscale Model to Model Cloud Comparison (M3C2). The study shows that the two new methods can meet the reference accuracy requirements in horizontal direction and elevation direction (RMSEX = 70.40 mm, RMSEY = 53.90 mm, RMSEZ = 87.70 mm). In contrast, the natural feature points as ground control points showed poor accuracy, with RMSEX = 94.80 mm, RMSEY = 68.80 mm, and RMSEZ = 104.40 mm for the checkpoints. This research considers and solves the problems of anomalous GCPs in the photogrammetry project from a unique perspective of supplementary photography, and proposes two new methods that greatly expand the means of solving the problem. In UAV high-precision projects, they can be used as an effective means to ensure accuracy when the GCP is anomalous, which has significant potential for application promotion. Compared with previous methods, they can be applied in more scenarios and have higher compatibility and operability. These two methods can be widely applied in cadastral surveys, geomorphological surveys, heritage conservation, and other fields.
Collapse
|
13
|
Simultaneous Localization and Mapping (SLAM) and Data Fusion in Unmanned Aerial Vehicles: Recent Advances and Challenges. DRONES 2022. [DOI: 10.3390/drones6040085] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/05/2023]
Abstract
This article presents a survey of simultaneous localization and mapping (SLAM) and data fusion techniques for object detection and environmental scene perception in unmanned aerial vehicles (UAVs). We critically evaluate some current SLAM implementations in robotics and autonomous vehicles and their applicability and scalability to UAVs. SLAM is envisioned as a potential technique for object detection and scene perception to enable UAV navigation through continuous state estimation. In this article, we bridge the gap between SLAM and data fusion in UAVs while also comprehensively surveying related object detection techniques such as visual odometry and aerial photogrammetry. We begin with an introduction to applications where UAV localization is necessary, followed by an analysis of multimodal sensor data fusion to fuse the information gathered from different sensors mounted on UAVs. We then discuss SLAM techniques such as Kalman filters and extended Kalman filters to address scene perception, mapping, and localization in UAVs. The findings are summarized to correlate prevalent and futuristic SLAM and data fusion for UAV navigation, and some avenues for further research are discussed.
Collapse
|
14
|
On the 3D Reconstruction of Coastal Structures by Unmanned Aerial Systems with Onboard Global Navigation Satellite System and Real-Time Kinematics and Terrestrial Laser Scanning. REMOTE SENSING 2022. [DOI: 10.3390/rs14061485] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
A wide variety of hard structures protect coastal activities and communities from the action of tides and waves worldwide. It is fundamental to monitor the integrity of coastal structures, as interventions and repairs may be needed in case of damages. This work compares the effectiveness of an Unmanned Aerial System (UAS) and a Terrestrial Laser Scanner (TLS) to reproduce the 3D geometry of a rocky groin. The Structure-from-Motion (SfM) photogrammetry technique applied on drone images generated a 3D point cloud and a Digital Surface Model (DSM) without data gaps. Even though the TLS returned a 3D point cloud four times denser than the drone one, the TLS returned a DSM which was not representing about 16% of the groin (data gaps). This was due to the occlusions encountered by the low-lying scans determined by the displaced rocks composing the groin. Given also that the survey by UAS was about eight time faster than the TLS, the SFM-MV applied on UAS images was the most suitable technique to reconstruct the rocky groin. The UAS remote sensing technique can be considered a valid alternative to monitor all types of coastal structures, to improve the inspection of likely damages, and to support coastal structure management.
Collapse
|
15
|
Fascista A. Toward Integrated Large-Scale Environmental Monitoring Using WSN/UAV/Crowdsensing: A Review of Applications, Signal Processing, and Future Perspectives. SENSORS (BASEL, SWITZERLAND) 2022; 22:1824. [PMID: 35270970 PMCID: PMC8914857 DOI: 10.3390/s22051824] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/18/2022] [Revised: 02/11/2022] [Accepted: 02/22/2022] [Indexed: 01/04/2023]
Abstract
Fighting Earth's degradation and safeguarding the environment are subjects of topical interest and sources of hot debate in today's society. According to the United Nations, there is a compelling need to take immediate actions worldwide and to implement large-scale monitoring policies aimed at counteracting the unprecedented levels of air, land, and water pollution. This requires going beyond the legacy technologies currently employed by government authorities and adopting more advanced systems that guarantee a continuous and pervasive monitoring of the environment in all its different aspects. In this paper, we take the research on integrated and large-scale environmental monitoring a step further by providing a comprehensive review that covers transversally all the main applications of wireless sensor networks (WSNs), unmanned aerial vehicles (UAVs), and crowdsensing monitoring technologies. By outlining the available solutions and current limitations, we identify in the cooperation among terrestrial (WSN/crowdsensing) and aerial (UAVs) sensing, coupled with the adoption of advanced signal processing techniques, the major pillars at the basis of future integrated (air, land, and water) and large-scale environmental monitoring systems. This review not only consolidates the progresses achieved in the field of environmental monitoring, but also sheds new lights on potential future research directions and synergies among different research areas.
Collapse
Affiliation(s)
- Alessio Fascista
- Department of Engineering, University of Salento, Via Monteroni, 73100 Lecce, Italy
| |
Collapse
|
16
|
Direct Georeferencing UAV-SfM in High-Relief Topography: Accuracy Assessment and Alternative Ground Control Strategies along Steep Inaccessible Rock Slopes. REMOTE SENSING 2022. [DOI: 10.3390/rs14030490] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
Steep rock slopes present key opportunities and challenges within Earth science applications. Due to partial or complete inaccessibility, high-precision surveys of these high-relief landscapes remain a challenge. Direct georeferencing (DG) of unoccupied aerial vehicles (UAVs) with advanced onboard GNSS receivers presents opportunities to generate high-resolution 3D datasets without ground-based access to the study area. However, recent research has revealed large vertical errors using DG that may prove problematic in near-vertical terrain. To address these concerns, we examined more than 75 photogrammetric UAV-datasets with various imaging angles (nadir, oblique, and combinations) and ground control scenarios, including DG, along a steep slope exposure. Results demonstrate that mean errors in DG scenarios are up to 0.12 m higher than datasets using integrated georeferencing with well-distributed GCPs. Inclusion of GCPs greatly reduced mean error values but had limited influence on precision (<0.01 m) for any given imaging strategy. Use of multiple image angles resulted in the highest precisions, regardless of georeferencing strategy. These findings have implications for applications requiring the highest precision and accuracy (e.g., geotechnical engineering, hazard mitigation and mapping, and geomorphic change detection), which should consider using ground control whenever possible. However, for applications less concerned with absolute accuracy, our results show that DG datasets provide strong internal consistency and relative accuracy that may be suitable for high precision measurements within a model, without use of ground control.
Collapse
|
17
|
Topographic Analysis of Intertidal Polychaete Reefs (Sabellaria alveolata) at a Very High Spatial Resolution. REMOTE SENSING 2022. [DOI: 10.3390/rs14020307] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
In temperate coastal regions of Western Europe, the polychaete Sabellaria alveolata (Linné) builds large intertidal reefs of several hectares on soft-bottom substrates. These reefs are protected by the European Habitat Directive EEC/92/43 under the status of biogenic structures hosting a high biodiversity and providing ecological functions such as protection against coastal erosion. As an alternative to time-consuming field campaigns, a UAV-based Structure-from-Motion photogrammetric survey was carried out in October 2020 over Noirmoutier Island (France) where the second-largest known European reef is located in a tidal delta. A DJI Phantom 4 Multispectral UAV provided a topographic dataset at very high resolutions of 5 cm/pixel for the Digital Surface Model (DSM) and 2.63 cm/pixel for the multispectral orthomosaic images. The reef footprint was mapped using a combination of two topographic indices: the Topographic Openness Index and the Topographic Position Index. The reef structures covered an area of 8.15 ha, with 89% corresponding to the main reef composed of connected and continuous biogenic structures, 7.6% of large isolated structures (<60 m2), and 4.4% of small isolated reef clumps (<2 m2). To further describe the topographic complexity of the reef, the Geomorphon landform classification was used. The spatial distribution of tabular platforms considered as a healthy stage of the reef in contrast to a degraded stage was mapped with a proxy that consists in comparing the reef volume to a theoretical tabular-shaped reef volume. Epibionts colonizing the reef (macroalgae, mussels, and oysters) were also mapped by combining multispectral indices such as the Normalised Difference Vegetation Index and simple band ratios with topographic indices. A confusion matrix showed that macroalgae and mussels were satisfactorily identified but that oysters could not be detected by an automated procedure due to their spectral complexity. The topographic indices used in this work should now be further exploited to propose a health index for these large intertidal reefs.
Collapse
|
18
|
Rice Height Monitoring between Different Estimation Models Using UAV Photogrammetry and Multispectral Technology. REMOTE SENSING 2021. [DOI: 10.3390/rs14010078] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
Unmanned aerial vehicle (UAV) photogrammetry was used to monitor crop height in a flooded paddy field. Three multi-rotor UAVs were utilized to conduct flight missions in order to capture RGB (RedGreenBlue) and multispectral images, and these images were analyzed using several different models to provide the best results. Two image sets taken by two UAVs, mounted with RGB cameras of the same resolution and Global Navigation Satellite System (GNSS) receivers of different accuracies, were applied to perform photogrammetry. Two methods were then proposed for creating crop height models (CHMs), one of which was denoted as the M1 method and was based on the Digital Surface Point Cloud (DSPC) and the Digital Terrain Point Cloud (DSPT). The other was denoted as the M2 method and was based on the DSPC and a bathymetric sensor. An image set taken by another UAV mounted with a multispectral camera was used for multispectral-based photogrammetry. A Normal Differential Vegetation Index (NDVI) and a Vegetation Fraction (VF) were then extracted. A new method based on multiple linear regression (MLR) combining the NDVI, the VF, and a Soil Plant Analysis Development (SPAD) value for estimating the measured height (MH) of rice was then proposed and denoted as the M3 method. The results show that the M1 method, the UAV with a GNSS receiver with a higher accuracy, obtained more reliable estimations, while the M2 method, the UAV with a GNSS receiver of moderate accuracy, was actually slightly better. The effect on the performance of CHMs created by the M1 and M2 methods is more negligible in different plots with different treatments; however, remarkably, the more uniform the distribution of vegetation over the water surface, the better the performance. The M3 method, which was created using only a SPAD value and a canopy NDVI value, showed the highest coefficient of determination (R2) for overall MH estimation, 0.838, compared with other combinations.
Collapse
|
19
|
A New Method for UAV Lidar Precision Testing Used for the Evaluation of an Affordable DJI ZENMUSE L1 Scanner. REMOTE SENSING 2021. [DOI: 10.3390/rs13234811] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Lately, affordable unmanned aerial vehicle (UAV)-lidar systems have started to appear on the market, highlighting the need for methods facilitating proper verification of their accuracy. However, the dense point cloud produced by such systems makes the identification of individual points that could be used as reference points difficult. In this paper, we propose such a method utilizing accurately georeferenced targets covered with high-reflectivity foil, which can be easily extracted from the cloud; their centers can be determined and used for the calculation of the systematic shift of the lidar point cloud. Subsequently, the lidar point cloud is cleaned of such systematic shift and compared with a dense SfM point cloud, thus yielding the residual accuracy. We successfully applied this method to the evaluation of an affordable DJI ZENMUSE L1 scanner mounted on the UAV DJI Matrice 300 and found that the accuracies of this system (3.5 cm in all directions after removal of the global georeferencing error) are better than manufacturer-declared values (10/5 cm horizontal/vertical). However, evaluation of the color information revealed a relatively high (approx. 0.2 m) systematic shift.
Collapse
|
20
|
Accuracy Assessment of UAV-Photogrammetric-Derived Products Using PPK and GCPs in Challenging Terrains: In Search of Optimized Rockfall Mapping. REMOTE SENSING 2021. [DOI: 10.3390/rs13193812] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Unmanned aerial photogrammetric surveys are increasingly being used for mapping and studying natural hazards, such as rockfalls. Surveys using unmanned aerial vehicles (UAVs) can be performed in remote, hardly accessible, and dangerous areas, while the photogrammetric-derived products, with high spatial and temporal accuracy, can provide us with detailed information about phenomena under consideration. However, as photogrammetry commonly uses indirect georeferencing through bundle block adjustment (BBA) with ground control points (GCPs), data acquisition in the field is not only time-consuming and labor-intensive, but also extremely dangerous. Therefore, the main goal of this study was to investigate how accurate photogrammetric products can be produced by using BBA without GCPs and auxiliary data, namely using the coordinates X0, Y0 and Z0 of the camera perspective centers computed with PPK (Post-Processing Kinematic). To this end, orthomosaics and digital surface models (DSMs) were produced for three rockfall sites by using images acquired with a DJI Phantom 4 RTK and the two different BBA methods mentioned above (hereafter referred to as BBA_traditional and BBA_PPK). The accuracy of the products, in terms of the Root Mean Square Error (RMSE), was computed by using verification points (VPs). The accuracy of both BBA methods was also assessed. To test the differences between the georeferencing methods, two statistical test were used, namely a paired Student’s t-test, and a non-parametric Wilcoxon signed-rank. The results show that the accuracy of the BBA_PPK is inferior to that of BBA_traditional, with the total RMSE values for the three sites being 0.056, 0.066, and 0.305 m, respectively, compared to 0.019, 0.036 and 0.014 m obtained with BBA_traditional. The accuracies of the BBA methods are reflected in the accuracy of the orthomosaics, whose values for the BBA_PPK are 0.039, 0.043 and 0.157 m, respectively, against 0.029, 0.036 and 0.020 m obtained with the BBA_traditional. Concerning the DSM, those produced with the BBA_PPK method present accuracy values of 0.065, 0.072 and 0.261 m, respectively, against 0.038, 0.060 and 0.030 m obtained with the BBA_traditional. Even though that there are statistically significant differences between the georeferencing methods, one can state that the BBA_PPK presents a viable solution to map dangerous and exposed areas, such as rockfall transit and deposit areas, especially for applications at a regional level.
Collapse
|
21
|
Suitability of Aerial Photogrammetry for Dump Documentation and Volume Determination in Large Areas. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11146564] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/15/2023]
Abstract
The study presented in this paper analyses the results of measurements and data processing for documentation and quantification of material in heaps in large areas, where UAVs may no longer be effective due to a large range. Two test heaps were selected from a whole area, where the aim was to confirm the suitability of using the method of digital aerial photogrammetry by manned (crewed) aerial vehicle. For comparison, a commonly used GNSS RTK method was also used. Terrestrial laser scanning was chosen as the control reference method. TLS measurement is a trusted method with high accuracy. The methods were compared with each other through the quality of the mesh, analysis of the cross-sections, and comparison of the volumes of heaps. As a result, the determination of heap volumes and documentation using digital aerial photogrammetry can be confirmed as an appropriate, efficient, fast, and accurate method. The difference in the detected volume was less than 0.1%, the mean difference of the meshes was less than 0.01 m, and the standard deviation was less than 0.05 m.
Collapse
|
22
|
How Image Acquisition Geometry of UAV Campaigns Affects the Derived Products and Their Accuracy in Areas with Complex Geomorphology. ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION 2021. [DOI: 10.3390/ijgi10060408] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/26/2022]
Abstract
The detailed and accurate mapping of landscapes and their geomorphological characteristics is a key issue in hazard management. The current study examines whether the image acquisition geometry of unmanned aerial vehicle (UAV) campaigns affects the accuracy of the derived products, i.e., orthophotos, digital surface models (DSMs) and photogrammetric point clouds, while performing a detailed geomorphological mapping of a landslide area. UAV flights were executed and the collected imagery was organized into three subcategories based on the viewing angle of the UAV camera. The first subcategory consists of the nadir imagery, the second is composed of the oblique imagery and the third category blends both nadir and oblique imagery. UAV imagery processing was carried out using structure-from-motion photogrammetry (SfM). High-resolution products were generated, consisting of orthophotos, DSMs and photogrammetric-based point clouds. Their accuracy was evaluated utilizing statistical approaches such as the estimation of the root mean square error (RMSE), calculation of the geometric mean of a feature, length measurement, calculation of cloud-to-cloud distances as well as qualitive criteria. All the quantitative and qualitative results were taken into account for the impact assessment. It was demonstrated that the oblique-viewing geometry as well as the combination of nadir and oblique imagery could be used effectively for geomorphological mapping in areas with complex topography and steep slopes that overpass 60 degrees. Moreover, the accuracy assessment revealed that those acquisition geometries contribute to the creation of significantly better products compared to the corresponding one arising from nadir-viewing imagery.
Collapse
|
23
|
Geometric Accuracy of 3D Reality Mesh Utilization for BIM-Based Earthwork Quantity Estimation Workflows. ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION 2021. [DOI: 10.3390/ijgi10060399] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/28/2022]
Abstract
Current surveying techniques are typically applied to survey the as-is condition of buildings, brownfield sites and infrastructure prior to design. However, within the past decade, these techniques evolved significantly, and their applications can be enhanced by adopting unmanned aerial vehicles (UAVs) for data acquisition, up-to-date software for creating 3D reality mesh, which in turn opens new possibilities for much more efficient construction site surveying and constant updating and process management. In this study the workflows of three UAV-based photogrammetry techniques: Real Time Kinematic (RTK), Post-Processing Kinematic (PPK) and Global Positioning System (GPS) based on control points were analyzed, described, and compared to conventional surveying method with Global Navigation Satellite System (GNSS) receiver. Tests were performed under realistic conditions in 36 ha quarry in Lithuania. The results of the relationship between ground sample distance (GSD) and the comparison of volume measurements under each technique, including conventional method were analyzed. The deviation of data collected on field vs. generated in reality mesh, including ground control points (GCPs) and check points (CHPs) with different configurations, was investigated. The research provides observations on each workflow in the terms of efficiency and reliability for earthwork quantity estimations and explains processing schemes with advanced commercial software tools.
Collapse
|
24
|
Digital Terrain Models Generated with Low-Cost UAV Photogrammetry: Methodology and Accuracy. ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION 2021. [DOI: 10.3390/ijgi10050285] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Digital terrain model (DTM) generation is essential to recreating terrain morphology once the external elements are removed. Traditional survey methods are still used to collect accurate geographic data on the land surface. Given the emergence of unmanned aerial vehicles (UAVs) equipped with low-cost digital cameras and better photogrammetric methods for digital mapping, efficient approaches are necessary to allow rapid land surveys with high accuracy. This paper provides a review, complemented with the authors’ experience, regarding the UAV photogrammetric process and field survey parameters for DTM generation using popular commercial photogrammetric software to process images obtained with fixed-wing or multicopter UAVs. We analyzed the quality and accuracy of the DTMs based on four categories: (i) the UAV system (UAV platforms and camera); (ii) flight planning and image acquisition (flight altitude, image overlap, UAV speed, orientation of the flight line, camera configuration, and georeferencing); (iii) photogrammetric DTM generation (software, image alignment, dense point cloud generation, and ground filtering); (iv) geomorphology and land use/cover. For flat terrain, UAV photogrammetry provided a horizontal root mean square error (RMSE) between 1 to 3 × the ground sample distance (GSD) and a vertical RMSE between 1 to 4.5 × GSD, and, for complex topography, a horizontal RMSE between 1 to 7 × GSD and a vertical RMSE between 1.5 to 5 × GSD. Finally, we stress that UAV photogrammetry can provide DTMs with high accuracy when the photogrammetric process variables are optimized.
Collapse
|