Automated 3D Reconstruction Using Optimized View-Planning Algorithms for Iterative Development of Structure-from-Motion Models

Geotechnical Measurements for the Investigation and Assessment of Arctic Coastal Erosion—A Review and Outlook

Geotechnical data are increasingly utilized to aid investigations of coastal erosion and the development of coastal morphological models; however, measurement techniques are still challenged by environmental conditions and accessibility in coastal areas, and particularly, by nearshore conditions. These challenges are exacerbated for Arctic coastal environments. This article reviews existing and emerging data collection methods in the context of geotechnical investigations of Arctic coastal erosion and nearshore change. Specifically, the use of cone penetration testing (CPT), which can provide key data for the mapping of soil and ice layers as well as for the assessment of slope and block failures, and the use of free-fall penetrometers (FFPs) for rapid mapping of seabed surface conditions, are discussed. Because of limitations in the spatial coverage and number of available in situ point measurements by penetrometers, data fusion with geophysical and remotely sensed data is considered. Offshore and nearshore, the combination of acoustic surveying with geotechnical testing can optimize large-scale seabed characterization, while onshore most recent developments in satellite-based and unmanned-aerial-vehicle-based data collection offer new opportunities to enhance spatial coverage and collect information on bathymetry and topography, amongst others. Emphasis is given to easily deployable and rugged techniques and strategies that can offer near-term opportunities to fill current gaps in data availability. This review suggests that data fusion of geotechnical in situ testing, using CPT to provide soil information at deeper depths and even in the presence of ice and using FFPs to offer rapid and large-coverage geotechnical testing of surface sediments (i.e., in the upper tens of centimeters to meters of sediment depth), combined with acoustic seabed surveying and emerging remote sensing tools, has the potential to provide essential data to improve the prediction of Arctic coastal erosion, particularly where climate-driven changes in soil conditions may bias the use of historic observations of erosion for future prediction.

Large-Scale Reality Modeling of a University Campus Using Combined UAV and Terrestrial Photogrammetry for Historical Preservation and Practical Use

Unmanned aerial vehicles (UAV) enable detailed historical preservation of large-scale infrastructure and contribute to cultural heritage preservation, improved maintenance, public relations, and development planning. Aerial and terrestrial photo data coupled with high accuracy GPS create hyper-realistic mesh and texture models, high resolution point clouds, orthophotos, and digital elevation models (DEMs) that preserve a snapshot of history. A case study is presented of the development of a hyper-realistic 3D model that spans the complex 1.7 km2 area of the Brigham Young University campus in Provo, Utah, USA and includes over 75 significant structures. The model leverages photos obtained during the historic COVID-19 pandemic during a mandatory and rare campus closure and details a large scale modeling workflow and best practice data acquisition and processing techniques. The model utilizes 80,384 images and high accuracy GPS surveying points to create a 1.65 trillion-pixel textured structure-from-motion (SfM) model with an average ground sampling distance (GSD) near structures of 0.5 cm and maximum of 4 cm. Separate model segments (31) taken from data gathered between April and August 2020 are combined into one cohesive final model with an average absolute error of 3.3 cm and a full model absolute error of <1 cm (relative accuracies from 0.25 cm to 1.03 cm). Optimized and automated UAV techniques complement the data acquisition of the large-scale model, and opportunities are explored to archive as-is building and campus information to enable historical building preservation, facility maintenance, campus planning, public outreach, 3D-printed miniatures, and the possibility of education through virtual reality (VR) and augmented reality (AR) tours.

An Imaging Network Design for UGV-Based 3D Reconstruction of Buildings

Imaging network design is a crucial step in most image-based 3D reconstruction applications based on Structure from Motion (SfM) and multi-view stereo (MVS) methods. This paper proposes a novel photogrammetric algorithm for imaging network design for building 3D reconstruction purposes. The proposed methodology consists of two main steps: (i) the generation of candidate viewpoints and (ii) the clustering and selection of vantage viewpoints. The first step includes the identification of initial candidate viewpoints, selecting the candidate viewpoints in the optimum range, and defining viewpoint direction stages. In the second step, four challenging approaches—named façade pointing, centre pointing, hybrid, and both centre & façade pointing—are proposed. The entire methodology is implemented and evaluated in both simulation and real-world experiments. In the simulation experiment, a building and its environment are computer-generated in the ROS (Robot Operating System) Gazebo environment and a map is created by using a simulated robot and Gmapping algorithm based on a Simultaneously Localization and Mapping (SLAM) algorithm using a simulated Unmanned Ground Vehicle (UGV). In the real-world experiment, the proposed methodology is evaluated for all four approaches for a real building with two common approaches, called continuous image capturing and continuous image capturing & clustering and selection approaches. The results of both evaluations reveal that the fusion of centre & façade pointing approach is more efficient than all other approaches in terms of both accuracy and completeness criteria.

Survey of 8 UAV Set-Covering Algorithms for Terrain Photogrammetry

Remote sensing with unmanned aerial vehicles (UAVs) facilitates photogrammetry for environmental and infrastructural monitoring. Models are created with less computational cost by reducing the number of photos required. Optimal camera locations for reducing the number of photos needed for structure-from-motion (SfM) are determined through eight mathematical set-covering algorithms as constrained by solve time. The algorithms examined are: traditional greedy, reverse greedy, carousel greedy (CG), linear programming, particle swarm optimization, simulated annealing, genetic, and ant colony optimization. Coverage and solve time are investigated for these algorithms. CG is the best method for choosing optimal camera locations as it balances number of photos required and time required to calculate camera positions as shown through an analysis similar to a Pareto Front. CG obtains a statistically significant 3.2 fewer cameras per modeled area than base greedy algorithm while requiring just one additional order of magnitude of solve time. For comparison, linear programming is capable of fewer cameras than base greedy but takes at least three orders of magnitude longer to solve. A grid independence study serves as a sensitivity analysis of the CG algorithms α (iteration number) and β (percentage to be recalculated) parameters that adjust traditional greedy heuristics, and a case study at the Rock Canyon collection dike in Provo, UT, USA, compares the results of all eight algorithms and the uniqueness (in terms of percentage comparisons based on location/angle metadata and qualitative visual comparison) of each selected set. Though this specific study uses SfM, the principles could apply to other instruments such as multi-spectral cameras or aerial LiDAR.