Registration of Laser Scanning Point Clouds: A Review

Analytical Formalism for Data Representation and Object Detection with 2D LiDAR: Application in Mobile Robotics

In mobile robotics, LASER scanners have a wide spectrum of indoor and outdoor applications, both in structured and unstructured environments, due to their accuracy and precision. Most works that use this sensor have their own data representation and their own case-specific modeling strategies, and no common formalism is adopted. To address this issue, this manuscript presents an analytical approach for the identification and localization of objects using 2D LiDARs. Our main contribution lies in formally defining LASER sensor measurements and their representation, the identification of objects, their main properties, and their location in a scene. We validate our proposal with experiments in generic semi-structured environments common in autonomous navigation, and we demonstrate its feasibility in multiple object detection and identification, strictly following its analytical representation. Finally, our proposal further encourages and facilitates the design, modeling, and implementation of other applications that use LASER scanners as a distance sensor.

Comparison of Point Cloud Registration Techniques on Scanned Physical Objects

This paper presents a comparative analysis of six prominent registration techniques for solving CAD model alignment problems. Unlike the typical approach of assessing registration algorithms with synthetic datasets, our study utilizes point clouds generated from the Cranfield benchmark. Point clouds are sampled from existing CAD models and 3D scans of physical objects, introducing real-world complexities such as noise and outliers. The acquired point cloud scans, including ground-truth transformations, are made publicly available. This dataset includes several cleaned-up scans of nine 3D-printed objects. Our main contribution lies in assessing the performance of three classical (GO-ICP, RANSAC, FGR) and three learning-based (PointNetLK, RPMNet, ROPNet) methods on real-world scans, using a wide range of metrics. These include recall, accuracy and computation time. Our comparison shows a high accuracy for GO-ICP, as well as PointNetLK, RANSAC and RPMNet combined with ICP refinement. However, apart from GO-ICP, all methods show a significant number of failure cases when applied to scans containing more noise or requiring larger transformations. FGR and RANSAC are among the quickest methods, while GO-ICP takes several seconds to solve. Finally, while learning-based methods demonstrate good performance and low computation times, they have difficulties in training and generalizing. Our results can aid novice researchers in the field in selecting a suitable registration method for their application, based on quantitative metrics. Furthermore, our code can be used by others to evaluate novel methods.

A review of rigid point cloud registration based on deep learning

With the development of 3D scanning devices, point cloud registration is gradually being applied in various fields. Traditional point cloud registration methods face challenges in noise, low overlap, uneven density, and large data scale, which limits the further application of point cloud registration in actual scenes. With the above deficiency, point cloud registration methods based on deep learning technology gradually emerged. This review summarizes the point cloud registration technology based on deep learning. Firstly, point cloud registration based on deep learning can be categorized into two types: complete overlap point cloud registration and partially overlapping point cloud registration. And the characteristics of the two kinds of methods are classified and summarized in detail. The characteristics of the partially overlapping point cloud registration method are introduced and compared with the completely overlapping method to provide further research insight. Secondly, the review delves into network performance improvement summarizes how to accelerate the point cloud registration method of deep learning from the hardware and software. Then, this review discusses point cloud registration applications in various domains. Finally, this review summarizes and outlooks the current challenges and future research directions of deep learning-based point cloud registration.

Automated Point Cloud Registration Approach Optimized for a Stop-and-Go Scanning System

The latest advances in mobile platforms, such as robots, have enabled the automatic acquisition of full coverage point cloud data from large areas with terrestrial laser scanning. Despite this progress, the crucial post-processing step of registration, which aligns raw point cloud data from separate local coordinate systems into a unified coordinate system, still relies on manual intervention. To address this practical issue, this study presents an automated point cloud registration approach optimized for a stop-and-go scanning system based on a quadruped walking robot. The proposed approach comprises three main phases: perpendicular constrained wall-plane extraction; coarse registration with plane matching using point-to-point displacement calculation; and fine registration with horizontality constrained iterative closest point (ICP). Experimental results indicate that the proposed method successfully achieved automated registration with an accuracy of 0.044 m and a successful scan rate (SSR) of 100% within a time frame of 424.2 s with 18 sets of scan data acquired from the stop-and-go scanning system in a real-world indoor environment. Furthermore, it surpasses conventional approaches, ensuring reliable registration for point cloud pairs with low overlap in specific indoor environmental conditions.

Automatic Multiview Alignment of RGB-D Range Maps of Upper Limb Anatomy

Digital representations of anatomical parts are crucial for various biomedical applications. This paper presents an automatic alignment procedure for creating accurate 3D models of upper limb anatomy using a low-cost handheld 3D scanner. The goal is to overcome the challenges associated with forearm 3D scanning, such as needing multiple views, stability requirements, and optical undercuts. While bulky and expensive multi-camera systems have been used in previous research, this study explores the feasibility of using multiple consumer RGB-D sensors for scanning human anatomies. The proposed scanner comprises three Intel® RealSenseTM D415 depth cameras assembled on a lightweight circular jig, enabling simultaneous acquisition from three viewpoints. To achieve automatic alignment, the paper introduces a procedure that extracts common key points between acquisitions deriving from different scanner poses. Relevant hand key points are detected using a neural network, which works on the RGB images captured by the depth cameras. A set of forearm key points is meanwhile identified by processing the acquired data through a specifically developed algorithm that seeks the forearm's skeleton line. The alignment process involves automatic, rough 3D alignment and fine registration using an iterative-closest-point (ICP) algorithm expressly developed for this application. The proposed method was tested on forearm scans and compared the results obtained by a manual coarse alignment followed by an ICP algorithm for fine registration using commercial software. Deviations below 5 mm, with a mean value of 1.5 mm, were found. The obtained results are critically discussed and compared with the available implementations of published methods. The results demonstrate significant improvements to the state of the art and the potential of the proposed approach to accelerate the acquisition process and automatically register point clouds from different scanner poses without the intervention of skilled operators. This study contributes to developing effective upper limb rehabilitation frameworks and personalized biomedical applications by addressing these critical challenges.

MInet: A Novel Network Model for Point Cloud Processing by Integrating Multi-Modal Information

Three-dimensional LiDAR systems that capture point cloud data enable the simultaneous acquisition of spatial geometry and multi-wavelength intensity information, thereby paving the way for three-dimensional point cloud recognition and processing. However, due to the irregular distribution, low resolution of point clouds, and limited spatial recognition accuracy in complex environments, inherent errors occur in classifying and segmenting the acquired target information. Conversely, two-dimensional visible light images provide real-color information, enabling the distinction of object contours and fine details, thus yielding clear, high-resolution images when desired. The integration of two-dimensional information with point clouds offers complementary advantages. In this paper, we present the incorporation of two-dimensional information to form a multi-modal representation. From this, we extract local features to establish three-dimensional geometric relationships and two-dimensional color relationships. We introduce a novel network model, termed MInet (Multi-Information net), which effectively captures features relating to both two-dimensional color and three-dimensional pose information. This enhanced network model improves feature saliency, thereby facilitating superior segmentation and recognition tasks. We evaluate our MInet architecture using the ShapeNet and ThreeDMatch datasets for point cloud segmentation, and the Stanford dataset for object recognition. The robust results, coupled with quantitative and qualitative experiments, demonstrate the superior performance of our proposed method in point cloud segmentation and object recognition tasks.

Point cloud completion in challenging indoor scenarios with human motion

Combining and completing point cloud data from two or more sensors with arbitrarily relative perspectives in a dynamic, cluttered, and complex environment is challenging, especially when the two sensors have significant perspective differences while the large overlap ratio and feature-rich scene cannot be guaranteed. We create a novel approach targeting this challenging scenario by registering two camera captures in a time series with unknown perspectives and human movements to easily use our system in a real-life scene. In our approach, we first reduce the six unknowns of 3D point cloud completion to three by aligning the ground planes found by our previous perspective-independent 3D ground plane estimation algorithm. Subsequently, we use a histogram-based approach to identify and extract all the humans from each frame generating a three-dimensional (3D) human walking sequence in a time series. To enhance accuracy and performance, we convert 3D human walking sequences to lines by calculating the center of mass (CoM) point of each human body and connecting them. Finally, we match the walking paths in different data trials by minimizing the Fréchet distance between two walking paths and using 2D iterative closest point (ICP) to find the remaining three unknowns in the overall transformation matrix for the final alignment. Using this approach, we can successfully register the corresponding walking path of the human between the two cameras' captures and estimate the transformation matrix between the two sensors.

Proximal and remote sensing in plant phenomics: 20 years of progress, challenges, and perspectives

Plant phenomics (PP) has been recognized as a bottleneck in studying the interactions of genomics and environment on plants, limiting the progress of smart breeding and precise cultivation. High-throughput plant phenotyping is challenging owing to the spatio-temporal dynamics of traits. Proximal and remote sensing (PRS) techniques are increasingly used for plant phenotyping because of their advantages in multi-dimensional data acquisition and analysis. Substantial progress of PRS applications in PP has been observed over the last two decades and is analyzed here from an interdisciplinary perspective based on 2972 publications. This progress covers most aspects of PRS application in PP, including patterns of global spatial distribution and temporal dynamics, specific PRS technologies, phenotypic research fields, working environments, species, and traits. Subsequently, we demonstrate how to link PRS to multi-omics studies, including how to achieve multi-dimensional PRS data acquisition and processing, how to systematically integrate all kinds of phenotypic information and derive phenotypic knowledge with biological significance, and how to link PP to multi-omics association analysis. Finally, we identify three future perspectives for PRS-based PP: (1) strengthening the spatial and temporal consistency of PRS data, (2) exploring novel phenotypic traits, and (3) facilitating multi-omics communication.

GCP-Based Automated Fine Alignment Method for Improving the Accuracy of Coordinate Information on UAV Point Cloud Data

3D point cloud data (PCD) can accurately and efficiently capture the 3D geometric information of a target and exhibits significant potential for construction applications. Although one of the most common approaches for generating PCD is the use of unmanned aerial vehicles (UAV), UAV photogrammetry-based point clouds are erroneous. This study proposes a novel framework for automatically improving the coordinate accuracy of PCD. Image-based deep learning and PCD analysis methods are integrated into a framework that includes the following four phases: GCP (Ground Control Point) detection, GCP global coordinate extraction, transformation matrix estimation, and fine alignment. Two different experiments, as follows, were performed in the case study to validate the proposed framework: (1) experiments on the fine alignment performance of the developed framework, and (2) performance and run time comparison between the fine alignment framework and common registration algorithms such as ICP (Iterative Closest Points). The framework achieved millimeter-level accuracy for each axis. The run time was less than 30 s, which indicated the feasibility of the proposed framework.

Detailed Three-Dimensional Building Façade Reconstruction: A Review on Applications, Data and Technologies

Urban environments are regions of complex and diverse architecture. Their reconstruction and representation as three-dimensional city models have attracted the attention of many researchers and industry specialists, as they increasingly recognise the potential for new applications requiring detailed building models. Nevertheless, despite being investigated for a few decades, the comprehensive reconstruction of buildings remains a challenging task. While there is a considerable body of literature on this topic, including several systematic reviews summarising ways of acquiring and reconstructing coarse building structures, there is a paucity of in-depth research on the detection and reconstruction of façade openings (i.e., windows and doors). In this review, we provide an overview of emerging applications, data acquisition and processing techniques for building façade reconstruction, emphasising building opening detection. The use of traditional technologies from terrestrial and aerial platforms, along with emerging approaches, such as mobile phones and volunteered geography information, is discussed. The current status of approaches for opening detection is then examined in detail, separated into methods for three-dimensional and two-dimensional data. Based on the review, it is clear that a key limitation associated with façade reconstruction is process automation and the need for user intervention. Another limitation is the incompleteness of the data due to occlusion, which can be reduced by data fusion. In addition, the lack of available diverse benchmark datasets and further investigation into deep-learning methods for façade openings extraction present crucial opportunities for future research.

Digitisation of Existing Water Facilities: A Framework for Realising the Value of Scan-to-BIM

Building information modelling (BIM) has been implemented in many utility-based organisations worldwide, and it has proved to provide substantial cost- and time-saving benefits and improved performance and asset management especially during the operations and maintenance (O&M) phase. BIM adoption and implementation success rely on the accurate asset information stored in BIM models, mainly for existing assets. However, the asset information stored in asset management systems is often inaccurate, incomplete, out of date, duplicated or missing. Capturing the accurate as-is conditions of existing buildings has become feasible with the recent advancement of point cloud from 3D laser-scanning, resulting in a shift from ‘as-designed’ BIM to ‘as-constructed’ BIM. The potential benefits of using as-constructed BIM models for facility operations are compelling. This paper identifies the cost and benefit elements of the scan-to-BIM process as part of a case study research project at a water treatment plant (WTP) in South East Queensland, Australia. The paper develops association mapping between the cost and benefit elements for relevant stakeholders and identifies the critical asset information for effectively managing the WTP case selected. Furthermore, the paper investigates the impact of various levels of detail (LOD) and levels of information (LOI) on BIM applications depending on the project and asset requirements. Finally, this paper presents a framework that water asset owners and stakeholders can utilise to obtain value from investing in scan-to-BIM for existing facilities.

Sensors and Sensor Fusion Methodologies for Indoor Odometry: A Review

Although Global Navigation Satellite Systems (GNSSs) generally provide adequate accuracy for outdoor localization, this is not the case for indoor environments, due to signal obstruction. Therefore, a self-contained localization scheme is beneficial under such circumstances. Modern sensors and algorithms endow moving robots with the capability to perceive their environment, and enable the deployment of novel localization schemes, such as odometry, or Simultaneous Localization and Mapping (SLAM). The former focuses on incremental localization, while the latter stores an interpretable map of the environment concurrently. In this context, this paper conducts a comprehensive review of sensor modalities, including Inertial Measurement Units (IMUs), Light Detection and Ranging (LiDAR), radio detection and ranging (radar), and cameras, as well as applications of polymers in these sensors, for indoor odometry. Furthermore, analysis and discussion of the algorithms and the fusion frameworks for pose estimation and odometry with these sensors are performed. Therefore, this paper straightens the pathway of indoor odometry from principle to application. Finally, some future prospects are discussed.

Driver's Head Pose and Gaze Zone Estimation Based on Multi-Zone Templates Registration and Multi-Frame Point Cloud Fusion

Head pose and eye gaze are vital clues for analysing a driver's visual attention. Previous approaches achieve promising results from point clouds in constrained conditions. However, these approaches face challenges in the complex naturalistic driving scene. One of the challenges is that the collected point cloud data under non-uniform illumination and large head rotation is prone to partial facial occlusion. It causes bad transformation during failed template matching or incorrect feature extraction. In this paper, a novel estimation method is proposed for predicting accurate driver head pose and gaze zone using an RGB-D camera, with an effective point cloud fusion and registration strategy. In the fusion step, to reduce bad transformation, continuous multi-frame point clouds are registered and fused to generate a stable point cloud. In the registration step, to reduce reliance on template registration, multiple point clouds in the nearest neighbor gaze zone are utilized as a template point cloud. A coarse transformation computed by the normal distributions transform is used as the initial transformation, and updated with particle filter. A gaze zone estimator is trained by combining the head pose and eye image features, in which the head pose is predicted by point cloud registration, and the eye image features are extracted via multi-scale spare coding. Extensive experiments demonstrate that the proposed strategy achieves better results on head pose tracking, and also has a low error on gaze zone classification.

Uniaxial Partitioning Strategy for Efficient Point Cloud Registration

In 3D reconstruction applications, an important issue is the matching of point clouds corresponding to different perspectives of a particular object or scene, which is addressed by the use of variants of the Iterative Closest Point (ICP) algorithm. In this work, we introduce a cloud-partitioning strategy for improved registration and compare it to other relevant approaches by using both time and quality of pose correction. Quality is assessed from a rotation metric and also by the root mean square error (RMSE) computed over the points of the source cloud and the corresponding closest ones in the corrected target point cloud. A wide and plural set of experimentation scenarios was used to test the algorithm and assess its generalization, revealing that our cloud-partitioning approach can provide a very good match in both indoor and outdoor scenes, even when the data suffer from noisy measurements or when the data size of the source and target models differ significantly. Furthermore, in most of the scenarios analyzed, registration with the proposed technique was achieved in shorter time than those from the literature.

A robust, autonomous, volumetric quality assurance method for 3D printed porous scaffolds

Bone tissue engineering strategies aimed at treating critical-sized craniofacial defects often utilize novel biomaterials and scaffolding. Rapid manufacturing of defect-matching geometries using 3D-printing strategies is a promising strategy to treat craniofacial bone loss to improve aesthetic and regenerative outcomes. To validate manufacturing quality, a robust, three-dimensional quality assurance pipeline is needed to provide an objective, quantitative metric of print quality if porous scaffolds are to be translated from laboratory to clinical settings. Previously published methods of assessing scaffold print quality utilized one- and two-dimensional measurements (e.g., strut widths, pore widths, and pore area) or, in some cases, the print quality of a single phantom is assumed to be representative of the quality of all subsequent prints. More robust volume correlation between anatomic shapes has been accomplished; however, it requires manual user correction in challenging cases such as porous objects like bone scaffolds. Here, we designed porous, anatomically-shaped scaffolds with homogenous or heterogenous porous structures. We 3D-printed the designs with acrylonitrile butadiene styrene (ABS) and used cone-beam computed tomography (CBCT) to obtain 3D image reconstructions. We applied the iterative closest point algorithm to superimpose the computational scaffold designs with the CBCT images to obtain a 3D volumetric overlap. In order to avoid false convergences while using an autonomous workflow for volumetric correlation, we developed an independent iterative closest point (I-ICP₁₀) algorithm using MATLAB®, which applied ten initial conditions for the spatial orientation of the CBCT images relative to the original design. Following successful correlation, scaffold quality can be quantified and visualized on a sub-voxel scale for any part of the volume.

Scanning Technologies to Building Information Modelling: A Review

Building information modelling (BIM) is evolving significantly in the architecture, engineering and construction industries. BIM involves various remote-sensing tools, procedures and standards that are useful for collating the semantic information required to produce 3D models. This is thanks to LiDAR technology, which has become one of the key elements in BIM, useful to capture a semantically rich geometric representation of 3D models in terms of 3D point clouds. This review paper explains the ‘Scan to BIM’ methodology in detail. The paper starts by summarising the 3D point clouds of LiDAR and photogrammetry. LiDAR systems based on different platforms, such as mobile, terrestrial, spaceborne and airborne, are outlined and compared. In addition, the importance of integrating multisource data is briefly discussed. Various methodologies involved in point-cloud processing such as sampling, registration and semantic segmentation are explained in detail. Furthermore, different open BIM standards are summarised and compared. Finally, current limitations and future directions are highlighted to provide useful solutions for efficient BIM models.

IMU-Aided Registration of MLS Point Clouds Using Inertial Trajectory Error Model and Least Squares Optimization

Mobile laser scanning (MLS) point cloud registration plays a critical role in mobile 3D mapping and inspection, but conventional point cloud registration methods for terrain LiDAR scanning (TLS) are not suitable for MLS. To cope with this challenge, we use inertial measurement unit (IMU) to assist registration and propose an MLS point cloud registration method based on an inertial trajectory error model. First, we propose an error model of inertial trajectory over a short time period to construct the constraints between trajectory points at different times. On this basis, a relationship between the point cloud registration error and the inertial trajectory error is established, then trajectory error parameters are estimated by minimizing the point cloud registration error using the least squares optimization. Finally, a reliable and concise inertial-assisted MLS registration algorithm is realized. We carried out experiments in three different scenarios: indoor, outdoor and integrated indoor–outdoor. We evaluated the overall performance, accuracy and efficiency of the proposed method. Compared with the ICP method, the accuracy and speed of the proposed method were improved by 2 and 2.8 times, respectively, which verified the effectiveness and reliability of the proposed method. Furthermore, experimental results show the significance of our method in constructing a reliable and scalable mobile 3D mapping system suitable for complex scenes.

PTRNet: Global Feature and Local Feature Encoding for Point Cloud Registration

Existing end-to-end cloud registration methods are often inefficient and susceptible to noise. We propose an end-to-end point cloud registration network model, Point Transformer for Registration Network (PTRNet), that considers local and global features to improve this behavior. Our model uses point clouds as inputs and applies a Transformer method to extract their global features. Using a K-Nearest Neighbor (K-NN) topology, our method then encodes the local features of a point cloud and integrates them with the global features to obtain the point cloud’s strong global features. Comparative experiments using the ModelNet40 data set show that our method offers better results than other methods, with a mean square error (MSE), root mean square error (RMSE), and mean absolute error (MAE) between the ground truth and predicted values lower than those of competing methods. In the case of multi-object class without noise, the rotation average absolute error of PTRNet is reduced to 1.601 degrees and the translation average absolute error is reduced to 0.005 units. Compared to other recent end-to-end registration methods and traditional point cloud registration methods, the PTRNet method has less error, higher registration accuracy, and better robustness.

Integration of Aerobiological Information for Construction Engineering Based on LiDAR and BIM

In green urban areas, the allergenic factor is important when selecting trees to improve the quality of life of the population. An application of laser imaging detection and ranging (LiDAR) in building information modelling (BIM) is the capture of geo-referenced geometric information of the environment. This study presents the process of digitalisation of a green infrastructure inventory based on the geolocation and bioparameters of the cypress species. The aerobiological index (IUGZA) was estimated by developing green infrastructure BIM models at different detail levels and with a new BIM dimension (6D) for the urban environment. The novelty of the study is the modelling of urban information for evaluating the potential environmental impact related to the allergenicity of the urban green infrastructure using LiDAR through BIM. The measurements of cypress trees based on bioparameters and distances were applied to the IUGZA. This innovation for describing the current 3D environments and designing new scenarios in 6D may prevent future problems in urban areas during construction projects.

Investigating Surface Fractures and Materials Behavior of Cultural Heritage Buildings Based on the Attribute Information of Point Clouds Stored in the TLS Dataset

To date, the potential development of 3D laser scanning has enabled the capture of high-quality and high-precision reality-based datasets for both research and industry. In particular, Terrestrial Laser Scanning (TLS) technology has played a key role in the documentation of cultural heritage. In the existing literature, the geometric properties of point clouds are still the main focus for 3D reconstruction, while the surface performance of the dataset is of less interest due to the partial and limited analysis performed by certain disciplines. As a consequence, geometric defects on surface datasets are often identified when visible through physical inspection. In response to that, this study presents an integrated approach for investigating the materials behavior of heritage building surfaces by making use of attribute point cloud information (i.e., XYZ, RGB, reflection intensity). To do so, fracture surface analysis and material properties are computed to identify vulnerable structures on the existing dataset. This is essential for architects or conservators so that they can assess and prepare preventive measures to minimize microclimatic impacts on the buildings.

Photogrammetry (SfM) vs. Terrestrial Laser Scanning (TLS) for Archaeological Excavations: Mosaic of Cantillana (Spain) as a Case Study

The discovery of a Roman mosaic from the 2nd century AD in Cantillana (Seville) generated interest and the need for exhaustive documentation, so that it could be recreated with real measurements in a 3D model, not only to obtain an exact replica, but with the intention of analyzing and studying the behavior of two main geomatics techniques. Thus, the objective of this study was the comparative analysis of both techniques: near object photogrammetry by SfM and terrestrial laser scanner or TLS. The aim of this comparison was to assess the use of both techniques in archaeological excavations. Special attention was paid to the accuracy and precision of measurements and models, especially in altimetry. Mosaics are frequently relocated from their original location to be exhibited in museums or for restoration work, after which they are returned to their original place. Therefore, the altimetric situation is of special relevance. To analyze the accuracy and errors of each technique, a total station was used to establish the real values of the ground control points (GCP) on which the comparisons of both methods were to be made. It can be concluded that the SfM technique was the most accurate and least limiting for use in semi-buried archaeological excavations. This manuscript opens new perspectives for the use of SfM-based photogrammetry in archaeological excavations.

Close-Range Sensing and Data Fusion for Built Heritage Inspection and Monitoring—A Review

Built cultural heritage is under constant threat due to environmental pressures, anthropogenic damages, and interventions. Understanding the preservation state of monuments and historical structures, and the factors that alter their architectural and structural characteristics through time, is crucial for ensuring their protection. Therefore, inspection and monitoring techniques are essential for heritage preservation, as they enable knowledge about the altering factors that put built cultural heritage at risk, by recording their immediate effects on monuments and historic structures. Nondestructive evaluations with close-range sensing techniques play a crucial role in monitoring. However, data recorded by different sensors are frequently processed separately, which hinders integrated use, visualization, and interpretation. This article’s aim is twofold: i) to present an overview of close-range sensing techniques frequently applied to evaluate built heritage conditions, and ii) to review the progress made regarding the fusion of multi-sensor data recorded by them. Particular emphasis is given to the integration of data from metric surveying and from recording techniques that are traditionally non-metric. The article attempts to shed light on the problems of the individual and integrated use of image-based modeling, laser scanning, thermography, multispectral imaging, ground penetrating radar, and ultrasonic testing, giving heritage practitioners a point of reference for the successful implementation of multidisciplinary approaches for built cultural heritage scientific investigations.

Pairwise Registration Algorithm for Large-Scale Planar Point Cloud Used in Flatness Measurement

In this paper, an optimized three-dimensional (3D) pairwise point cloud registration algorithm is proposed, which is used for flatness measurement based on a laser profilometer. The objective is to achieve a fast and accurate six-degrees-of-freedom (6-DoF) pose estimation of a large-scale planar point cloud to ensure that the flatness measurement is precise. To that end, the proposed algorithm extracts the boundary of the point cloud to obtain more effective feature descriptors of the keypoints. Then, it eliminates the invalid keypoints by neighborhood evaluation to obtain the initial matching point pairs. Thereafter, clustering combined with the geometric consistency constraints of correspondences is conducted to realize coarse registration. Finally, the iterative closest point (ICP) algorithm is used to complete fine registration based on the boundary point cloud. The experimental results demonstrate that the proposed algorithm is superior to the current algorithms in terms of boundary extraction and registration performance.

ICP registration with DCA descriptor for 3D point clouds

Widely used in three-dimensional (3D) modeling, reverse engineering and other fields, point cloud registration aims to find the translation and rotation matrix between two point clouds obtained from different perspectives, and thus correctly match the two point clouds. As the most common point cloud registration method, ICP algorithm, however, requires a good initial value, not too large transformation between the two point clouds, and also not too much occlusion; Otherwise, the iteration would fall into a local minimum. To solve this problem, this paper proposes an ICP registration algorithm based on the local features of point clouds. With this algorithm, a robust and efficient 3D local feature descriptor (density, curvature and normal angle, DCA) is firstly designed by combining the density, curvature, and normal information of the point clouds, then based on the feature description, the correspondence between the point clouds and also the initial registration result are found, and finally, the aforementioned result is used as the initial value of ICP to achieve fine tuning of the registration result. The experimental results on public data sets show that the improved ICP algorithm boosts good registration accuracy and robustness, and a fast running speed as well.

Linear-Based Incremental Co-Registration of MLS and Photogrammetric Point Clouds

Today, mobile laser scanning and oblique photogrammetry are two standard urban remote sensing acquisition methods, and the cross-source point-cloud data obtained using these methods have significant differences and complementarity. Accurate co-registration can make up for the limitations of a single data source, but many existing registration methods face critical challenges. Therefore, in this paper, we propose a systematic incremental registration method that can successfully register MLS and photogrammetric point clouds in the presence of a large number of missing data, large variations in point density, and scale differences. The robustness of this method is due to its elimination of noise in the extracted linear features and its 2D incremental registration strategy. There are three main contributions of our work: (1) the development of an end-to-end automatic cross-source point-cloud registration method; (2) a way to effectively extract the linear feature and restore the scale; and (3) an incremental registration strategy that simplifies the complex registration process. The experimental results show that this method can successfully achieve cross-source data registration, while other methods have difficulty obtaining satisfactory registration results efficiently. Moreover, this method can be extended to more point-cloud sources.

Hierarchical registration of laser point clouds between airborne and vehicle-borne data considering building eave attributes

Laser point cloud registration is a key step in multisource laser scanning data fusion and application. Aimed at the problems of fewer overlapping regional features and the influence of building eaves on registration accuracy, a hierarchical registration algorithm of laser point clouds that considers building eave attributes is proposed in this paper. After extracting the building feature points of airborne and vehicle-borne light detection and ranging data, the similarity measurement model is constructed to carry out coarse registration based on pseudo-conjugate points. To obtain the feature points of the potential eaves (FPPE), the building contour lines of the vehicle-borne data are extended using the direction prediction algorithm. The FPPE data are regarded as the search set, in which the iterative closest point (ICP) algorithm is employed to match the true conjugate points between the airborne laser scanning data and vehicle-borne laser scanning data. The ICP algorithm is used again to complete the fine registration. To evaluate the registration performance, the developed method was applied to the data processing near Shandong University of Science and Technology, Qingdao, China. The experimental results showed that the FPPE dataset can effectively address the coarse registration accuracy effects on the convergence of the iterative ICP. Before considering eave attributes, the mean registration errors (MREs) of the proposed method in the xoz plane, yoz plane, and xoy plane are 0.318, 0.96, and 0.786 m, respectively. After considering eave attributes, the MREs decrease to 0.129, 0.187, and 0.169 m, respectively. The developed method can effectively improve the registration accuracy of the laser point clouds, which not only solves the problem of matching true conjugate points under the effects of the eaves but also avoids converging to a local minimum due to ICP's poor coarse registration.

The morphological response of the Tegnas alpine catchment (Northeast Italy) to a Large Infrequent Disturbance

A recent storm (27th-30th October 2018), named Vaia, hit most part of the Northeast of Italy affecting the geomorphic aspect of almost all mountain catchments of the area. The event triggered new instabilities such as windthrows, landslides and debris flows. At present, few studies dealt with the analysis of the impact of a Large Infrequent Disturbance at large catchment scale. This work provides a focus on the Tegnas Torrent Basin (Belluno Province) and aims at detecting how, where, and how much this storm affected the basin. Moreover, it integrates two different approaches considering both the dynamic and static aspects of the sediment, via DEM of Difference (DoD) and Index of Connectivity (IC), respectively. The Tegnas sub-basins responded contrastingly: the Bordina (volcanic origin and covered by pastures and spruce forests) was mainly affected by windthrows (7% of the sub-basin area) and landslides (0.5%), while the Angheraz (outcropping dolomite rocks), was stricken only by debris flows (1.0%). Morphological changes were clear along the entire channel network, with predominant erosion in the steepest upstream parts (over 2 m of the channel elevation), and deposition in the lower main valley floor (over 3 m of the channel elevation). The IC analysis along the instabilities highlighted that the windthrows occurred mainly in areas of high connectivity, which may be important for future management strategies. Moreover, the proposed integrated approach, based on the combination IC-DoD, permitted a detailed identification of sediment routing and a contemporary estimation of erosion and deposition volumes generated by a high magnitude low-frequency event. Based on these results, cascading processes are expected and further analysis are required to fully consider the impact of a Large Infrequent Disturbance.

Development of Improved Semi-Automated Processing Algorithms for the Creation of Rockfall Databases

While terrestrial laser scanning and photogrammetry provide high quality point cloud data that can be used for rock slope monitoring, their increased use has overwhelmed current data analysis methodologies. Accordingly, point cloud processing workflows have previously been developed to automate many processes, including point cloud alignment, generation of change maps and clustering. However, for more specialized rock slope analyses (e.g., generating a rockfall database), the creation of more specialized processing routines and algorithms is necessary. More specialized algorithms include the reconstruction of rockfall volumes from clusters and points and automatic classification of those volumes are both processing steps required to automate the generation of a rockfall database. We propose a workflow that can automate all steps of the point cloud processing workflow. In this study, we detail adaptions to commonly used algorithms for rockfall monitoring use cases, such as Multiscale Model to Model Cloud Comparison (M3C2). This workflow details the entire processing pipeline for rockfall database generation using terrestrial laser scanning.

A Decade of Modern Bridge Monitoring Using Terrestrial Laser Scanning: Review and Future Directions

Over the last decade, particular interest in using state-of-the-art emerging technologies for inspection, assessment, and management of civil infrastructures has remarkably increased. Advanced technologies, such as laser scanners, have become a suitable alternative for labor intensive, expensive, and unsafe traditional inspection and maintenance methods, which encourage the increasing use of this technology in construction industry, especially in bridges. This paper aims to provide a thorough mixed scientometric and state-of-the-art review on the application of terrestrial laser scanners (TLS) in bridge engineering and explore investigations and recommendations of researchers in this area. Following the review, more than 1500 research publications were collected, investigated and analyzed through a two-fold literature search published within the last decade from 2010 to 2020. Research trends, consisting of dominated sub-fields, co-occurrence of keywords, network of researchers and their institutions, along with the interaction of research networks, were quantitatively analyzed. Moreover, based on the collected papers, application of TLS in bridge engineering and asset management was reviewed according to four categories including (1) generation of 3D model, (2) quality inspection, (3) structural assessment, and (4) bridge information modeling (BrIM). Finally, the paper identifies the current research gaps, future directions obtained from the quantitative analysis, and in-depth discussions of the collected papers in this area.

Estimation of LAI with the LiDAR Technology: A Review

Leaf area index (LAI) is an important vegetation parameter. Active light detection and ranging (LiDAR) technology has been widely used to estimate vegetation LAI. In this study, LiDAR technology, LAI retrieval and validation methods, and impact factors are reviewed. First, the paper introduces types of LiDAR systems and LiDAR data preprocessing methods. After introducing the application of different LiDAR systems, LAI retrieval methods are described. Subsequently, the review discusses various LiDAR LAI validation schemes and limitations in LiDAR LAI validation. Finally, factors affecting LAI estimation are analyzed. The review presents that LAI is mainly estimated from LiDAR data by means of the correlation with the gap fraction and contact frequency, and also from the regression of forest biophysical parameters derived from LiDAR. Terrestrial laser scanning (TLS) can be used to effectively estimate the LAI and vertical foliage profile (VFP) within plots, but this method is affected by clumping, occlusion, voxel size, and woody material. Airborne laser scanning (ALS) covers relatively large areas in a spatially contiguous manner. However, the capability of describing the within-canopy structure is limited, and the accuracy of LAI estimation with ALS is affected by the height threshold and sampling size, and types of return. Spaceborne laser scanning (SLS) provides the global LAI and VFP, and the accuracy of estimation is affected by the footprint size and topography. The use of LiDAR instruments for the retrieval of the LAI and VFP has increased; however, current LiDAR LAI validation studies are mostly performed at local scales. Future research should explore new methods to invert LAI and VFP from LiDAR and enhance the quantitative analysis and large-scale validation of the parameters.

Efficient Coarse Registration of Pairwise TLS Point Clouds Using Ortho Projected Feature Images

The degree of automation and efficiency are among the most important factors that influence the availability of Terrestrial light detection and ranging (LiDAR) Scanning (TLS) registration algorithms. This paper proposes an Ortho Projected Feature Images (OPFI) based 4 Degrees of Freedom (DOF) coarse registration method, which is fully automated and with high efficiency, for TLS point clouds acquired using leveled or inclination compensated LiDAR scanners. The proposed 4DOF registration algorithm decomposes the parameter estimation into two parts: (1) the parameter estimation of horizontal translation vector and azimuth angle; and (2) the parameter estimation of the vertical translation vector. The parameter estimation of the horizontal translation vector and the azimuth angle is achieved by ortho projecting the TLS point clouds into feature images and registering the ortho projected feature images by Scale Invariant Feature Transform (SIFT) key points and descriptors. The vertical translation vector is estimated using the height difference of source points and target points in the overlapping regions after horizontally aligned. Three real TLS datasets captured by the Riegl VZ-400 and the Trimble SX10 and one simulated dataset were used to validate the proposed method. The proposed method was compared with four state-of-the-art 4DOF registration methods. The experimental results showed that: (1) the accuracy of the proposed coarse registration method ranges from 0.02 m to 0.07 m in horizontal and 0.01 m to 0.02 m in elevation, which is at centimeter-level and sufficient for fine registration; and (2) as many as 120 million points can be registered in less than 50 s, which is much faster than the compared methods.

Comparative Study of Two Pose Measuring Systems Used to Reduce Robot Localization Error

The performance of marker-based, six degrees of freedom (6DOF) pose measuring systems is investigated. For instruments in this class, the pose is derived from locations of a few three-dimensional (3D) points. For such configurations to be used, the rigid-body condition—which requires that the distance between any two points must be fixed, regardless of orientation and position of the configuration—must be satisfied. This report introduces metrics that gauge the deviation from the rigid-body condition. The use of these metrics is demonstrated on the problem of reducing robot localization error in assembly applications. Experiments with two different systems used to reduce the localization error of the same industrial robot yielded two conflicting outcomes. The data acquired with one system led to substantial reduction in both position and orientation error of the robot, while the data acquired with a second system led to comparable reduction in the position error only. The difference is attributed to differences between metrics used to characterize the two systems.

Establishment of a New Quantitative Evaluation Model of the Targets' Geometry Distribution for Terrestrial Laser Scanning

The precision of target-based registration is related to the geometry distribution of targets, while the current method of setting the targets mainly depends on experience, and the impact is only evaluated qualitatively by the findings from empirical experiments and through simulations. In this paper, we propose a new quantitative evaluation model, which is comprised of the rotation dilution of precision (rDOP, assessing the impact of targets’ geometry distribution on the rotation parameters) and the translation dilution of precision (tDOP, assessing the impact of targets’ geometry distribution on the translation parameters). Here, the definitions and derivation of relevant formulas of the rDOP and tDOP are given, the experience conclusions are theoretically proven by the model of rDOP and tDOP, and an accurate method for determining the optimal placement location of targets and the scanner is proposed by calculating the minimum value of rDOP and tDOP. Furthermore, we can refer to the model (rDOP and tDOP) as a unified model of the geometric distribution evaluation model, which includes the DOP model in GPS.

Fast Method of Registration for 3D RGB Point Cloud with Improved Four Initial Point Pairs Algorithm

Three-dimensional (3D) point cloud registration is an important step in three-dimensional (3D) model reconstruction or 3D mapping. Currently, there are many methods for point cloud registration, but these methods are not able to simultaneously solve the problem of both efficiency and precision. We propose a fast method of global registration, which is based on RGB (Red, Green, Blue) value by using the four initial point pairs (FIPP) algorithm. First, the number of different RGB values of points in a dataset are counted and the colors in the target dataset having too few points are discarded by using a color filter. A candidate point set in the source dataset are then generated by comparing the similarity of colors between two datasets with color tolerance, and four point pairs are searched from the two datasets by using an improved FIPP algorithm. Finally, a rigid transformation matrix of global registration is calculated with total least square (TLS) and local registration with the iterative closest point (ICP) algorithm. The proposed method (RGB-FIPP) has been validated with two types of data, and the results show that it can effectively improve the speed of 3D point cloud registration while maintaining high accuracy. The method is suitable for points with RGB values.

A Novel Method for Plane Extraction from Low-Resolution Inhomogeneous Point Clouds and its Application to a Customized Low-Cost Mobile Mapping System

Over the last decade, increasing demands for building interior mapping have brought the challenge of effectively and efficiently acquiring geometric information. Most mobile mapping methods rely on the integration of Simultaneous Localization And Mapping (SLAM) and costly Inertial Measurement Units (IMUs). Meanwhile, the methods also suffer misalignment errors caused by the low-resolution inhomogeneous point clouds captured using multi-line Mobile Laser Scanners (MLSs). While point-based alignments between such point clouds are affected by the highly dynamic moving patterns of the platform, plane-based methods are limited by the poor quality of the planes extracted, which reduce the methods’ robustness, reliability, and applicability. To alleviate these issues, we proposed and developed a method for plane extraction from low-resolution inhomogeneous point clouds. Based on the definition of virtual scanlines and the Enhanced Line Simplification (ELS) algorithm, the method extracts feature points, generates line segments, forms patches, and merges multi-direction fractions to form planes. The proposed method reduces the over-segmentation fractions caused by measurement noise and scanline curvature. A dedicated plane-to-plane point cloud alignment workflow based on the proposed plane extraction method was created to demonstrate the method’s application. The implementation of the coarse-to-fine procedure and the shortest-path initialization strategy eliminates the necessity of IMUs in mobile mapping. A mobile mapping prototype was designed to test the performance of the proposed methods. The results show that the proposed workflow and hardware system achieves centimeter-level accuracy, which suggests that it can be applied to mobile mapping and sensor fusion.

A Rapid Terrestrial Laser Scanning Method for Coastal Erosion Studies: A Case Study at Freeport, Texas, USA

Terrestrial laser scanning (TLS) has become a powerful data acquisition technique for high-resolution high-accuracy topographic and morphological studies. Conventional static TLS surveys require setting up numerous reflectors (tie points) in the field for point clouds registration and georeferencing. To reduce surveying time and simplify field operational tasks, we have developed a rapid TLS surveying method that requires only one reflector in the field. The method allows direct georeferencing of point clouds from individual scans to an East–North–Height (ENH) coordinate system tied to a stable geodetic reference frame. TLS datasets collected at a segment of the beach–dune–wetland area in Freeport, Texas, USA are used to evaluate the performance of the rapid surveying method by comparing with kinematic GPS measurements. The rapid surveying method uses two GPS units mounted on the scanner and a reflector for calculating the northing angle of the scanner’s own coordinate system (SOCS). The Online Positioning User Service (OPUS) is recommended for GPS data processing. According to this study, OPUS Rapid-Static (OPUS-RS) solutions retain 1–2 cm root mean square (RMS) accuracy in the horizontal directions and 2–3 cm accuracy in the vertical direction for static observational sessions of approximately 30 min in the coastal region of Texas, USA. The rapid TLS surveys can achieve an elevation accuracy (RMS) of approximately 3–5 cm for georeferenced points and 2–3 cm for digital elevation models (DEMs). The elevation errors superimposed into the TLS surveying points roughly fit a normal distribution. The proposed TLS surveying method is particularly useful for morphological mapping over time in coastal regions, where strong wind and soft sand prohibit reflectors from remaining strictly stable for a long period. The theories and results presented in this paper are beneficial to researchers who frequently utilize TLS datasets in their research, but do not have opportunities to be involved in field data acquisition.

New Target for Accurate Terrestrial Laser Scanning and Unmanned Aerial Vehicle Point Cloud Registration

The main goal of our research was to design and implement an innovative target that would be suitable for accurately registering point clouds produced from unmanned aerial vehicle (UAV) images and terrestrial laser scans. Our new target is composed of three perpendicular planes that combine the properties of plane and volume targets. The new target enables the precise determination of reference target points in aerial and terrestrial point clouds. Different types of commonly used plane and volume targets as well as the new target were placed in an established test area in order to evaluate their performance. The targets were scanned from multiple scanner stations and surveyed with an unmanned aerial vehicle DJI Phantom 4 PRO at three different altitudes (20, 40, and 75 m). The reference data were measured with a Leica Nova MS50 MultiStation. Several registrations were performed, each time with a different target. The quality of these registrations was assessed on the check points. The results showed that the new target yielded the best results in all cases, which confirmed our initial expectations. The proposed new target is innovative and not difficult to create and use.

A Survey of Mobile Laser Scanning Applications and Key Techniques over Urban Areas

Urban planning and management need accurate three-dimensional (3D) data such as light detection and ranging (LiDAR) point clouds. The mobile laser scanning (MLS) data, with up to millimeter-level accuracy and point density of a few thousand points/m2, have gained increasing attention in urban applications. Substantial research has been conducted in the past decade. This paper conducted a comprehensive survey of urban applications and key techniques based on MLS point clouds. We first introduce the key characteristics of MLS systems and the corresponding point clouds, and present the challenges and opportunities of using the data. Next, we summarize the current applications of using MLS over urban areas, including transportation infrastructure mapping, building information modeling, utility surveying and mapping, vegetation inventory, and autonomous vehicle driving. Then, we review common key issues for processing and analyzing MLS point clouds, including classification methods, object recognition, data registration, data fusion, and 3D city modeling. Finally, we discuss the future prospects for MLS technology and urban applications.

A Review of Point Set Registration: From Pairwise Registration to Groupwise Registration

This paper presents a comprehensive literature review on point set registration. The state-of-the-art modeling methods and algorithms for point set registration are discussed and summarized. Special attention is paid to methods for pairwise registration and groupwise registration. Some of the most prominent representative methods are selected to conduct qualitative and quantitative experiments. From the experiments we have conducted on 2D and 3D data, CPD-GL pairwise registration algorithm and JRMPC groupwise registration algorithm seem to outperform their rivals both in accuracy and computational complexity. Furthermore, future research directions and avenues in the area are identified.

Heritage Building Information Modeling (H-BIM) Applied to A Stone Bridge

Certain historical works of civil engineering should be preserved as heritage monuments and when possible should continue serving the function they were designed for. Old stone bridges could be sustainably maintained but their conservation requires accurate documentation. In this study, we have scanned Ízbor bridge (1860) in Spain, and to facilitate conservation, we have modeled the ancient bridge using BIM (building information modeling). We propose a method and a model for this kind of bridge to be used as a reference for similar heritage monuments. Ízbor bridge modeled in this way will be useful for government planning and conservation agencies.