SLAM and 3D Semantic Reconstruction Based on the Fusion of Lidar and Monocular Vision

Point Cloud Densification Algorithm for Multiple Cameras and Lidars Data Fusion

Fusing data from many sources helps to achieve improved analysis and results. In this work, we present a new algorithm to fuse data from multiple cameras with data from multiple lidars. This algorithm was developed to increase the sensitivity and specificity of autonomous vehicle perception systems, where the most accurate sensors measuring the vehicle's surroundings are cameras and lidar devices. Perception systems based on data from one type of sensor do not use complete information and have lower quality. The camera provides two-dimensional images; lidar produces three-dimensional point clouds. We developed a method for matching pixels on a pair of stereoscopic images using dynamic programming inspired by an algorithm to match sequences of amino acids used in bioinformatics. We improve the quality of the basic algorithm using additional data from edge detectors. Furthermore, we also improve the algorithm performance by reducing the size of matched pixels determined by available car speeds. We perform point cloud densification in the final step of our method, fusing lidar output data with stereo vision output. We implemented our algorithm in C++ with Python API, and we provided the open-source library named Stereo PCD. This library very efficiently fuses data from multiple cameras and multiple lidars. In the article, we present the results of our approach to benchmark databases in terms of quality and performance. We compare our algorithm with other popular methods.

Clique-like Point Cloud Registration: A Flexible Sampling Registration Method Based on Clique-like for Low-Overlapping Point Cloud

Three-dimensional point cloud registration is a critical task in 3D perception for sensors that aims to determine the optimal alignment between two point clouds by finding the best transformation. Existing methods like RANSAC and its variants often face challenges, such as sensitivity to low overlap rates, high computational costs, and susceptibility to outliers, leading to inaccurate results, especially in complex or noisy environments. In this paper, we introduce a novel 3D registration method, CL-PCR, inspired by the concept of maximal cliques and built upon the SC2-PCR framework. Our approach allows for the flexible use of smaller sampling subsets to extract more local consensus information, thereby generating accurate pose hypotheses even in scenarios with low overlap between point clouds. This method enhances robustness against low overlap and reduces the influence of outliers, addressing the limitations of traditional techniques. First, we construct a graph matrix to represent the compatibility relationships among the initial correspondences. Next, we build clique-likes subsets of various sizes within the graph matrix, each representing a consensus set. Then, we compute the transformation hypotheses for the subsets using the SVD algorithm and select the best hypothesis for registration based on evaluation metrics. Extensive experiments demonstrate the effectiveness of CL-PCR. In comparison experiments on the 3DMatch/3DLoMatch datasets using both FPFH and FCGF descriptors, our Fast-CL-PCRv1 outperforms state-of-the-art algorithms, achieving superior registration performance. Additionally, we validate the practicality and robustness of our method with real-world data.

ANN-Based LiDAR Positioning System for B5G

This work reports the development of an efficient and precise indoor positioning system utilizing two-dimensional (2D) light detection and ranging (LiDAR) technology, aiming to address the challenging sensing and positioning requirements of the beyond fifth-generation (B5G) mobile networks. The core of this work is the implementation of a 2D-LiDAR system enhanced by an artificial neural network (ANN), chosen due to its robustness against electromagnetic interference and higher accuracy over traditional radiofrequency signal-based methods. The proposed system uses 2D-LiDAR sensors for data acquisition and digital filters for signal improvement. Moreover, a camera and an image-processing algorithm are used to automate the labeling of samples that will be used to train the ANN by means of indicating the regions where the pedestrians are positioned. This accurate positioning information is essential for the optimization of B5G network operation, including the control of antenna arrays and reconfigurable intelligent surfaces (RIS). The experimental validation demonstrates the efficiency of mapping pedestrian locations with a precision of up to 98.787%, accuracy of 95.25%, recall of 98.537%, and an F1 score of 98.571%. These results show that the proposed system has the potential to solve the problem of sensing and positioning in indoor environments with high reliability and accuracy.

Implementation and analysis of a parallel kalman filter algorithm for lidar localization based on CUDA technology

Introduction: Navigation satellite systems can fail to work or work incorrectly in a number of conditions: signal shadowing, electromagnetic interference, atmospheric conditions, and technical problems. All of these factors can significantly affect the localization accuracy of autonomous driving systems. This emphasizes the need for other localization technologies, such as Lidar. Methods: The use of the Kalman filter in combination with Lidar can be very effective in various applications due to the synergy of their capabilities. The Kalman filter can improve the accuracy of lidar measurements by taking into account the noise and inaccuracies present in the measurements. Results: In this paper, we propose a parallel Kalman algorithm in three-dimensional space to speed up the computational speed of Lidar localization. At the same time, the initial localization accuracy of the latter is preserved. A distinctive feature of the proposed approach is that the Kalman localization algorithm itself is parallelized, rather than the process of building a map for navigation. The proposed algorithm allows us to obtain the result 3.8 times faster without compromising the localization accuracy, which was 3% for both cases, making it effective for real-time decision-making. Discussion: The reliability of this result is confirmed by a preliminary theoretical estimate of the acceleration rate based on Ambdahl's law. Accelerating the Kalman filter with CUDA for Lidar localization can be of significant practical value, especially in real-time and in conditions where large amounts of data from Lidar sensors need to be processed.

Laser Rangefinder Methods: Autonomous-Vehicle Trajectory Control in Horticultural Plantings

This article presents a developed motion control system for a robotic platform based on laser-ranging methods, a graph traversal algorithm and the search for the optimal path. The algorithm was implemented in an agricultural building and in the field. As a result, the most efficient algorithm for finding the optimal path (A*) for the robotic platform was chosen when performing various technological operations. In the Rviz visualization environment, a program code was developed for planning the movement path and setting the points of the movement trajectory in real time. To find the optimal navigation graph in an artificial garden, an application was developed using the C# programming language and Visual Studio 2019. The results of the experiments showed that field conditions can differ significantly from laboratory conditions, while the positioning accuracy is significantly lower. The statistical processing of the experimental data showed that, for the movement of a robotic platform along a given trajectory in the field, the most effective conditions are as follows: speed: 2.5 km/h; illumination: 109,600 lux; distance to the tree: 0.5 m. An analysis of the operating parameters of the LiDAR sensor showed that it provides a high degree of positioning accuracy under various lighting conditions at various speeds in the aisles of a garden 3 m wide with an inter-stem distance of 1.5 m and a tree crown width of 0.5 m. The use of sensors-rangefinders of the optical range-allows for the performance of positional movements of the robotic platform and ensures the autonomous performance of the basic technological operations of the units in intensive gardens with a deviation from the specified trajectory of no more than 8.4 cm, which meets the agrotechnical requirements.

Efficient Detection and Tracking of Human Using 3D LiDAR Sensor

Light Detection and Ranging (LiDAR) technology is now becoming the main tool in many applications such as autonomous driving and human-robot collaboration. Point-cloud-based 3D object detection is becoming popular and widely accepted in the industry and everyday life due to its effectiveness for cameras in challenging environments. In this paper, we present a modular approach to detect, track and classify persons using a 3D LiDAR sensor. It combines multiple principles: a robust implementation for object segmentation, a classifier with local geometric descriptors, and a tracking solution. Moreover, we achieve a real-time solution in a low-performance machine by reducing the number of points to be processed by obtaining and predicting regions of interest via movement detection and motion prediction without any previous knowledge of the environment. Furthermore, our prototype is able to successfully detect and track persons consistently even in challenging cases due to limitations on the sensor field of view or extreme pose changes such as crouching, jumping, and stretching. Lastly, the proposed solution is tested and evaluated in multiple real 3D LiDAR sensor recordings taken in an indoor environment. The results show great potential, with particularly high confidence in positive classifications of the human body as compared to state-of-the-art approaches.

Three-Dimensional Immersion Scanning Technique: A Scalable Low-Cost Solution for 3D Scanning Using Water-Based Fluid

Three-dimensional scanning technology has been traditionally used in the medical and engineering industries, but these scanners can be expensive or limited in their capabilities. This research aimed to develop low-cost 3D scanning using rotation and immersion in a water-based fluid. This technique uses a reconstruction approach similar to CT scanners but with significantly less instrumentation and cost than traditional CT scanners or other optical scanning techniques. The setup consisted of a container filled with a mixture of water and Xanthan gum. The object to be scanned was submerged at various rotation angles. A stepper motor slide with a needle was used to measure the fluid level increment as the object being scanned was submerged into the container. The results showed that the 3D scanning using immersion in a water-based fluid was feasible and could be adapted to a wide range of object sizes. The technique produced reconstructed images of objects with gaps or irregularly shaped openings in a low-cost fashion. A 3D printed model with a width of 30.7200 ± 0.2388 mm and height of 31.6800 ± 0.3445 mm was compared to its scan to evaluate the precision of the technique. Its width/height ratio (0.9697 ± 0.0084) overlaps the margin of error of the width/height ratio of the reconstructed image (0.9649 ± 0.0191), showing statistical similarities. The signal-to-noise ratio was calculated at around 6 dB. Suggestions for future work are made to improve the parameters of this promising, low-cost technique.