1
|
Qiu H, Zhang X, Wang H, Xiang D, Xiao M, Zhu Z, Wang L. A Robust and Integrated Visual Odometry Framework Exploiting the Optical Flow and Feature Point Method. SENSORS (BASEL, SWITZERLAND) 2023; 23:8655. [PMID: 37896748 PMCID: PMC10611077 DOI: 10.3390/s23208655] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/28/2023] [Revised: 10/18/2023] [Accepted: 10/20/2023] [Indexed: 10/29/2023]
Abstract
In this paper, we propose a robust and integrated visual odometry framework exploiting the optical flow and feature point method that achieves faster pose estimate and considerable accuracy and robustness during the odometry process. Our method utilizes optical flow tracking to accelerate the feature point matching process. In the odometry, two visual odometry methods are used: global feature point method and local feature point method. When there is good optical flow tracking and enough key points optical flow tracking matching is successful, the local feature point method utilizes prior information from the optical flow to estimate relative pose transformation information. In cases where there is poor optical flow tracking and only a small number of key points successfully match, the feature point method with a filtering mechanism is used for posing estimation. By coupling and correlating the two aforementioned methods, this visual odometry greatly accelerates the computation time for relative pose estimation. It reduces the computation time of relative pose estimation to 40% of that of the ORB_SLAM3 front-end odometry, while ensuring that it is not too different from the ORB_SLAM3 front-end odometry in terms of accuracy and robustness. The effectiveness of this method was validated and analyzed using the EUROC dataset within the ORB_SLAM3 open-source framework. The experimental results serve as supporting evidence for the efficacy of the proposed approach.
Collapse
Affiliation(s)
- Haiyang Qiu
- School of Naval Architecture and Ocean Engineering, Guangzhou Maritime University, Guangzhou 510725, China; (H.W.); (D.X.); (M.X.)
| | - Xu Zhang
- School of Automation, Jiangsu University of Science and Technology, Zhenjiang 212013, China; (X.Z.); (Z.Z.)
| | - Hui Wang
- School of Naval Architecture and Ocean Engineering, Guangzhou Maritime University, Guangzhou 510725, China; (H.W.); (D.X.); (M.X.)
| | - Dan Xiang
- School of Naval Architecture and Ocean Engineering, Guangzhou Maritime University, Guangzhou 510725, China; (H.W.); (D.X.); (M.X.)
| | - Mingming Xiao
- School of Naval Architecture and Ocean Engineering, Guangzhou Maritime University, Guangzhou 510725, China; (H.W.); (D.X.); (M.X.)
| | - Zhiyu Zhu
- School of Automation, Jiangsu University of Science and Technology, Zhenjiang 212013, China; (X.Z.); (Z.Z.)
| | - Lei Wang
- State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430072, China;
| |
Collapse
|
2
|
Asl Sabbaghian Hokmabadi I, Ai M, El-Sheimy N. Shaped-Based Tightly Coupled IMU/Camera Object-Level SLAM. SENSORS (BASEL, SWITZERLAND) 2023; 23:7958. [PMID: 37766021 PMCID: PMC10536907 DOI: 10.3390/s23187958] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 09/04/2023] [Accepted: 09/15/2023] [Indexed: 09/29/2023]
Abstract
Object-level simultaneous localization and mapping (SLAM) has gained popularity in recent years since it can provide a means for intelligent robot-to-environment interactions. However, most of these methods assume that the distribution of the errors is Gaussian. This assumption is not valid under many circumstances. Further, these methods use a delayed initialization of the objects in the map. During this delayed period, the solution relies on the motion model provided by an inertial measurement unit (IMU). Unfortunately, the errors tend to accumulate quickly due to the dead-reckoning nature of these motion models. Finally, the current solutions depend on a set of salient features on the object's surface and not the object's shape. This research proposes an accurate object-level solution to the SLAM problem with a 4.1 to 13.1 cm error in the position (0.005 to 0.021 of the total path). The developed solution is based on Rao-Blackwellized Particle Filtering (RBPF) that does not assume any predefined error distribution for the parameters. Further, the solution relies on the shape and thus can be used for objects that lack texture on their surface. Finally, the developed tightly coupled IMU/camera solution is based on an undelayed initialization of the objects in the map.
Collapse
|
3
|
Bavle H, Sanchez-Lopez JL, Cimarelli C, Tourani A, Voos H. From SLAM to Situational Awareness: Challenges and Survey. SENSORS (BASEL, SWITZERLAND) 2023; 23:4849. [PMID: 37430762 DOI: 10.3390/s23104849] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/10/2023] [Revised: 04/27/2023] [Accepted: 05/13/2023] [Indexed: 07/12/2023]
Abstract
The capability of a mobile robot to efficiently and safely perform complex missions is limited by its knowledge of the environment, namely the situation. Advanced reasoning, decision-making, and execution skills enable an intelligent agent to act autonomously in unknown environments. Situational Awareness (SA) is a fundamental capability of humans that has been deeply studied in various fields, such as psychology, military, aerospace, and education. Nevertheless, it has yet to be considered in robotics, which has focused on single compartmentalized concepts such as sensing, spatial perception, sensor fusion, state estimation, and Simultaneous Localization and Mapping (SLAM). Hence, the present research aims to connect the broad multidisciplinary existing knowledge to pave the way for a complete SA system for mobile robotics that we deem paramount for autonomy. To this aim, we define the principal components to structure a robotic SA and their area of competence. Accordingly, this paper investigates each aspect of SA, surveying the state-of-the-art robotics algorithms that cover them, and discusses their current limitations. Remarkably, essential aspects of SA are still immature since the current algorithmic development restricts their performance to only specific environments. Nevertheless, Artificial Intelligence (AI), particularly Deep Learning (DL), has brought new methods to bridge the gap that maintains these fields apart from the deployment to real-world scenarios. Furthermore, an opportunity has been discovered to interconnect the vastly fragmented space of robotic comprehension algorithms through the mechanism of Situational Graph (S-Graph), a generalization of the well-known scene graph. Therefore, we finally shape our vision for the future of robotic situational awareness by discussing interesting recent research directions.
Collapse
Affiliation(s)
- Hriday Bavle
- Interdisciplinary Center for Security Reliability and Trust (SnT), University of Luxembourg, 1855 Luxembourg, Luxembourg
| | - Jose Luis Sanchez-Lopez
- Interdisciplinary Center for Security Reliability and Trust (SnT), University of Luxembourg, 1855 Luxembourg, Luxembourg
| | - Claudio Cimarelli
- Interdisciplinary Center for Security Reliability and Trust (SnT), University of Luxembourg, 1855 Luxembourg, Luxembourg
| | - Ali Tourani
- Interdisciplinary Center for Security Reliability and Trust (SnT), University of Luxembourg, 1855 Luxembourg, Luxembourg
| | - Holger Voos
- Interdisciplinary Center for Security Reliability and Trust (SnT), University of Luxembourg, 1855 Luxembourg, Luxembourg
- Department of Engineering, Faculty of Science, Technology, and Medicine (FSTM), University of Luxembourg, 1359 Luxembourg, Luxembourg
| |
Collapse
|
4
|
Huang Q, Papalia A, Leonard JJ. Nested Sampling for Non-Gaussian Inference in SLAM Factor Graphs. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2022.3189786] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Affiliation(s)
- Qiangqiang Huang
- Computer Science and Artificial Intelligence Lab (CSAIL), Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Alan Papalia
- CSAIL at MIT and the Department of Applied Ocean Physics and Engineering, Woods Hole Oceanographic Institution, Woods Hole, MA, USA
| | - John J. Leonard
- Computer Science and Artificial Intelligence Lab (CSAIL), Massachusetts Institute of Technology, Cambridge, MA, USA
| |
Collapse
|
5
|
Piecewise-deterministic Quasi-static Pose Graph SLAM in Unstructured Dynamic Environments. J INTELL ROBOT SYST 2022. [DOI: 10.1007/s10846-022-01739-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/14/2022]
|
6
|
Farhi EI, Indelman V. Bayesian incremental inference update by re-using calculations from belief space planning: a new paradigm. Auton Robots 2022. [DOI: 10.1007/s10514-022-10045-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
7
|
Saxena A, Chiu CY, Shrivastava R, Menke J, Sastry S. Simultaneous Localization and Mapping: Through the Lens of Nonlinear Optimization. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2022.3181409] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Affiliation(s)
- Amay Saxena
- Department of EECS at the University of California, Berkeley, CA, USA
| | - Chih-Yuan Chiu
- Department of EECS at the University of California, Berkeley, CA, USA
| | | | - Joseph Menke
- Department of EECS at the University of California, Berkeley, CA, USA
| | - Shankar Sastry
- Department of EECS at the University of California, Berkeley, CA, USA
| |
Collapse
|
8
|
Elimelech K, Indelman V. Simplified decision making in the belief space using belief sparsification. Int J Rob Res 2022. [DOI: 10.1177/02783649221076381] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
In this work, we introduce a new and efficient solution approach for the problem of decision making under uncertainty, which can be formulated as decision making in a belief space, over a possibly high-dimensional state space. Typically, to solve a decision problem, one should identify the optimal action from a set of candidates, according to some objective. We claim that one can often generate and solve an analogous yet simplified decision problem, which can be solved more efficiently. A wise simplification method can lead to the same action selection, or one for which the maximal loss in optimality can be guaranteed. Furthermore, such simplification is separated from the state inference and does not compromise its accuracy, as the selected action would finally be applied on the original state. First, we present the concept for general decision problems and provide a theoretical framework for a coherent formulation of the approach. We then practically apply these ideas to decision problems in the belief space, which can be simplified by considering a sparse approximation of their initial belief. The scalable belief sparsification algorithm we provide is able to yield solutions which are guaranteed to be consistent with the original problem. We demonstrate the benefits of the approach in the solution of a realistic active-SLAM problem and manage to significantly reduce computation time, with no loss in the quality of solution. This work is both fundamental and practical and holds numerous possible extensions.
Collapse
Affiliation(s)
- Khen Elimelech
- Robotics and Autonomous Systems Program, Technion—Israel Institute of Technology, Haifa
| | - Vadim Indelman
- Department of Aerospace Engineering, Technion—Israel Institute of Technology, Haifa
| |
Collapse
|
9
|
Cimarelli C, Bavle H, Sanchez-Lopez JL, Voos H. RAUM-VO: Rotational Adjusted Unsupervised Monocular Visual Odometry. SENSORS 2022; 22:s22072651. [PMID: 35408264 PMCID: PMC9003133 DOI: 10.3390/s22072651] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Revised: 03/14/2022] [Accepted: 03/26/2022] [Indexed: 12/10/2022]
Abstract
Unsupervised learning for monocular camera motion and 3D scene understanding has gained popularity over traditional methods, which rely on epipolar geometry or non-linear optimization. Notably, deep learning can overcome many issues of monocular vision, such as perceptual aliasing, low-textured areas, scale drift, and degenerate motions. In addition, concerning supervised learning, we can fully leverage video stream data without the need for depth or motion labels. However, in this work, we note that rotational motion can limit the accuracy of the unsupervised pose networks more than the translational component. Therefore, we present RAUM-VO, an approach based on a model-free epipolar constraint for frame-to-frame motion estimation (F2F) to adjust the rotation during training and online inference. To this end, we match 2D keypoints between consecutive frames using pre-trained deep networks, Superpoint and Superglue, while training a network for depth and pose estimation using an unsupervised training protocol. Then, we adjust the predicted rotation with the motion estimated by F2F using the 2D matches and initializing the solver with the pose network prediction. Ultimately, RAUM-VO shows a considerable accuracy improvement compared to other unsupervised pose networks on the KITTI dataset, while reducing the complexity of other hybrid or traditional approaches and achieving comparable state-of-the-art results.
Collapse
|
10
|
Taguchi S, Deguchi H, Hirose N, Kidono K. Fast Bayesian graph update for SLAM. Adv Robot 2022. [DOI: 10.1080/01691864.2021.2013939] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/01/2022]
Affiliation(s)
- Shun Taguchi
- Toyota Central R&D Labs., Inc., Nagakute, Aichi, Japan
| | | | | | | |
Collapse
|
11
|
Guadagnino T, Giammarino LD, Grisetti G. HiPE: Hierarchical Initialization for Pose Graphs. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2021.3125046] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
12
|
Nguyen TXB, Rosser K, Chahl J. A Review of Modern Thermal Imaging Sensor Technology and Applications for Autonomous Aerial Navigation. J Imaging 2021; 7:jimaging7100217. [PMID: 34677303 PMCID: PMC8540138 DOI: 10.3390/jimaging7100217] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2021] [Revised: 09/30/2021] [Accepted: 10/09/2021] [Indexed: 11/16/2022] Open
Abstract
Limited navigation capabilities of many current robots and UAVs restricts their applications in GPS denied areas. Large aircraft with complex navigation systems rely on a variety of sensors including radio frequency aids and high performance inertial systems rendering them somewhat resistant to GPS denial. The rapid development of computer vision has seen cameras incorporated into small drones. Vision-based systems, consisting of one or more cameras, could arguably satisfy both size and weight constraints faced by UAVs. A new generation of thermal sensors is available that are lighter, smaller and widely available. Thermal sensors are a solution to enable navigation in difficult environments, including in low-light, dust or smoke. The purpose of this paper is to present a comprehensive literature review of thermal sensors integrated into navigation systems. Furthermore, the physics and characteristics of thermal sensors will also be presented to provide insight into challenges when integrating thermal sensors in place of conventional visual spectrum sensors.
Collapse
Affiliation(s)
- Tran Xuan Bach Nguyen
- School of Engineering, University of South Australia, Mawson Lakes 5095, Australia;
- Correspondence:
| | - Kent Rosser
- Aerospace Division, Defence Science and Technology Group, Edinburgh 5111, Australia;
| | - Javaan Chahl
- School of Engineering, University of South Australia, Mawson Lakes 5095, Australia;
- Joint and Operations Analysis Division, Defence Science and Technology Group, Melbourne 3000, Australia
| |
Collapse
|
13
|
Terblanche J, Claassens S, Fourie D. Multimodal Navigation-Affordance Matching for SLAM. IEEE Robot Autom Lett 2021. [DOI: 10.1109/lra.2021.3098788] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
14
|
|
15
|
Low-Bandwidth and Compute-Bound RGB-D Planar Semantic SLAM. SENSORS 2021; 21:s21165400. [PMID: 34450841 PMCID: PMC8399848 DOI: 10.3390/s21165400] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/17/2021] [Revised: 08/07/2021] [Accepted: 08/07/2021] [Indexed: 11/16/2022]
Abstract
Visual simultaneous location and mapping (SLAM) using RGB-D cameras has been a necessary capability for intelligent mobile robots. However, when using point-cloud map representations as most RGB-D SLAM systems do, limitations in onboard compute resources, and especially communication bandwidth can significantly limit the quantity of data processed and shared. This article proposes techniques that help address these challenges by mapping point clouds to parametric models in order to reduce computation and bandwidth load on agents. This contribution is coupled with a convolutional neural network (CNN) that extracts semantic information. Semantics provide guidance in object modeling which can reduce the geometric complexity of the environment. Pairing a parametric model with a semantic label allows agents to share the knowledge of the world with much less complexity, opening a door for multi-agent systems to perform complex tasking, and human–robot cooperation. This article takes the first step towards a generalized parametric model by limiting the geometric primitives to a planar surface and providing semantic labels when appropriate. Two novel compression algorithms for depth data and a method to independently fit planes to RGB-D data are provided, so that plane data can be used for real-time odometry estimation and mapping. Additionally, we extend maps with semantic information predicted from sparse geometries (planes) by a CNN. In experiments, the advantages of our approach in terms of computational and bandwidth resources savings are demonstrated and compared with other state-of-the-art SLAM systems.
Collapse
|
16
|
Cao Y, Beltrame G. VIR-SLAM: visual, inertial, and ranging SLAM for single and multi-robot systems. Auton Robots 2021. [DOI: 10.1007/s10514-021-09992-7] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
17
|
Wang D, Xie F, Yang J, Lu R, Zhu T, Liu Y. Industry robotic motion and pose recognition method based on camera pose estimation and neural network. INT J ADV ROBOT SYST 2021. [DOI: 10.1177/17298814211018549] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
To control industry robots and make sure they are working in a correct status, an efficient way to judge the motion of the robot is important. In this article, an industry robotic motion and pose recognition method based on camera pose estimation and neural network are proposed. Firstly, industry robotic motion recognition based on the neural network has been developed to estimate and optimize motion of the robotics only by a monoscope camera. Secondly, the motion recognition including key flames recording and pose adjustment has been proposed and analyzed to restore the pose of the robotics more accurately. Finally, a KUKA industry robot has been used to test the proposed method, and the test results have demonstrated that the motion and pose recognition method can recognize the industry robotic pose accurately and efficiently without inertial measurement unit (IMU) and other censers. Below in the same algorithm, the error of the method introduced in this article is better than the traditional method using IMU and has a better merit of reducing cumulative error.
Collapse
Affiliation(s)
- Ding Wang
- School of Electrical and Automation Engineering, Nanjing Normal University, Nanjing, China
- Nanjing Zhongke Yuchen Laser Technology Co., Ltd., Nanjing, China
| | - Fei Xie
- School of Electrical and Automation Engineering, Nanjing Normal University, Nanjing, China
- Nanjing Zhongke Yuchen Laser Technology Co., Ltd., Nanjing, China
- Jiangsu Key Laboratory of 3D Printing Equipment and Manufacturing, Nanjing Normal University, Nanjing, China
| | - Jiquan Yang
- School of Electrical and Automation Engineering, Nanjing Normal University, Nanjing, China
- Nanjing Zhongke Yuchen Laser Technology Co., Ltd., Nanjing, China
- Jiangsu Key Laboratory of 3D Printing Equipment and Manufacturing, Nanjing Normal University, Nanjing, China
| | - Rongjian Lu
- Nanjing Zhongke Yuchen Laser Technology Co., Ltd., Nanjing, China
- Automation Department, School of Mechanical and Electronic Engineering, Nanjing Forestry University, Nanjing, China
| | - Tengfei Zhu
- School of Electrical and Automation Engineering, Nanjing Normal University, Nanjing, China
- Nanjing Zhongke Yuchen Laser Technology Co., Ltd., Nanjing, China
| | - Yijian Liu
- School of Electrical and Automation Engineering, Nanjing Normal University, Nanjing, China
- Nanjing Zhongke Yuchen Laser Technology Co., Ltd., Nanjing, China
- Jiangsu Key Laboratory of 3D Printing Equipment and Manufacturing, Nanjing Normal University, Nanjing, China
| |
Collapse
|
18
|
Mapping in unstructured natural environment: a sensor fusion framework for wearable sensor suites. SN APPLIED SCIENCES 2021. [DOI: 10.1007/s42452-021-04555-y] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022] Open
Abstract
AbstractWe present a generalized mapping framework that can withstand the challenges incurred by working in unstructured outdoor environments, such as a snowy forest. The proposed method takes advantage of a sensor fusion scheme, where sensors such as cameras and lidars are used in order to reconstruct the surrounding natural environment. Although mapping techniques such as SLAM and ICP cannot themselves properly handle the complexity of natural scenes, they do have the potential to contribute to the global solution in a proposed sensor fusion scheme, based on a factor graph architecture. In this paper, we propose an innovative map registration scheme for visual maps, and show how it can improve the reconstruction quality after data fusion. We also analyze the behavior and sensitivity of factor graphs to uncertainties, by comparing the residual error with different parameter combinations such as variances, using an exhaustive grid search with ground truth comparison. Finally, we suggest an ICP-inferred loop closure, capable of compensating position and attitude drift. The experiments are carried out by recording in a snowy forest using a wearable sensor suite. In the experiments, ground truth was acquired using a millimeter-accurate total station. The proposed framework is shown to be robust and likewise capable of providing estimates that are otherwise unattainable using classic techniques, such as visual SLAM and ICP for lasers. Finally, a visible improvement in the map reconstruction quality is shown, and the proposed framework achieves a translation error of 0.36 m.
Collapse
|
19
|
Elimelech K, Indelman V. Efficient Modification of the Upper Triangular Square Root Matrix on Variable Reordering. IEEE Robot Autom Lett 2021. [DOI: 10.1109/lra.2020.3048663] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
20
|
Fan T, Wang H, Rubenstein M, Murphey T. CPL-SLAM: Efficient and Certifiably Correct Planar Graph-Based SLAM Using the Complex Number Representation. IEEE T ROBOT 2020. [DOI: 10.1109/tro.2020.3006717] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
21
|
|
22
|
Mangelson JG, Ghaffari M, Vasudevan R, Eustice RM. Characterizing the Uncertainty of Jointly Distributed Poses in the Lie Algebra. IEEE T ROBOT 2020. [DOI: 10.1109/tro.2020.2994457] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
23
|
Robot Localization in Water Pipes Using Acoustic Signals and Pose Graph Optimization. SENSORS 2020; 20:s20195584. [PMID: 33003456 PMCID: PMC7583040 DOI: 10.3390/s20195584] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/04/2020] [Revised: 09/21/2020] [Accepted: 09/24/2020] [Indexed: 11/17/2022]
Abstract
One of the most fundamental tasks for robots inspecting water distribution pipes is localization, which allows for autonomous navigation, for faults to be communicated, and for interventions to be instigated. Pose-graph optimization using spatially varying information is used to enable localization within a feature-sparse length of pipe. We present a novel method for improving estimation of a robot’s trajectory using the measured acoustic field, which is applicable to other measurements such as magnetic field sensing. Experimental results show that the use of acoustic information in pose-graph optimization reduces errors by 39% compared to the use of typical pose-graph optimization using landmark features only. High location accuracy is essential to efficiently and effectively target investment to maximise the use of our aging pipe infrastructure.
Collapse
|
24
|
Abstract
Nowadays, Nonlinear Least-Squares embodies the foundation of many Robotics and Computer Vision systems. The research community deeply investigated this topic in the last few years, and this resulted in the development of several open-source solvers to approach constantly increasing classes of problems. In this work, we propose a unified methodology to design and develop efficient Least-Squares Optimization algorithms, focusing on the structures and patterns of each specific domain. Furthermore, we present a novel open-source optimization system that addresses problems transparently with a different structure and designed to be easy to extend. The system is written in modern C++ and runs efficiently on embedded systemsWe validated our approach by conducting comparative experiments on several problems using standard datasets. The results show that our system achieves state-of-the-art performances in all tested scenarios.
Collapse
|
25
|
Zhang HE, Ye C. Plane-Aided Visual-Inertial Odometry for 6-DOF Pose Estimation of a Robotic Navigation Aid. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2020; 8:90042-90051. [PMID: 33747673 PMCID: PMC7977623 DOI: 10.1109/access.2020.2994299] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
The classic visual-inertial odometry (VIO) method estimates the 6-DOF pose of a moving camera by fusing the camera's ego-motion estimated by visual odometry (VO) and the motion measured by an inertial measurement unit (IMU). The VIO attempts to updates the estimates of the IMU's biases at each step by using the VO's output to improve the accuracy of IMU measurement. This approach works only if an accurate VO output can be identified and used. However, there is no reliable method that can be used to perform an online evaluation of the accuracy of the VO. In this paper, a new VIO method is introduced for pose estimation of a robotic navigation aid (RNA) that uses a 3D time-of-flight camera for assistive navigation. The method, called plane-aided visual-inertial odometry (PAVIO), extracts planes from the 3D point cloud of the current camera view and track them onto the next camera view by using the IMU's measurement. The covariance matrix of each tracked plane's parameters is computed and used to perform a plane consistent check based on a chi-square test to evaluate the accuracy of VO's output. PAVIO accepts a VO output only if it is accurate. The accepted VO outputs, the information of the extracted planes, and the IMU's measurements over time are used to create a factor graph. By optimizing the graph, the method improves the accuracy in estimating the IMU bias and reduces the camera's pose error. Experimental results with the RNA validate the effectiveness of the proposed method. PAVIO can be used to estimate the 6-DOF pose for any 3D-camera-based visual-inertial navigation system.
Collapse
Affiliation(s)
- H E Zhang
- Computer Science Department, Virginia Commonwealth University, Richmond, VA 23284, USA
| | - Cang Ye
- Computer Science Department, Virginia Commonwealth University, Richmond, VA 23284, USA
| |
Collapse
|
26
|
|
27
|
Representations and Benchmarking of Modern Visual SLAM Systems. SENSORS 2020; 20:s20092572. [PMID: 32366018 PMCID: PMC7248763 DOI: 10.3390/s20092572] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/23/2020] [Revised: 04/27/2020] [Accepted: 04/28/2020] [Indexed: 11/16/2022]
Abstract
Simultaneous Localisation And Mapping (SLAM) has long been recognised as a core problem to be solved within countless emerging mobile applications that require intelligent interaction or navigation in an environment. Classical solutions to the problem primarily aim at localisation and reconstruction of a geometric 3D model of the scene. More recently, the community increasingly investigates the development of Spatial Artificial Intelligence (Spatial AI), an evolutionary paradigm pursuing a simultaneous recovery of object-level composition and semantic annotations of the recovered 3D model. Several interesting approaches have already been presented, producing object-level maps with both geometric and semantic properties rather than just accurate and robust localisation performance. As such, they require much broader ground truth information for validation purposes. We discuss the structure of the representations and optimisation problems involved in Spatial AI, and propose new synthetic datasets that, for the first time, include accurate ground truth information about the scene composition as well as individual object shapes and poses. We furthermore propose evaluation metrics for all aspects of such joint geometric-semantic representations and apply them to a new semantic SLAM framework. It is our hope that the introduction of these datasets and proper evaluation metrics will be instrumental in the evaluation of current and future Spatial AI systems and as such contribute substantially to the overall research progress on this important topic.
Collapse
|
28
|
Latency Compensated Visual-Inertial Odometry for Agile Autonomous Flight. SENSORS 2020; 20:s20082209. [PMID: 32295132 PMCID: PMC7218848 DOI: 10.3390/s20082209] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/28/2020] [Revised: 04/10/2020] [Accepted: 04/12/2020] [Indexed: 12/05/2022]
Abstract
In visual-inertial odometry (VIO), inertial measurement unit (IMU) dead reckoning acts as the dynamic model for flight vehicles while camera vision extracts information about the surrounding environment and determines features or points of interest. With these sensors, the most widely used algorithm for estimating vehicle and feature states for VIO is an extended Kalman filter (EKF). The design of the standard EKF does not inherently allow for time offsets between the timestamps of the IMU and vision data. In fact, sensor-related delays that arise in various realistic conditions are at least partially unknown parameters. A lack of compensation for unknown parameters often leads to a serious impact on the accuracy of VIO systems and systems like them. To compensate for the uncertainties of the unknown time delays, this study incorporates parameter estimation into feature initialization and state estimation. Moreover, computing cross-covariance and estimating delays in online temporal calibration correct residual, Jacobian, and covariance. Results from flight dataset testing validate the improved accuracy of VIO employing latency compensated filtering frameworks. The insights and methods proposed here are ultimately useful in any estimation problem (e.g., multi-sensor fusion scenarios) where compensation for partially unknown time delays can enhance performance.
Collapse
|
29
|
Watson RM, Gross JN, Taylor CN, Leishman RC. Robust Incremental State Estimation Through Covariance Adaptation. IEEE Robot Autom Lett 2020. [DOI: 10.1109/lra.2020.2979655] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
30
|
MapperBot/iSCAN: open-source integrated robotic platform and algorithm for 2D mapping. INTERNATIONAL JOURNAL OF INTELLIGENT ROBOTICS AND APPLICATIONS 2020. [DOI: 10.1007/s41315-020-00118-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
31
|
Zhang R, Zhu S, Shen T, Zhou L, Luo Z, Fang T, Quan L. Distributed Very Large Scale Bundle Adjustment by Global Camera Consensus. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 2020; 42:291-303. [PMID: 29993533 DOI: 10.1109/tpami.2018.2840719] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
The increasing scale of Structure-from-Motion is fundamentally limited by the conventional optimization framework for the all-in-one global bundle adjustment. In this paper, we propose a distributed approach to coping with this global bundle adjustment for very large scale Structure-from-Motion computation. First, we derive the distributed formulation from the classical optimization algorithm ADMM, Alternating Direction Method of Multipliers, based on the global camera consensus. Then, we analyze the conditions under which the convergence of this distributed optimization would be guaranteed. In particular, we adopt over-relaxation and self-adaption schemes to improve the convergence rate. After that, we propose to split the large scale camera-point visibility graph in order to reduce the communication overheads of the distributed computing. The experiments on both public large scale SfM data-sets and our very large scale aerial photo sets demonstrate that the proposed distributed method clearly outperforms the state-of-the-art method in efficiency and accuracy.
Collapse
|
32
|
Aloise I, Grisetti G. Chordal Based Error Function for 3-D Pose-Graph Optimization. IEEE Robot Autom Lett 2020. [DOI: 10.1109/lra.2019.2956456] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
33
|
Liu X, Zhang L, Qin S, Tian D, Ouyang S, Chen C. Optimized LOAM Using Ground Plane Constraints and SegMatch-Based Loop Detection. SENSORS 2019; 19:s19245419. [PMID: 31835338 PMCID: PMC6960903 DOI: 10.3390/s19245419] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/05/2019] [Revised: 12/05/2019] [Accepted: 12/06/2019] [Indexed: 11/16/2022]
Abstract
Reducing the cumulative error in the process of simultaneous localization and mapping (SLAM) has always been a hot issue. In this paper, in order to improve the localization and mapping accuracy of ground vehicles, we proposed a novel optimized lidar odometry and mapping method using ground plane constraints and SegMatch-based loop detection. We only used the lidar point cloud to estimate the pose between consecutive frames, without any other sensors, such as Global Positioning System (GPS) and Inertial Measurement Unit (IMU). Firstly, the ground plane constraints were used to reduce matching errors. Then, based on more accurate lidar odometry obtained from lidar odometry and mapping (LOAM), SegMatch completed segmentation matching and loop detection to optimize the global pose. The neighborhood search was also used to accomplish the loop detection task in case of failure. Finally, the proposed method was evaluated and compared with the existing 3D lidar SLAM methods. Experiment results showed that the proposed method could realize low drift localization and dense 3D point cloud map construction.
Collapse
Affiliation(s)
- Xiao Liu
- Faculty of Robot Science and Engineering, Northeastern University, Shenyang 110016, China;
- Shenyang SIASUN Robot & Automation Co., LTD., Shenyang 110168, China; (L.Z.); (S.Q.); (D.T.); (S.O.)
- Correspondence:
| | - Lei Zhang
- Shenyang SIASUN Robot & Automation Co., LTD., Shenyang 110168, China; (L.Z.); (S.Q.); (D.T.); (S.O.)
| | - Shengran Qin
- Shenyang SIASUN Robot & Automation Co., LTD., Shenyang 110168, China; (L.Z.); (S.Q.); (D.T.); (S.O.)
- School of Information Science and Engineering, Shenyang University of Technology, Shenyang 110870, China
| | - Daji Tian
- Shenyang SIASUN Robot & Automation Co., LTD., Shenyang 110168, China; (L.Z.); (S.Q.); (D.T.); (S.O.)
| | - Shihan Ouyang
- Shenyang SIASUN Robot & Automation Co., LTD., Shenyang 110168, China; (L.Z.); (S.Q.); (D.T.); (S.O.)
- School of Information Science and Engineering, Shenyang University of Technology, Shenyang 110870, China
| | - Chu Chen
- Faculty of Robot Science and Engineering, Northeastern University, Shenyang 110016, China;
- Shenyang SIASUN Robot & Automation Co., LTD., Shenyang 110168, China; (L.Z.); (S.Q.); (D.T.); (S.O.)
| |
Collapse
|
34
|
|
35
|
Incremental Pose Map Optimization for Monocular Vision SLAM Based on Similarity Transformation. SENSORS 2019; 19:s19224945. [PMID: 31766236 PMCID: PMC6891346 DOI: 10.3390/s19224945] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/16/2019] [Revised: 11/08/2019] [Accepted: 11/10/2019] [Indexed: 11/25/2022]
Abstract
The novel contribution of this paper is to propose an incremental pose map optimization for monocular vision simultaneous localization and mapping (SLAM) based on similarity transformation, which can effectively solve the scale drift problem of SLAM for monocular vision and eliminate the cumulative error by global optimization. With the method of mixed inverse depth estimation based on a probability graph, the problem of the uncertainty of depth estimation is effectively solved and the robustness of depth estimation is improved. Firstly, this paper proposes a method combining the sparse direct method based on histogram equalization and the feature point method for front-end processing, and the mixed inverse depth estimation method based on a probability graph is used to estimate the depth information. Then, a bag-of-words model based on the mean initialization K-means is proposed for closed-loop feature detection. Finally, the incremental pose map optimization method based on similarity transformation is proposed to process the back end to optimize the pose and depth information of the camera. When the closed loop is detected, global optimization is carried out to effectively eliminate the cumulative error of the system. In this paper, indoor and outdoor environmental experiments are carried out using open data sets, such as TUM and KITTI, which fully proves the effectiveness of this method. Closed-loop detection experiments using hand-held cameras verify the importance of closed-loop detection. This method can effectively solve the scale drift problem of monocular vision SLAM and has strong robustness.
Collapse
|
36
|
Kopitkov D, Indelman V. General-purpose incremental covariance update and efficient belief space planning via a factor-graph propagation action tree. Int J Rob Res 2019. [DOI: 10.1177/0278364919875199] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Fast covariance calculation is required both for simultaneous localization and mapping (SLAM; e.g., in order to solve data association) and for evaluating the information-theoretic term for different candidate actions in belief space planning (BSP). In this article, we make two primary contributions. First, we develop a novel general-purpose incremental covariance update technique, which efficiently recovers specific covariance entries after any change in probabilistic inference, such as the introduction of new observations/variables or relinearization. Our approach is shown to recover them faster than other state-of-the-art methods. Second, we present a computationally efficient approach for BSP in high-dimensional state spaces, leveraging our incremental covariance update method. State-of-the-art BSP approaches perform belief propagation for each candidate action and then evaluate an objective function that typically includes an information-theoretic term, such as entropy or information gain. Yet, candidate actions often have similar parts (e.g., common trajectory parts), which are however evaluated separately for each candidate. Moreover, calculating the information-theoretic term involves a costly determinant computation of the entire information (covariance) matrix, which is [Formula: see text] with [Formula: see text] being dimension of the state or costly Schur complement operations if only marginal posterior covariance of certain variables is of interest. Our approach, rAMDL-Tree, extends our previous BSP method rAMDL, by exploiting incremental covariance calculation and performing calculation reuse between common parts of non-myopic candidate actions, such that these parts are evaluated only once, in contrast to existing approaches. To that end, we represent all candidate actions together in a single unified graphical model, which we introduce and call a factor-graph propagation (FGP) action tree. Each arrow (edge) of the FGP action tree represents a sub-action of one (or more) candidate action sequence(s) and in order to evaluate its information impact we require specific covariance entries of an intermediate belief represented by the tree’s vertex from which the edge is coming out (e.g., tail of the arrow). Overall, our approach has only a one-time calculation that depends on [Formula: see text], while evaluating action impact does not depend on [Formula: see text]. We perform a careful examination of our approaches in simulation, considering the problem of autonomous navigation in unknown environments, where rAMDL-Tree shows superior performance compared with rAMDL, while determining the same best actions.
Collapse
Affiliation(s)
- Dmitry Kopitkov
- Technion Autonomous Systems Program (TASP), Technion - Israel Institute of Technology, Haifa, Israel
| | - Vadim Indelman
- Department of Aerospace Engineering, Technion - Israel Institute of Technology, Haifa, Israel
| |
Collapse
|
37
|
A Decorrelated Distributed EKF-SLAM System for the Autonomous Navigation of Mobile Robots. J INTELL ROBOT SYST 2019. [DOI: 10.1007/s10846-019-01069-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
38
|
Aloise I, Corte BD, Nardi F, Grisetti G. Systematic Handling of Heterogeneous Geometric Primitives in Graph-SLAM Optimization. IEEE Robot Autom Lett 2019. [DOI: 10.1109/lra.2019.2918054] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
39
|
Moratuwage D, Adams M, Inostroza F. δ-Generalized Labeled Multi-Bernoulli Simultaneous Localization and Mapping with an Optimal Kernel-Based Particle Filtering Approach. SENSORS 2019; 19:s19102290. [PMID: 31108994 PMCID: PMC6567325 DOI: 10.3390/s19102290] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/16/2019] [Revised: 05/14/2019] [Accepted: 05/15/2019] [Indexed: 11/16/2022]
Abstract
Under realistic environmental conditions, heuristic-based data association and map management routines often result in divergent map and trajectory estimates in robotic Simultaneous Localization And Mapping (SLAM). To address these issues, SLAM solutions have been proposed based on the Random Finite Set (RFS) framework, which models the map and measurements such that the usual requirements of external data association routines and map management heuristics can be circumvented and realistic sensor detection uncertainty can be taken into account. Rao-Blackwellized particle filter (RBPF)-based RFS SLAM solutions have been demonstrated using the Probability Hypothesis Density (PHD) filter and subsequently the Labeled Multi-Bernoulli (LMB) filter. In multi-target tracking, the LMB filter, which was introduced as an efficient approximation to the computationally expensive δ -Generalized LMB ( δ -GLMB) filter, converts its representation of an LMB distribution to δ -GLMB form during the measurement update step. This not only results in a loss of information yielding inferior results (compared to the δ -GLMB filter) but also fails to take computational advantages in parallelized implementations possible with RBPF-based SLAM algorithms. Similar to state-of-the-art random vector-valued RBPF solutions such as FastSLAM and MH-FastSLAM, the performances of all RBPF-based SLAM algorithms based on the RFS framework also diverge from ground truth over time due to random sampling approaches, which only rely on control noise variance. Further, the methods lose particle diversity and diverge over time as a result of particle degeneracy. To alleviate this problem and further improve the quality of map estimates, a SLAM solution using an optimal kernel-based particle filter combined with an efficient variant of the δ -GLMB filter ( δ -GLMB-SLAM) is presented. The performance of the proposed δ -GLMB-SLAM algorithm, referred to as δ -GLMB-SLAM2.0, was demonstrated using simulated datasets and a section of the publicly available KITTI dataset. The results suggest that even with a limited number of particles, δ -GLMB-SLAM2.0 outperforms state-of-the-art RBPF-based RFS SLAM algorithms.
Collapse
Affiliation(s)
- Diluka Moratuwage
- Department of Electrical Engineering & Advanced Mining Technology Center Universidad de Chile, 837-0451 Santiago, Chile.
| | - Martin Adams
- Department of Electrical Engineering & Advanced Mining Technology Center Universidad de Chile, 837-0451 Santiago, Chile.
| | - Felipe Inostroza
- Department of Electrical Engineering Universidad de Chile, 837-0451 Santiago, Chile.
| |
Collapse
|
40
|
Agarwal S, Parunandi KS, Chakravorty S. Robust Pose-Graph SLAM Using Absolute Orientation Sensing. IEEE Robot Autom Lett 2019. [DOI: 10.1109/lra.2019.2893436] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
41
|
Lajoie PY, Hu S, Beltrame G, Carlone L. Modeling Perceptual Aliasing in SLAM via Discrete–Continuous Graphical Models. IEEE Robot Autom Lett 2019. [DOI: 10.1109/lra.2019.2894852] [Citation(s) in RCA: 34] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
42
|
Han L, Xu L, Bobkov D, Steinbach E, Fang L. Real-Time Global Registration for Globally Consistent RGB-D SLAM. IEEE T ROBOT 2019. [DOI: 10.1109/tro.2018.2882730] [Citation(s) in RCA: 23] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
43
|
Bai H, Taylor CN. Control-enabled Observability and Sensitivity Functions in Visual-Inertial Odometry. J INTELL ROBOT SYST 2019. [DOI: 10.1007/s10846-018-0808-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
44
|
Abstract
Estimation-over-graphs (EoG) is a class of estimation problems that admit a natural graphical representation. Several key problems in robotics and sensor networks, including sensor network localization, synchronization over a group, and simultaneous localization and mapping (SLAM) fall into this category. We pursue two main goals in this work. First, we aim to characterize the impact of the graphical structure of SLAM and related problems on estimation reliability. We draw connections between several notions of graph connectivity and various properties of the underlying estimation problem. In particular, we establish results on the impact of the weighted number of spanning trees on the D-optimality criterion in 2D SLAM. These results enable agents to evaluate estimation reliability based only on the graphical representation of the EoG problem. We then use our findings and study the problem of designing sparse SLAM problems that lead to reliable maximum likelihood estimates through the synthesis of sparse graphs with the maximum weighted tree connectivity. Characterizing graphs with the maximum number of spanning trees is an open problem in general. To tackle this problem, we establish several new theoretical results, including the monotone log-submodularity of the weighted number of spanning trees. We exploit these structures and design a complementary greedy–convex pair of efficient approximation algorithms with provable guarantees. The proposed synthesis framework is applied to various forms of the measurement selection problem in resource-constrained SLAM. Our algorithms and theoretical findings are validated using random graphs, existing and new synthetic SLAM benchmarks, and publicly available real pose-graph SLAM datasets.
Collapse
Affiliation(s)
- Kasra Khosoussi
- Laboratory for Information and Decision Systems (LIDS), Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Matthew Giamou
- Laboratory for Information and Decision Systems (LIDS), Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Gaurav S Sukhatme
- Department of Computer Science Viterbi School of Engineering, University of Southern California, Los Angeles, CA, USA
| | - Shoudong Huang
- Centre for Autonomous Systems (CAS), University of Technology Sydney, Sydney, Australia
| | - Gamini Dissanayake
- Centre for Autonomous Systems (CAS), University of Technology Sydney, Sydney, Australia
| | - Jonathan P How
- Laboratory for Information and Decision Systems (LIDS), Massachusetts Institute of Technology, Cambridge, MA, USA
| |
Collapse
|
45
|
Mukadam M, Dong J, Yan X, Dellaert F, Boots B. Continuous-time Gaussian process motion planning via probabilistic inference. Int J Rob Res 2018. [DOI: 10.1177/0278364918790369] [Citation(s) in RCA: 55] [Impact Index Per Article: 9.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
We introduce a novel formulation of motion planning, for continuous-time trajectories, as probabilistic inference. We first show how smooth continuous-time trajectories can be represented by a small number of states using sparse Gaussian process (GP) models. We next develop an efficient gradient-based optimization algorithm that exploits this sparsity and GP interpolation. We call this algorithm the Gaussian Process Motion Planner (GPMP). We then detail how motion planning problems can be formulated as probabilistic inference on a factor graph. This forms the basis for GPMP2, a very efficient algorithm that combines GP representations of trajectories with fast, structure-exploiting inference via numerical optimization. Finally, we extend GPMP2 to an incremental algorithm, iGPMP2, that can efficiently replan when conditions change. We benchmark our algorithms against several sampling-based and trajectory optimization-based motion planning algorithms on planning problems in multiple environments. Our evaluation reveals that GPMP2 is several times faster than previous algorithms while retaining robustness. We also benchmark iGPMP2 on replanning problems, and show that it can find successful solutions in a fraction of the time required by GPMP2 to replan from scratch.
Collapse
Affiliation(s)
- Mustafa Mukadam
- Institute for Robotics and Intelligent Machines, Georgia Institute of Technology, Atlanta, GA, USA
| | - Jing Dong
- Institute for Robotics and Intelligent Machines, Georgia Institute of Technology, Atlanta, GA, USA
| | - Xinyan Yan
- Institute for Robotics and Intelligent Machines, Georgia Institute of Technology, Atlanta, GA, USA
| | - Frank Dellaert
- Institute for Robotics and Intelligent Machines, Georgia Institute of Technology, Atlanta, GA, USA
| | - Byron Boots
- Institute for Robotics and Intelligent Machines, Georgia Institute of Technology, Atlanta, GA, USA
| |
Collapse
|
46
|
Wen W, Hsu LT, Zhang G. Performance Analysis of NDT-based Graph SLAM for Autonomous Vehicle in Diverse Typical Driving Scenarios of Hong Kong. SENSORS 2018; 18:s18113928. [PMID: 30441784 PMCID: PMC6263388 DOI: 10.3390/s18113928] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/26/2018] [Revised: 11/01/2018] [Accepted: 11/07/2018] [Indexed: 11/16/2022]
Abstract
Robust and lane-level positioning is essential for autonomous vehicles. As an irreplaceable sensor, Light detection and ranging (LiDAR) can provide continuous and high-frequency pose estimation by means of mapping, on condition that enough environment features are available. The error of mapping can accumulate over time. Therefore, LiDAR is usually integrated with other sensors. In diverse urban scenarios, the environment feature availability relies heavily on the traffic (moving and static objects) and the degree of urbanization. Common LiDAR-based simultaneous localization and mapping (SLAM) demonstrations tend to be studied in light traffic and less urbanized area. However, its performance can be severely challenged in deep urbanized cities, such as Hong Kong, Tokyo, and New York with dense traffic and tall buildings. This paper proposes to analyze the performance of standalone NDT-based graph SLAM and its reliability estimation in diverse urban scenarios to further evaluate the relationship between the performance of LiDAR-based SLAM and scenario conditions. The normal distribution transform (NDT) is employed to calculate the transformation between frames of point clouds. Then, the LiDAR odometry is performed based on the calculated continuous transformation. The state-of-the-art graph-based optimization is used to integrate the LiDAR odometry measurements to implement optimization. The 3D building models are generated and the definition of the degree of urbanization based on Skyplot is proposed. Experiments are implemented in different scenarios with different degrees of urbanization and traffic conditions. The results show that the performance of the LiDAR-based SLAM using NDT is strongly related to the traffic condition and degree of urbanization. The best performance is achieved in the sparse area with normal traffic and the worse performance is obtained in dense urban area with 3D positioning error (summation of horizontal and vertical) gradients of 0.024 m/s and 0.189 m/s, respectively. The analyzed results can be a comprehensive benchmark for evaluating the performance of standalone NDT-based graph SLAM in diverse scenarios which is significant for multi-sensor fusion of autonomous vehicle.
Collapse
Affiliation(s)
- Weisong Wen
- Department of Mechanical Engineering, The Hong Kong Polytechnic University, Hong Kong, China.
| | - Li-Ta Hsu
- Interdisciplinary Division of Aeronautical and Aviation Engineering, The Hong Kong Polytechnic University, Hong Kong, China.
| | - Guohao Zhang
- Interdisciplinary Division of Aeronautical and Aviation Engineering, The Hong Kong Polytechnic University, Hong Kong, China.
| |
Collapse
|
47
|
Rosen DM, Carlone L, Bandeira AS, Leonard JJ. SE-Sync: A certifiably correct algorithm for synchronization over the special Euclidean group. Int J Rob Res 2018. [DOI: 10.1177/0278364918784361] [Citation(s) in RCA: 87] [Impact Index Per Article: 14.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Many important geometric estimation problems naturally take the form of synchronization over the special Euclidean group: estimate the values of a set of unknown group elements [Formula: see text] given noisy measurements of a subset of their pairwise relative transforms [Formula: see text]. Examples of this class include the foundational problems of pose-graph simultaneous localization and mapping (SLAM) (in robotics), camera motion estimation (in computer vision), and sensor network localization (in distributed sensing), among others. This inference problem is typically formulated as a non-convex maximum-likelihood estimation that is computationally hard to solve in general. Nevertheless, in this paper we present an algorithm that is able to efficiently recover certifiably globally optimal solutions of the special Euclidean synchronization problem in a non-adversarial noise regime. The crux of our approach is the development of a semidefinite relaxation of the maximum-likelihood estimation (MLE) whose minimizer provides an exact maximum-likelihood estimate so long as the magnitude of the noise corrupting the available measurements falls below a certain critical threshold; furthermore, whenever exactness obtains, it is possible to verify this fact a posteriori, thereby certifying the optimality of the recovered estimate. We develop a specialized optimization scheme for solving large-scale instances of this semidefinite relaxation by exploiting its low-rank, geometric, and graph-theoretic structure to reduce it to an equivalent optimization problem defined on a low-dimensional Riemannian manifold, and then design a Riemannian truncated-Newton trust-region method to solve this reduction efficiently. Finally, we combine this fast optimization approach with a simple rounding procedure to produce our algorithm, SE-Sync. Experimental evaluation on a variety of simulated and real-world pose-graph SLAM datasets shows that SE-Sync is capable of recovering certifiably globally optimal solutions when the available measurements are corrupted by noise up to an order of magnitude greater than that typically encountered in robotics and computer vision applications, and does so significantly faster than the Gauss–Newton-based approach that forms the basis of current state-of-the-art techniques.
Collapse
Affiliation(s)
| | - Luca Carlone
- Laboratory for Information and Decision Systems, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Afonso S Bandeira
- Department of Mathematics and Center for Data Science, Courant Institute of Mathematical Sciences, New York University, New York, NY, USA
| | - John J Leonard
- Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA, USA
| |
Collapse
|
48
|
Zhang J, Singh S. Laser-visual-inertial odometry and mapping with high robustness and low drift. J FIELD ROBOT 2018. [DOI: 10.1002/rob.21809] [Citation(s) in RCA: 89] [Impact Index Per Article: 14.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Affiliation(s)
- Ji Zhang
- Kaarta, Inc.; Pittsburgh Pennsylvania
| | | |
Collapse
|
49
|
|
50
|
Lenac K, Ćesić J, Marković I, Petrović I. Exactly sparse delayed state filter on Lie groups for long-term pose graph SLAM. Int J Rob Res 2018. [DOI: 10.1177/0278364918767756] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
In this paper we propose a simultaneous localization and mapping (SLAM) back-end solution called the exactly sparse delayed state filter on Lie groups (LG-ESDSF). We derive LG-ESDSF and demonstrate that it retains all the good characteristics of the classic Euclidean ESDSF, the main advantage being the exact sparsity of the information matrix. The key advantage of LG-ESDSF in comparison with the classic ESDSF lies in the ability to respect the state space geometry by negotiating uncertainties and employing filtering equations directly on Lie groups. We also exploit the special structure of the information matrix in order to allow long-term operation while the robot is moving repeatedly through the same environment. To prove the effectiveness of the proposed SLAM solution, we conducted extensive experiments on two different publicly available datasets, namely the KITTI and EuRoC datasets, using two front-ends: one based on the stereo camera and the other on the 3D LIDAR. We compare LG-ESDSF with the general graph optimization framework ([Formula: see text]) when coupled with the same front-ends. Similarly to [Formula: see text] the proposed LG-ESDSF is front-end agnostic and the comparison demonstrates that our solution can match the accuracy of [Formula: see text], while maintaining faster computation times. Furthermore, the proposed back-end coupled with the stereo camera front-end forms a complete visual SLAM solution dubbed LG-SLAM. Finally, we evaluated LG-SLAM using the online KITTI protocol and at the time of writing it achieved the second best result among the stereo odometry solutions and the best result among the tested SLAM algorithms.
Collapse
Affiliation(s)
- Kruno Lenac
- University of Zagreb Faculty of Electrical Engineering and Computing, Croatia
| | - Josip Ćesić
- University of Zagreb Faculty of Electrical Engineering and Computing, Croatia
| | - Ivan Marković
- University of Zagreb Faculty of Electrical Engineering and Computing, Croatia
| | - Ivan Petrović
- University of Zagreb Faculty of Electrical Engineering and Computing, Croatia
| |
Collapse
|