1
|
Keipour A, Pereira GAS, Bonatti R, Garg R, Rastogi P, Dubey G, Scherer S. Visual Servoing Approach to Autonomous UAV Landing on a Moving Vehicle. SENSORS (BASEL, SWITZERLAND) 2022; 22:6549. [PMID: 36081008 PMCID: PMC9459808 DOI: 10.3390/s22176549] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/17/2022] [Revised: 08/24/2022] [Accepted: 08/25/2022] [Indexed: 06/15/2023]
Abstract
Many aerial robotic applications require the ability to land on moving platforms, such as delivery trucks and marine research boats. We present a method to autonomously land an Unmanned Aerial Vehicle on a moving vehicle. A visual servoing controller approaches the ground vehicle using velocity commands calculated directly in image space. The control laws generate velocity commands in all three dimensions, eliminating the need for a separate height controller. The method has shown the ability to approach and land on the moving deck in simulation, indoor and outdoor environments, and compared to the other available methods, it has provided the fastest landing approach. Unlike many existing methods for landing on fast-moving platforms, this method does not rely on additional external setups, such as RTK, motion capture system, ground station, offboard processing, or communication with the vehicle, and it requires only the minimal set of hardware and localization sensors. The videos and source codes are also provided.
Collapse
Affiliation(s)
| | - Guilherme A. S. Pereira
- Department of Mechanical and Aerospace Engineering, West Virginia University, Morgantown, WV 26506, USA
| | | | | | | | | | - Sebastian Scherer
- Robotics Institute, Carnegie Mellon University, Pittsburgh, PA 15213, USA
| |
Collapse
|
2
|
Li X, Zhang B, Zhang H, Xu R, Bai Y. Research on solving heading attitude of airdrop cargo platform based on line features. INT J ADV ROBOT SYST 2022. [DOI: 10.1177/17298806221081643] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
The present study envisages the development of an improved line features method to accurately estimate the attitude of the airdrop cargo platform during airdrop landing. Therefore, this article uses the geometric characteristics of the line features to improve the traditional line features extraction and removes the locally dense line features in the image, which greatly reduces the number of line features in the image. Then, the improved random sample consensus is used to remove the mismatching of line features, which improves the real-time performance of the algorithm and the accuracy of the attitude angle, and makes up for the problem of difficult extraction of point features or low matching accuracy in the airdrop environment. Finally, a constraint equation is established for the line features that are successfully matched, and using homography to obtain attitude of the airdrop cargo platform. This article also meets the requirements of accurate calculation attitude of airdrop cargo platform. The experiment shows the significance and feasibility of the airdrop cargo platform heading and attitude calculation technology based on the line feature, and it has a good application prospect.
Collapse
Affiliation(s)
- Xia Li
- Tianjin Key Laboratory for Advanced Mechatronic System Design and Intelligent Control, School of Mechanical Engineering, Tianjin University of Technology, Tianjin, China
- National Demonstration Center for Experimental Mechanical and Electrical Engineering Education, Tianjin University of Technology, Tianjin, China
| | - Bin Zhang
- Tianjin Key Laboratory for Advanced Mechatronic System Design and Intelligent Control, School of Mechanical Engineering, Tianjin University of Technology, Tianjin, China
- National Demonstration Center for Experimental Mechanical and Electrical Engineering Education, Tianjin University of Technology, Tianjin, China
| | - Hongying Zhang
- College of Aerospace Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Ronghua Xu
- Aviation Industry Aerospace Lifesaving Equipment Limited Liability Company, Hubei, China
| | - Yalei Bai
- College of Aerospace Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| |
Collapse
|
3
|
Synthesized Landing Strategy for Quadcopter to Land Precisely on a Vertically Moving Apron. MATHEMATICS 2022. [DOI: 10.3390/math10081328] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
Quadcopter unmanned aerial vehicles have become increasingly popular for various real-world applications, and a significant body of literature exists regarding the improvement of their flight capabilities to render them fully autonomous. The precise landing onto moving platforms, such as ship decks, is one of the remaining challenges that is largely unresolved. The reason why this operation poses a considerable challenge is because landing performance is considerably degraded by the ground effect or external disturbances. In this paper, we propose a synthesized landing algorithm that allows a quadcopter to land precisely on a vertically moving pad. Firstly, we introduce a disturbance observer-based altitude controller that allows the vehicle to perform robust altitude flight in the presence of external disturbances and the ground effect, strictly proving the system’s stability using Lyapunov’s theory. Secondly, we derive an apron state estimator to provide information on the landing target’s relative position. Additionally, we propose a landing planner to ensure that the landing task is completed in a safe and reliable manner. Finally, the proposed algorithms are implemented in an actual quadcopter, and we demonstrate the effectiveness and applicability of our method through real flight experiments.
Collapse
|
4
|
Autonomous Landing of a Quadrotor on a Moving Platform via Model Predictive Control. AEROSPACE 2022. [DOI: 10.3390/aerospace9010034] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
Landing on a moving platform is an essential requirement to achieve high-performance autonomous flight with various vehicles, including quadrotors. We propose an efficient and reliable autonomous landing system, based on model predictive control, which can accurately land in the presence of external disturbances. To detect and track the landing marker, a fast two-stage algorithm is introduced in the gimbaled camera, while a model predictive controller with variable sampling time is used to predict and calculate the entire landing trajectory based on the estimated platform information. As the quadrotor approaches the target platform, the sampling time is gradually shortened to feed a re-planning process that perfects the landing trajectory continuously and rapidly, improving the overall accuracy and computing efficiency. At the same time, a cascade incremental nonlinear dynamic inversion control method is adopted to track the planned trajectory and improve robustness against external disturbances. We carried out both simulations and outdoor flight experiments to demonstrate the effectiveness of the proposed landing system. The results show that the quadrotor can land rapidly and accurately even under external disturbance and that the terminal position, speed and attitude satisfy the requirements of a smooth landing mission.
Collapse
|
5
|
Zhang HT, Hu BB, Xu Z, Cai Z, Liu B, Wang X, Geng T, Zhong S, Zhao J. Visual Navigation and Landing Control of an Unmanned Aerial Vehicle on a Moving Autonomous Surface Vehicle via Adaptive Learning. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2021; 32:5345-5355. [PMID: 34048350 DOI: 10.1109/tnnls.2021.3080980] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
This article presents a visual navigation and landing control paradigm for an unmanned aerial vehicle (UAV) to land on a moving autonomous surface vehicle (ASV). Therein, an adaptive learning navigation rule with a multilayer nested guidance is designed to pinpoint the position of the ASV and to guide and control the UAV to fulfill horizontal tracking and vertical descending in a narrow landing region of the ASV by means of merely relative position feedback. To ensure the feasibility of the proposed control law, asymptotical stability conditions are derived based on Lyapunov stability theory. Landing experimental results are reported for a UAV-ASV system consisting of an M-100 UAV and a self-developed three-meters-long HUSTER-30 ASV on a lake to substantiate the efficacy of the proposed landing control method.
Collapse
|
6
|
Real-Time Monocular Vision System for UAV Autonomous Landing in Outdoor Low-Illumination Environments. SENSORS 2021; 21:s21186226. [PMID: 34577433 PMCID: PMC8471562 DOI: 10.3390/s21186226] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/18/2021] [Revised: 09/09/2021] [Accepted: 09/14/2021] [Indexed: 12/05/2022]
Abstract
Landing an unmanned aerial vehicle (UAV) autonomously and safely is a challenging task. Although the existing approaches have resolved the problem of precise landing by identifying a specific landing marker using the UAV’s onboard vision system, the vast majority of these works are conducted in either daytime or well-illuminated laboratory environments. In contrast, very few researchers have investigated the possibility of landing in low-illumination conditions by employing various active light sources to lighten the markers. In this paper, a novel vision system design is proposed to tackle UAV landing in outdoor extreme low-illumination environments without the need to apply an active light source to the marker. We use a model-based enhancement scheme to improve the quality and brightness of the onboard captured images, then present a hierarchical-based method consisting of a decision tree with an associated light-weight convolutional neural network (CNN) for coarse-to-fine landing marker localization, where the key information of the marker is extracted and reserved for post-processing, such as pose estimation and landing control. Extensive evaluations have been conducted to demonstrate the robustness, accuracy, and real-time performance of the proposed vision system. Field experiments across a variety of outdoor nighttime scenarios with an average luminance of 5 lx at the marker locations have proven the feasibility and practicability of the system.
Collapse
|
7
|
Zhao M, Anzai T, Shi F, Maki T, Nishio T, Ito K, Kuromiya N, Okada K, Inaba M. Versatile multilinked aerial robot with tilted propellers: Design, modeling, control, and state estimation for autonomous flight and manipulation. J FIELD ROBOT 2021. [DOI: 10.1002/rob.22019] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Affiliation(s)
- Moju Zhao
- Department of Mechano‐Infomatics The University of Tokyo Tokyo Japan
| | - Tomoki Anzai
- Department of Mechano‐Infomatics The University of Tokyo Tokyo Japan
| | - Fan Shi
- Department of Mechano‐Infomatics The University of Tokyo Tokyo Japan
| | - Toshiya Maki
- Department of Mechano‐Infomatics The University of Tokyo Tokyo Japan
| | - Takuzumi Nishio
- Department of Mechano‐Infomatics The University of Tokyo Tokyo Japan
| | - Keita Ito
- Department of Mechano‐Infomatics The University of Tokyo Tokyo Japan
| | - Naoki Kuromiya
- Department of Mechano‐Infomatics The University of Tokyo Tokyo Japan
| | - Kei Okada
- Department of Mechano‐Infomatics The University of Tokyo Tokyo Japan
| | - Masayuki Inaba
- Department of Mechano‐Infomatics The University of Tokyo Tokyo Japan
| |
Collapse
|
8
|
Muskardin T, Coelho A, Noce ERD, Ollero A, Kondak K. Energy-Based Cooperative Control for Landing Fixed-Wing UAVs on Mobile Platforms Under Communication Delays. IEEE Robot Autom Lett 2020. [DOI: 10.1109/lra.2020.3005374] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|