51
|
Wang Y, Liu Z, Kandhari A, Daltorio KA. Obstacle Avoidance Path Planning for Worm-like Robot Using Bézier Curve. Biomimetics (Basel) 2021; 6:biomimetics6040057. [PMID: 34698058 PMCID: PMC8544220 DOI: 10.3390/biomimetics6040057] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2021] [Revised: 09/17/2021] [Accepted: 09/22/2021] [Indexed: 12/22/2022] Open
Abstract
Worm-like robots have demonstrated great potential in navigating through environments requiring body shape deformation. Some examples include navigating within a network of pipes, crawling through rubble for search and rescue operations, and medical applications such as endoscopy and colonoscopy. In this work, we developed path planning optimization techniques and obstacle avoidance algorithms for the peristaltic method of locomotion of worm-like robots. Based on our previous path generation study using a modified rapidly exploring random tree (RRT), we have further introduced the Bézier curve to allow more path optimization flexibility. Using Bézier curves, the path planner can explore more areas and gain more flexibility to make the path smoother. We have calculated the obstacle avoidance limitations during turning tests for a six-segment robot with the developed path planning algorithm. Based on the results of our robot simulation, we determined a safe turning clearance distance with a six-body diameter between the robot and the obstacles. When the clearance is less than this value, additional methods such as backward locomotion may need to be applied for paths with high obstacle offset. Furthermore, for a worm-like robot, the paths of subsequent segments will be slightly different than the path of the head segment. Here, we show that as the number of segments increases, the differences between the head path and tail path increase, necessitating greater lateral clearance margins.
Collapse
|
52
|
Elmokadem T, Savkin AV. Towards Fully Autonomous UAVs: A Survey. SENSORS 2021; 21:s21186223. [PMID: 34577430 PMCID: PMC8473245 DOI: 10.3390/s21186223] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/09/2021] [Revised: 09/09/2021] [Accepted: 09/09/2021] [Indexed: 11/17/2022]
Abstract
Unmanned Aerial Vehicles have undergone rapid developments in recent decades. This has made them very popular for various military and civilian applications allowing us to reach places that were previously hard to reach in addition to saving time and lives. A highly desirable direction when developing unmanned aerial vehicles is towards achieving fully autonomous missions and performing their dedicated tasks with minimum human interaction. Thus, this paper provides a survey of some of the recent developments in the field of unmanned aerial vehicles related to safe autonomous navigation, which is a very critical component in the whole system. A great part of this paper focus on advanced methods capable of producing three-dimensional avoidance maneuvers and safe trajectories. Research challenges related to unmanned aerial vehicle development are also highlighted.
Collapse
|
53
|
Mullick AA, Baniña MC, Tomita Y, Fung J, Levin MF. Obstacle Avoidance and Dual-Tasking During Reaching While Standing in Patients With Mild Chronic Stroke. Neurorehabil Neural Repair 2021; 35:915-928. [PMID: 34455852 DOI: 10.1177/15459683211023190] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Background. Poststroke individuals use their paretic arms less often than expected in daily life situations, even when motor recovery is scored highly in clinical tests. Real-world environments are often unpredictable and require the ability to multitask and make decisions about rapid and accurate arm movement adjustments. Objective. To identify whether and to what extent cognitive-motor deficits in well-recovered individuals with stroke affect the ability to rapidly adapt reaching movements in changing cognitive and environmental conditions. Methods. Thirteen individuals with mild stroke and 11 healthy controls performed an obstacle avoidance task in a virtual environment while standing. Subjects reached for a virtual juice bottle with their hemiparetic arm as quickly as possible under single- and dual-task conditions. In the single-task condition, a sliding glass door partially obstructed the reaching path of the paretic arm. A successful trial was counted when the subject touched the bottle without the hand colliding with the door. In the dual-task condition, subjects repeated the same task while performing an auditory-verbal working memory task. Results. Individuals with stroke had significantly lower success rates than controls in avoiding the moving door in single-task (stroke: 51.8 ± 21.2%, control: 70.6 ± 12.7%; P = .018) and dual-task conditions (stroke: 40.0 ± 27.6%, control: 65.3 ± 20.0%; P = .015). Endpoint speed was lower in stroke subjects for successful trials in both conditions. Obstacle avoidance deficits were exacerbated by increased cognitive demands in both groups. Individuals reporting greater confidence using their hemiparetic arm had higher success rates. Conclusion. Clinically well-recovered individuals with stroke may have persistent deficits performing a complex reaching task.
Collapse
|
54
|
Wang Y, Li X, Zhang J, Li S, Xu Z, Zhou X. Review of wheeled mobile robot collision avoidance under unknown environment. Sci Prog 2021; 104:368504211037771. [PMID: 34379021 PMCID: PMC10450763 DOI: 10.1177/00368504211037771] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Recently, the working scenes of the robot have been emerging as diversity and complexity with gradually mature of robotic control technology. The challenge of robot adaptability emerges, especially in complicated and unknown environments. Among the numerous researches on improving the adaptability of robots, aiming at avoiding collision between robot and external environment, obstacle avoidance has drawn much attention. Compared to the global circumvention requiring the environmental information that is known, the local obstacle avoidance is a promising method due to the environment is possibly dynamic and unknown. This study is aimed at making a review of research progress about local obstacle avoidance methods for wheeled mobile robots (WMRs) under complex unknown environment in the last 20 years. Sensor-based obstacle perception and identification is first introduced. Then, obstacle avoidance methods related to WMRs' motion control are reviewed, mainly including artificial potential field (APF)-based, population-involved meta heuristic-based, artificial neural network (ANN)-based, fuzzy logic (FL)-based and quadratic optimization-based, etc. Next, the relevant research on Unmanned Ground Vehicles (UGVs) is surveyed. Finally, conclusion and prospection are given. Appropriate obstacle avoidance methods should be chosen based on the specific requirements or criterion. For the moment, effective fusion of multiple obstacle avoidance methods is becoming a promising method.
Collapse
|
55
|
Del Bianco M, Kepinski S. How plants get round problems: new insights into the root obstacle avoidance response. THE NEW PHYTOLOGIST 2021; 231:8-10. [PMID: 34060664 DOI: 10.1111/nph.17419] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
|
56
|
Xiong L, Fu Z, Zeng D, Leng B. An Optimized Trajectory Planner and Motion Controller Framework for Autonomous Driving in Unstructured Environments. SENSORS 2021; 21:s21134409. [PMID: 34199118 PMCID: PMC8271740 DOI: 10.3390/s21134409] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/14/2021] [Revised: 06/16/2021] [Accepted: 06/25/2021] [Indexed: 12/01/2022]
Abstract
This paper proposes an optimized trajectory planner and motion planner framework, which aim to deal with obstacle avoidance along a reference road for autonomous driving in unstructured environments. The trajectory planning problem is decomposed into lateral and longitudinal planning sub-tasks along the reference road. First, a vehicle kinematic model with road coordinates is established to describe the lateral movement of the vehicle. Then, nonlinear optimization based on a vehicle kinematic model in the space domain is employed to smooth the reference road. Second, a multilayered search algorithm is applied in the lateral-space domain to deal with obstacles and find a suitable path boundary. Then, the optimized path planner calculates the optimal path by considering the distance to the reference road and the curvature constraints. Furthermore, the optimized speed planner takes into account the speed boundary in the space domain and the constraints on vehicle acceleration. The optimal speed profile is obtained by using a numerical optimization method. Furthermore, a motion controller based on a kinematic error model is proposed to follow the desired trajectory. Finally, the experimental results show the effectiveness of the proposed trajectory planner and motion controller framework in handling typical scenarios and avoiding obstacles safely and smoothly on the reference road and in unstructured environments.
Collapse
|
57
|
Exploring a Novel Multiple-Query Resistive Grid-Based Planning Method Applied to High-DOF Robotic Manipulators. SENSORS 2021; 21:s21093274. [PMID: 34068486 PMCID: PMC8126022 DOI: 10.3390/s21093274] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/21/2021] [Revised: 04/29/2021] [Accepted: 04/30/2021] [Indexed: 11/17/2022]
Abstract
The applicability of the path planning strategy to robotic manipulators has been an exciting topic for researchers in the last few decades due to the large demand in the industrial sector and its enormous potential development for space, surgical, and pharmaceutical applications. The automation of high-degree-of-freedom (DOF) manipulator robots is a challenging task due to the high redundancy in the end-effector position. Additionally, in the presence of obstacles in the workspace, the task becomes even more complicated. Therefore, for decades, the most common method of integrating a manipulator in an industrial automated process has been the demonstration technique through human operator intervention. Although it is a simple strategy, some drawbacks must be considered: first, the path’s success, length, and execution time depend on operator experience; second, for a structured environment with few objects, the planning task is easy. However, for most typical industrial applications, the environments contain many obstacles, which poses challenges for planning a collision-free trajectory. In this paper, a multiple-query method capable of obtaining collision-free paths for high DOF manipulators with multiple surrounding obstacles is presented. The proposed method is inspired by the resistive grid-based planner method (RGBPM). Furthermore, several improvements are implemented to solve complex planning problems that cannot be handled by the original formulation. The most important features of the proposed planner are as follows: (1) the easy implementation of robotic manipulators with multiple degrees of freedom, (2) the ability to handle dozens of obstacles in the environment, (3) compatibility with various obstacle representations using mathematical models, (4) a new recycling of a previous simulation strategy to convert the RGBPM into a multiple-query planner, and (5) the capacity to handle large sparse matrices representing the configuration space. A numerical simulation was carried out to validate the proposed planning method’s effectiveness for manipulators with three, five, and six DOFs on environments with dozens of surrounding obstacles. The case study results show the applicability of the proposed novel strategy in quickly computing new collision-free paths using the first execution data. Each new query requires less than 0.2 s for a 3 DOF manipulator in a configuration space free-modeled by a 7291 × 7291 sparse matrix and less than 30 s for five and six DOF manipulators in a configuration space free-modeled by 313,958 × 313,958 and 204,087 × 204,087 sparse matrices, respectively. Finally, a simulation was conducted to validate the proposed multiple-query RGBPM planner’s efficacy in finding feasible paths without collision using a six-DOF manipulator (KUKA LBR iiwa 14R820) in a complex environment with dozens of surrounding obstacles.
Collapse
|
58
|
El-taher FEZ, Taha A, Courtney J, Mckeever S. A Systematic Review of Urban Navigation Systems for Visually Impaired People. SENSORS (BASEL, SWITZERLAND) 2021; 21:3103. [PMID: 33946857 PMCID: PMC8125253 DOI: 10.3390/s21093103] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/31/2021] [Revised: 04/22/2021] [Accepted: 04/25/2021] [Indexed: 11/16/2022]
Abstract
Blind and Visually impaired people (BVIP) face a range of practical difficulties when undertaking outdoor journeys as pedestrians. Over the past decade, a variety of assistive devices have been researched and developed to help BVIP navigate more safely and independently. In addition, research in overlapping domains are addressing the problem of automatic environment interpretation using computer vision and machine learning, particularly deep learning, approaches. Our aim in this article is to present a comprehensive review of research directly in, or relevant to, assistive outdoor navigation for BVIP. We breakdown the navigation area into a series of navigation phases and tasks. We then use this structure for our systematic review of research, analysing articles, methods, datasets and current limitations by task. We also provide an overview of commercial and non-commercial navigation applications targeted at BVIP. Our review contributes to the body of knowledge by providing a comprehensive, structured analysis of work in the domain, including the state of the art, and guidance on future directions. It will support both researchers and other stakeholders in the domain to establish an informed view of research progress.
Collapse
|
59
|
Adaptive Simplex Architecture for Safe, Real-Time Robot Path Planning. SENSORS 2021; 21:s21082589. [PMID: 33917089 PMCID: PMC8067738 DOI: 10.3390/s21082589] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/27/2021] [Revised: 03/22/2021] [Accepted: 03/29/2021] [Indexed: 11/17/2022]
Abstract
The paper addresses the problem of using machine learning in practical robot applications, like dynamic path planning with obstacle avoidance, so as to achieve the performance level of machine learning model scorers in terms of speed and reliability, and the safety and accuracy level of possibly slower, exact algorithmic solutions to the same problems. To this end, the existing simplex architecture for safety assurance in critical systems is extended by an adaptation mechanism, in which one of the redundant controllers (called a high-performance controller) is represented by a trained machine learning model. This model is retrained using field data to reduce its failure rate and redeployed continuously. The proposed adaptive simplex architecture (ASA) is evaluated on the basis of a robot path planning application with dynamic obstacle avoidance in the context of two human-robot collaboration scenarios in manufacturing. The evaluation results indicate that ASA enables a response by the robot in real time when it encounters an obstacle. The solution predicted by the model is economic in terms of path length and smoother than analogous algorithmic solutions. ASA ensures safety by providing an acceptance test, which checks whether the predicted path crosses the obstacle; in which case a suboptimal, yet safe, solution is used.
Collapse
|
60
|
Tokunaga S, Premachandra C, Premachandra HWH, Kawanaka H, Sumathipala S, Sudantha BS. Autonomous Spiral Motion by a Small-Type Robot on an Obstacle-Available Surface. MICROMACHINES 2021; 12:mi12040375. [PMID: 33915731 PMCID: PMC8066120 DOI: 10.3390/mi12040375] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/02/2021] [Revised: 03/22/2021] [Accepted: 03/26/2021] [Indexed: 11/23/2022]
Abstract
Several robot-related studies have been conducted in recent years; however, studies on the autonomous travel of small mobile robots in small spaces are lacking. In this study, we investigate the development of autonomous travel for small robots that need to travel and cover the entire smooth surface, such as those employed for cleaning tables or solar panels. We consider an obstacle-available surface and target this travel on it by proposing a spiral motion method. To achieve the spiral motion, we focus on developing autonomous avoidance of obstacles, return to original path, and fall prevention when robots traverse a surface. The development of regular travel by a robot without an encoder is an important feature of this study. The traveled distance was measured using the traveling time. We achieved spiral motion by analyzing the data from multiple small sensors installed on the robot by introducing a new attitude-control method, and we ensured that the robot returned to the original spiral path autonomously after avoiding obstacles and without falling over the edge of the surface.
Collapse
|
61
|
Song H, Li A, Wang T, Wang M. Multimodal Deep Reinforcement Learning with Auxiliary Task for Obstacle Avoidance of Indoor Mobile Robot. SENSORS (BASEL, SWITZERLAND) 2021; 21:1363. [PMID: 33671913 PMCID: PMC7918974 DOI: 10.3390/s21041363] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/12/2021] [Revised: 02/08/2021] [Accepted: 02/09/2021] [Indexed: 11/16/2022]
Abstract
It is an essential capability of indoor mobile robots to avoid various kinds of obstacles. Recently, multimodal deep reinforcement learning (DRL) methods have demonstrated great capability for learning control policies in robotics by using different sensors. However, due to the complexity of indoor environment and the heterogeneity of different sensor modalities, it remains an open challenge to obtain reliable and robust multimodal information for obstacle avoidance. In this work, we propose a novel multimodal DRL method with auxiliary task (MDRLAT) for obstacle avoidance of indoor mobile robot. In MDRLAT, a powerful bilinear fusion module is proposed to fully capture the complementary information from two-dimensional (2D) laser range findings and depth images, and the generated multimodal representation is subsequently fed into dueling double deep Q-network to output control commands for mobile robot. In addition, an auxiliary task of velocity estimation is introduced to further improve representation learning in DRL. Experimental results show that MDRLAT achieves remarkable performance in terms of average accumulated reward, convergence speed, and success rate. Moreover, experiments in both virtual and real-world testing environments further demonstrate the outstanding generalization capability of our method.
Collapse
|
62
|
Chang HC, Hsu YL, Hung SS, Ou GR, Wu JR, Hsu C. Autonomous Water Quality Monitoring and Water Surface Cleaning for Unmanned Surface Vehicle. SENSORS 2021; 21:s21041102. [PMID: 33562712 PMCID: PMC7914901 DOI: 10.3390/s21041102] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/21/2020] [Revised: 01/22/2021] [Accepted: 01/26/2021] [Indexed: 11/23/2022]
Abstract
Water is one of the most precious resources. However, industrial development has made water pollution a critical problem today and thus water quality monitoring and surface cleaning are essential for water resource protection. In this study, we have used the sensor fusion technology as a basis to develop a multi-function unmanned surface vehicle (MF-USV) for obstacle avoidance, water-quality monitoring, and water surface cleaning. The MF-USV comprises a USV control unit, a locomotion module, a positioning module, an obstacle avoidance module, a water quality monitoring system, a water surface cleaning system, a communication module, a power module, and a remote human–machine interface. We equip the MF-USV with the following functions: (1) autonomous obstacle detection, avoidance, and navigation positioning, (2) water quality monitoring, sampling, and positioning, (3) water surface detection and cleaning, and (4) remote navigation control and real-time information display. The experimental results verified that when the floating garbage located in the visual angle ranged from −30° to 30° on the front of the MF-USV and the distances between the floating garbage and the MF-USV were 40 and 70 cm, the success rates of floating garbage detection are all 100%. When the distance between the floating garbage and the MF-USV was 130 cm and the floating garbage was located on the left side (15°~30°), left front side (0°~15°), front side (0°), right front side (0°~15°), and the right side (15°~30°), the success rates of the floating garbage collection were 70%, 92%, 95%, 95%, and 75%, respectively. Finally, the experimental results also verified that the applications of the MF-USV and relevant algorithms to obstacle avoidance, water quality monitoring, and water surface cleaning were effective.
Collapse
|
63
|
Laser-Based People Detection and Obstacle Avoidance for a Hospital Transport Robot. SENSORS 2021; 21:s21030961. [PMID: 33535488 PMCID: PMC7867058 DOI: 10.3390/s21030961] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/28/2020] [Revised: 01/21/2021] [Accepted: 01/25/2021] [Indexed: 11/17/2022]
Abstract
This paper describes the development of a laser-based people detection and obstacle avoidance algorithm for a differential-drive robot, which is used for transporting materials along a reference path in hospital domains. Detecting humans from laser data is an important functionality for the safety of navigation in the shared workspace with people. Nevertheless, traditional methods normally utilize machine learning techniques on hand-crafted geometrical features extracted from individual clusters. Moreover, the datasets used to train the models are usually small and need to manually label every laser scan, increasing the difficulty and cost of deploying people detection algorithms in new environments. To tackle these problems, (1) we propose a novel deep learning-based method, which uses the deep neural network in a sliding window fashion to effectively classify every single point of a laser scan. (2) To increase the speed of inference without losing performance, we use a jump distance clustering method to decrease the number of points needed to be evaluated. (3) To reduce the workload of labeling data, we also propose an approach to automatically annotate datasets collected in real scenarios. In general, the proposed approach runs in real-time and performs much better than traditional methods. Secondly, conventional pure reactive obstacle avoidance algorithms can produce inefficient and oscillatory behaviors in dynamic environments, making pedestrians confused and possibly leading to dangerous reactions. To improve the legibility and naturalness of obstacle avoidance in human crowded environments, we introduce a sampling-based local path planner, similar to the method used in autonomous driving cars. The key idea is to avoid obstacles by switching lanes. We also adopt a simple rule to decrease the number of unnecessary deviations from the reference path. Experiments carried out in real-world environments confirmed the effectiveness of the proposed algorithms.
Collapse
|
64
|
Xie Y, Zhou R, Yang Y. Improved Distorted Configuration Space Path Planning and its Application to Robot Manipulators. SENSORS 2020; 20:s20216060. [PMID: 33114444 PMCID: PMC7684471 DOI: 10.3390/s20216060] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/23/2020] [Revised: 10/17/2020] [Accepted: 10/21/2020] [Indexed: 12/02/2022]
Abstract
Real-time obstacle avoidance path planning is critically important for a robot when it operates in a crowded or cluttered workspace. At the same time, the computational cost is a big concern once the degree of freedom (DOF) of a robot is high. A novel path planning strategy, the distorted configuration space (DC-space) method, was proposed and proven to outperform the traditional search-based methods in terms of computational efficiency. However, the original DC-space method did not sufficiently consider the demands on automatic planning, convex space preservation, and path optimization, which makes it not practical when applied to the path planning for robot manipulators. The treatments for the problems mentioned above are proposed in this paper, and their applicability is examined on a three DOFs robot. The experiments demonstrate the effectiveness of the proposed improved distorted configuration space (IDCS) method on rapidly finding an obstacle-free path. Besides, the optimized IDCS method is presented to shorten the generated path. The performance of the above algorithms is compared with the classic Rapidly-exploring Random Tree (RRT) searching method in terms of their computation time and path length.
Collapse
|
65
|
Design of a Small Unmanned Aircraft System for Bridge Inspections. SENSORS 2020; 20:s20185358. [PMID: 32962108 PMCID: PMC7570898 DOI: 10.3390/s20185358] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/16/2020] [Revised: 09/07/2020] [Accepted: 09/09/2020] [Indexed: 11/16/2022]
Abstract
Bridge inspections are an important procedure for maintaining the infrastructure vital to our economy and well-being. The current methodology of utilizing specialized equipment such as snooper trucks and scaffolding to support manned-inspections poses a significant financial cost, disrupts traffic, and is dangerous to the inspectors and public. The advent of unmanned aerial systems (UAS), more commonly called drones, presents a practical solution that promises reduced cost, enhanced safety, and is significantly less intrusive than previous methodologies. Current limitations in the implementation of UAS include the reliance on a skilled operator and/or the requirement for a UAS to operate in a cluttered, GPS-denied environment. A solution to these challenges is presented in this paper by utilizing commercial off-the-shelf (COTS) hardware including laser rangefinders, optical flow sensors, and live video telemetry. Included in the system is the obstacle avoidance equipped drone and a ground station intended to be manned by a pilot and bridge inspector. The proposed custom-fabricated UAS was implemented during eight inspections of Florida Department of Transportation (FDOT) bridges. The UAS was able to navigate under GPS-denied and obstacle-laden bridge decks with position-hold performance comparable to, if not better than, a COTS unit in an unobstructed environment. The position hold capability maintained an altitude of ±12.8 cm with a horizontal hold of ±435 cm. Details of the hardware, algorithm development, and suggestions for future research are discussed in this paper.
Collapse
|
66
|
Sun Q, Guo Y, Fu R, Wang C, Yuan W. Human-Like Obstacle Avoidance Trajectory Planning and Tracking Model for Autonomous Vehicles That Considers the River's Operation Characteristics. SENSORS 2020; 20:s20174821. [PMID: 32858979 PMCID: PMC7547385 DOI: 10.3390/s20174821] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/22/2020] [Revised: 08/15/2020] [Accepted: 08/25/2020] [Indexed: 11/16/2022]
Abstract
Developing a human-like autonomous driving system has gained increasing amounts of attention from both technology companies and academic institutions, as it can improve the interpretability and acceptance of the autonomous system. Planning a safe and human-like obstacle avoidance trajectory is one of the critical issues for the development of autonomous vehicles (AVs). However, when designing automatic obstacle avoidance systems, few studies have focused on the obstacle avoidance characteristics of human drivers. This paper aims to develop an obstacle avoidance trajectory planning and trajectory tracking model for AVs that is consistent with the characteristics of human drivers' obstacle avoidance trajectory. Therefore, a modified artificial potential field (APF) model was established by adding a road boundary repulsive potential field and ameliorating the obstacle repulsive potential field based on the traditional APF model. The model predictive control (MPC) algorithm was combined with the APF model to make the planning model satisfy the kinematic constraints of the vehicle. In addition, a human driver's obstacle avoidance experiment was implemented based on a six-degree-of-freedom driving simulator equipped with multiple sensors to obtain the drivers' operation characteristics and provide a basis for parameter confirmation of the planning model. Then, a linear time-varying MPC algorithm was employed to construct the trajectory tracking model. Finally, a co-simulation model based on CarSim/Simulink was established for off-line simulation testing, and the results indicated that the proposed trajectory planning controller and the trajectory tracking controller were more human-like under the premise of ensuring the safety and comfort of the obstacle avoidance operation, providing a foundation for the development of AVs.
Collapse
|
67
|
Zhao W, Chu H, Miao X, Guo L, Shen H, Zhu C, Zhang F, Liang D. Research on the Multiagent Joint Proximal Policy Optimization Algorithm Controlling Cooperative Fixed-Wing UAV Obstacle Avoidance. SENSORS (BASEL, SWITZERLAND) 2020; 20:E4546. [PMID: 32823783 PMCID: PMC7471982 DOI: 10.3390/s20164546] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/10/2020] [Revised: 08/07/2020] [Accepted: 08/10/2020] [Indexed: 11/26/2022]
Abstract
Multiple unmanned aerial vehicle (UAV) collaboration has great potential. To increase the intelligence and environmental adaptability of multi-UAV control, we study the application of deep reinforcement learning algorithms in the field of multi-UAV cooperative control. Aiming at the problem of a non-stationary environment caused by the change of learning agent strategy in reinforcement learning in a multi-agent environment, the paper presents an improved multiagent reinforcement learning algorithm-the multiagent joint proximal policy optimization (MAJPPO) algorithm with the centralized learning and decentralized execution. This algorithm uses the moving window averaging method to make each agent obtain a centralized state value function, so that the agents can achieve better collaboration. The improved algorithm enhances the collaboration and increases the sum of reward values obtained by the multiagent system. To evaluate the performance of the algorithm, we use the MAJPPO algorithm to complete the task of multi-UAV formation and the crossing of multiple-obstacle environments. To simplify the control complexity of the UAV, we use the six-degree of freedom and 12-state equations of the dynamics model of the UAV with an attitude control loop. The experimental results show that the MAJPPO algorithm has better performance and better environmental adaptability.
Collapse
|
68
|
Bassolillo SR, D’Amato E, Notaro I, Blasi L, Mattei M. Decentralized Mesh-Based Model Predictive Control for Swarms of UAVs. SENSORS (BASEL, SWITZERLAND) 2020; 20:E4324. [PMID: 32756360 PMCID: PMC7436082 DOI: 10.3390/s20154324] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/29/2020] [Revised: 07/26/2020] [Accepted: 07/28/2020] [Indexed: 11/16/2022]
Abstract
This paper deals with the design of a decentralized guidance and control strategy for a swarm of unmanned aerial vehicles (UAVs), with the objective of maintaining a given connection topology with assigned mutual distances while flying to a target area. In the absence of obstacles, the assigned topology, based on an extended Delaunay triangulation concept, implements regular and connected formation shapes. In the presence of obstacles, this technique is combined with a model predictive control (MPC) that allows forming independent sub-swarms optimizing the formation spreading to avoid obstacles and collisions between neighboring vehicles. A custom numerical simulator was developed in a Matlab/Simulink environment to prove the effectiveness of the proposed guidance and control scheme in several 2D operational scenarios with obstacles of different sizes and increasing number of aircraft.
Collapse
|
69
|
Ali H, Gong D, Wang M, Dai X. Path Planning of Mobile Robot With Improved Ant Colony Algorithm and MDP to Produce Smooth Trajectory in Grid-Based Environment. Front Neurorobot 2020; 14:44. [PMID: 32733227 PMCID: PMC7363842 DOI: 10.3389/fnbot.2020.00044] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2019] [Accepted: 05/27/2020] [Indexed: 11/17/2022] Open
Abstract
This approach has been derived mainly to improve quality and efficiency of global path planning for a mobile robot with unknown static obstacle avoidance features in grid-based environment. The quality of the global path in terms of smoothness, path consistency and safety can affect the autonomous behavior of a robot. In this paper, the efficiency of Ant Colony Optimization (ACO) algorithm has improved with additional assistance of A* Multi-Directional algorithm. In the first part, A* Multi-directional algorithm starts to search in map and stores the best nodes area between start and destination with optimal heuristic value and that area of nodes has been chosen for path search by ACO to avoid blind search at initial iterations. The path obtained in grid-based environment consist of points in Cartesian coordinates connected through line segments with sharp bends. Therefore, Markov Decision Process (MDP) trajectory evaluation model is introduced with a novel reward policy to filter and reduce the sharpness in global path generated in grid environment. With arc-length parameterization, a curvilinear smooth route has been generated among filtered waypoints and produces consistency and smoothness in the global path. To achieve a comfort drive and safety for robot, lateral and longitudinal control has been utilized to form a set of optimal trajectories along the reference route, as well as, minimizing total cost. The total cost includes curvature, lateral and longitudinal coordinates constraints. Additionally, for collision detection, at every step the set of optimal local trajectories have been checked for any unexpected obstacle. The results have been verified through simulations in MATLAB compared with previous global path planning algorithms to differentiate the efficiency and quality of derived approach in different constraint environments.
Collapse
|
70
|
Rubio-Sierra C, Domínguez D, Gonzalo J, Escapa A. Path Planner for Autonomous Exploration of Underground Mines by Aerial Vehicles. SENSORS 2020; 20:s20154259. [PMID: 32751686 PMCID: PMC7435854 DOI: 10.3390/s20154259] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/02/2020] [Revised: 07/24/2020] [Accepted: 07/27/2020] [Indexed: 11/16/2022]
Abstract
This paper presents a path planner solution that makes it possible to autonomously explore underground mines with aerial robots (typically multicopters). In these environments the operations may be limited by many factors like the lack of external navigation signals, the narrow passages and the absence of radio communications. The designed path planner is defined as a simple and highly computationally efficient algorithm that, only relying on a laser imaging detection and ranging (LIDAR) sensor with Simultaneous localization and mapping (SLAM) capability, permits the exploration of a set of single-level mining tunnels. It performs dynamic planning based on exploration vectors, a novel variant of the open sector method with reinforced filtering. The algorithm incorporates global awareness and obstacle avoidance modules. The first one prevents the possibility of getting trapped in a loop, whereas the second one facilitates the navigation along narrow tunnels. The performance of the proposed solution has been tested in different study cases with a Hardware-in-the-loop (HIL) simulator developed for this purpose. In all situations the path planner logic performed as expected and the used routing was optimal. Furthermore, the path efficiency, measured in terms of traveled distance and used time, was high when compared with an ideal reference case. The result is a very fast, real-time, and static memory capable algorithm, which implemented on the proposed architecture presents a feasible solution for the autonomous exploration of underground mines.
Collapse
|
71
|
Duan A, Camoriano R, Ferigo D, Huang Y, Calandriello D, Rosasco L, Pucci D. Learning to Avoid Obstacles With Minimal Intervention Control. Front Robot AI 2020; 7:60. [PMID: 33501228 PMCID: PMC7806040 DOI: 10.3389/frobt.2020.00060] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2019] [Accepted: 04/08/2020] [Indexed: 11/15/2022] Open
Abstract
Programming by demonstration has received much attention as it offers a general framework which allows robots to efficiently acquire novel motor skills from a human teacher. While traditional imitation learning that only focuses on either Cartesian or joint space might become inappropriate in situations where both spaces are equally important (e.g., writing or striking task), hybrid imitation learning of skills in both Cartesian and joint spaces simultaneously has been studied recently. However, an important issue which often arises in dynamical or unstructured environments is overlooked, namely how can a robot avoid obstacles? In this paper, we aim to address the problem of avoiding obstacles in the context of hybrid imitation learning. Specifically, we propose to tackle three subproblems: (i) designing a proper potential field so as to bypass obstacles, (ii) guaranteeing joint limits are respected when adjusting trajectories in the process of avoiding obstacles, and (iii) determining proper control commands for robots such that potential human-robot interaction is safe. By solving the aforementioned subproblems, the robot is capable of generalizing observed skills to new situations featuring obstacles in a feasible and safe manner. The effectiveness of the proposed method is validated through a toy example as well as a real transportation experiment on the iCub humanoid robot.
Collapse
|
72
|
Kolar P, Benavidez P, Jamshidi M. Survey of Datafusion Techniques for Laser and Vision Based Sensor Integration for Autonomous Navigation. SENSORS 2020; 20:s20082180. [PMID: 32290582 PMCID: PMC7218742 DOI: 10.3390/s20082180] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/26/2020] [Revised: 04/03/2020] [Accepted: 04/04/2020] [Indexed: 11/16/2022]
Abstract
This paper focuses on data fusion, which is fundamental to one of the most important modules in any autonomous system: perception. Over the past decade, there has been a surge in the usage of smart/autonomous mobility systems. Such systems can be used in various areas of life like safe mobility for the disabled, senior citizens, and so on and are dependent on accurate sensor information in order to function optimally. This information may be from a single sensor or a suite of sensors with the same or different modalities. We review various types of sensors, their data, and the need for fusion of the data with each other to output the best data for the task at hand, which in this case is autonomous navigation. In order to obtain such accurate data, we need to have optimal technology to read the sensor data, process the data, eliminate or at least reduce the noise and then use the data for the required tasks. We present a survey of the current data processing techniques that implement data fusion using different sensors like LiDAR that use light scan technology, stereo/depth cameras, Red Green Blue monocular (RGB) and Time-of-flight (TOF) cameras that use optical technology and review the efficiency of using fused data from multiple sensors rather than a single sensor in autonomous navigation tasks like mapping, obstacle detection, and avoidance or localization. This survey will provide sensor information to researchers who intend to accomplish the task of motion control of a robot and detail the use of LiDAR and cameras to accomplish robot navigation.
Collapse
|
73
|
Abedi Khoozani P, Voudouris D, Blohm G, Fiehler K. Reaching around obstacles accounts for uncertainty in coordinate transformations. J Neurophysiol 2020; 123:1920-1932. [PMID: 32267186 DOI: 10.1152/jn.00049.2020] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
When reaching to a visual target, humans need to transform the spatial target representation into the coordinate system of their moving arm. It has been shown that increased uncertainty in such coordinate transformations, for instance, when the head is rolled toward one shoulder, leads to higher movement variability and influence movement decisions. However, it is unknown whether the brain incorporates such added variability in planning and executing movements. We designed an obstacle avoidance task in which participants had to reach with or without visual feedback of the hand to a visual target while avoiding collisions with an obstacle. We varied coordinate transformation uncertainty by varying head roll (straight, 30° clockwise, and 30° counterclockwise). In agreement with previous studies, we observed that the reaching variability increased when the head was tilted. Indeed, head roll did not influence the number of collisions during reaching compared with the head-straight condition, but it did systematically change the obstacle avoidance behavior. Participants changed the preferred direction of passing the obstacle and increased the safety margins indicated by stronger movement curvature. These results suggest that the brain takes the added movement variability during head roll into account and compensates for it by adjusting the reaching trajectories.NEW & NOTEWORTHY We show that changing body geometry such as head roll results in compensatory reaching behaviors around obstacles. Specifically, we observed head roll causes changed preferred movement direction and increased trajectory curvature. As has been shown before, head roll increases movement variability due to stochastic coordinate transformations. Thus these results provide evidence that the brain must consider the added movement variability caused by coordinate transformations for accurate reach movements.
Collapse
|
74
|
Shimizu K, Kihara Y, Itou K, Tai K, Furuna T. How perception of personal space influence obstacle avoidance during walking: differences between young and older adults. Phys Ther Res 2020; 23:31-38. [PMID: 32850276 DOI: 10.1298/ptr.e9988] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2019] [Accepted: 10/05/2019] [Indexed: 11/23/2022]
Abstract
OBJECTIVE Individuals maintain a spatial margin or 'personal space' between themselves and others. The form of this space and strategies for avoiding obstacles can be influenced by participant characteristics such as age. In this study, we investigated the characteristics of personal space and obstacle avoidance strategies in young and older adults. We also examined differences in perceptual personal space and walking trajectory during obstacle avoidance using a three-dimensional motion capture system. Methods Ten young adults and ten older adults participated in this study. We calculated actual obstacle avoidance trajectory and obstacle avoidance data such as the lateral spatial margin and body rotation angle during walking in a task that included obstacle avoidance. We also measured the perceptual personal space created by approaching a confederate. In order to calculate each personal space and obstacle avoidance data, we used a three-dimensional motion capture system. Two factors (two groups and personal space) of repeated analysis of variance were used in statistical analysis. Results We found no age-related differences in personal space or obstacle avoidance strategy in this study (F = 0.52, p = 0.48). However, we found significant differences in the form of perceptual personal space and personal space formed during obstacle avoidance (F = 11.86, p = 0.0030). Conclusion This study indicates that perceptual personal space did not reflect the walking trajectory created by actual obstacle avoidance. In addition, age did not influence the obstacle avoidance strategy. These results suggest that the perceptual personal space and aging have little effect in the situation of avoiding a single standing pedestrian.
Collapse
|
75
|
Coolen B, Beek PJ, Geerse DJ, Roerdink M. Avoiding 3D Obstacles in Mixed Reality: Does It Differ from Negotiating Real Obstacles? SENSORS (BASEL, SWITZERLAND) 2020; 20:E1095. [PMID: 32079351 PMCID: PMC7071133 DOI: 10.3390/s20041095] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/18/2019] [Revised: 01/29/2020] [Accepted: 02/14/2020] [Indexed: 12/22/2022]
Abstract
Mixed-reality technologies are evolving rapidly, allowing for gradually more realistic interaction with digital content while moving freely in real-world environments. In this study, we examined the suitability of the Microsoft HoloLens mixed-reality headset for creating locomotor interactions in real-world environments enriched with 3D holographic obstacles. In Experiment 1, we compared the obstacle-avoidance maneuvers of 12 participants stepping over either real or holographic obstacles of different heights and depths. Participants' avoidance maneuvers were recorded with three spatially and temporally integrated Kinect v2 sensors. Similar to real obstacles, holographic obstacles elicited obstacle-avoidance maneuvers that scaled with obstacle dimensions. However, with holographic obstacles, some participants showed dissimilar trail or lead foot obstacle-avoidance maneuvers compared to real obstacles: they either consistently failed to raise their trail foot or crossed the obstacle with extreme lead-foot margins. In Experiment 2, we examined the efficacy of mixed-reality video feedback in altering such dissimilar avoidance maneuvers. Participants quickly adjusted their trail-foot crossing height and gradually lowered extreme lead-foot crossing heights in the course of mixed-reality video feedback trials, and these improvements were largely retained in subsequent trials without feedback. Participant-specific differences in real and holographic obstacle avoidance notwithstanding, the present results suggest that 3D holographic obstacles supplemented with mixed-reality video feedback may be used for studying and perhaps also training 3D obstacle avoidance.
Collapse
|