A Hierarchical Path Planning Approach with Multi-SARSA Based on Topological Map

In this paper, a novel path planning algorithm with Reinforcement Learning is proposed based on the topological map. The proposed algorithm has a two-level structure. At the first level, the proposed method generates the topological area using the region dynamic growth algorithm based on the grid map. In the next level, the Multi-SARSA method divided into two layers is applied to find a near-optimal global planning path, in which the artificial potential field method, first of all, is used to initialize the first Q table for faster learning speed, and then the second Q table is initialized with the connected domain obtained by topological map, which provides the prior information. A combination of the two algorithms makes the algorithm easier to converge. Simulation experiments for path planning have been executed. The results indicate that the method proposed in this paper can find the optimal path with a shorter path length, which demonstrates the effectiveness of the presented method.

Coordinated Multi-Robotic Vehicles Navigation and Control in Shop Floor Automation

In this paper, we propose a global navigation function applied to model predictive control (MPC) for autonomous mobile robots, with application to warehouse automation. The approach considers static and dynamic obstacles and generates smooth, collision-free trajectories. The navigation function is based on a potential field derived from an E* graph search algorithm on a discrete occupancy grid and by bicubic interpolation. It has convergent behavior from anywhere to the target and is computed in advance to increase computational efficiency. The novel optimization strategy used in MPC combines a discrete set of velocity candidates with randomly perturbed candidates from particle swarm optimization. Adaptive horizon length is used to improve performance. The efficiency of the proposed approaches is validated using simulations and experimental results.

Autonomous UAV System for Cleaning Insulators in Power Line Inspection and Maintenance

The inspection and maintenance tasks of electrical installations are very demanding. Nowadays, insulator cleaning is carried out manually by operators using scaffolds, ropes, or even helicopters. However, these operations involve potential risks for humans and the electrical structure. The use of Unmanned Aerial Vehicles (UAV) to reduce the risk of these tasks is rising. This paper presents an UAV to autonomously clean insulators on power lines. First, an insulator detection and tracking algorithm has been implemented to control the UAV in operation. Second, a cleaning tool has been designed consisting of a pump, a tank, and an arm to direct the flow of cleaning liquid. Third, a vision system has been developed that is capable of detecting soiled areas using a semantic segmentation neuronal network, calculating the trajectory for cleaning in the image plane, and generating arm trajectories to efficiently clean the insulator. Fourth, an autonomous system has been developed to land on a charging pad to charge the batteries and potentially fill the tank with cleaning liquid. Finally, the autonomous system has been validated in a controlled outdoor environment.

Determination of the Kinematic Excitation Originating from the Irregular Envelope of an Omnidirectional Wheel

This paper describes a test stand for determining the kinematic excitation originating from the contact between a vehicle's wheel and the ground, thus acting on the single suspension upright of the vehicle. This excitation is unique to the movement of omnidirectional wheels and originates from the irregular envelope of the wheel. The presented attitude enables the vertical displacement of the wheel's axis rolling on a horizontal surface to be determined. This work includes experimental results considering different wheel orientations against the direction of movement.

The SMOOTH-Robot: A Modular, Interactive Service Robot

The SMOOTH-robot is a mobile robot that-due to its modularity-combines a relatively low price with the possibility to be used for a large variety of tasks in a wide range of domains. In this article, we demonstrate the potential of the SMOOTH-robot through three use cases, two of which were performed in elderly care homes. The robot is designed so that it can either make itself ready or be quickly changed by staff to perform different tasks. We carefully considered important design parameters such as the appearance, intended and unintended interactions with users, and the technical complexity, in order to achieve high acceptability and a sufficient degree of utilization of the robot. Three demonstrated use cases indicate that such a robot could contribute to an improved work environment, having the potential to free resources of care staff which could be allocated to actual care-giving tasks. Moreover, the SMOOTH-robot can be used in many other domains, as we will also exemplify in this article.

The SMOOTH-Robot: A Modular, Interactive Service Robot

The SMOOTH-robot is a mobile robot that-due to its modularity-combines a relatively low price with the possibility to be used for a large variety of tasks in a wide range of domains. In this article, we demonstrate the potential of the SMOOTH-robot through three use cases, two of which were performed in elderly care homes. The robot is designed so that it can either make itself ready or be quickly changed by staff to perform different tasks. We carefully considered important design parameters such as the appearance, intended and unintended interactions with users, and the technical complexity, in order to achieve high acceptability and a sufficient degree of utilization of the robot. Three demonstrated use cases indicate that such a robot could contribute to an improved work environment, having the potential to free resources of care staff which could be allocated to actual care-giving tasks. Moreover, the SMOOTH-robot can be used in many other domains, as we will also exemplify in this article.

Mobile Robot-Based Gait Training after Total Hip Arthroplasty (THA) Improves Walking in Biomechanical Gait Analysis

There are multiple attempts to decrease costs in the healthcare system while maintaining a high treatment quality. Digital therapies receive increasing attention in clinical practice, mainly relating to home-based exercises supported by mobile devices, eventually in combination with wearable sensors. The aim of this study was to determine if patients following total hip arthroplasty (THA) could benefit from gait training on crutches conducted by a mobile robot in a clinical setting.

METHOD

This clinical trial was conducted with 30 patients following total hip arthroplasty. Fifteen patients received the conventional physiotherapy program in the clinic (including 5 min of gait training supported by a physiotherapist). The intervention group of 15 patients passed the same standard physiotherapy program, but the 5-min gait training supported by a physiotherapist was replaced by 2 × 5 min of gait training conducted by the robot. Length of stay of the patients was set to five days. Biomechanical gait parameters of the patients were assessed pre-surgery and upon patient discharge.

RESULTS

While before surgery no significant difference in gait parameters was existent, patients from the intervention group showed a significant higher absolute walking speed (0.83 vs. 0.65 m/s, p = 0.029), higher relative walking speed (0.2 vs. 0.16 m/s, p = 0.043) or shorter relative cycle time (3.35 vs. 3.68 s, p = 0.041) than the patients from the control group.

CONCLUSION

The significant higher walking speed of patients indicates that such robot-based gait training on crutches may shorten length of stay (LOS) in acute clinics. However, the number of patients involved was rather small, thus calling for further studies.

Active Mapping and Robot Exploration: A Survey

Simultaneous localization and mapping responds to the problem of building a map of the environment without any prior information and based on the data obtained from one or more sensors. In most situations, the robot is driven by a human operator, but some systems are capable of navigating autonomously while mapping, which is called native simultaneous localization and mapping. This strategy focuses on actively calculating the trajectories to explore the environment while building a map with a minimum error. In this paper, a comprehensive review of the research work developed in this field is provided, targeting the most relevant contributions in indoor mobile robotics.

Approaches for Efficiently Detecting Frontier Cells in Robotics Exploration

Many robot exploration algorithms that are used to explore office, home, or outdoor environments, rely on the concept of frontier cells. Frontier cells define the border between known and unknown space. Frontier-based exploration is the process of repeatedly detecting frontiers and moving towards them, until there are no more frontiers and therefore no more unknown regions. The faster frontier cells can be detected, the more efficient exploration becomes. This paper proposes several algorithms for detecting frontiers. The first is called Naïve Active Area (NaïveAA) frontier detection and achieves frontier detection in constant time by only evaluating the cells in the active area defined by scans taken. The second algorithm is called Expanding-Wavefront Frontier Detection (EWFD) and uses frontiers from the previous timestep as a starting point for searching for frontiers in newly discovered space. The third approach is called Frontier-Tracing Frontier Detection (FTFD) and also uses the frontiers from the previous timestep as well as the endpoints of the scan, to determine the frontiers at the current timestep. Algorithms are compared to state-of-the-art algorithms such as Naïve, WFD, and WFD-INC. NaïveAA is shown to operate in constant time and therefore is suitable as a basic benchmark for frontier detection algorithms. EWFD and FTFD are found to be significantly faster than other algorithms.

An Approach of Social Navigation Based on Proxemics for Crowded Environments of Humans and Robots

Nowadays, mobile robots are playing an important role in different areas of science, industry, academia and even in everyday life. In this sense, their abilities and behaviours become increasingly complex. In particular, in indoor environments, such as hospitals, schools, banks and museums, where the robot coincides with people and other robots, its movement and navigation must be programmed and adapted to robot–robot and human–robot interactions. However, existing approaches are focused either on multi-robot navigation (robot–robot interaction) or social navigation with human presence (human–robot interaction), neglecting the integration of both approaches. Proxemic interaction is recently being used in this domain of research, to improve Human–Robot Interaction (HRI). In this context, we propose an autonomous navigation approach for mobile robots in indoor environments, based on the principles of proxemic theory, integrated with classical navigation algorithms, such as ORCA, Social Momentum, and A*. With this novel approach, the mobile robot adapts its behaviour, by analysing the proximity of people to each other, with respect to it, and with respect to other robots to decide and plan its respective navigation, while showing acceptable social behaviours in presence of humans. We describe our proposed approach and show how proxemics and the classical navigation algorithms are combined to provide an effective navigation, while respecting social human distances. To show the suitability of our approach, we simulate several situations of coexistence of robots and humans, demonstrating an effective social navigation.

Autonomous Navigation of a Team of Unmanned Surface Vehicles for Intercepting Intruders on a Region Boundary

We study problems of intercepting single and multiple invasive intruders on a boundary of a planar region by employing a team of autonomous unmanned surface vehicles. First, the problem of intercepting a single intruder has been studied and then the proposed strategy has been applied to intercepting multiple intruders on the region boundary. Based on the proposed decentralised motion control algorithm and decision making strategy, each autonomous vehicle intercepts any intruder, which tends to leave the region by detecting the most vulnerable point of the boundary. An efficient and simple mathematical rules based control algorithm for navigating the autonomous vehicles on the boundary of the see region is developed. The proposed algorithm is computationally simple and easily implementable in real life intruder interception applications. In this paper, we obtain necessary and sufficient conditions for the existence of a real-time solution to the considered problem of intruder interception. The effectiveness of the proposed method is confirmed by computer simulations with both single and multiple intruders.

Real-Time Parallel-Serial LiDAR-Based Localization Algorithm with Centimeter Accuracy for GPS-Denied Environments

In this paper, we introduce a real-time parallel-serial algorithm for autonomous robot positioning for GPS-denied, dark environments, such as caves and mine galleries. To achieve a good complexity-accuracy trade-off, we fuse data from light detection and ranging (LiDAR) and an inertial measurement unit (IMU). The proposed algorithm’s main novelty is that, unlike in most algorithms, we apply an extended Kalman filter (EKF) to each LiDAR scan point and calculate the location relative to a triangular mesh. We also introduce three implementations of the algorithm: serial, parallel, and parallel-serial. The first implementation verifies the correctness of our innovative approach, but is too slow for real-time execution. The second approach implements a well-known parallel data fusion approach, but is still too slow for our application. The third and final implementation of the presented algorithm along with the state-of-the-art GPU data structures achieves real-time performance. According to our experimental findings, our algorithm outperforms the reference Gaussian mixture model (GMM) localization algorithm in terms of accuracy by a factor of two.

A Sensor Fusion Method for Pose Estimation of C-Legged Robots

In this work the authors present a novel algorithm for estimating the odometry of "C" legged robots with compliant legs and an analysis to estimate the pose of the robot. Robots with "C" legs are an alternative to wheeled and tracked robots for overcoming obstacles that can be found in different scenarios like stairs, debris, etc. Therefore, this kind of robot has become very popular for its locomotion capabilities, but at this point these robots do not have developed algorithms to implement autonomous navigation. With that objective in mind, the authors present a novel algorithm using the encoders of the legs to improve the estimation of the robot localization together with other sensors. Odometry is necessary for using some algorithms like the Extended Kalman Filter, which is used for some autonomous navigation algorithms. Due to the flexible properties of the "C" legs and the localization of the rotational axis, obtaining the displacement at every step is not as trivial as in a wheeled robot; to solve those complexities, the algorithm presented in this work makes a linear approximation of the leg compressed instead of calculating in each iteration the mechanics of the leg using finite element analysis, so the calculus level is reduced. Furthermore, the algorithm was tested in simulations and with a real robot. The results obtained in the tests are promising and together with the algorithm and fusion sensor can be used to endow the robots with autonomous navigation.

Integrating Mobile Robots into Automated Laboratory Processes: A Suitable Workflow Management System

The general trend of automation is currently increasing in life science laboratories. The samples to be examined show a high diversity in their structures and composition as well as the determination methods. Complex automation lines such as those used in classic industrial automation are not a suitable solution with respect to the required flexibility of the systems due to changing application requirements. Rather, full automation requires the connection of several different subsystems, including manual process steps by the laboratory staff. This requires suitable workflow management systems that enable the planning and execution of complex process steps. The integration of mobile robots for transportation tasks is currently an important development trend for realizing full automation in life science laboratories. The article "Workflow Management System for the Integration of Mobile Robots in Future Labs of Life Sciences" presents the development and application of a hierarchical workflow management system (HWMS) as a top-level process management and control system. This concept combines the typical hierarchical automation structure with novel approaches for the integration of transportation tasks with variable degrees of automation. The aim is to create a general-purpose workflow management system that can be used in different areas of the life sciences, regardless of the specific device components and applications used.

Graph Search-Based Exploration Method Using a Frontier-Graph Structure for Mobile Robots

This paper describes a graph search-based exploration method. Segmented frontier nodes and their relative transformations constitute a frontier-graph structure. Frontier detection and segmentation are performed using local grid maps of adjacent nodes. The proposed frontier-graph structure can systematically manage local information according to the exploration state and overcome the problem caused by updating a single global grid map. The robot selects the next target using breadth-first search (BFS) exploration of the frontier-graph. The BFS exploration is improved to generate an efficient loop-closing sequence between adjacent nodes. We verify that our BFS-based exploration method can gradually extend the frontier-graph structure and efficiently map the entire environment, regardless of the starting position.

Robust Lateral Stabilization Control of In-Wheel-Motor-Driven Mobile Robots via Active Disturbance Suppression Approach

Due to the praiseworthy maneuverability and actuation flexibility, the in-wheel-motor-driven mobile robots (IWMD-MR) are widely employed in various industrial fields. However, the active estimation and rejection of unknown disturbances/uncertainties remain a tough work for formulating a stable lateral motion controller. To address the challenge, this paper proposes a robust lateral stabilization control (RLSC) scheme for the developed IWMD-MR by designing an active disturbance suppression mechanism. The distinctive features of the proposed RLSC method are threefold: (i) With a fuzzy estimator, a modified super-twisting sliding mode method is designed to eliminate the system perturbations and time-varying lumped disturbances in an active manner; (ii) The resultant system trajectory is forced into a bounded switching region within finite time, which can be maintained therein for subsequent periods; (iii) Employing the Lyapunov function, new adaption rules for multivariable gains are derived to preserve the lateral motion stability and robustness. Finally, under the direct yaw moment control framework, simulation experiments of real-life IWMD-MR are offered to verify the effectiveness of the presented RLSC method.

RGB-D Object SLAM Using Quadrics for Indoor Environments

Indoor service robots need to build an object-centric semantic map to understand and execute human instructions. Conventional visual simultaneous localization and mapping (SLAM) systems build a map using geometric features such as points, lines, and planes as landmarks. However, they lack a semantic understanding of the environment. This paper proposes an object-level semantic SLAM algorithm based on RGB-D data, which uses a quadric surface as an object model to compactly represent the object’s position, orientation, and shape. This paper proposes and derives two types of RGB-D camera-quadric observation models: a complete model and a partial model. The complete model combines object detection and point cloud data to estimate a complete ellipsoid in a single RGB-D frame. The partial model is activated when the depth data is severely missing because of illuminations or occlusions, which uses bounding boxes from object detection to constrain objects. Compared with the state-of-the-art quadric SLAM algorithms that use a monocular observation model, the RGB-D observation model reduces the requirements of the observation number and viewing angle changes, which helps improve the accuracy and robustness. This paper introduces a nonparametric pose graph to solve data associations in the back end, and innovatively applies it to the quadric surface model. We thoroughly evaluated the algorithm on two public datasets and an author-collected mobile robot dataset in a home-like environment. We obtained obvious improvements on the localization accuracy and mapping effects compared with two state-of-the-art object SLAM algorithms.

A Novel Dynamic Three-Level Tracking Controller for Mobile Robots Considering Actuators and Power Stage Subsystems: Experimental Assessment

In order to solve the trajectory tracking task in a wheeled mobile robot (WMR), a dynamic three-level controller is presented in this paper. The controller considers the mechanical structure, actuators, and power stage subsystems. Such a controller is designed as follows: At the high level is a dynamic control for the WMR (differential drive type). At the medium level is a PI current control for the actuators (DC motors). Lastly, at the low level is a differential flatness-based control for the power stage (DC/DC Buck power converters). The feasibility, robustness, and performance in closed-loop of the proposed controller are validated on a DDWMR prototype through Matlab-Simulink, the real-time interface ControlDesk, and a DS1104 board. The obtained results are experimentally assessed with a hierarchical tracking controller, recently reported in literature, that was also designed on the basis of the mechanical structure, actuators, and power stage subsystems. Although both controllers are robust when parametric disturbances are taken into account, the dynamic three-level tracking controller presented in this paper is better than the hierarchical tracking controller reported in literature.

Strapdown Inertial Navigation Systems for Positioning Mobile Robots-MEMS Gyroscopes Random Errors Analysis Using Allan Variance Method

A problem of estimating the movement and orientation of a mobile robot is examined in this paper. The strapdown inertial navigation systems are often engaged to solve this common obstacle. The most important and critically sensitive component of such positioning approximation system is a gyroscope. Thus, we analyze here the random error components of the gyroscope, such as bias instability and random rate walk, as well as those that cause the presence of white and exponentially correlated (Markov) noise and perform an optimization of these parameters. The MEMS gyroscopes of InvenSense MPU-6050 type for each axis of the gyroscope with a sampling frequency of 70 Hz are investigated, as a result, Allan variance graphs and the values of bias instability coefficient and angle random walk for each axis are determined. It was found that in the output signals of the gyroscopes there is no Markov noise and random rate walk, and the X and Z axes are noisier than the Y axis. In the process of inertial measurement unit (IMU) calibration, the correction coefficients are calculated, which allow partial compensating the influence of destabilizing factors and determining the perpendicularity inaccuracy for sensitivity axes, and the conversion coefficients for each axis, which transform the sensor source codes into the measure unit and bias for each axis. The output signals of the calibrated gyroscope are noisy and offset from zero to all axes, so processing accelerometer and gyroscope data by the alpha-beta filter or Kalman filter is required to reduce noise influence.

Statistical Study of the Performance of Recursive Bayesian Filters with Abnormal Observations from Range Sensors

Range sensors are currently present in countless applications related to perception of the environment. In mobile robots, these devices constitute a key part of the sensory apparatus and enable essential operations, that are often addressed by applying methods grounded on probabilistic frameworks such as Bayesian filters. Unfortunately, modern mobile robots have to navigate within challenging environments from the perspective of their sensory devices, getting abnormal observations (e.g., biased, missing, etc.) that may compromise these operations. Although there exist previous contributions that either address filtering performance or identification of abnormal sensory observations, they do not provide a complete treatment of both problems at once. In this work we present a statistical approach that allows us to study and quantify the impact of abnormal observations from range sensors on the performance of Bayesian filters. For that, we formulate the estimation problem from a generic perspective (abstracting from concrete implementations), analyse the main limitations of common robotics range sensors, and define the factors that potentially affect the filtering performance. Rigorous statistical methods are then applied to a set of simulated experiments devised to reproduce a diversity of situations. The obtained results, which we also validate in a real environment, provide novel and relevant conclusions on the effect of abnormal range observations in these filters.

An Integrated Strategy for Autonomous Exploration of Spatial Processes in Unknown Environments

Exploration of spatial processes, such as radioactivity or temperature is a fundamental task in many robotic applications. In the literature, robotic exploration is mainly carried out for applications where the environment is a priori known. However, for most real life applications this assumption often does not hold, specifically for disaster scenarios. In this paper, we propose a novel integrated strategy that allows a robot to explore a spatial process of interest in an unknown environment. To this end, we build upon two major blocks. First, we propose the use of GP to model the spatial process of interest, and process entropy to drive the exploration. Second, we employ registration algorithms for robot mapping and localization, and frontier-based exploration to explore the environment. However, map and process exploration can be conflicting goals. Our integrated strategy fuses the two aforementioned blocks through a trade-off between process and map exploration. We carry out extensive evaluations of our algorithm in simulated environments with respect to different baselines and environment setups using simulated GP data as a process at hand. Additionally, we perform experimental verification with a mobile holonomic robot exploring a simulated process in an unknown labyrinth environment. Demonstrated results show that our integrated strategy outperforms both frontier-based and GP entropy-driven exploration strategies.

Edge Computing Resource Allocation for Dynamic Networks: The DRUID-NET Vision and Perspective

The potential offered by the abundance of sensors, actuators, and communications in the Internet of Things (IoT) era is hindered by the limited computational capacity of local nodes. Several key challenges should be addressed to optimally and jointly exploit the network, computing, and storage resources, guaranteeing at the same time feasibility for time-critical and mission-critical tasks. We propose the DRUID-NET framework to take upon these challenges by dynamically distributing resources when the demand is rapidly varying. It includes analytic dynamical modeling of the resources, offered workload, and networking environment, incorporating phenomena typically met in wireless communications and mobile edge computing, together with new estimators of time-varying profiles. Building on this framework, we aim to develop novel resource allocation mechanisms that explicitly include service differentiation and context-awareness, being capable of guaranteeing well-defined Quality of Service (QoS) metrics. DRUID-NET goes beyond the state of the art in the design of control algorithms by incorporating resource allocation mechanisms to the decision strategy itself. To achieve these breakthroughs, we combine tools from Automata and Graph theory, Machine Learning, Modern Control Theory, and Network Theory. DRUID-NET constitutes the first truly holistic, multidisciplinary approach that extends recent, albeit fragmented results from all aforementioned fields, thus bridging the gap between efforts of different communities.

Autonomous Microrobotic Manipulation Using Visual Servo Control

This describes the application of a visual servo control method to the microrobotic manipulation of polymer beads on a two-dimensional fluid interface. A microrobot, actuated through magnetic fields, is utilized to manipulate a non-magnetic polymer bead into a desired position. The controller utilizes multiple modes of robot actuation to address the different stages of the task. A filtering strategy employed in separation mode allows the robot to spiral from the manipuland in a fashion that promotes the manipulation positioning objective. Experiments demonstrate that our multiphase controller can be used to direct a microrobot to position a manipuland to within an average positional error of approximately 8 pixels (64 µm) over numerous trials.

Automatic Waypoint Generation to Improve Robot Navigation Through Narrow Spaces

In domestic robotics, passing through narrow areas becomes critical for safe and effective robot navigation. Due to factors like sensor noise or miscalibration, even if the free space is sufficient for the robot to pass through, it may not see enough clearance to navigate, hence limiting its operational space. An approach to facing this is to insert waypoints strategically placed within the problematic areas in the map, which are considered by the robot planner when generating a trajectory and help to successfully traverse them. This is typically carried out by a human operator either by relying on their experience or by trial-and-error. In this paper, we present an automatic procedure to perform this task that: (i) detects problematic areas in the map and (ii) generates a set of auxiliary navigation waypoints from which more suitable trajectories can be generated by the robot planner. Our proposal, fully compatible with the robotic operating system (ROS), has been successfully applied to robots deployed in different houses within the H2020 MoveCare project. Moreover, we have performed extensive simulations with four state-of-the-art robots operating within real maps. The results reveal significant improvements in the number of successful navigations for the evaluated scenarios, demonstrating its efficacy in realistic situations.

Social Navigation in a Cognitive Architecture Using Dynamic Proxemic Zones

Robots have begun to populate the everyday environments of human beings. These social robots must perform their tasks without disturbing the people with whom they share their environment. This paper proposes a navigation algorithm for robots that is acceptable to people. Robots will detect the personal areas of humans, to carry out their tasks, generating navigation routes that have less impact on human activities. The main novelty of this work is that the robot will perceive the moods of people to adjust the size of proxemic areas. This work will contribute to making the presence of robots in human-populated environments more acceptable. As a result, we have integrated this approach into a cognitive architecture designed to perform tasks in human-populated environments. The paper provides quantitative experimental results in two scenarios: controlled, including social navigation metrics in comparison with a traditional navigation method, and non-controlled, in robotic competitions where different studies of social robotics are measured.