26
|
Lijcklama à Nijeholt L, Kronshorst TY, van Teeffelen K, van Manen B, Emaus R, Knotter J, Mersha A. Utilizing Drone-Based Ground-Penetrating Radar for Crime Investigations in Localizing and Identifying Clandestine Graves. SENSORS (BASEL, SWITZERLAND) 2023; 23:7119. [PMID: 37631665 PMCID: PMC10459563 DOI: 10.3390/s23167119] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Revised: 07/14/2023] [Accepted: 07/20/2023] [Indexed: 08/27/2023]
Abstract
The decomposition of a body is influenced by burial conditions, making it crucial to understand the impact of different conditions for accurate grave detection. Geophysical techniques using drones have gained popularity in locating clandestine graves, offering non-invasive methods for detecting surface and subsurface irregularities. Ground-penetrating radar (GPR) is an effective technology for identifying potential grave locations without disturbance. This research aimed to prototype a drone system integrating GPR to assist in grave localization and to develop software for data management. Initial experiments compared GPR with other technologies, demonstrating its valuable applicability. It is suitable for various decomposition stages and soil types, although certain soil compositions have limitations. The research used the DJI M600 Pro drone and a drone-based GPR system enhanced by the real-time kinematic (RTK) global positioning system (GPS) for precision and autonomy. Tests with simulated graves and cadavers validated the system's performance, evaluating optimal altitude, speed, and obstacle avoidance techniques. Furthermore, global and local planning algorithms ensured efficient and obstacle-free flight paths. The results highlighted the potential of the drone-based GPR system in locating clandestine graves while minimizing disturbance, contributing to the development of effective tools for forensic investigations and crime scene analysis.
Collapse
|
27
|
Miura Y, Yoshimoto K, Shinya M. Shape of an obstacle affects the mediolateral trajectory of the lower limb during the crossing process. Front Sports Act Living 2023; 5:1130332. [PMID: 37637222 PMCID: PMC10450917 DOI: 10.3389/fspor.2023.1130332] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2022] [Accepted: 07/19/2023] [Indexed: 08/29/2023] Open
Abstract
In previous studies involving obstacle crossing, vertical foot clearance has been used as an indicator of the risk of contact. Under normal circumstances, individuals do not always cross over obstacles with the same height on both sides, and depending on the shape of the obstacle, the risk of contact may differ depending on the foot elevation position. Therefore, we investigated whether task-related control of the mediolateral foot position is adapted to the shape of the obstacle. Sixteen healthy young adults performed a task in which they crossed over two obstacles with different shapes while walking: a trapezoidal obstacle and a rectangular obstacle, as viewed from the frontal plane. It was shown that when crossing over a trapezoidal obstacle, the participants maintained foot clearance by controlling the mediolateral direction, which chose the height that needed to be cleared. The results of this study suggest that the lower limb movements that occur during obstacle crossing are controlled not only in the vertical direction but also in the mediolateral direction by adjusting the foot trajectory to reduce the risk of contact. It was demonstrated that control was not only based on the height of the obstacle directly under the foot but also in the foot mediolateral direction, considering the shape of the entire obstacle, including the opposite limb.
Collapse
|
28
|
Chen Z, Zhao Z, Xu J, Wang X, Lu Y, Yu J. A Cooperative Hunting Method for Multi-USV Based on the A* Algorithm in an Environment with Obstacles. SENSORS (BASEL, SWITZERLAND) 2023; 23:7058. [PMID: 37631593 PMCID: PMC10458174 DOI: 10.3390/s23167058] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Revised: 08/07/2023] [Accepted: 08/07/2023] [Indexed: 08/27/2023]
Abstract
A single unmanned surface combatant (USV) has poor mission execution capability, so the cooperation of multiple unmanned surface ships is widely used. Cooperative hunting is an important aspect of multi USV collaborative research. Therefore, this paper proposed a cooperative hunting method for multi-USV based on the A* algorithm in an environment with obstacles. First, based on the traditional A* algorithm, a path smoothing method based on USV minimum turning radius is proposed. At the same time, the post order traversal recursive algorithm in the binary tree method is used to replace the enumeration algorithm to obtain the optimal path, which improves the efficiency of the A* algorithm. Second, a biomimetic multi USV swarm collaborative hunting method is proposed. Multiple USV clusters simulate the hunting strategy of lions to pre-form on the target's path, so multiple USV clusters do not require manual formation. During the hunting process, the formation of multiple USV groups is adjusted to limit the movement and turning of the target, thereby reducing the range of activity of the target and improving the effectiveness of the algorithm. To verify the effectiveness of the algorithm, two sets of simulation experiments were conducted. The results show that the algorithm has good performance in path planning and target search.
Collapse
|
29
|
Brighton CH, Kempton JA, France LA, KleinHeerenbrink M, Miñano S, Taylor GK. Obstacle avoidance in aerial pursuit. Curr Biol 2023; 33:3192-3202.e3. [PMID: 37421951 DOI: 10.1016/j.cub.2023.06.047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2023] [Revised: 06/16/2023] [Accepted: 06/19/2023] [Indexed: 07/10/2023]
Abstract
Pursuing prey through clutter is a complex and risky activity requiring integration of guidance subsystems for obstacle avoidance and target pursuit. The unobstructed pursuit trajectories of Harris' hawks Parabuteo unicinctus are well modeled by a mixed guidance law feeding back target deviation angle and line-of-sight rate. Here we ask how their pursuit behavior is modified in response to obstacles, using high-speed motion capture to reconstruct flight trajectories recorded during obstructed pursuit of maneuvering targets. We find that Harris' hawks use the same mixed guidance law during obstructed pursuit but appear to superpose a discrete bias command that resets their flight direction to aim at a clearance of approximately one wing length from an upcoming obstacle as they reach some threshold distance from it. Combining a feedback command in response to target motion with a feedforward command in response to upcoming obstacles provides an effective means of prioritizing obstacle avoidance while remaining locked-on to a target. We therefore anticipate that a similar mechanism may be used in terrestrial and aquatic pursuit. The same biased guidance law could also be used for obstacle avoidance in drones designed to intercept other drones in clutter, or to navigate between fixed waypoints in urban environments.
Collapse
|
30
|
Dang TV, Tran DMC, Tan PX. IRDC-Net: Lightweight Semantic Segmentation Network Based on Monocular Camera for Mobile Robot Navigation. SENSORS (BASEL, SWITZERLAND) 2023; 23:6907. [PMID: 37571691 PMCID: PMC10422405 DOI: 10.3390/s23156907] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/20/2023] [Revised: 07/31/2023] [Accepted: 08/02/2023] [Indexed: 08/13/2023]
Abstract
Computer vision plays a significant role in mobile robot navigation due to the wealth of information extracted from digital images. Mobile robots localize and move to the intended destination based on the captured images. Due to the complexity of the environment, obstacle avoidance still requires a complex sensor system with a high computational efficiency requirement. This study offers a real-time solution to the problem of extracting corridor scenes from a single image using a lightweight semantic segmentation model integrating with the quantization technique to reduce the numerous training parameters and computational costs. The proposed model consists of an FCN as the decoder and MobilenetV2 as the decoder (with multi-scale fusion). This combination allows us to significantly minimize computation time while achieving high precision. Moreover, in this study, we also propose to use the Balance Cross-Entropy loss function to handle diverse datasets, especially those with class imbalances and to integrate a number of techniques, for example, the Adam optimizer and Gaussian filters, to enhance segmentation performance. The results demonstrate that our model can outperform baselines across different datasets. Moreover, when being applied to practical experiments with a real mobile robot, the proposed model's performance is still consistent, supporting the optimal path planning, allowing the mobile robot to efficiently and effectively avoid the obstacles.
Collapse
|
31
|
Zeng D, Chen H, Yu Y, Hu Y, Deng Z, Zhang P, Xie D. Microrobot Path Planning Based on the Multi-Module DWA Method in Crossing Dense Obstacle Scenario. MICROMACHINES 2023; 14:1181. [PMID: 37374766 DOI: 10.3390/mi14061181] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Revised: 05/25/2023] [Accepted: 05/27/2023] [Indexed: 06/29/2023]
Abstract
A hard issue in the field of microrobots is path planning in complicated situations with dense obstacle distribution. Although the Dynamic Window Approach (DWA) is a good obstacle avoidance planning algorithm, it struggles to adapt to complex situations and has a low success rate when planning in densely populated obstacle locations. This paper suggests a multi-module enhanced DWA (MEDWA) obstacle avoidance planning algorithm to address the aforementioned issues. An obstacle-dense area judgment approach is initially presented by combining Mahalanobis distance, Frobenius norm, and covariance matrix on the basis of a multi-obstacle coverage model. Second, MEDWA is a hybrid of enhanced DWA (EDWA) algorithms in non-dense areas with a class of two-dimensional analytic vector field methods developed in dense areas. The vector field methods are used instead of the DWA algorithms with poor planning performance in dense areas, which greatly improves the passing ability of microrobots over dense obstacles. The core of EDWA is to extend the new navigation function by modifying the original evaluation function and dynamically adjusting the weights of the trajectory evaluation function in different modules using the improved immune algorithm (IIA), thus improving the adaptability of the algorithm to different scenarios and achieving trajectory optimization. Finally, two scenarios with different obstacle-dense area locations were constructed to test the proposed method 1000 times, and the performance of the algorithm was verified in terms of step number, trajectory length, heading angle deviation, and path deviation. The findings indicate that the method has a smaller planning deviation and that the length of the trajectory and the number of steps can both be reduced by about 15%. This improves the ability of the microrobot to pass through obstacle-dense areas while successfully preventing the phenomenon of microrobots going around or even colliding with obstacles outside of dense areas.
Collapse
|
32
|
Gyenes Z, Bölöni L, Szádeczky-Kardoss EG. Can Genetic Algorithms Be Used for Real-Time Obstacle Avoidance for LiDAR-Equipped Mobile Robots? SENSORS (BASEL, SWITZERLAND) 2023; 23:3039. [PMID: 36991749 PMCID: PMC10054601 DOI: 10.3390/s23063039] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/07/2023] [Revised: 03/03/2023] [Accepted: 03/07/2023] [Indexed: 06/19/2023]
Abstract
Despite significant progress in robot hardware, the number of mobile robots deployed in public spaces remains low. One of the challenges hindering a wider deployment is that even if a robot can build a map of the environment, for instance through the use of LiDAR sensors, it also needs to calculate, in real time, a smooth trajectory that avoids both static and mobile obstacles. Considering this scenario, in this paper we investigate whether genetic algorithms can play a role in real-time obstacle avoidance. Historically, the typical use of genetic algorithms was in offline optimization. To investigate whether an online, real-time deployment is possible, we create a family of algorithms called GAVO that combines genetic algorithms with the velocity obstacle model. Through a series of experiments, we show that a carefully chosen chromosome representation and parametrization can achieve real-time performance on the obstacle avoidance problem.
Collapse
|
33
|
Muroi D, Saito Y, Koyake A, Hiroi Y, Higuchi T. Training for walking through an opening improves collision avoidance behavior in subacute patients with stroke: a randomized controlled trial. Disabil Rehabil 2023:1-9. [PMID: 36815267 DOI: 10.1080/09638288.2023.2181412] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2022] [Revised: 02/02/2023] [Accepted: 02/11/2023] [Indexed: 02/24/2023]
Abstract
PURPOSE Paretic side collisions frequently occur in stroke patients, especially while walking through narrow spaces. We determined whether training for walking through an opening (T-WTO) while entering from the paretic side would improve collision avoidance behavior and prevent falls after 6 months. MATERIALS AND METHODS Thirty-eight adults with moderate-to-mild hemiparetic gait after stroke who were hospitalized in a rehabilitation setting were randomly allocated to the T-WTO (n = 20) or regular rehabilitation (R-Control; n = 18) program. Both groups received five sessions of 40 min per week, for three weeks total. T-WTO included walking through openings of various widths while rotating with the paretic side in front, and R-Control involved normal walking without body rotation. Obstacle avoidance ability, 10-m walking test, timed Up and Go test, Berg Balance Scale, Activities-specific Balance Confidence, the perceptual judgment of passability, and fall incidence were assessed. RESULTS Collision rate and time to passage of the opening in obstacle avoidance task significantly improved in the T-WTO group compared with those in the R-Control group. Contrast, T-WTO did not lead to significant improvements in other outcomes. CONCLUSIONS T-WTO improved efficiency and safety in managing subacute stroke patients. Such training could improve patient outcomes/safety because of the paretic body side during walking. CLINICAL TRIAL REGISTRATION NO. R000038375 UMIN000033926.
Collapse
|
34
|
Gan W, Su L, Chu Z. Trajectory Planning of Autonomous Underwater Vehicles Based on Gauss Pseudospectral Method. SENSORS (BASEL, SWITZERLAND) 2023; 23:2350. [PMID: 36850948 PMCID: PMC9968012 DOI: 10.3390/s23042350] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Revised: 02/15/2023] [Accepted: 02/18/2023] [Indexed: 06/18/2023]
Abstract
This paper aims to address the obstacle avoidance problem of autonomous underwater vehicles (AUVs) in complex environments by proposing a trajectory planning method based on the Gauss pseudospectral method (GPM). According to the kinematics and dynamics constraints, and the obstacle avoidance requirement in AUV navigation, a multi-constraint trajectory planning model is established. The model takes energy consumption and sailing time as optimization objectives. The optimal control problem is transformed into a nonlinear programming problem by the GPM. The trajectory satisfying the optimization objective can be obtained by solving the problem with a sequential quadratic programming (SQP) algorithm. For the optimization of calculation parameters, the cubic spline interpolation method is proposed to generate initial value. Finally, through comparison with the linear fitting method, the rapidity of the solution of the cubic spline interpolation method is verified. The simulation results show that the cubic spline interpolation method improves the operation performance by 49.35% compared with the linear fitting method, which verifies the effectiveness of the cubic spline interpolation method in solving the optimal control problem.
Collapse
|
35
|
Li Y, Chen Z, Wang T, Zeng X, Yin Z. Apollo: Adaptive Polar Lattice-Based Local Obstacle Avoidance and Motion Planning for Automated Vehicles. SENSORS (BASEL, SWITZERLAND) 2023; 23:1813. [PMID: 36850410 PMCID: PMC9964177 DOI: 10.3390/s23041813] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/30/2022] [Revised: 02/01/2023] [Accepted: 02/02/2023] [Indexed: 06/18/2023]
Abstract
The motion planning module is the core module of the automated vehicle software system, which plays a key role in connecting its preceding element, i.e., the sensing module, and its following element, i.e., the control module. The design of an adaptive polar lattice-based local obstacle avoidance (APOLLO) algorithm proposed in this paper takes full account of the characteristics of the vehicle's sensing and control systems. The core of our approach mainly consists of three phases, i.e., the adaptive polar lattice-based local search space design, the collision-free path generation and the path smoothing. By adjusting a few parameters, the algorithm can be adapted to different driving environments and different kinds of vehicle chassis. Simulations show that the proposed method owns strong environmental adaptability and low computation complexity.
Collapse
|
36
|
Li Z, Yuan S, Yin X, Li X, Tang S. Research into Autonomous Vehicles Following and Obstacle Avoidance Based on Deep Reinforcement Learning Method under Map Constraints. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23020844. [PMID: 36679640 PMCID: PMC9861567 DOI: 10.3390/s23020844] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/24/2022] [Revised: 12/31/2022] [Accepted: 01/08/2023] [Indexed: 05/27/2023]
Abstract
Compared with traditional rule-based algorithms, deep reinforcement learning methods in autonomous driving are able to reduce the response time of vehicles to the driving environment and fully exploit the advantages of autopilot. Nowadays, autonomous vehicles mainly drive on urban roads and are constrained by some map elements such as lane boundaries, lane driving rules, and lane center lines. In this paper, a deep reinforcement learning approach seriously considering map elements is proposed to deal with the autonomous driving issues of vehicles following and obstacle avoidance. When the deep reinforcement learning method is modeled, an obstacle representation method is proposed to represent the external obstacle information required by the ego vehicle input, aiming to address the problem that the number and state of external obstacles are not fixed.
Collapse
|
37
|
Faria MH, Simieli L, Rietdyk S, Penedo T, Santinelli FB, Barbieri FA. (A)symmetry during gait initiation in people with Parkinson's disease: A motor and cortical activity exploratory study. Front Aging Neurosci 2023; 15:1142540. [PMID: 37139089 PMCID: PMC10150081 DOI: 10.3389/fnagi.2023.1142540] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2023] [Accepted: 03/28/2023] [Indexed: 05/05/2023] Open
Abstract
Background Gait asymmetry and deficits in gait initiation (GI) are among the most disabling symptoms in people with Parkinson's disease (PwPD). Understanding if PwPD with reduced asymmetry during GI have higher asymmetry in cortical activity may provide support for an adaptive mechanism to improve GI, particularly in the presence of an obstacle. Objective This study quantified the asymmetry of anticipatory postural adjustments (APAs), stepping parameters and cortical activity during GI, and tested if the presence of an obstacle regulates asymmetry in PwPD. Methods Sixteen PwPD and 16 control group (CG) performed 20-trials in two conditions: unobstructed and obstructed GI with right and left limbs. We measured, through symmetry index, (i) motor parameters: APAs and stepping, and (ii) cortical activity: the PSD of the frontal, sensorimotor and occipital areas during APA, STEP-I (moment of heel-off of the leading foot in the GI until the heel contact of the same foot); and STEP-II (moment of the heel-off of the trailing foot in the GI until the heel contact of the same foot) phases. Results Parkinson's disease showed higher asymmetry in cortical activity during APA, STEP-I and STEP-II phases and step velocity (STEP-II phase) during unobstructed GI than CG. However, unexpectedly, PwPD reduced the level of asymmetry of anterior-posterior displacement (p < 0.01) and medial-lateral velocity (p < 0.05) of the APAs. Also, when an obstacle was in place, PwPD showed higher APAs asymmetry (medial-lateral velocity: p < 0.002), with reduced and increased asymmetry of the cortical activity during APA and STEP-I phases, respectively. Conclusion Parkinson's disease were not motor asymmetric during GI, indicating that higher cortical activity asymmetry can be interpreted as an adaptive behavior to reduce motor asymmetry. In addition, the presence of obstacle did not regulate motor asymmetry during GI in PwPD.
Collapse
|
38
|
Xiao G, Wu T, Weng R, Zhang R, Han Y, Dong Y, Liang Y. NA-OR: A path optimization method for manipulators via node attraction and obstacle repulsion. SCIENCE CHINA. TECHNOLOGICAL SCIENCES 2023; 66:1205-1213. [PMID: 37153370 PMCID: PMC10104768 DOI: 10.1007/s11431-022-2238-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/25/2022] [Accepted: 10/08/2022] [Indexed: 05/09/2023]
Abstract
This paper is concerned with the issue of path optimization for manipulators in multi-obstacle environments. Aimed at overcoming the deficiencies of the sampling-based path planning algorithm with high path curvature and low safety margin, a path optimization method, named NA-OR, is proposed for manipulators, where the NA (node attraction) and OR (obstacle repulsion) functions are developed to refine the path by iterations. In the iterations of path optimization, the node attraction function is designed to pull the path nodes toward the center of their neighbor nodes, thereby reducing the path curvature and improving the smoothness. Also, the obstacle repulsion function is developed to push the path nodes out of the potentially unsafe region by generating a repulsive torque on the path nodes, thus improving the safety margin of the motion. By introducing the effect of NA-OR, the optimized path has a significant improvement in path curvature and safety margin compared with the initial path planned by Bi-RRT, which meaningfully enhances the operation ability of manipulators for the applications that give a strong emphasis on security. Experimental results on a 6-DOF manipulator in 4 scenarios demonstrate the effectiveness and superiority of the proposed method in terms of the path cost, safety margin, and path smoothness.
Collapse
|
39
|
Tang X, Li B, Du H. A Study on Dynamic Motion Planning for Autonomous Vehicles Based on Nonlinear Vehicle Model. SENSORS (BASEL, SWITZERLAND) 2022; 23:443. [PMID: 36617040 PMCID: PMC9824284 DOI: 10.3390/s23010443] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/12/2022] [Revised: 12/28/2022] [Accepted: 12/28/2022] [Indexed: 06/17/2023]
Abstract
Autonomous driving technology, especially motion planning and the trajectory tracking method, is the foundation of an intelligent interconnected vehicle, which needs to be improved urgently. Currently, research on path planning methods has improved, but few of the current studies consider the vehicle's nonlinear characteristics in the reference model, due to the heavy computational effort. At present, most of the algorithms are designed by a linear vehicle model in order to achieve the real-time performance at the cost of lost accuracy. To achieve a better performance, the dynamics and kinematics characteristics of the vehicle must be simulated, and real-time computing ensured at the same time. In this article, a Takagi-Sugeno fuzzy-model-based closed-loop rapidly exploring random tree algorithm with on-line re-planning process is applied to build the motion planner, which effectively improves the vehicle performance of dynamic obstacle avoidance, and plans the local obstacle avoidance path in line with the dynamic characteristics of the vehicle. A nonlinear vehicle model is integrated into the motion planner design directly. For fast local path planning mission, the Takagi-Sugeno fuzzy modelling method is applied to the modeling process in the planner design, so that the vehicle state can be directly utilized into the path planner to create a feasible path in real-time. The performance of the planner was evaluated by numerical simulation. The results demonstrate that the proposed motion planner can effectively generate a reference trajectory that guarantees driving efficiency with a lower re-planning rate.
Collapse
|
40
|
Malik RN, Marigold DS, Chow M, Lam T. Probing the deployment of peripheral visual attention during obstacle-crossing planning. Front Hum Neurosci 2022; 16:1039201. [PMID: 36618994 PMCID: PMC9813236 DOI: 10.3389/fnhum.2022.1039201] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2022] [Accepted: 11/29/2022] [Indexed: 12/24/2022] Open
Abstract
Gaze is directed to one location at a time, making peripheral visual input important for planning how to negotiate different terrain during walking. Whether and how the brain attends to this input is unclear. We developed a novel paradigm to probe the deployment of sustained covert visual attention by testing orientation discrimination of a Gabor patch at stepping and non-stepping locations during obstacle-crossing planning. Compared to remaining stationary, obstacle-crossing planning decreased visual performance (percent correct) and sensitivity (d') at only the first of two stepping locations. Given the timing of the first and second steps before obstacle crossing relative to the Gabor patch presentation, the results suggest the brain uses peripheral vision to plan one step at a time during obstacle crossing, in contrast to how it uses central vision to plan two or more steps in advance. We propose that this protocol, along with multiple possible variations, presents a novel behavioral approach to identify the role of covert visual attention during obstacle-crossing planning and other goal-directed walking tasks.
Collapse
|
41
|
Ferracuti F, Freddi A, Iarlori S, Monteriù A, Omer KIM, Porcaro C. A human-in-the-loop approach for enhancing mobile robot navigation in presence of obstacles not detected by the sensory set. Front Robot AI 2022; 9:909971. [PMID: 36523445 PMCID: PMC9744805 DOI: 10.3389/frobt.2022.909971] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2022] [Accepted: 11/07/2022] [Indexed: 04/20/2024] Open
Abstract
Human-in-the-loop approaches can greatly enhance the human-robot interaction by making the user an active part of the control loop, who can provide a feedback to the robot in order to augment its capabilities. Such feedback becomes even more important in all those situations where safety is of utmost concern, such as in assistive robotics. This study aims to realize a human-in-the-loop approach, where the human can provide a feedback to a specific robot, namely, a smart wheelchair, to augment its artificial sensory set, extending and improving its capabilities to detect and avoid obstacles. The feedback is provided by both a keyboard and a brain-computer interface: with this scope, the work has also included a protocol design phase to elicit and evoke human brain event-related potentials. The whole architecture has been validated within a simulated robotic environment, with electroencephalography signals acquired from different test subjects.
Collapse
|
42
|
Wu W, Zhang X, Miao Y. Starling-Behavior-Inspired Flocking Control of Fixed-Wing Unmanned Aerial Vehicle Swarm in Complex Environments with Dynamic Obstacles. Biomimetics (Basel) 2022; 7:biomimetics7040214. [PMID: 36546914 PMCID: PMC9775248 DOI: 10.3390/biomimetics7040214] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2022] [Revised: 11/21/2022] [Accepted: 11/21/2022] [Indexed: 11/29/2022] Open
Abstract
For the sake of accomplishing the rapidity, safety and consistency of obstacle avoidance for a large-scale unmanned aerial vehicle (UAV) swarm in a dynamic and unknown 3D environment, this paper proposes a flocking control algorithm that mimics the behavior of starlings. By analyzing the orderly and rapid obstacle avoidance behavior of a starling flock, a motion model inspired by a flock of starlings is built, which contains three kinds of motion patterns, including the collective pattern, evasion pattern and local-following pattern. Then, the behavior patterns of the flock of starlings are mapped on a fixed-wing UAV swarm to improve the ability of obstacle avoidance. The key contribution of this paper is collective and collision-free motion planning for UAV swarms in unknown 3D environments with dynamic obstacles. Numerous simulations are conducted in different scenarios and the results demonstrate that the proposed algorithm improves the speed, order and safety of the UAV swarm when avoiding obstacles.
Collapse
|
43
|
Sadi MS, Alotaibi M, Islam MR, Islam MS, Alhmiedat T, Bassfar Z. Finger-Gesture Controlled Wheelchair with Enabling IoT. SENSORS (BASEL, SWITZERLAND) 2022; 22:8716. [PMID: 36433326 PMCID: PMC9693444 DOI: 10.3390/s22228716] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/05/2022] [Revised: 10/30/2022] [Accepted: 11/07/2022] [Indexed: 06/16/2023]
Abstract
Modern wheelchairs, with advanced and robotic technologies, could not reach the life of millions of disabled people due to their high costs, technical limitations, and safety issues. This paper proposes a gesture-controlled smart wheelchair system with an IoT-enabled fall detection mechanism to overcome these problems. It can recognize gestures using Convolutional Neural Network (CNN) model along with computer vision algorithms and can control the wheelchair automatically by utilizing these gestures. It maintains the safety of the users by performing fall detection with IoT-based emergency messaging systems. The development cost of the overall system is cheap and is lesser than USD 300. Hence, it is expected that the proposed smart wheelchair should be affordable, safe, and helpful to physically disordered people in their independent mobility.
Collapse
|
44
|
Muroi D, Ohtera S, Saito Y, Koyake A, Higuchi T. Pathophysiological and motor factors associated with collision avoidance behavior in individuals with stroke. NeuroRehabilitation 2022; 52:155-163. [PMID: 36278363 DOI: 10.3233/nre-220174] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
BACKGROUND High collision rates and frequency of entering the opening from non-paretic sides are associated with collision in individuals with stroke. OBJECTIVE To identify factors associated with collision avoidance behavior when individuals with stroke walked through narrow openings. METHODS Participants with subacute or chronic stroke walked through a narrow opening and had to avoid colliding with obstacles. Multiple regression analyses were conducted with pathophysiology, motor function, and judgment ability as predictor variables; collision rate and frequency of entering the opening from non-paretic sides were outcome variables. RESULTS Sixty-one eligible individuals with stroke aged 63±12 years were enrolled. Thirty participants collided twice or more and 37 entered the opening from the non-paretic side. Higher collision occurrence was associated with slower Timed Up and Go tests and left-right sway (odds ratios, 1.2 and 5.6; 95% confidence intervals, 1.1-1.3 and 1.3-28.2; p = .008 and.025, respectively). Entering from non-paretic sides was associated with lesions in the thalamus, left-sided hemiplegia, and Brunnstrom stage 3 or lower (odds ratios, 6.6, 8.7, and 6.7; 95% confidence intervals, 1.3-52.5, 2.5-36.5, and 1.2-57.5; and p = .038,.001, and.048, respectively). CONCLUSION Walking ability is associated with avoiding obstacle collision, while pathophysiological characteristics and degree of paralysis are associated with a preference for which side of the body enters an opening first. Interventions to improve walking ability may improve collision avoidance. Avoidance behavior during intervention varies depending on the lesion position.
Collapse
|
45
|
Imad M, Doukhi O, Lee DJ, Kim JC, Kim YJ. Deep Learning-Based NMPC for Local Motion Planning of Last-Mile Delivery Robot. SENSORS (BASEL, SWITZERLAND) 2022; 22:8101. [PMID: 36365800 PMCID: PMC9655314 DOI: 10.3390/s22218101] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/06/2022] [Revised: 09/29/2022] [Accepted: 10/08/2022] [Indexed: 06/16/2023]
Abstract
Feasible local motion planning for autonomous mobile robots in dynamic environments requires predicting how the scene evolves. Conventional navigation stakes rely on a local map to represent how a dynamic scene changes over time. However, these navigation stakes depend highly on the accuracy of the environmental map and the number of obstacles. This study uses semantic segmentation-based drivable area estimation as an alternative representation to assist with local motion planning. Notably, a realistic 3D simulator based on an Unreal Engine was created to generate a synthetic dataset under different weather conditions. A transfer learning technique was used to train the encoder-decoder model to segment free space from the occupied sidewalk environment. The local planner uses a nonlinear model predictive control (NMPC) scheme that inputs the estimated drivable space, the state of the robot, and a global plan to produce safe velocity commands that minimize the tracking cost and actuator effort while avoiding collisions with dynamic and static obstacles. The proposed approach achieves zero-shot transfer from a simulation to real-world environments that have never been experienced during training. Several intensive experiments were conducted and compared with the dynamic window approach (DWA) to demonstrate the effectiveness of our system in dynamic sidewalk environments.
Collapse
|
46
|
Choutri K, Lagha M, Meshoul S, Fadloun S. Path Planning and Formation Control for UAV-Enabled Mobile Edge Computing Network. SENSORS (BASEL, SWITZERLAND) 2022; 22:7243. [PMID: 36236342 PMCID: PMC9572838 DOI: 10.3390/s22197243] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/25/2022] [Revised: 09/17/2022] [Accepted: 09/20/2022] [Indexed: 06/16/2023]
Abstract
Recent developments in unmanned aerial vehicles (UAVs) have led to the introduction of a wide variety of innovative applications, especially in the Mobile Edge Computing (MEC) field. UAV swarms are suggested as a promising solution to cope with the issues that may arise when connecting Internet of Things (IoT) applications to a fog platform. We are interested in a crucial aspect of designing a swarm of UAVs in this work, which is the coordination of swarm agents in complicated and unknown environments. Centralized leader-follower formations are one of the most prevalent architectural designs in the literature. In the event of a failed leader, however, the entire mission is canceled. This paper proposes a framework to enable the use of UAVs under different MEC architectures, overcomes the drawbacks of centralized architectures, and improves their overall performance. The most significant contribution of this research is the combination of distributed formation control, online leader election, and collaborative obstacle avoidance. For the initial phase, the optimal path between departure and arrival points is generated, avoiding obstacles and agent collisions. Next, a quaternion-based sliding mode controller is designed for formation control and trajectory tracking. Moreover, in the event of a failed leader, the leader election phase allows agents to select the most qualified leader for the formation. Multiple possible scenarios simulating real-time applications are used to evaluate the framework. The obtained results demonstrate the capability of UAVs to adapt to different MEC architectures under different constraints. Lastly, a comparison is made with existing structures to demonstrate the effectiveness, safety, and durability of the designed framework.
Collapse
|
47
|
Wang S, Song J, Qi P, Yuan C, Wu H, Zhang L, Liu W, Liu Y, He X. Design and development of orchard autonomous navigation spray system. FRONTIERS IN PLANT SCIENCE 2022; 13:960686. [PMID: 35979071 PMCID: PMC9376256 DOI: 10.3389/fpls.2022.960686] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/03/2022] [Accepted: 06/30/2022] [Indexed: 06/15/2023]
Abstract
Driven by the demand for efficient plant protection in orchards, the autonomous navigation system for orchards is hereby designed and developed in this study. According to the three modules of unmanned system "perception-decision-control," the environment perception and map construction strategy based on 3D lidar is constructed for the complex environment in orchards. At the same time, millimeter-wave radar is further selected for multi-source information fusion for the perception of obstacles. The extraction of orchard navigation lines is achieved by formulating a four-step extraction strategy according to the obtained lidar data. Finally, aiming at the control problem of plant protection machine, the ADRC control strategy is adopted to enhance the noise immunity of the system. Different working conditions are designed in the experimental section for testing the obstacle avoidance performance and navigation accuracy of the autonomous navigation sprayer. The experimental results show that the unmanned vehicle can identify the obstacle quickly and make an emergency stop and find a rather narrow feasible area when a moving person or a different thin column is used as an obstacle. Many experiments have shown a safe distance for obstacle avoidance about 0.5 m, which meets the obstacle avoidance requirements. In the navigation accuracy experiment, the average navigation error in both experiments is within 15 cm, satisfying the requirements for orchard spray operation. A set of spray test experiments are designed in the final experimental part to further verify the feasibility of the system developed by the institute, and the coverage rate of the leaves of the canopy is about 50%.
Collapse
|
48
|
Yang J, Ni J, Li Y, Wen J, Chen D. The Intelligent Path Planning System of Agricultural Robot via Reinforcement Learning. SENSORS 2022; 22:s22124316. [PMID: 35746099 PMCID: PMC9227048 DOI: 10.3390/s22124316] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/09/2022] [Revised: 05/29/2022] [Accepted: 06/04/2022] [Indexed: 01/27/2023]
Abstract
Agricultural robots are one of the important means to promote agricultural modernization and improve agricultural efficiency. With the development of artificial intelligence technology and the maturity of Internet of Things (IoT) technology, people put forward higher requirements for the intelligence of robots. Agricultural robots must have intelligent control functions in agricultural scenarios and be able to autonomously decide paths to complete agricultural tasks. In response to this requirement, this paper proposes a Residual-like Soft Actor Critic (R-SAC) algorithm for agricultural scenarios to realize safe obstacle avoidance and intelligent path planning of robots. In addition, in order to alleviate the time-consuming problem of exploration process of reinforcement learning, this paper proposes an offline expert experience pre-training method, which improves the training efficiency of reinforcement learning. Moreover, this paper optimizes the reward mechanism of the algorithm by using multi-step TD-error, which solves the probable dilemma during training. Experiments verify that our proposed method has stable performance in both static and dynamic obstacle environments, and is superior to other reinforcement learning algorithms. It is a stable and efficient path planning method and has visible application potential in agricultural robots.
Collapse
|
49
|
Chin DD, Lentink D. Birds both avoid and control collisions by harnessing visually guided force vectoring. J R Soc Interface 2022; 19:20210947. [PMID: 35702862 PMCID: PMC9198520 DOI: 10.1098/rsif.2021.0947] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2021] [Accepted: 05/16/2022] [Indexed: 11/12/2022] Open
Abstract
Birds frequently manoeuvre around plant clutter in complex-structured habitats. To understand how they rapidly negotiate obstacles while flying between branches, we measured how foraging Pacific parrotlets avoid horizontal strings obstructing their preferred flight path. Informed by visual cues, the birds redirect forces with their legs and wings to manoeuvre around the obstacle and make a controlled collision with the goal perch. The birds accomplish aerodynamic force vectoring by adjusting their body pitch, stroke plane angle and lift-to-drag ratios beat-by-beat, resulting in a range of about 100° relative to the horizontal plane. The key role of drag in force vectoring revises earlier ideas on how the avian stroke plane and body angle correspond to aerodynamic force direction-providing new mechanistic insight into avian manoeuvring-and how the evolution of flight may have relied on harnessing drag.
Collapse
|
50
|
Muroi D, Saito Y, Koyake A, Yasuda K, Higuchi T. Walking through a narrow opening improves collision avoidance behavior in a patient with stroke and unilateral spatial neglect: an ABA single-case design. Neurocase 2022; 28:149-157. [PMID: 35465827 DOI: 10.1080/13554794.2022.2042566] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Abstract
We investigated the effect of a 3-week intervention-wherein a patient with unilateral spatial neglect walks through a narrow opening while entering from the contralesional side-to improve walking ability or ADL. A 66-year-old man was diagnosed with right parietal subcortical hemorrhage. We used an ABA single-case design; period B was set as the intervention. The intervention improved the continuous walking distance and balance ability and decreased the number of collisions when walking through the narrow opening; however, it exerted minimal effect on ADL. Thus, the intervention may effectively improve continuous physical or spatial attention behavior, regardless of ADL improvement.
Collapse
|