Review of Vision-Based Environmental Perception for Lower-Limb Exoskeleton Robots

The exoskeleton robot is a wearable electromechanical device inspired by animal exoskeletons. It combines technologies such as sensing, control, information, and mobile computing, enhancing human physical abilities and assisting in rehabilitation training. In recent years, with the development of visual sensors and deep learning, the environmental perception of exoskeletons has drawn widespread attention in the industry. Environmental perception can provide exoskeletons with a certain level of autonomous perception and decision-making ability, enhance their stability and safety in complex environments, and improve the human-machine-environment interaction loop. This paper provides a review of environmental perception and its related technologies of lower-limb exoskeleton robots. First, we briefly introduce the visual sensors and control system. Second, we analyze and summarize the key technologies of environmental perception, including related datasets, detection of critical terrains, and environment-oriented adaptive gait planning. Finally, we analyze the current factors limiting the development of exoskeleton environmental perception and propose future directions.

Biomimetic lizard robot for adapting to Martian surface terrain

The exploration of the planet Mars still is a top priority in planetary science. The Mars surface is extensively covered with soil-like material. Current wheeled rovers on Mars have been occasionally experiencing immobilization instances in unexpectedly weak terrains. The development of Mars rovers adaptable to these terrains is instrumental in improving exploration efficiency. Inspired by locomotion of the desert lizard, this paper illustrates a biomimetic quadruped robot with structures of flexible active spine and toes. By accounting for spine lateral flexion and its coordination with four leg movements, three gaits of tripod, trot and turning are designed. The motions corresponding to the three gaits are conceptually and numerically analyzed. On the granular terrains analog to Martian surface, the gasping forces by the active toes are estimated. Then traversing tests for the robot to move on Martian soil surface analog with the three gaits were investigated. Moreover, the traversing characteristics for Martian rocky and slope surface analog are analyzed. Results show that the robot can traverse Martian soil surface analog with maximum forward speed 28.13 m s-1turning speed 1.94° s-1and obstacle height 74.85 mm. The maximum angle for climbing Martian soil slope analog is 28°, corresponding slippery rate 76.8%. It is predicted that this robot can adapt to Martian granular rough terrain with gentle slopes.

Design and Motion Analysis of a Soft-Limb Robot Inspired by Bacterial Flagella

Soft robots demonstrate an impressive ability to adapt to objects and environments. However, current soft mobile robots often use a single mode of movement. This gives soft robots good locomotion performance in specific environments but poor performance in others. In this paper, we propose a leg-wheel mechanism inspired by bacterial flagella and use it to design a leg-wheel robot. This mechanism employs a tendon-driven continuum structure to replicate the bacterial flagellar filaments, while servo and gear components mimic the action of bacterial flagellar motors. By utilizing twisting and swinging motions of the continuum structure, the robot achieves both wheeled and legged locomotion. The paper provides comprehensive descriptions and detailed kinematic analysis of the mechanism and the robot. To verify the feasibility of the robot, a prototype was implemented, and experiments were performed on legged mode, wheeled mode, and post-overturning motion. The experimental results demonstrate that the robot can achieve legged and wheeled motions. Moreover, it is also demonstrated that the robot still has mobility after overturning. This expands the applicability scenarios of the current soft mobile robot.

Research on Walking Gait Planning and Simulation of a Novel Hybrid Biped Robot

A kinematics analysis of a new hybrid mechanical leg suitable for bipedal robots was carried out and the gait of the robot walking on flat ground was planned. Firstly, the kinematics of the hybrid mechanical leg were analyzed and the applicable relevant models were established. Secondly, based on the preliminary motion requirements, the inverted pendulum model was used to divide the robot walking into three stages for gait planning: mid-step, start and stop. In the three stages of robot walking, the forward and lateral robot centroid motion trajectories and the swinging leg joint trajectories were calculated. Finally, dynamic simulation software was used to simulate the virtual prototype of the robot, achieving its stable walking on flat ground in the virtual environment, and verifying the feasibility of the mechanism design and gait planning. This study provides a reference for the gait planning of hybrid mechanical legged bipedal robots and lays the foundation for further research on the robots involved in this thesis.

A Novel Balance Control Strategy Based on Enhanced Stability Pyramid Index and Dynamic Movement Primitives for a Lower Limb Human-Exoskeleton System

The lower limb exoskeleton is playing an increasing role in enabling individuals with spinal cord injury (SCI) to stand upright, walk, turn, and so on. Hence, it is essential to maintain the balance of the human-exoskeleton system during movements. However, the balance of the human-exoskeleton system is challenging to maintain. There are no effective balance control strategies because most of them can only be used in a specific movement like walking or standing. Hence, the primary aim of the current study is to propose a balance control strategy to improve the balance of the human-exoskeleton system in dynamic movements. This study proposes a new safety index named Enhanced Stability Pyramid Index (ESPI), and a new balance control strategy is based on the ESPI and the Dynamic Movement Primitives (DMPs). To incorporate dynamic information of the system, the ESPI employs eXtrapolated Center of Mass (XCoM) instead of the center of mass (CoM). Meanwhile, Time-to-Contact (TTC), the urgency of safety, is used as an automatic weight assignment factor of ESPI instead of the traditional manual one. Then, the balance control strategy utilizing DMPs to generate the gait trajectory according to the scalar and vector values of the ESPI is proposed. Finally, the walking simulation in Gazebo and the experiments of the human-exoskeleton system verify the effectiveness of the index and balance control strategy.

Lower Limb Exoskeleton Gait Planning Based on Crutch and Human-Machine Foot Combined Center of Pressure

With the help of wearable robotics, the lower limb exoskeleton becomes a promising solution for spinal cord injury (SCI) patients to recover lower body locomotion ability. However, fewer exoskeleton gait planning methods can meet the needs of patient in real time, e.g., stride length or step width, etc., which may lead to human-machine incoordination, limit comfort, and increase the risk of falling. This work presents a human-exoskeleton-crutch system with the center of pressure (CoP)-based gait planning method to enable the balance control during the exoskeleton-assisted walking with crutches. The CoP generated by crutches and human-machine feet makes it possible to obtain the overall stability conditions of the system in the process of exoskeleton-assisted quasi-static walking, and therefore, to determine the next stride length and ensure the balance of the next step. Thus, the exoskeleton gait is planned with the guidance of stride length. It is worth emphasizing that the nominal reference gait is adopted as a reference to ensure that the trajectory of the swing ankle mimics the reference one well. This gait planning method enables the patient to adaptively interact with the exoskeleton gait. The online gait planning walking tests with five healthy volunteers proved the method's feasibility. Experimental results indicate that the algorithm can deal with the sensed signals and plan the landing point of the swing leg to ensure balanced and smooth walking. The results suggest that the method is an effective means to improve human-machine interaction. Additionally, it is meaningful for the further training of independent walking stability control in exoskeletons for SCI patients with less assistance of crutches.

CPG-Based Gait Generation of the Curved-Leg Hexapod Robot with Smooth Gait Transition

This paper presents a novel CPG-based gait generation of the curved-leg hexapod robot that can enable smooth gait transitions between multi-mode gaits. First, the locomotion of the curved leg and instability during the gait transitions are analyzed. Then, a modified Hopf oscillator is applied in the CPG control, which can realize multiple gaits by adjusting a simple parameter. In addition, a smooth gait switching method is also proposed via smooth gait transition functions and gait planning. Tripod gait, quadruped gait, and wave gait are planned for the hexapod robot to achieve quick and stable gait transitions smoothly and continuously. MATLAB and ADAMS simulations and corresponding practical experiments are conducted. The results show that the proposed method can achieve smooth and continuous mutual gait transitions, which proves the effectiveness of the proposed CPG-based hexapod robot control.

Adaptive Spatial Filter Based on Similarity Indices to Preserve the Neural Information on EEG Signals during On-Line Processing

This work presents a new on-line adaptive filter, which is based on a similarity analysis between standard electrode locations, in order to reduce artifacts and common interferences throughout electroencephalography (EEG) signals, but preserving the useful information. Standard deviation and Concordance Correlation Coefficient (CCC) between target electrodes and its correspondent neighbor electrodes are analyzed on sliding windows to select those neighbors that are highly correlated. Afterwards, a model based on CCC is applied to provide higher values of weight to those correlated electrodes with lower similarity to the target electrode. The approach was applied to brain computer-interfaces (BCIs) based on Canonical Correlation Analysis (CCA) to recognize 40 targets of steady-state visual evoked potential (SSVEP), providing an accuracy (ACC) of 86.44 ± 2.81%. In addition, also using this approach, features of low frequency were selected in the pre-processing stage of another BCI to recognize gait planning. In this case, the recognition was significantly (p<0.01) improved for most of the subjects (ACC≥74.79%), when compared with other BCIs based on Common Spatial Pattern, Filter Bank-Common Spatial Pattern, and Riemannian Geometry.

Facilitation of cutaneous inputs during the planning phase of gait initiation

It has been shown that during the planning of a voluntary movement the transmission of cutaneous afferent inputs to the somatosensory cortex is attenuated shortly before the motor output as well as during movement execution. However, it is not known whether the sensory suppression observed during the planning phase (i.e., before any movement execution) is a systemic phenomenon or whether it is dependent on movement context. For example, movements such as step initiation are controlled based on information received from cutaneous receptors in the feet. Because afferent information emerging from these receptors is critical for movement initiation, we hypothesized that suppression of these inputs may not occur during the planning phase prior to gait initiation. To examine this hypothesis we measured the cortical response to somatosensory stimulation during the planning phase of step initiation and during movement execution. Sensitivity to cutaneous stimulation was assessed by measuring the amplitude of the cortical somatosensory-evoked potential (SEP, over the Cz electrode) following electrical stimulations of the plantar sole of one foot. Two stimulations were provided during the planning phase of a step movement and two stimulations during movement execution. It was found that the P50-N80 SEP was facilitated in the early planning phase (-700 ms before motor execution) compared with when participants remained still (control standing task). This mechanism might contribute to an enhanced perception of cutaneous input leading to a more accurate setting of the forces to be exerted onto the ground to shift the body's weight toward the supporting side prior to foot-off.