Generic Neural Locomotion Control Framework for Legged Robots

Research on control strategy of pneumatic soft bionic robot based on improved CPG

To achieve the accuracy and anti-interference of the motion control of the soft robot more effectively, the motion control strategy of the pneumatic soft bionic robot based on the improved Central Pattern Generator (CPG) is proposed. According to the structure and motion characteristics of the robot, a two-layer neural network topology model for the robot is constructed by coupling 22 Hopfield neuron nonlinear oscillators. Then, based on the Adaptive Neuro-Fuzzy Inference System (ANFIS), the membership functions are offline learned and trained to construct the CPG-ANFIS-PID motion control strategy for the robot. Through simulation research on the impact of CPG-ANFIS-PID input parameters on the swimming performance of the robot, it is verified that the control strategy can quickly respond to input parameter changes between different swimming modes, and stably output smooth and continuous dynamic position signals, which has certain advantages. Then, the motion performance of the robot prototype is analyzed experimentally and compared with the simulation results. The results show that the CPG-ANFIS-PID motion control strategy can output coupled waveform signals stably, and control the executing mechanisms of the pneumatic soft bionic robot to achieve biological rhythms motion propulsion waveforms, confirming that the control strategy has accuracy and anti-interference characteristics, and enable the robot have certain maneuverability, flexibility, and environmental adaptability. The significance of this work lies in establishing a CPG-ANFIS-PID control strategy applicable to pneumatic soft bionic robot and proposing a rhythmic motion control method applicable to pneumatic soft bionic robot.

Hybrid learning mechanisms under a neural control network for various walking speed generation of a quadruped robot

Legged robots that can instantly change motor patterns at different walking speeds are useful and can accomplish various tasks efficiently. However, state-of-the-art control methods either are difficult to develop or require long training times. In this study, we present a comprehensible neural control framework to integrate probability-based black-box optimization (PIBB) and supervised learning for robot motor pattern generation at various walking speeds. The control framework structure is based on a combination of a central pattern generator (CPG), a radial basis function (RBF) -based premotor network and a hypernetwork, resulting in a so-called neural CPG-RBF-hyper control network. First, the CPG-driven RBF network, acting as a complex motor pattern generator, was trained to learn policies (multiple motor patterns) for different speeds using PIBB. We also introduce an incremental learning strategy to avoid local optima. Second, the hypernetwork, which acts as a task/behavior to control parameter mapping, was trained using supervised learning. It creates a mapping between the internal CPG frequency (reflecting the walking speed) and motor behavior. This map represents the prior knowledge of the robot, which contains the optimal motor joint patterns at various CPG frequencies. Finally, when a user-defined robot walking frequency or speed is provided, the hypernetwork generates the corresponding policy for the CPG-RBF network. The result is a versatile locomotion controller which enables a quadruped robot to perform stable and robust walking at different speeds without sensory feedback. The policy of the controller was trained in the simulation (less than 1 h) and capable of transferring to a real robot. The generalization ability of the controller was demonstrated by testing the CPG frequencies that were not encountered during training.

Computed torque control and force analysis for mechanical leg with variable rotation axis powered by servo pneumatic muscle

It is difficult for a humanoid leg driven by two groups of antagonistic pneumatic muscles (PMs) to achieve a flexible humanoid gait, and its inherent strong coupling nonlinear characteristics make it hard to achieve good tracking performance in a large range of motion. Therefore, a four-bar linkage bionic knee joint structure with a variable axis and a double closed-loop servo position control strategy based on computed torque control are designed to improve anthropomorphic characteristics and the dynamic performance of the bionic mechanical leg powered by servo pneumatic muscle (SPM). Firstly, the relationship between the joint torque, the initial jump angle and the bounce height of the mechanical leg is established, and then we design a double-joint PM bionic mechanical leg containing a four-bar linkage mechanism of the knee joint. Secondly, a cascade position control strategy is developed, which consists of the outer position loop and the inner contraction force loop, and the mapping relationship is designed between joint torque and antagonistic PM contraction force. Finally, we further project bounce action timing of mechanical leg to realize the periodic jumping movement of the mechanical leg, and simulation and physical experiments of the real-style machine platform have been provided to demonstrate the effectiveness of the designed SPM controller.

A CPG-Based Versatile Control Framework for Metameric Earthworm-Like Robotic Locomotion

Annelids such as earthworms are considered to have central pattern generators (CPGs) that generate rhythms in neural circuits to coordinate the deformation of body segments for effective locomotion. At present, the states of earthworm-like robot segments are often assigned holistically and artificially by mimicking the earthworms' retrograde peristalsis wave, which is unable to adapt their gaits for variable environments and tasks. This motivates the authors to extend the bioinspired research from morphology to neurobiology by mimicking the CPG to build a versatile framework for spontaneous motion control. Here, the spatiotemporal dynamics is exploited from the coupled Hopf oscillators to not only unify the two existing gait generators for restoring temporal-symmetric phase-coordinated gaits and discrete gaits but also generate novel temporal-asymmetric phase-coordinated gaits. Theoretical and experimental tests consistently confirm that the introduction of temporal asymmetry improves the robot's locomotion performance. The CPG-based controller also enables seamless online switching of locomotion gaits to avoid abrupt changes, sharp stops, and starts, thus improving the robot's adaptability in variable working scenarios.

Robust and reusable self-organized locomotion of legged robots under adaptive physical and neural communications

Introduction

Animals such as cattle can achieve versatile and elegant behaviors through automatic sensorimotor coordination. Their self-organized movements convey an impression of adaptability, robustness, and motor memory. However, the adaptive mechanisms underlying such natural abilities of these animals have not been completely realized in artificial legged systems.

Methods

Hence, we propose adaptive neural control that can mimic these abilities through adaptive physical and neural communications. The control algorithm consists of distributed local central pattern generator (CPG)-based neural circuits for generating basic leg movements, an adaptive sensory feedback mechanism for generating self-organized phase relationships among the local CPG circuits, and an adaptive neural coupling mechanism for transferring and storing the formed phase relationships (a gait pattern) into the neural structure. The adaptive neural control was evaluated in experiments using a quadruped robot.

Results

The adaptive neural control enabled the robot to 1) rapidly and automatically form its gait (i.e., self-organized locomotion) within a few seconds, 2) memorize the gait for later recovery, and 3) robustly walk, even when a sensory feedback malfunction occurs. It also enabled maneuverability, with the robot being able to change its walking speed and direction. Moreover, implementing adaptive physical and neural communications provided an opportunity for understanding the mechanism of motor memory formation.

Discussion

Overall, this study demonstrates that the integration of the two forms of communications through adaptive neural control is a powerful way to achieve robust and reusable self-organized locomotion in legged robots.

A Trust-Assist Framework for Human–Robot Co-Carry Tasks

Robots are increasingly being employed for diverse applications where they must work and coexist with humans. The trust in human–robot collaboration (HRC) is a critical aspect of any shared-task performance for both the human and the robot. The study of a human-trusting robot has been investigated by numerous researchers. However, a robot-trusting human, which is also a significant issue in HRC, is seldom explored in the field of robotics. Motivated by this gap, we propose a novel trust-assist framework for human–robot co-carry tasks in this study. This framework allows the robot to determine a trust level for its human co-carry partner. The calculations of this trust level are based on human motions, past interactions between the human–robot pair, and the human’s current performance in the co-carry task. The trust level between the human and the robot is evaluated dynamically throughout the collaborative task, and this allows the trust to change if the human performs false positive actions, which can help the robot avoid making unpredictable movements and causing injury to the human. Additionally, the proposed framework can enable the robot to generate and perform assisting movements to follow human-carrying motions and paces when the human is considered trustworthy in the co-carry task. The results of our experiments suggest that the robot effectively assists the human in real-world collaborative tasks through the proposed trust-assist framework.

A gecko-inspired robot with CPG-based neural control for locomotion and body height adaptation

Today's gecko-inspired robots have shown the ability of omnidirectional climbing on slopes with a low centre of mass. However, such an ability cannot efficiently cope with bumpy terrains or terrains with obstacles. In this study, we developed a gecko-inspired robot (Nyxbot) with an adaptable body height to overcome this limitation. Based on an analysis of the skeletal system and kinematics of real geckos, the adhesive mechanism and leg structure design of the robot were designed to endow it with adhesion and adjustable body height capabilities. Neural control with exteroceptive sensory feedback is utilised to realise body height adaptability while climbing on a slope. The locomotion performance and body adaptability of the robot were tested by conducting slope climbing and obstacle crossing experiments. The gecko robot can climb a 30° slope with spontaneous obstacle crossing (maximum obstacle height of 38% of the body height) and can climb even steeper slopes (up to 60°) without an obstacle or bump. Using 3D force measuring platforms for ground reaction force analysis of geckos and the robot, we show that the motions of the developed robot driven by neural control and the motions of geckos are dynamically comparable. To this end, this study provides a basis for developing climbing robots with adaptive bump/obstacle crossing on slopes towards more agile and versatile gecko-like locomotion.

NeuroVis: Real-Time Neural Information Measurement and Visualization of Embodied Neural Systems

Understanding the real-time dynamical mechanisms of neural systems remains a significant issue, preventing the development of efficient neural technology and user trust. This is because the mechanisms, involving various neural spatial-temporal ingredients [i.e., neural structure (NS), neural dynamics (ND), neural plasticity (NP), and neural memory (NM)], are too complex to interpret and analyze altogether. While advanced tools have been developed using explainable artificial intelligence (XAI), node-link diagram, topography map, and other visualization techniques, they still fail to monitor and visualize all of these neural ingredients online. Accordingly, we propose here for the first time "NeuroVis," real-time neural spatial-temporal information measurement and visualization, as a method/tool to measure temporal neural activities and their propagation throughout the network. By using this neural information along with the connection strength and plasticity, NeuroVis can visualize the NS, ND, NM, and NP via i) spatial 2D position and connection, ii) temporal color gradient, iii) connection thickness, and iv) temporal luminous intensity and change of connection thickness, respectively. This study presents three use cases of NeuroVis to evaluate its performance: i) function approximation using a modular neural network with recurrent and feedforward topologies together with supervised learning, ii) robot locomotion control and learning using the same modular network with reinforcement learning, and iii) robot locomotion control and adaptation using another larger-scale adaptive modular neural network. The use cases demonstrate how NeuroVis tracks and analyzes all neural ingredients of various (embodied) neural systems in real-time under the robot operating system (ROS) framework. To this end, it will offer the opportunity to better understand embodied dynamic neural information processes, boost efficient neural technology development, and enhance user trust.

Locomotion Control With Frequency and Motor Pattern Adaptations

Existing adaptive locomotion control mechanisms for legged robots are usually aimed at one specific type of adaptation and rarely combined with others. Adaptive mechanisms thus stay at a conceptual level without their coupling effect with other mechanisms being investigated. However, we hypothesize that the combination of adaptation mechanisms can be exploited for enhanced and more efficient locomotion control as in biological systems. Therefore, in this work, we present a central pattern generator (CPG) based locomotion controller integrating both a frequency and motor pattern adaptation mechanisms. We use the state-of-the-art Dual Integral Learner for frequency adaptation, which can automatically and quickly adapt the CPG frequency, enabling the entire motor pattern or output signal of the CPG to be followed at a proper high frequency with low tracking error. Consequently, the legged robot can move with high energy efficiency and perform the generated locomotion with high precision. The versatile state-of-the-art CPG-RBF network is used as a motor pattern adaptation mechanism. Using this network, the motor patterns or joint trajectories can be adapted to fit the robot's morphology and perform sensorimotor integration enabling online motor pattern adaptation based on sensory feedback. The results show that the two adaptation mechanisms can be combined for adaptive locomotion control of a hexapod robot in a complex environment. Using the CPG-RBF network for motor pattern adaptation, the hexapod learned basic straight forward walking, steering, and step climbing. In general, the frequency and motor pattern mechanisms complement each other well and their combination can be seen as an essential step toward further studies on adaptive locomotion control.

Insect-Inspired Robots: Bridging Biological and Artificial Systems

This review article aims to address common research questions in hexapod robotics. How can we build intelligent autonomous hexapod robots that can exploit their biomechanics, morphology, and computational systems, to achieve autonomy, adaptability, and energy efficiency comparable to small living creatures, such as insects? Are insects good models for building such intelligent hexapod robots because they are the only animals with six legs? This review article is divided into three main sections to address these questions, as well as to assist roboticists in identifying relevant and future directions in the field of hexapod robotics over the next decade. After an introduction in section (1), the sections will respectively cover the following three key areas: (2) biomechanics focused on the design of smart legs; (3) locomotion control; and (4) high-level cognition control. These interconnected and interdependent areas are all crucial to improving the level of performance of hexapod robotics in terms of energy efficiency, terrain adaptability, autonomy, and operational range. We will also discuss how the next generation of bioroboticists will be able to transfer knowledge from biology to robotics and vice versa.

Estimation of knee and ankle angles during walking using thigh and shank angles

Estimation of joints' trajectories is commonly used in human gait analysis, and in the development of motion planners and high-level controllers for prosthetics, orthotics, exoskeletons and humanoids. Human locomotion is the result of the cooperation between leg joints and limbs. This suggests the existence of underlying relationships between them which lead to a harmonic gait. In this study we aimed to estimate knee and ankle trajectories using thigh and shank angles. To do so, an estimation approach was developed that continuously mapped the inputs to the outputs, which did not require switching rules, speed estimation, gait percent identification or look-up tables. The estimation algorithm was based on a nonlinear auto-regressive model with exogenous inputs. The method was then combined with wavelets theory, and then the two were used in a neural network. To evaluate the estimation performance, three scenarios were developed which used only one source of inputs (i.e., only shank angles or only thigh angles). First, knee anglesθ_k(outputs) were estimated using thigh anglesθ_th(inputs). Second, ankle anglesθ_a(outputs) were estimated using thigh anglesθ_sh(inputs), and third, the ankle angles were estimated using shank angles (inputs). The proposed approach was investigated for 22 subjects at different walking speeds and the leave-one-subject-out procedure was used for training and testing the estimation algorithm. Average root mean square errors were 3.9°-5.3° and 2.1°-2.3° for knee and ankle angles, respectively. Average mean absolute errors (MAEs) MAEs were 3.2°-4° and 1.7°-1.8°, and average correlation coefficientsρ_ccwere 0.95-0.98 and 0.94-0.96 for knee and ankle angles, respectively. The limitations and strengths of the proposed approach are discussed in detail and the results are compared with several studies.

Distributed-force-feedback-based reflex with online learning for adaptive quadruped motor control

Biological motor control mechanisms (e.g., central pattern generators (CPGs), sensory feedback, reflexes, and motor learning) play a crucial role in the adaptive locomotion of animals. However, the interaction and integration of these mechanisms - necessary for generating the efficient, adaptive locomotion responses of legged robots to diverse terrains - have not yet been fully realized. One issue is that of achieving adaptive motor control for fast postural adaptation across various terrains. To address this issue, this study proposes a novel distributed-force-feedback-based reflex with online learning (DFRL). It integrates force-sensory feedback, reflexes, and learning to cooperate with CPGs in producing adaptive motor commands. The DFRL is based on a simple neural network that uses plastic synapses modulated online by a fast dual integral learner. Experimental results on different quadruped robots show that the DFRL can (1) automatically and rapidly adapt the CPG patterns (motor commands) of the robots, enabling them to realize appropriate body postures during locomotion and (2) enable the robots to effectively accommodate themselves to various slope terrains, including steep ones. Consequently, the DFRL-controlled robots can achieve efficient adaptive locomotion, to tackle complex terrains with diverse slopes.