Biped locomotion control with evolved adaptive center-crossing continuous time recurrent neural networks

Multiobjective Evolution of Biped Robot Gaits Using Advanced Continuous Ant-Colony Optimized Recurrent Neural Networks

This paper proposes the optimization of a fully connected recurrent neural network (FCRNN) using advanced multiobjective continuous ant colony optimization (AMO-CACO) for the multiobjective gait generation of a biped robot (the NAO). The FCRNN functions as a central pattern generator and is optimized to generate angles of the hip roll and pitch, the knee pitch, and the ankle pitch and roll. The performance of the FCRNN-generated gait is evaluated according to the walking speed, trajectory straightness, oscillations of the body in the pitch and yaw directions, and walking posture, subject to the basic constraints that the robot cannot fall down and must walk forward. This paper formulates this gait generation task as a constrained multiobjective optimization problem and solves this problem through an AMO-CACO-based evolutionary learning approach. The AMO-CACO finds Pareto optimal solutions through ant-path selection and sampling operations by introducing an accumulated rank for the solutions in each single-objective function into solution sorting to improve learning performance. Simulations are conducted to verify the AMO-CACO-based FCRNN gait generation performance through comparisons with different multiobjective optimization algorithms. Selected software-designed Pareto optimal FCRNNs are then applied to control the gait of a real NAO robot.

Generation of diversity in a reaction-diffusion-based controller

A controller of biological or artificial organism (e.g., in bio-inspired cellular robots) consists of a number of processes that drive its dynamics. For a system of processes to perform as a successful controller, different properties can be mentioned. One of the desirable properties of such a system is the capability of generating sufficiently diverse patterns of outputs and behaviors. A system with such a capability is potentially adaptable to perform complicated tasks with proper parameterizations and may successfully reach the solution space of behaviors from the point of view of search and evolutionary algorithms. This article aims to take an early step toward exploring this capability at the levels of individuals and populations by introducing measures of diversity generation and by evaluating the influence of different types of processes on diversity generation. A reaction-diffusion-based controller called the artificial homeostatic hormone system (AHHS) is studied as a system consisting of different processes with various domains of functioning (e.g., internal or external to the control unit). Various combinations of these processes are investigated in terms of diversity generation at levels of both individuals and populations, and the effects of the processes are discussed representing different influences for the processes. A case study of evolving a multimodular AHHS controller with all the various process combinations is also investigated, representing the relevance of the diversity generation measures and practical scenarios.