Neurorobotics-A Thriving Community and a Promising Pathway Toward Intelligent Cognitive Robots

Active Inference for Learning and Development in Embodied Neuromorphic Agents

Taking inspiration from humans can help catalyse embodied AI solutions for important real-world applications. Current human-inspired tools include neuromorphic systems and the developmental approach to learning. However, this developmental neurorobotics approach is currently lacking important frameworks for human-like computation and learning. We propose that human-like computation is inherently embodied, with its interface to the world being neuromorphic, and its learning processes operating across different timescales. These constraints necessitate a unified framework: active inference, underpinned by the free energy principle (FEP). Herein, we describe theoretical and empirical support for leveraging this framework in embodied neuromorphic agents with autonomous mental development. We additionally outline current implementation approaches (including toolboxes) and challenges, and we provide suggestions for next steps to catalyse this important field.

A neurorobotics approach to behaviour selection based on human activity recognition

Behaviour selection has been an active research topic for robotics, in particular in the field of human-robot interaction. For a robot to interact autonomously and effectively with humans, the coupling between techniques for human activity recognition and robot behaviour selection is of paramount importance. However, most approaches to date consist of deterministic associations between the recognised activities and the robot behaviours, neglecting the uncertainty inherent to sequential predictions in real-time applications. In this paper, we address this gap by presenting an initial neurorobotics model that embeds, in a simulated robot, computational models of parts of the mammalian brain that resembles neurophysiological aspects of the basal ganglia-thalamus-cortex (BG-T-C) circuit, coupled with human activity recognition techniques. A robotics simulation environment was developed for assessing the model, where a mobile robot accomplished tasks by using behaviour selection in accordance with the activity being performed by the inhabitant of an intelligent home. Initial results revealed that the initial neurorobotics model is advantageous, especially considering the coupling between the most accurate activity recognition approaches and the computational models of more complex animals.

Understanding brain functional architecture through robotics

Robotics is increasingly seen as a useful test bed for computational models of the brain functional architecture underlying animal behavior. We provide an overview of past and current work, focusing on probabilistic and dynamical models, including approaches premised on the free energy principle, situating this endeavor in relation to evidence that the brain constitutes a layered control system. We argue that future neurorobotic models should integrate multiple neurobiological constraints and be hybrid in nature.

When neuro-robots go wrong: A review

Neuro-robots are a class of autonomous machines that, in their architecture, mimic aspects of the human brain and cognition. As such, they represent unique artifacts created by humans based on human understanding of healthy human brains. European Union's Convention on Roboethics 2025 states that the design of all robots (including neuro-robots) must include provisions for the complete traceability of the robots' actions, analogous to an aircraft's flight data recorder. At the same time, one can anticipate rising instances of neuro-robotic failure, as they operate on imperfect data in real environments, and the underlying AI behind such neuro-robots has yet to achieve explainability. This paper reviews the trajectory of the technology used in neuro-robots and accompanying failures. The failures demand an explanation. While drawing on existing explainable AI research, we argue explainability in AI limits the same in neuro-robots. In order to make robots more explainable, we suggest potential pathways for future research.

Organic neuromorphic electronics for sensorimotor integration and learning in robotics

In living organisms, sensory and motor processes are distributed, locally merged, and capable of forming dynamic sensorimotor associations. We introduce a simple and efficient organic neuromorphic circuit for local sensorimotor merging and processing on a robot that is placed in a maze. While the robot is exposed to external environmental stimuli, visuomotor associations are formed on the adaptable neuromorphic circuit. With this on-chip sensorimotor integration, the robot learns to follow a path to the exit of a maze, while being guided by visually indicated paths. The ease of processability of organic neuromorphic electronics and their unconventional form factors, in combination with education-purpose robotics, showcase a promising approach of an affordable, versatile, and readily accessible platform for exploring, designing, and evaluating behavioral intelligence through decentralized sensorimotor integration.

Neuro4PD: An Initial Neurorobotics Model of Parkinson's Disease

In this work, we present the first steps toward the creation of a new neurorobotics model of Parkinson's Disease (PD) that embeds, for the first time in a real robot, a well-established computational model of PD. PD mostly affects the modulation of movement in humans. The number of people suffering from this neurodegenerative disease is set to double in the next 15 years and there is still no cure. With the new model we were capable to further explore the dynamics of the disease using a humanoid robot. Results show that the embedded model under both conditions, healthy and parkinsonian, was capable of performing a simple behavioural task with different levels of motor disturbance. We believe that this neurorobotics model is a stepping stone to the development of more sophisticated models that could eventually test and inform new PD therapies and help to reduce and replace animals in research.

Differential mapping spiking neural network for sensor-based robot control

In this work, a spiking neural network (SNN) is proposed for approximating differential sensorimotor maps of robotic systems. The computed model is used as a local Jacobian-like projection that relates changes in sensor space to changes in motor space. The SNN consists of an input (sensory) layer and an output (motor) layer connected through plastic synapses, with inter-inhibitory connections at the output layer. Spiking neurons are modeled as Izhikevich neurons with a synaptic learning rule based on spike timing-dependent plasticity. Feedback data from proprioceptive and exteroceptive sensors are encoded and fed into the input layer through a motor babbling process. A guideline for tuning the network parameters is proposed and applied along with the particle swarm optimization technique. Our proposed control architecture takes advantage of biologically plausible tools of an SNN to achieve the target reaching task while minimizing deviations from the desired path, and consequently minimizing the execution time. Thanks to the chosen architecture and optimization of the parameters, the number of neurons and the amount of data required for training are considerably low. The SNN is capable of handling noisy sensor readings to guide the robot movements in real-time. Experimental results are presented to validate the control methodology with a vision-guided robot.

A Database for Learning Numbers by Visual Finger Recognition in Developmental Neuro-Robotics

Numerical cognition is a fundamental component of human intelligence that has not been fully understood yet. Indeed, it is a subject of research in many disciplines, e.g., neuroscience, education, cognitive and developmental psychology, philosophy of mathematics, linguistics. In Artificial Intelligence, aspects of numerical cognition have been modelled through neural networks to replicate and analytically study children behaviours. However, artificial models need to incorporate realistic sensory-motor information from the body to fully mimic the children's learning behaviours, e.g., the use of fingers to learn and manipulate numbers. To this end, this article presents a database of images, focused on number representation with fingers using both human and robot hands, which can constitute the base for building new realistic models of numerical cognition in humanoid robots, enabling a grounded learning approach in developmental autonomous agents. The article provides a benchmark analysis of the datasets in the database that are used to train, validate, and test five state-of-the art deep neural networks, which are compared for classification accuracy together with an analysis of the computational requirements of each network. The discussion highlights the trade-off between speed and precision in the detection, which is required for realistic applications in robotics.

Robustness Improvement of Visual Templates Matching Based on Frequency-Tuned Model in RatSLAM

This paper describes an improved brain-inspired simultaneous localization and mapping (RatSLAM) that extracts visual features from saliency maps using a frequency-tuned (FT) model. In the traditional RatSLAM algorithm, the visual template feature is organized as a one-dimensional vector whose values only depend on pixel intensity; therefore, this feature is susceptible to changes in illumination intensity. In contrast to this approach, which directly generates visual templates from raw RGB images, we propose an FT model that converts RGB images into saliency maps to obtain visual templates. The visual templates extracted from the saliency maps contain more of the feature information contained within the original images. Our experimental results demonstrate that the accuracy of loop closure detection was improved, as measured by the number of loop closures detected by our method compared with the traditional RatSLAM system. We additionally verified that the proposed FT model-based visual templates improve the robustness of familiar visual scene identification by RatSLAM.

A hybrid and scalable brain-inspired robotic platform

Recent years have witnessed tremendous progress of intelligent robots brought about by mimicking human intelligence. However, current robots are still far from being able to handle multiple tasks in a dynamic environment as efficiently as humans. To cope with complexity and variability, further progress toward scalability and adaptability are essential for intelligent robots. Here, we report a brain-inspired robotic platform implemented by an unmanned bicycle that exhibits scalability of network scale, quantity and diversity to handle the changing needs of different scenarios. The platform adopts rich coding schemes and a trainable and scalable neural state machine, enabling flexible cooperation of hybrid networks. In addition, an embedded system is developed using a cross-paradigm neuromorphic chip to facilitate the implementation of diverse neural networks in spike or non-spike form. The platform achieved various real-time tasks concurrently in different real-world scenarios, providing a new pathway to enhance robots' intelligence.

Neurorobots as a Means Toward Neuroethology and Explainable AI

Understanding why deep neural networks and machine learning algorithms act as they do is a difficult endeavor. Neuroscientists are faced with similar problems. One way biologists address this issue is by closely observing behavior while recording neurons or manipulating brain circuits. This has been called neuroethology. In a similar way, neurorobotics can be used to explain how neural network activity leads to behavior. In real world settings, neurorobots have been shown to perform behaviors analogous to animals. Moreover, a neuroroboticist has total control over the network, and by analyzing different neural groups or studying the effect of network perturbations (e.g., simulated lesions), they may be able to explain how the robot's behavior arises from artificial brain activity. In this paper, we review neurorobot experiments by focusing on how the robot's behavior leads to a qualitative and quantitative explanation of neural activity, and vice versa, that is, how neural activity leads to behavior. We suggest that using neurorobots as a form of computational neuroethology can be a powerful methodology for understanding neuroscience, as well as for artificial intelligence and machine learning.

Neurorobotics Workshop for High School Students Promotes Competence and Confidence in Computational Neuroscience

Understanding the brain is a fascinating challenge, captivating the scientific community and the public alike. The lack of effective treatment for most brain disorders makes the training of the next generation of neuroscientists, engineers and physicians a key concern. Over the past decade there has been a growing effort to introduce neuroscience in primary and secondary schools, however, hands-on laboratories have been limited to anatomical or electrophysiological activities. Modern neuroscience research labs are increasingly using computational tools to model circuits of the brain to understand information processing. Here we introduce the use of neurorobots – robots controlled by computer models of biological brains – as an introduction to computational neuroscience in the classroom. Neurorobotics has enormous potential as an education technology because it combines multiple activities with clear educational benefits including neuroscience, active learning, and robotics. We describe a 1-week introductory neurorobot workshop that teaches high school students how to use neurorobots to investigate key concepts in neuroscience, including spiking neural networks, synaptic plasticity, and adaptive action selection. Our do-it-yourself (DIY) neurorobot uses wheels, a camera, a speaker, and a distance sensor to interact with its environment, and can be built from generic parts costing about $170 in under 4 h. Our Neurorobot App visualizes the neurorobot’s visual input and brain activity in real-time, and enables students to design new brains and deliver dopamine-like reward signals to reinforce chosen behaviors. We ran the neurorobot workshop at two high schools (n = 295 students total) and found significant improvement in students’ understanding of key neuroscience concepts and in students’ confidence in neuroscience, as assessed by a pre/post workshop survey. Here we provide DIY hardware assembly instructions, discuss our open-source Neurorobot App and demonstrate how to teach the Neurorobot Workshop. By doing this we hope to accelerate research in educational neurorobotics and promote the use of neurorobots to teach computational neuroscience in high school.

Curated Model Development Using NEUROiD: A Web-Based NEUROmotor Integration and Design Platform

Decades of research on neuromotor circuits and systems has provided valuable information on neuronal control of movement. Computational models of several elements of the neuromotor system have been developed at various scales, from sub-cellular to system. While several small models abound, their structured integration is the key to building larger and more biologically realistic models which can predict the behavior of the system in different scenarios. This effort calls for integration of elements across neuroscience and musculoskeletal biomechanics. There is also a need for development of methods and tools for structured integration that yield larger in silico models demonstrating a set of desired system responses. We take a small step in this direction with the NEUROmotor integration and Design (NEUROiD) platform. NEUROiD helps integrate results from motor systems anatomy, physiology, and biomechanics into an integrated neuromotor system model. Simulation and visualization of the model across multiple scales is supported. Standard electrophysiological operations such as slicing, current injection, recording of membrane potential, and local field potential are part of NEUROiD. The platform allows traceability of model parameters to primary literature. We illustrate the power and utility of NEUROiD by building a simple ankle model and its controlling neural circuitry by curating a set of published components. NEUROiD allows researchers to utilize remote high-performance computers for simulation, while controlling the model using a web browser.

Spatial Concept Learning: A Spiking Neural Network Implementation in Virtual and Physical Robots

This paper proposes an artificial spiking neural network (SNN) sustaining the cognitive abstract process of spatial concept learning, embedded in virtual and real robots. Based on an operant conditioning procedure, the robots learn the relationship of horizontal/vertical and left/right visual stimuli, regardless of their specific pattern composition or their location on the images. Tests with novel patterns and locations were successfully completed after the acquisition learning phase. Results show that the SNN can adapt its behavior in real time when the rewarding rule changes.

Spiking Neurons Integrating Visual Stimuli Orientation and Direction Selectivity in a Robotic Context

Visual motion detection is essential for the survival of many species. The phenomenon includes several spatial properties, not fully understood at the level of a neural circuit. This paper proposes a computational model of a visual motion detector that integrates direction and orientation selectivity features. A recent experiment in the Drosophila model highlights that stimulus orientation influences the neural response of direction cells. However, this interaction and the significance at the behavioral level are currently unknown. As such, another objective of this article is to study the effect of merging these two visual processes when contextualized in a neuro-robotic model and an operant conditioning procedure. In this work, the learning task was solved using an artificial spiking neural network, acting as the brain controller for virtual and physical robots, showing a behavior modulation from the integration of both visual processes.