1
|
Sandini G, Sciutti A, Morasso P. Artificial cognition vs. artificial intelligence for next-generation autonomous robotic agents. Front Comput Neurosci 2024; 18:1349408. [PMID: 38585280 PMCID: PMC10995397 DOI: 10.3389/fncom.2024.1349408] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Accepted: 02/20/2024] [Indexed: 04/09/2024] Open
Abstract
The trend in industrial/service robotics is to develop robots that can cooperate with people, interacting with them in an autonomous, safe and purposive way. These are the fundamental elements characterizing the fourth and the fifth industrial revolutions (4IR, 5IR): the crucial innovation is the adoption of intelligent technologies that can allow the development of cyber-physical systems, similar if not superior to humans. The common wisdom is that intelligence might be provided by AI (Artificial Intelligence), a claim that is supported more by media coverage and commercial interests than by solid scientific evidence. AI is currently conceived in a quite broad sense, encompassing LLMs and a lot of other things, without any unifying principle, but self-motivating for the success in various areas. The current view of AI robotics mostly follows a purely disembodied approach that is consistent with the old-fashioned, Cartesian mind-body dualism, reflected in the software-hardware distinction inherent to the von Neumann computing architecture. The working hypothesis of this position paper is that the road to the next generation of autonomous robotic agents with cognitive capabilities requires a fully brain-inspired, embodied cognitive approach that avoids the trap of mind-body dualism and aims at the full integration of Bodyware and Cogniware. We name this approach Artificial Cognition (ACo) and ground it in Cognitive Neuroscience. It is specifically focused on proactive knowledge acquisition based on bidirectional human-robot interaction: the practical advantage is to enhance generalization and explainability. Moreover, we believe that a brain-inspired network of interactions is necessary for allowing humans to cooperate with artificial cognitive agents, building a growing level of personal trust and reciprocal accountability: this is clearly missing, although actively sought, in current AI. The ACo approach is a work in progress that can take advantage of a number of research threads, some of them antecedent the early attempts to define AI concepts and methods. In the rest of the paper we will consider some of the building blocks that need to be re-visited in a unitary framework: the principles of developmental robotics, the methods of action representation with prospection capabilities, and the crucial role of social interaction.
Collapse
Affiliation(s)
| | | | - Pietro Morasso
- Italian Institute of Technology, Cognitive Architecture for Collaborative Technologies (CONTACT) and Robotics, Brain and Cognitive Sciences (RBCS) Research Units, Genoa, Italy
| |
Collapse
|
2
|
Schilling M, Cruse H. neuroWalknet, a controller for hexapod walking allowing for context dependent behavior. PLoS Comput Biol 2023; 19:e1010136. [PMID: 36693085 PMCID: PMC9897571 DOI: 10.1371/journal.pcbi.1010136] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2022] [Revised: 02/03/2023] [Accepted: 11/18/2022] [Indexed: 01/25/2023] Open
Abstract
Decentralized control has been established as a key control principle in insect walking and has been successfully leveraged to account for a wide range of walking behaviors in the proposed neuroWalknet architecture. This controller allows for walking patterns at different velocities in both, forward and backward direction-quite similar to the behavior shown in stick insects-, for negotiation of curves, and for robustly dealing with various disturbances. While these simulations focus on the cooperation of different, decentrally controlled legs, here we consider a set of biological experiments not yet been tested by neuroWalknet, that focus on the function of the individual leg and are context dependent. These intraleg studies deal with four groups of interjoint reflexes. The reflexes are elicited by stimulation of the femoral chordotonal organ (fCO) or groups of campaniform sensilla (CS). Motor output signals are recorded from the alpha-joint, the beta-joint or the gamma-joint of the leg. Furthermore, the influence of these sensory inputs to artificially induced oscillations by application of pilocarpine has been studied. Although these biological data represent results obtained from different local reflexes in different contexts, they fit with and are embedded into the behavior shown by the global structure of neuroWalknet. In particular, a specific and intensively studied behavior, active reaction, has since long been assumed to represent a separate behavioral element, from which it is not clear why it occurs in some situations, but not in others. This question could now be explained as an emergent property of the holistic structure of neuroWalknet which has shown to be able to produce artificially elicited pilocarpine-driven oscillation that can be controlled by sensory input without the need of explicit innate CPG structures. As the simulation data result from a holistic system, further results were obtained that could be used as predictions to be tested in further biological experiments.
Collapse
Affiliation(s)
- Malte Schilling
- Malte Schilling, Autonomous Intelligent Systems Group, University of Münster, Münster, Germany
- * E-mail:
| | - Holk Cruse
- Biological Cybernetics, Faculty of Biology, Bielefeld University, Bielefeld, Germany
| |
Collapse
|
3
|
Manoonpong P, Patanè L, Xiong X, Brodoline I, Dupeyroux J, Viollet S, Arena P, Serres JR. Insect-Inspired Robots: Bridging Biological and Artificial Systems. SENSORS (BASEL, SWITZERLAND) 2021; 21:7609. [PMID: 34833685 PMCID: PMC8623770 DOI: 10.3390/s21227609] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/09/2021] [Revised: 10/26/2021] [Accepted: 10/27/2021] [Indexed: 12/18/2022]
Abstract
This review article aims to address common research questions in hexapod robotics. How can we build intelligent autonomous hexapod robots that can exploit their biomechanics, morphology, and computational systems, to achieve autonomy, adaptability, and energy efficiency comparable to small living creatures, such as insects? Are insects good models for building such intelligent hexapod robots because they are the only animals with six legs? This review article is divided into three main sections to address these questions, as well as to assist roboticists in identifying relevant and future directions in the field of hexapod robotics over the next decade. After an introduction in section (1), the sections will respectively cover the following three key areas: (2) biomechanics focused on the design of smart legs; (3) locomotion control; and (4) high-level cognition control. These interconnected and interdependent areas are all crucial to improving the level of performance of hexapod robotics in terms of energy efficiency, terrain adaptability, autonomy, and operational range. We will also discuss how the next generation of bioroboticists will be able to transfer knowledge from biology to robotics and vice versa.
Collapse
Affiliation(s)
- Poramate Manoonpong
- Embodied Artificial Intelligence and Neurorobotics Laboratory, SDU Biorobotics, The Mærsk Mc-Kinney Møller Institute, University of Southern Denmark, 5230 Odense, Denmark;
- Bio-Inspired Robotics and Neural Engineering Laboratory, School of Information Science and Technology, Vidyasirimedhi Institute of Science and Technology, Rayong 21210, Thailand
| | - Luca Patanè
- Department of Engineering, University of Messina, 98100 Messina, Italy
| | - Xiaofeng Xiong
- Embodied Artificial Intelligence and Neurorobotics Laboratory, SDU Biorobotics, The Mærsk Mc-Kinney Møller Institute, University of Southern Denmark, 5230 Odense, Denmark;
| | - Ilya Brodoline
- Department of Biorobotics, Aix Marseille University, CNRS, ISM, CEDEX 07, 13284 Marseille, France; (I.B.); (S.V.)
| | - Julien Dupeyroux
- Faculty of Aerospace Engineering, Delft University of Technology, 52600 Delft, The Netherlands;
| | - Stéphane Viollet
- Department of Biorobotics, Aix Marseille University, CNRS, ISM, CEDEX 07, 13284 Marseille, France; (I.B.); (S.V.)
| | - Paolo Arena
- Department of Electrical, Electronic and Computer Engineering, University of Catania, 95131 Catania, Italy
| | - Julien R. Serres
- Department of Biorobotics, Aix Marseille University, CNRS, ISM, CEDEX 07, 13284 Marseille, France; (I.B.); (S.V.)
| |
Collapse
|
4
|
Goldsmith CA, Quinn RD, Szczecinski NS. Investigating the role of low level reinforcement reflex loops in insect locomotion. BIOINSPIRATION & BIOMIMETICS 2021; 16:065008. [PMID: 34547724 DOI: 10.1088/1748-3190/ac28ea] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/21/2021] [Accepted: 09/21/2021] [Indexed: 06/13/2023]
Abstract
Insects are highly capable walkers, but many questions remain regarding how the insect nervous system controls locomotion. One particular question is how information is communicated between the 'lower level' ventral nerve cord (VNC) and the 'higher level' head ganglia to facilitate control. In this work, we seek to explore this question by investigating how systems traditionally described as 'positive feedback' may initiate and maintain stepping in the VNC with limited information exchanged between lower and higher level centers. We focus on the 'reflex reversal' of the stick insect femur-tibia joint between a resistance reflex (RR) and an active reaction in response to joint flexion, as well as the activation of populations of descending dorsal median unpaired (desDUM) neurons from limb strain as our primary reflex loops. We present the development of a neuromechanical model of the stick insect (Carausius morosus) femur-tibia (FTi) and coxa-trochanter joint control networks 'in-the-loop' with a physical robotic limb. The control network generates motor commands for the robotic limb, whose motion and forces generate sensory feedback for the network. We based our network architecture on the anatomy of the non-spiking interneuron joint control network that controls the FTi joint, extrapolated network connectivity based on known muscle responses, and previously developed mechanisms to produce 'sideways stepping'. Previous studies hypothesized that RR is enacted by selective inhibition of sensory afferents from the femoral chordotonal organ, but no study has tested this hypothesis with a model of an intact limb. We found that inhibiting the network's flexion position and velocity afferents generated a reflex reversal in the robot limb's FTi joint. We also explored the intact network's ability to sustain steady locomotion on our test limb. Our results suggested that the reflex reversal and limb strain reinforcement mechanisms are both necessary but individually insufficient to produce and maintain rhythmic stepping in the limb, which can be initiated or halted by brief, transient descending signals. Removing portions of this feedback loop or creating a large enough disruption can halt stepping independent of the higher-level centers. We conclude by discussing why the nervous system might control motor output in this manner, as well as how to apply these findings to generalized nervous system understanding and improved robotic control.
Collapse
Affiliation(s)
- C A Goldsmith
- West Virginia University, One Waterfront Place, Morgantown, WV 26506, United States of America
| | - R D Quinn
- Case Western Reserve University, 10900 Euclid Ave, Cleveland, OH 44106, United States of America
| | - N S Szczecinski
- West Virginia University, One Waterfront Place, Morgantown, WV 26506, United States of America
| |
Collapse
|
5
|
Schilling M, Melnik A, Ohl FW, Ritter HJ, Hammer B. Decentralized control and local information for robust and adaptive decentralized Deep Reinforcement Learning. Neural Netw 2021; 144:699-725. [PMID: 34673323 DOI: 10.1016/j.neunet.2021.09.017] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2021] [Revised: 09/13/2021] [Accepted: 09/21/2021] [Indexed: 12/18/2022]
Abstract
Decentralization is a central characteristic of biological motor control that allows for fast responses relying on local sensory information. In contrast, the current trend of Deep Reinforcement Learning (DRL) based approaches to motor control follows a centralized paradigm using a single, holistic controller that has to untangle the whole input information space. This motivates to ask whether decentralization as seen in biological control architectures might also be beneficial for embodied sensori-motor control systems when using DRL. To answer this question, we provide an analysis and comparison of eight control architectures for adaptive locomotion that were derived for a four-legged agent, but with their degree of decentralization varying systematically between the extremes of fully centralized and fully decentralized. Our comparison shows that learning speed is significantly enhanced in distributed architectures-while still reaching the same high performance level of centralized architectures-due to smaller search spaces and local costs providing more focused information for learning. Second, we find an increased robustness of the learning process in the decentralized cases-it is less demanding to hyperparameter selection and less prone to becoming trapped in poor local minima. Finally, when examining generalization to uneven terrains-not used during training-we find best performance for an intermediate architecture that is decentralized, but integrates only local information from both neighboring legs. Together, these findings demonstrate beneficial effects of distributing control into decentralized units and relying on local information. This appears as a promising approach towards more robust DRL and better generalization towards adaptive behavior.
Collapse
Affiliation(s)
- Malte Schilling
- Machine Learning Group, Bielefeld University, 33501 Bielefeld, Germany.
| | - Andrew Melnik
- Neuroinformatics Group, Bielefeld University, 33501 Bielefeld, Germany
| | - Frank W Ohl
- Department of Systems Physiology of Learning, Leibniz Institute for Neurobiology, Magdeburg, Germany; Institute of Biology, Otto-von-Guericke University, Magdeburg, Germany
| | - Helge J Ritter
- Neuroinformatics Group, Bielefeld University, 33501 Bielefeld, Germany
| | - Barbara Hammer
- Machine Learning Group, Bielefeld University, 33501 Bielefeld, Germany
| |
Collapse
|
6
|
Schilling M, Paskarbeit J, Ritter H, Schneider A, Cruse H. From Adaptive Locomotion to Predictive Action Selection – Cognitive Control for a Six-Legged Walker. IEEE T ROBOT 2021. [DOI: 10.1109/tro.2021.3106832] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
7
|
Dürr V, Arena PP, Cruse H, Dallmann CJ, Drimus A, Hoinville T, Krause T, Mátéfi-Tempfli S, Paskarbeit J, Patanè L, Schäffersmann M, Schilling M, Schmitz J, Strauss R, Theunissen L, Vitanza A, Schneider A. Integrative Biomimetics of Autonomous Hexapedal Locomotion. Front Neurorobot 2019; 13:88. [PMID: 31708765 PMCID: PMC6819508 DOI: 10.3389/fnbot.2019.00088] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2019] [Accepted: 10/07/2019] [Indexed: 01/31/2023] Open
Abstract
Despite substantial advances in many different fields of neurorobotics in general, and biomimetic robots in particular, a key challenge is the integration of concepts: to collate and combine research on disparate and conceptually disjunct research areas in the neurosciences and engineering sciences. We claim that the development of suitable robotic integration platforms is of particular relevance to make such integration of concepts work in practice. Here, we provide an example for a hexapod robotic integration platform for autonomous locomotion. In a sequence of six focus sections dealing with aspects of intelligent, embodied motor control in insects and multipedal robots—ranging from compliant actuation, distributed proprioception and control of multiple legs, the formation of internal representations to the use of an internal body model—we introduce the walking robot HECTOR as a research platform for integrative biomimetics of hexapedal locomotion. Owing to its 18 highly sensorized, compliant actuators, light-weight exoskeleton, distributed and expandable hardware architecture, and an appropriate dynamic simulation framework, HECTOR offers many opportunities to integrate research effort across biomimetics research on actuation, sensory-motor feedback, inter-leg coordination, and cognitive abilities such as motion planning and learning of its own body size.
Collapse
Affiliation(s)
- Volker Dürr
- Department of Biological Cybernetics, Faculty of Biology, Bielefeld University, Bielefeld, Germany.,Cognitive Interaction Technology: Center of Excellence, Bielefeld University, Bielefeld, Germany
| | - Paolo P Arena
- DIEEI: Dipartimento di Ingegneria Elettrica Elettronica e Informatica, Università degli Studi di Catania, Catania, Italy
| | - Holk Cruse
- Cognitive Interaction Technology: Center of Excellence, Bielefeld University, Bielefeld, Germany
| | - Chris J Dallmann
- Department of Biological Cybernetics, Faculty of Biology, Bielefeld University, Bielefeld, Germany.,Cognitive Interaction Technology: Center of Excellence, Bielefeld University, Bielefeld, Germany
| | - Alin Drimus
- Mads Clausen Institute, University of Southern Denmark, Sønderborg, Denmark
| | - Thierry Hoinville
- Department of Biological Cybernetics, Faculty of Biology, Bielefeld University, Bielefeld, Germany.,Cognitive Interaction Technology: Center of Excellence, Bielefeld University, Bielefeld, Germany
| | - Tammo Krause
- Institut für Entwicklungsbiologie und Neurobiologie, Johannes Gutenberg-Universität, Mainz, Germany
| | | | - Jan Paskarbeit
- Cognitive Interaction Technology: Center of Excellence, Bielefeld University, Bielefeld, Germany
| | - Luca Patanè
- DIEEI: Dipartimento di Ingegneria Elettrica Elettronica e Informatica, Università degli Studi di Catania, Catania, Italy
| | - Mattias Schäffersmann
- Cognitive Interaction Technology: Center of Excellence, Bielefeld University, Bielefeld, Germany
| | - Malte Schilling
- Cognitive Interaction Technology: Center of Excellence, Bielefeld University, Bielefeld, Germany
| | - Josef Schmitz
- Department of Biological Cybernetics, Faculty of Biology, Bielefeld University, Bielefeld, Germany.,Cognitive Interaction Technology: Center of Excellence, Bielefeld University, Bielefeld, Germany
| | - Roland Strauss
- Institut für Entwicklungsbiologie und Neurobiologie, Johannes Gutenberg-Universität, Mainz, Germany
| | - Leslie Theunissen
- Department of Biological Cybernetics, Faculty of Biology, Bielefeld University, Bielefeld, Germany.,Cognitive Interaction Technology: Center of Excellence, Bielefeld University, Bielefeld, Germany
| | - Alessandra Vitanza
- DIEEI: Dipartimento di Ingegneria Elettrica Elettronica e Informatica, Università degli Studi di Catania, Catania, Italy
| | - Axel Schneider
- Cognitive Interaction Technology: Center of Excellence, Bielefeld University, Bielefeld, Germany.,Institute of System Dynamics and Mechatronics, Bielefeld University of Applied Sciences, Bielefeld, Germany
| |
Collapse
|
8
|
Aoi S, Manoonpong P, Ambe Y, Matsuno F, Wörgötter F. Adaptive Control Strategies for Interlimb Coordination in Legged Robots: A Review. Front Neurorobot 2017; 11:39. [PMID: 28878645 PMCID: PMC5572352 DOI: 10.3389/fnbot.2017.00039] [Citation(s) in RCA: 59] [Impact Index Per Article: 8.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2016] [Accepted: 07/31/2017] [Indexed: 12/02/2022] Open
Abstract
Walking animals produce adaptive interlimb coordination during locomotion in accordance with their situation. Interlimb coordination is generated through the dynamic interactions of the neural system, the musculoskeletal system, and the environment, although the underlying mechanisms remain unclear. Recently, investigations of the adaptation mechanisms of living beings have attracted attention, and bio-inspired control systems based on neurophysiological findings regarding sensorimotor interactions are being developed for legged robots. In this review, we introduce adaptive interlimb coordination for legged robots induced by various factors (locomotion speed, environmental situation, body properties, and task). In addition, we show characteristic properties of adaptive interlimb coordination, such as gait hysteresis and different time-scale adaptations. We also discuss the underlying mechanisms and control strategies to achieve adaptive interlimb coordination and the design principle for the control system of legged robots.
Collapse
Affiliation(s)
- Shinya Aoi
- Department of Aeronautics and Astronautics, Graduate School of Engineering, Kyoto UniversityKyoto, Japan
| | - Poramate Manoonpong
- Embodied AI & Neurorobotics Lab, Centre for Biorobotics, Mærsk Mc-Kinney Møller Institute, University of Southern DenmarkOdense, Denmark
| | - Yuichi Ambe
- Department of Applied Information Sciences, Graduate School of Information Sciences, Tohoku UniversityAoba-ku, Japan
| | - Fumitoshi Matsuno
- Department of Mechanical Engineering and Science, Graduate School of Engineering, Kyoto UniversityKyoto, Japan
| | - Florentin Wörgötter
- Bernstein Center for Computational Neuroscience, Third Institute of Physics, Georg-August-Universität GöttingenGöttingen, Germany
| |
Collapse
|
9
|
Schilling M, Hoinville T, Schmitz J, Cruse H. Walknet, a bio-inspired controller for hexapod walking. BIOLOGICAL CYBERNETICS 2013; 107:397-419. [PMID: 23824506 PMCID: PMC3755227 DOI: 10.1007/s00422-013-0563-5] [Citation(s) in RCA: 70] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/13/2012] [Accepted: 06/18/2013] [Indexed: 06/02/2023]
Abstract
Walknet comprises an artificial neural network that allows for the simulation of a considerable amount of behavioral data obtained from walking and standing stick insects. It has been tested by kinematic and dynamic simulations as well as on a number of six-legged robots. Over the years, various different expansions of this network have been provided leading to different versions of Walknet. This review summarizes the most important biological findings described by Walknet and how they can be simulated. Walknet shows how a number of properties observed in insects may emerge from a decentralized architecture. Examples are the continuum of so-called "gaits," coordination of up to 18 leg joints during stance when walking forward or backward over uneven surfaces and negotiation of curves, dealing with leg loss, as well as being able following motion trajectories without explicit precalculation. The different Walknet versions are compared to other approaches describing insect-inspired hexapod walking. Finally, we briefly address the ability of this decentralized reactive controller to form the basis for the simulation of higher-level cognitive faculties exceeding the capabilities of insects.
Collapse
Affiliation(s)
- Malte Schilling
- Department of Biological Cybernetics and Theoretical Biology, Bielefeld University, P.O. Box 100131, 33501 , Bielefeld, Germany.
| | | | | | | |
Collapse
|