1
|
Baladron J, Vitay J, Fietzek T, Hamker FH. The contribution of the basal ganglia and cerebellum to motor learning: A neuro-computational approach. PLoS Comput Biol 2023; 19:e1011024. [PMID: 37011086 PMCID: PMC10101648 DOI: 10.1371/journal.pcbi.1011024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2022] [Revised: 04/13/2023] [Accepted: 03/13/2023] [Indexed: 04/05/2023] Open
Abstract
Motor learning involves a widespread brain network including the basal ganglia, cerebellum, motor cortex, and brainstem. Despite its importance, little is known about how this network learns motor tasks and which role different parts of this network take. We designed a systems-level computational model of motor learning, including a cortex-basal ganglia motor loop and the cerebellum that both determine the response of central pattern generators in the brainstem. First, we demonstrate its ability to learn arm movements toward different motor goals. Second, we test the model in a motor adaptation task with cognitive control, where the model replicates human data. We conclude that the cortex-basal ganglia loop learns via a novelty-based motor prediction error to determine concrete actions given a desired outcome, and that the cerebellum minimizes the remaining aiming error.
Collapse
Affiliation(s)
- Javier Baladron
- Department of Computer Science, Chemnitz University of Technology, Chemnitz, Germany
- Departamento de Ingeniería Informática, Universidad de Santiago de Chile, Santiago, Chile
| | - Julien Vitay
- Department of Computer Science, Chemnitz University of Technology, Chemnitz, Germany
| | - Torsten Fietzek
- Department of Computer Science, Chemnitz University of Technology, Chemnitz, Germany
| | - Fred H Hamker
- Department of Computer Science, Chemnitz University of Technology, Chemnitz, Germany
| |
Collapse
|
2
|
Datteri E, Chaminade T, Romano D. Going Beyond the "Synthetic Method": New Paradigms Cross-Fertilizing Robotics and Cognitive Neuroscience. Front Psychol 2022; 13:819042. [PMID: 35719586 PMCID: PMC9204052 DOI: 10.3389/fpsyg.2022.819042] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2021] [Accepted: 05/16/2022] [Indexed: 11/13/2022] Open
Abstract
In so-called ethorobotics and robot-supported social cognitive neurosciences, robots are used as scientific tools to study animal behavior and cognition. Building on previous epistemological analyses of biorobotics, in this article it is argued that these two research fields, widely differing from one another in the kinds of robots involved and in the research questions addressed, share a common methodology, which significantly differs from the "synthetic method" that, until recently, dominated biorobotics. The methodological novelty of this strategy, the research opportunities that it opens, and the theoretical and technological challenges that it gives rise to, will be discussed with reference to the peculiarities of the two research fields. Some broad methodological issues related to the generalization of results concerning robot-animal interaction to theoretical conclusions on animal-animal interaction will be identified and discussed.
Collapse
Affiliation(s)
- Edoardo Datteri
- RobotiCSS Lab, Laboratory of Robotics for the Cognitive and Social Sciences, Department of Human Sciences for Education, University of Milano-Bicocca, Milan, Italy
| | - Thierry Chaminade
- Aix-Marseille Université, Institut de Neurosciences de la Timone, UMR 7289, CNRS, Marseille, France
| | - Donato Romano
- Sant'Anna School of Advanced Studies, The BioRobotics Institute, Pisa, Italy.,Department of Excellence in Robotics and AI, Sant'Anna School of Advanced Studies, Pisa, Italy
| |
Collapse
|
3
|
Vandervert L. The evolution of theory of mind (ToM) within the evolution of cerebellar sequence detection in stone-tool making and language: implications for studies of higher-level cognitive functions in degenerative cerebellar atrophy. CEREBELLUM & ATAXIAS 2019; 6:1. [PMID: 31293790 PMCID: PMC6591877 DOI: 10.1186/s40673-019-0101-x] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 05/06/2019] [Accepted: 06/16/2019] [Indexed: 11/10/2022]
Abstract
INTRODUCTION Within the context of Clausi, Olivito, Lupo, Siciliano, Bozzali and Leggio's (Cell Neurosci 12:510, 2019) insightful study of how prediction of theory of mind (ToM) is compromised in degenerative cerebellar atrophy, this article describes how prediction can also be understood as the cerebro-cerebellar system's capacity to rapidly shift attention to manipulate cause-and-effect relationships embedded in language. METHOD The evolution of the capacity of ToM is described within the evolution of stone-tool making, language, and the origin of the phonological loop in verbal working memory. Specifically, it is argued that this evolutionary framework offers a way to get further inside the prediction process by illuminating how sub-vocal speech evolved during stone-tool evolution due to its adaptive refinement of early human ability to manipulate and hold in memory progressively more detailed cause-and-effect relationships in the origin of verbal working memory. CONCLUSION The addition of sub-vocal speech/cause-and-effect relationship to the analysis of prediction provides an evolutionary model of the mechanisms of ToM, which, in turn, brings forward additional cerebro-cerebellar mechanisms which can (1) further support Clausi, Olivito, Lupo et al's findings and (2) shed light on additional mechanisms that might further clarify what might be behind cerebellar dysfunction in the construction of ToM. Problems encountered by cerebellar degenerative atrophy patients with the Faux pas test and Advanced ToM task with unexpected events may stem from a combination of an inability (1) of their cerebellar internal models to rapidly switch attention among cause-and-effect elements of the stories and (2) to extend cerebellar internal models to the prediction of the resulting similar but unexpected events. That is, with both (1) and (2) occurring at the same time, alternative meanings of causes and effects might be missed in both automatic and consciously manipulated sub-vocal verbal working memory. A method to measure sub-vocal speech in this context is suggested.
Collapse
Affiliation(s)
- Larry Vandervert
- American Nonlinear Systems, 1529 W. Courtland Avenue Spokane, Spokane, WA 99205-2608 USA
| |
Collapse
|
4
|
Kim J, Lee J, Kakei S, Kim J. Motor control characteristics for circular tracking movements of human wrist. Adv Robot 2016. [DOI: 10.1080/01691864.2016.1266121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Affiliation(s)
- Jihun Kim
- Department of Mechanical and Control Engineering, Handong Global University, Pohang, Republic of Korea
| | - Jongho Lee
- Motor Disorders Project, Tokyo Metropolitan Institute of Medical Science, Tokyo, Japan
| | - Shinji Kakei
- Motor Disorders Project, Tokyo Metropolitan Institute of Medical Science, Tokyo, Japan
| | - Jaehyo Kim
- Department of Mechanical and Control Engineering, Handong Global University, Pohang, Republic of Korea
| |
Collapse
|
5
|
Morimoto J, Kawato M. Creating the brain and interacting with the brain: an integrated approach to understanding the brain. J R Soc Interface 2015; 12:20141250. [PMID: 25589568 DOI: 10.1098/rsif.2014.1250] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
In the past two decades, brain science and robotics have made gigantic advances in their own fields, and their interactions have generated several interdisciplinary research fields. First, in the 'understanding the brain by creating the brain' approach, computational neuroscience models have been applied to many robotics problems. Second, such brain-motivated fields as cognitive robotics and developmental robotics have emerged as interdisciplinary areas among robotics, neuroscience and cognitive science with special emphasis on humanoid robots. Third, in brain-machine interface research, a brain and a robot are mutually connected within a closed loop. In this paper, we review the theoretical backgrounds of these three interdisciplinary fields and their recent progress. Then, we introduce recent efforts to reintegrate these research fields into a coherent perspective and propose a new direction that integrates brain science and robotics where the decoding of information from the brain, robot control based on the decoded information and multimodal feedback to the brain from the robot are carried out in real time and in a closed loop.
Collapse
Affiliation(s)
- Jun Morimoto
- Department of Brain Robot Interface, ATR Computational Neuroscience Labs, Kyoto, Japan
| | - Mitsuo Kawato
- ATR Brain Information Communication research Laboratory Group, Kyoto, Japan
| |
Collapse
|
6
|
Mirror neurons: Functions, mechanisms and models. Neurosci Lett 2013; 540:43-55. [DOI: 10.1016/j.neulet.2012.10.005] [Citation(s) in RCA: 82] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2012] [Revised: 09/27/2012] [Accepted: 10/02/2012] [Indexed: 11/18/2022]
|
7
|
Porrill J, Dean P, Anderson SR. Adaptive filters and internal models: multilevel description of cerebellar function. Neural Netw 2012; 47:134-49. [PMID: 23391782 DOI: 10.1016/j.neunet.2012.12.005] [Citation(s) in RCA: 76] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2012] [Revised: 11/22/2012] [Accepted: 12/17/2012] [Indexed: 11/16/2022]
Abstract
Cerebellar function is increasingly discussed in terms of engineering schemes for motor control and signal processing that involve internal models. To address the relation between the cerebellum and internal models, we adopt the chip metaphor that has been used to represent the combination of a homogeneous cerebellar cortical microcircuit with individual microzones having unique external connections. This metaphor indicates that identifying the function of a particular cerebellar chip requires knowledge of both the general microcircuit algorithm and the chip's individual connections. Here we use a popular candidate algorithm as embodied in the adaptive filter, which learns to decorrelate its inputs from a reference ('teaching', 'error') signal. This algorithm is computationally powerful enough to be used in a very wide variety of engineering applications. However, the crucial issue is whether the external connectivity required by such applications can be implemented biologically. We argue that some applications appear to be in principle biologically implausible: these include the Smith predictor and Kalman filter (for state estimation), and the feedback-error-learning scheme for adaptive inverse control. However, even for plausible schemes, such as forward models for noise cancellation and novelty-detection, and the recurrent architecture for adaptive inverse control, there is unlikely to be a simple mapping between microzone function and internal model structure. This initial analysis suggests that cerebellar involvement in particular behaviours is therefore unlikely to have a neat classification into categories such as 'forward model'. It is more likely that cerebellar microzones learn a task-specific adaptive-filter operation which combines a number of signal-processing roles.
Collapse
Affiliation(s)
- John Porrill
- Department of Psychology, Sheffield University, Western Bank, Sheffield, S10 2TP, UK
| | | | | |
Collapse
|
8
|
Abstract
Neurofeedback is defined as a method to read out information from the brain and feed the information back to the brain. This technology has developed in the past ten years and attracted considerable attention as potential treatments for rehabilitation and psychiatric disease. We recently invented the decoded neurofeedback (DecNef) method, a new neurofeedback technique using functional magnetic resonance imaging. With DecNef, subjects were trained to regulate their brain activation pattern in a specific area and lead the pattern to a target state. We found that the DecNef training for several days leads to perceptual improvement that corresponds to the induced target state. DecNef enables us to test cause-and-effect relationships between neural activation in a target brain area and changes in perception, cognition, and behavior. In this sense, this method can be a powerful tool in cognitive and systems neuroscience. In addition, the concept of DecNef, leading a neural activation pattern to a specific state, can be applied for a variety of fields including engineering and medical treatment.
Collapse
Affiliation(s)
- Kazuhisa Shibata
- Brain Information Communication Research Laboratory Group, Advanced Telecommunication Research Institute International
| |
Collapse
|
9
|
Shibata K, Watanabe T, Sasaki Y, Kawato M. Perceptual learning incepted by decoded fMRI neurofeedback without stimulus presentation. Science 2012; 334:1413-5. [PMID: 22158821 DOI: 10.1126/science.1212003] [Citation(s) in RCA: 295] [Impact Index Per Article: 24.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
Abstract
It is controversial whether the adult primate early visual cortex is sufficiently plastic to cause visual perceptual learning (VPL). The controversy occurs partially because most VPL studies have examined correlations between behavioral and neural activity changes rather than cause-and-effect relationships. With an online-feedback method that uses decoded functional magnetic resonance imaging (fMRI) signals, we induced activity patterns only in early visual cortex corresponding to an orientation without stimulus presentation or participants' awareness of what was to be learned. The induced activation caused VPL specific to the orientation. These results suggest that early visual areas are so plastic that mere inductions of activity patterns are sufficient to cause VPL. This technique can induce plasticity in a highly selective manner, potentially leading to powerful training and rehabilitative protocols.
Collapse
Affiliation(s)
- Kazuhisa Shibata
- Advanced Telecommunications Research Institute International Computational Neuroscience Laboratories, Keihanna Science City, Kyoto 619-0288, Japan
| | | | | | | |
Collapse
|
10
|
|
11
|
The cerebellar microcircuit as an adaptive filter: experimental and computational evidence. Nat Rev Neurosci 2009; 11:30-43. [DOI: 10.1038/nrn2756] [Citation(s) in RCA: 309] [Impact Index Per Article: 20.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/26/2022]
|
12
|
Mergner T, Tahboub K. Neurorobotics approaches to human and humanoid sensorimotor control. ACTA ACUST UNITED AC 2009; 103:115-8. [PMID: 19665557 DOI: 10.1016/j.jphysparis.2009.07.006] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
13
|
|
14
|
Lenz A, Anderson SR, Pipe AG, Melhuish C, Dean P, Porrill J. Cerebellar-inspired adaptive control of a robot eye actuated by pneumatic artificial muscles. ACTA ACUST UNITED AC 2009; 39:1420-33. [PMID: 19369158 DOI: 10.1109/tsmcb.2009.2018138] [Citation(s) in RCA: 47] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
In this paper, a model of cerebellar function is implemented and evaluated in the control of a robot eye actuated by pneumatic artificial muscles. The investigated control problem is stabilization of the visual image in response to disturbances. This is analogous to the vestibuloocular reflex (VOR) in humans. The cerebellar model is structurally based on the adaptive filter, and the learning rule is computationally analogous to least-mean squares, where parameter adaptation at the parallel fiber/Purkinje cell synapse is driven by the correlation of the sensory error signal (carried by the climbing fiber) and the motor command signal. Convergence of the algorithm is first analyzed in simulation on a model of the robot and then tested online in both one and two degrees of freedom. The results show that this model of neural function successfully works on a real-world problem, providing empirical evidence for validating: 1) the generic cerebellar learning algorithm; 2) the function of the cerebellum in the VOR; and 3) the signal transmission between functional neural components of the VOR.
Collapse
|
15
|
Sang-Ho Hyon. Compliant Terrain Adaptation for Biped Humanoids Without Measuring Ground Surface and Contact Forces. IEEE T ROBOT 2009. [DOI: 10.1109/tro.2008.2006870] [Citation(s) in RCA: 94] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
16
|
Okano H, Yanagida T, Iriki A. Introduction. Japan: its tradition and hot topics in biological sciences. Philos Trans R Soc Lond B Biol Sci 2008; 363:2067-9. [PMID: 18339598 DOI: 10.1098/rstb.2008.2275] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Affiliation(s)
- Hideyuki Okano
- School of Medicine, Keio University, Shinjyuku-ku, Tokyo 160-8582, Japan
| | | | | |
Collapse
|
17
|
Kasabov N. Evolving Intelligence in Humans and Machines: Integrative Evolving Connectionist Systems Approach. IEEE COMPUT INTELL M 2008. [DOI: 10.1109/mci.2008.926584] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
18
|
Iriki A, Sakura O. The neuroscience of primate intellectual evolution: natural selection and passive and intentional niche construction. Philos Trans R Soc Lond B Biol Sci 2008; 363:2229-41. [PMID: 18426757 PMCID: PMC2394573 DOI: 10.1098/rstb.2008.2274] [Citation(s) in RCA: 97] [Impact Index Per Article: 6.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
We trained Japanese macaque monkeys to use tools, an advanced cognitive function monkeys do not exhibit in the wild, and then examined their brains for signs of modification. Following tool-use training, we observed neurophysiological, molecular genetic and morphological changes within the monkey brain. Despite being 'artificially' induced, these novel behaviours and neural connectivity patterns reveal overlap with those of humans. Thus, they may provide us with a novel experimental platform for studying the mechanisms of human intelligence, for revealing the evolutionary path that created these mechanisms from the 'raw material' of the non-human primate brain, and for deepening our understanding of what cognitive abilities are and of those that are not uniquely human. On these bases, we propose a theory of 'intentional niche construction' as an extension of natural selection in order to reveal the evolutionary mechanisms that forged the uniquely intelligent human brain.
Collapse
Affiliation(s)
- Atsushi Iriki
- RIKEN Brain Science Institute, Saitama 351-0198, Japan.
| | | |
Collapse
|
19
|
Abstract
In January 2008, Duke University and the Japan Science and Technology Agency (JST) publicized their successful control of a brain-machine interface for a humanoid robot by a monkey brain across the Pacific Ocean. The activities of a few hundred neurons were recorded from a monkey's motor cortex in Miguel Nicolelis's lab at Duke University, and the kinematic features of monkey locomotion on a treadmill were decoded from neural firing rates in real time. The decoded information was sent to a humanoid robot, CB-i, in ATR Computational Neuroscience Laboratories located in Kyoto, Japan. This robot was developed by the JST International Collaborative Research Project (ICORP) as the "Computational Brain Project." CB-i's locomotion-like movement was video-recorded and projected on a screen in front of the monkey. Although the bidirectional communication used a conventional Internet connection, its delay was suppressed below one over several seconds, partly due to a video-streaming technique, and this encouraged the monkey's voluntary locomotion and influenced its brain activity. This commentary introduces the background and future directions of the brain-controlled robot.
Collapse
Affiliation(s)
- Mitsuo Kawato
- Japan Science and Technology Agency ICORP, Computational Brain Project, and ATR Computational Neuroscience Laboratories, Hikaridai 2-2-2, Seika-cho, Soraku-gun, Kyoto, 619-0288, Japan
| |
Collapse
|
20
|
Sang-Ho Hyon, Hale J, Cheng G. Full-Body Compliant Human–Humanoid Interaction: Balancing in the Presence of Unknown External Forces. IEEE T ROBOT 2007. [DOI: 10.1109/tro.2007.904896] [Citation(s) in RCA: 254] [Impact Index Per Article: 14.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|