1
|
Gold J, Ciorciari J. A neurocognitive model of flow states and the role of cerebellar internal models. Behav Brain Res 2021; 407:113244. [PMID: 33744335 DOI: 10.1016/j.bbr.2021.113244] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2020] [Revised: 02/24/2021] [Accepted: 03/10/2021] [Indexed: 01/02/2023]
Abstract
This paper conceptualizes a comprehensive body of neurocognitive knowledge of flow states based on two primary competing neurocognitive theories underpinning flow's purported functioning, the transient hypofrontality hypothesis and the network synchronization model. With these models in mind, a new neurocognitive model of flow is synthesized based on the similarities of these pre-existing theories and utilizing the internal models of the cerebellum to elucidate the differences and crossover in the current flow research. Ultimately, this paper works to provide a platform for researchers to use as a future reference and for hypothesis generation.
Collapse
Affiliation(s)
- Joshua Gold
- Centre for Mental Health, Swinburne Neuroimaging (SNI), Swinburne University of Technology, Hawthorn, VIC, Australia.
| | - Joseph Ciorciari
- Department of Psychological Sciences, Swinburne University of Technology, Hawthorn, VIC, Australia
| |
Collapse
|
2
|
Wiers RW, Verschure P. Curing the broken brain model of addiction: Neurorehabilitation from a systems perspective. Addict Behav 2021; 112:106602. [PMID: 32889442 DOI: 10.1016/j.addbeh.2020.106602] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2020] [Revised: 07/09/2020] [Accepted: 08/04/2020] [Indexed: 12/11/2022]
Abstract
The dominant biomedical perspective on addictions has been that they are chronic brain diseases. While we acknowledge that the brains of people with addictions differ from those without, we argue that the "broken brain" model of addiction has important limitations. We propose that a systems-level perspective more effectively captures the integrated architecture of the embodied and situated human mind and brain in relation to the development of addictions. This more dynamic conceptualization places addiction in the broader context of the addicted brain that drives behavior, where the addicted brain is the substrate of the addicted mind, that in turn is situated in a physical and socio-cultural environment. From this perspective, neurorehabilitation should shift from a "broken-brain" to a systems theoretical framework, which includes high-level concepts related to the physical and social environment, motivation, self-image, and the meaning of alternative activities, which in turn will dynamically influence subsequent brain adaptations. We call this integrated approach system-oriented neurorehabilitation. We illustrate our proposal by showing the link between addiction and the architecture of the embodied brain, including a systems-level perspective on classical conditioning, which has been successfully translated into neurorehabilitation. Central to this example is the notion that the human brain makes predictions on future states as well as expected (or counterfactual) errors, in the context of its goals. We advocate system-oriented neurorehabilitation of addiction where the patients' goals are central in targeted, personalized assessment and intervention.
Collapse
|
3
|
Rasmussen A. Graded error signals in eyeblink conditioning. Neurobiol Learn Mem 2020; 170:107023. [DOI: 10.1016/j.nlm.2019.04.011] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2019] [Revised: 04/15/2019] [Accepted: 04/23/2019] [Indexed: 01/06/2023]
|
4
|
Herreros I, Miquel L, Blithikioti C, Nuño L, Rubio Ballester B, Grechuta K, Gual A, Balcells-Oliveró M, Verschure P. Motor Adaptation Impairment in Chronic Cannabis Users Assessed by a Visuomotor Rotation Task. J Clin Med 2019; 8:jcm8071049. [PMID: 31323815 PMCID: PMC6678817 DOI: 10.3390/jcm8071049] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2019] [Revised: 07/14/2019] [Accepted: 07/16/2019] [Indexed: 12/30/2022] Open
Abstract
Background—The cerebellum has been recently suggested as an important player in the addiction brain circuit. Cannabis is one of the most used drugs worldwide, and its long-term effects on the central nervous system are not fully understood. No valid clinical evaluations of cannabis impact on the brain are available today. The cerebellum is expected to be one of the brain structures that are highly affected by prolonged exposure to cannabis, due to its high density in endocannabinoid receptors. We aim to use a motor adaptation paradigm to indirectly assess cerebellar function in chronic cannabis users (CCUs). Methods—We used a visuomotor rotation (VMR) task that probes a putatively-cerebellar implicit motor adaptation process together with the learning and execution of an explicit aiming rule. We conducted a case-control study, recruiting 18 CCUs and 18 age-matched healthy controls. Our main measure was the angular aiming error. Results—Our results show that CCUs have impaired implicit motor adaptation, as they showed a smaller rate of adaptation compared with healthy controls (drift rate: 19.3 +/− 6.8° vs. 27.4 +/− 11.6°; t(26) = −2.1, p = 0.048, Cohen’s d = −0.8, 95% CI = (−1.7, −0.15)). Conclusions—We suggest that a visuomotor rotation task might be the first step towards developing a useful tool for the detection of alterations in implicit learning among cannabis users.
Collapse
Affiliation(s)
- Ivan Herreros
- SPECS lab, Universitat Pompeu Fabra, 08002 Barcelona, Spain
| | - Laia Miquel
- GRAC, Grup de Recerca en addiccions clínic, Villarroel, 170 08036 Barcelona, Spain.
- IDIBAPS, Institut d'Investigacions Biomèdiques August Pi i Sunyer, Villarroel, 170 08036 Barcelona, Spain.
| | - Chrysanthi Blithikioti
- GRAC, Grup de Recerca en addiccions clínic, Villarroel, 170 08036 Barcelona, Spain
- IDIBAPS, Institut d'Investigacions Biomèdiques August Pi i Sunyer, Villarroel, 170 08036 Barcelona, Spain
| | - Laura Nuño
- GRAC, Grup de Recerca en addiccions clínic, Villarroel, 170 08036 Barcelona, Spain
| | - Belen Rubio Ballester
- IBEC, Institute for Biomedical Engineering of Catalonia, Universitat Politècnica de Catalunya, 08028 Barcelona, Spain
| | - Klaudia Grechuta
- IBEC, Institute for Biomedical Engineering of Catalonia, Universitat Politècnica de Catalunya, 08028 Barcelona, Spain
| | - Antoni Gual
- IDIBAPS, Institut d'Investigacions Biomèdiques August Pi i Sunyer, Villarroel, 170 08036 Barcelona, Spain
- ICREA, Institució Catalana de Recerca i Estudis Avançats, Passeig Lluís Companys, 08010 Barcelona, Spain
| | | | - Paul Verschure
- IBEC, Institute for Biomedical Engineering of Catalonia, Universitat Politècnica de Catalunya, 08028 Barcelona, Spain
- ICREA, Institució Catalana de Recerca i Estudis Avançats, Passeig Lluís Companys, 08010 Barcelona, Spain
| |
Collapse
|
5
|
Kalidindi HT, George Thuruthel T, Laschi C, Falotico E. Modeling the Encoding of Saccade Kinematic Metrics in the Purkinje Cell Layer of the Cerebellar Vermis. Front Comput Neurosci 2019; 12:108. [PMID: 30687055 PMCID: PMC6335360 DOI: 10.3389/fncom.2018.00108] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2018] [Accepted: 12/19/2018] [Indexed: 11/25/2022] Open
Abstract
Recent electrophysiological observations related to saccadic eye movements in rhesus monkeys, suggest a prediction of the sensory consequences of movement in the Purkinje cell layer of the cerebellar oculomotor vermis (OMV). A definite encoding of real-time motion of the eye has been observed in simple-spike responses of the combined burst-pause Purkinje cell populations, organized based upon their complex-spike directional tuning. However, the underlying control mechanisms that could lead to such action encoding are still unclear. We propose a saccade control model, with emphasis on the structure of the OMV and its interaction with the extra-cerebellar components. In the simulated bilateral organization of the OMV, each caudal fastigial nucleus is arranged to receive incoming projections from combined burst-pause Purkinje cell populations. The OMV, through the caudal fastigial nuclei, interacts with the brainstem to provide adaptive saccade gain corrections that minimize the visual error in reaching a given target location. The simulation results corroborate the experimental Purkinje cell population activity patterns and their relation with saccade kinematic metrics. The Purkinje layer activity that emerges from the proposed organization, precisely predicted the speed of the eye at different target eccentricities. Simulated granular layer activity suggests no separate dynamics with respect to shaping the bilateral Purkine layer activity. We further examine the validity of the simulated OMV in maintaining the accuracy of saccadic eye movements in the presence of signal dependent variabilities, that can occur in extra-cerebellar pathways.
Collapse
Affiliation(s)
| | | | - Cecilia Laschi
- The BioRobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy
| | - Egidio Falotico
- The BioRobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy
| |
Collapse
|
6
|
McMorris T, Barwood M, Corbett J. Central fatigue theory and endurance exercise: Toward an interoceptive model. Neurosci Biobehav Rev 2018; 93:93-107. [DOI: 10.1016/j.neubiorev.2018.03.024] [Citation(s) in RCA: 55] [Impact Index Per Article: 9.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2017] [Revised: 02/15/2018] [Accepted: 03/22/2018] [Indexed: 12/20/2022]
|
7
|
Geminiani A, Casellato C, Antonietti A, D’Angelo E, Pedrocchi A. A Multiple-Plasticity Spiking Neural Network Embedded in a Closed-Loop Control System to Model Cerebellar Pathologies. Int J Neural Syst 2018; 28:1750017. [DOI: 10.1142/s0129065717500174] [Citation(s) in RCA: 37] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
Abstract
The cerebellum plays a crucial role in sensorimotor control and cerebellar disorders compromise adaptation and learning of motor responses. However, the link between alterations at network level and cerebellar dysfunction is still unclear. In principle, this understanding would benefit of the development of an artificial system embedding the salient neuronal and plastic properties of the cerebellum and operating in closed-loop. To this aim, we have exploited a realistic spiking computational model of the cerebellum to analyze the network correlates of cerebellar impairment. The model was modified to reproduce three different damages of the cerebellar cortex: (i) a loss of the main output neurons (Purkinje Cells), (ii) a lesion to the main cerebellar afferents (Mossy Fibers), and (iii) a damage to a major mechanism of synaptic plasticity (Long Term Depression). The modified network models were challenged with an Eye-Blink Classical Conditioning test, a standard learning paradigm used to evaluate cerebellar impairment, in which the outcome was compared to reference results obtained in human or animal experiments. In all cases, the model reproduced the partial and delayed conditioning typical of the pathologies, indicating that an intact cerebellar cortex functionality is required to accelerate learning by transferring acquired information to the cerebellar nuclei. Interestingly, depending on the type of lesion, the redistribution of synaptic plasticity and response timing varied greatly generating specific adaptation patterns. Thus, not only the present work extends the generalization capabilities of the cerebellar spiking model to pathological cases, but also predicts how changes at the neuronal level are distributed across the network, making it usable to infer cerebellar circuit alterations occurring in cerebellar pathologies.
Collapse
Affiliation(s)
- Alice Geminiani
- NeuroEngineering and Medical Robotics Laboratory, Department of Electronics, Information and Bioengineering, Politecnico di Milano, P.zza Leonardo Da Vinci 32, 20133, Milano, Italy
| | - Claudia Casellato
- NeuroEngineering and Medical Robotics Laboratory, Department of Electronics, Information and Bioengineering, Politecnico di Milano, P.zza Leonardo Da Vinci 32, 20133, Milano, Italy
| | - Alberto Antonietti
- NeuroEngineering and Medical Robotics Laboratory, Department of Electronics, Information and Bioengineering, Politecnico di Milano, P.zza Leonardo Da Vinci 32, 20133, Milano, Italy
| | - Egidio D’Angelo
- Department of Brain and Behavioral Sciences, University of Pavia, Via Forlanini 6, I-27100 Pavia, Italy
- Brain Connectivity Center, Istituto Neurologico, IRCCS Fondazione C. Mondino Via, Mondino 2, I-27100, Pavia, Italy
| | - Alessandra Pedrocchi
- Neuroengineering and Medical Robotics Laboratory, Department of Electronics, Information and Bioengineering, Politecnico di Milano, P.zza Leonardo Da Vinci 32, 20133 Milano, Italy
| |
Collapse
|
8
|
Maffei G, Herreros I, Sanchez-Fibla M, Friston KJ, Verschure PFMJ. The perceptual shaping of anticipatory actions. Proc Biol Sci 2017; 284:20171780. [PMID: 29263282 PMCID: PMC5745402 DOI: 10.1098/rspb.2017.1780] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2017] [Accepted: 11/22/2017] [Indexed: 02/06/2023] Open
Abstract
Humans display anticipatory motor responses to minimize the adverse effects of predictable perturbations. A widely accepted explanation for this behaviour relies on the notion of an inverse model that, learning from motor errors, anticipates corrective responses. Here, we propose and validate the alternative hypothesis that anticipatory control can be realized through a cascade of purely sensory predictions that drive the motor system, reflecting the causal sequence of the perceptual events preceding the error. We compare both hypotheses in a simulated anticipatory postural adjustment task. We observe that adaptation in the sensory domain, but not in the motor one, supports the robust and generalizable anticipatory control characteristic of biological systems. Our proposal unites the neurobiology of the cerebellum with the theory of active inference and provides a concrete implementation of its core tenets with great relevance both to our understanding of biological control systems and, possibly, to their emulation in complex artefacts.
Collapse
Affiliation(s)
- Giovanni Maffei
- Institute for Bioengineering of Catalonia (IBEC), Barcelona Institute of Science and Technology (BIST), Barcelona, Spain
- Department of Information and Communication Technologies, Universitat Pompeu Fabra (UPF), Barcelona, Spain
| | - Ivan Herreros
- Department of Information and Communication Technologies, Universitat Pompeu Fabra (UPF), Barcelona, Spain
- Imaging Neuroscience and Theoretical Neurobiology, Wellcome Trust Centre for Neuroimaging, University College of London (UCL), London, UK
| | - Marti Sanchez-Fibla
- Department of Information and Communication Technologies, Universitat Pompeu Fabra (UPF), Barcelona, Spain
| | - Karl J Friston
- Imaging Neuroscience and Theoretical Neurobiology, Wellcome Trust Centre for Neuroimaging, University College of London (UCL), London, UK
| | - Paul F M J Verschure
- Institute for Bioengineering of Catalonia (IBEC), Barcelona Institute of Science and Technology (BIST), Barcelona, Spain
- Department of Information and Communication Technologies, Universitat Pompeu Fabra (UPF), Barcelona, Spain
- Catalan Institution for Research and Advanced Studies (ICREA), Barcelona, Spain
| |
Collapse
|
9
|
Antonietti A, Casellato C, D'Angelo E, Pedrocchi A. Model-Driven Analysis of Eyeblink Classical Conditioning Reveals the Underlying Structure of Cerebellar Plasticity and Neuronal Activity. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2017; 28:2748-2762. [PMID: 27608482 DOI: 10.1109/tnnls.2016.2598190] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
The cerebellum plays a critical role in sensorimotor control. However, how the specific circuits and plastic mechanisms of the cerebellum are engaged in closed-loop processing is still unclear. We developed an artificial sensorimotor control system embedding a detailed spiking cerebellar microcircuit with three bidirectional plasticity sites. This proved able to reproduce a cerebellar-driven associative paradigm, the eyeblink classical conditioning (EBCC), in which a precise time relationship between an unconditioned stimulus (US) and a conditioned stimulus (CS) is established. We challenged the spiking model to fit an experimental data set from human subjects. Two subsequent sessions of EBCC acquisition and extinction were recorded and transcranial magnetic stimulation (TMS) was applied on the cerebellum to alter circuit function and plasticity. Evolutionary algorithms were used to find the near-optimal model parameters to reproduce the behaviors of subjects in the different sessions of the protocol. The main finding is that the optimized cerebellar model was able to learn to anticipate (predict) conditioned responses with accurate timing and success rate, demonstrating fast acquisition, memory stabilization, rapid extinction, and faster reacquisition as in EBCC in humans. The firing of Purkinje cells (PCs) and deep cerebellar nuclei (DCN) changed during learning under the control of synaptic plasticity, which evolved at different rates, with a faster acquisition in the cerebellar cortex than in DCN synapses. Eventually, a reduced PC activity released DCN discharge just after the CS, precisely anticipating the US and causing the eyeblink. Moreover, a specific alteration in cortical plasticity explained the EBCC changes induced by cerebellar TMS in humans. In this paper, for the first time, it is shown how closed-loop simulations, using detailed cerebellar microcircuit models, can be successfully used to fit real experimental data sets. Thus, the changes of the model parameters in the different sessions of the protocol unveil how implicit microcircuit mechanisms can generate normal and altered associative behaviors.The cerebellum plays a critical role in sensorimotor control. However, how the specific circuits and plastic mechanisms of the cerebellum are engaged in closed-loop processing is still unclear. We developed an artificial sensorimotor control system embedding a detailed spiking cerebellar microcircuit with three bidirectional plasticity sites. This proved able to reproduce a cerebellar-driven associative paradigm, the eyeblink classical conditioning (EBCC), in which a precise time relationship between an unconditioned stimulus (US) and a conditioned stimulus (CS) is established. We challenged the spiking model to fit an experimental data set from human subjects. Two subsequent sessions of EBCC acquisition and extinction were recorded and transcranial magnetic stimulation (TMS) was applied on the cerebellum to alter circuit function and plasticity. Evolutionary algorithms were used to find the near-optimal model parameters to reproduce the behaviors of subjects in the different sessions of the protocol. The main finding is that the optimized cerebellar model was able to learn to anticipate (predict) conditioned responses with accurate timing and success rate, demonstrating fast acquisition, memory stabilization, rapid extinction, and faster reacquisition as in EBCC in humans. The firing of Purkinje cells (PCs) and deep cerebellar nuclei (DCN) changed during learning under the control of synaptic plasticity, which evolved at different rates, with a faster acquisition in the cerebellar cortex than in DCN synapses. Eventually, a reduced PC activity released DCN discharge just after the CS, precisely anticipating the US and causing the eyeblink. Moreover, a specific alteration in cortical plasticity explained the EBCC changes induced by cerebellar TMS in humans. In this paper, for the first time, it is shown how closed-loop simulations, using detailed cerebellar microcircuit models, can be successfully used to fit real experimental data sets. Thus, the changes of the model parameters in the different sessions of the protocol unveil how implicit microcircuit mechanisms can generate normal and altered associative behaviors.
Collapse
Affiliation(s)
- Alberto Antonietti
- Department of Electronics, Neuroengineering and Medical Robotics Laboratory, Information and Bioengineering, Politecnico di Milano, Milan, Italy
| | - Claudia Casellato
- Department of Electronics, Neuroengineering and Medical Robotics Laboratory, Information and Bioengineering, Politecnico di Milano, Milan, Italy
| | - Egidio D'Angelo
- Department of Brain and Behavioral Sciences, Brain Connectivity Center, Istituto di Ricovero e Cura a Carattere Scientifico and the Istituto Neurologico Nazionale C. Mondino, University of Pavia, Pavia, Italy
| | - Alessandra Pedrocchi
- Department of Electronics, Neuroengineering and Medical Robotics Laboratory, Information and Bioengineering, Politecnico di Milano, Milan, Italy
| |
Collapse
|
10
|
Consensus Paper: Towards a Systems-Level View of Cerebellar Function: the Interplay Between Cerebellum, Basal Ganglia, and Cortex. THE CEREBELLUM 2017; 16:203-229. [PMID: 26873754 PMCID: PMC5243918 DOI: 10.1007/s12311-016-0763-3] [Citation(s) in RCA: 242] [Impact Index Per Article: 34.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
Despite increasing evidence suggesting the cerebellum works in concert with the cortex and basal ganglia, the nature of the reciprocal interactions between these three brain regions remains unclear. This consensus paper gathers diverse recent views on a variety of important roles played by the cerebellum within the cerebello-basal ganglia-thalamo-cortical system across a range of motor and cognitive functions. The paper includes theoretical and empirical contributions, which cover the following topics: recent evidence supporting the dynamical interplay between cerebellum, basal ganglia, and cortical areas in humans and other animals; theoretical neuroscience perspectives and empirical evidence on the reciprocal influences between cerebellum, basal ganglia, and cortex in learning and control processes; and data suggesting possible roles of the cerebellum in basal ganglia movement disorders. Although starting from different backgrounds and dealing with different topics, all the contributors agree that viewing the cerebellum, basal ganglia, and cortex as an integrated system enables us to understand the function of these areas in radically different ways. In addition, there is unanimous consensus between the authors that future experimental and computational work is needed to understand the function of cerebellar-basal ganglia circuitry in both motor and non-motor functions. The paper reports the most advanced perspectives on the role of the cerebellum within the cerebello-basal ganglia-thalamo-cortical system and illustrates other elements of consensus as well as disagreements and open questions in the field.
Collapse
|
11
|
Caligiore D, Mannella F, Arbib MA, Baldassarre G. Dysfunctions of the basal ganglia-cerebellar-thalamo-cortical system produce motor tics in Tourette syndrome. PLoS Comput Biol 2017; 13:e1005395. [PMID: 28358814 PMCID: PMC5373520 DOI: 10.1371/journal.pcbi.1005395] [Citation(s) in RCA: 69] [Impact Index Per Article: 9.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2016] [Accepted: 02/01/2017] [Indexed: 12/24/2022] Open
Abstract
Motor tics are a cardinal feature of Tourette syndrome and are traditionally associated with an excess of striatal dopamine in the basal ganglia. Recent evidence increasingly supports a more articulated view where cerebellum and cortex, working closely in concert with basal ganglia, are also involved in tic production. Building on such evidence, this article proposes a computational model of the basal ganglia-cerebellar-thalamo-cortical system to study how motor tics are generated in Tourette syndrome. In particular, the model: (i) reproduces the main results of recent experiments about the involvement of the basal ganglia-cerebellar-thalamo-cortical system in tic generation; (ii) suggests an explanation of the system-level mechanisms underlying motor tic production: in this respect, the model predicts that the interplay between dopaminergic signal and cortical activity contributes to triggering the tic event and that the recently discovered basal ganglia-cerebellar anatomical pathway may support the involvement of the cerebellum in tic production; (iii) furnishes predictions on the amount of tics generated when striatal dopamine increases and when the cortex is externally stimulated. These predictions could be important in identifying new brain target areas for future therapies. Finally, the model represents the first computational attempt to study the role of the recently discovered basal ganglia-cerebellar anatomical links. Studying this non-cortex-mediated basal ganglia-cerebellar interaction could radically change our perspective about how these areas interact with each other and with the cortex. Overall, the model also shows the utility of casting Tourette syndrome within a system-level perspective rather than viewing it as related to the dysfunction of a single brain area. Tourette syndrome is a neuropsychiatric disorder characterized by vocal and motor tics. Tics represent a cardinal symptom traditionally associated with a dysfunction of the basal ganglia leading to an excess of the dopamine neurotransmitter. This view gives a restricted clinical picture and limits therapeutic approaches because it ignores the influence of altered interactions between the basal ganglia and other brain areas. In this respect, recent evidence supports a more articulated framework where cerebellum and cortex are also involved in tic production. Building on these data, we propose a computational model of the basal ganglia-cerebellar-thalamo-cortical network to investigate the specific mechanisms underlying motor tic production. The model reproduces the results of recent experiments and suggests an explanation of the system-level processes underlying tic production. Moreover, it furnishes predictions related to the amount of tics generated when there are dysfunctions in the basal ganglia-cerebellar-thalamo-cortical circuits. These predictions could be important in identifying new brain target areas for future therapies based on a system-level view of Tourette syndrome.
Collapse
Affiliation(s)
- Daniele Caligiore
- Laboratory of Computational Embodied Neuroscience, Institute of Cognitive Sciences and Technologies, National Research Council (CNR-ISTC-LOCEN), Roma, Italy
- * E-mail:
| | - Francesco Mannella
- Laboratory of Computational Embodied Neuroscience, Institute of Cognitive Sciences and Technologies, National Research Council (CNR-ISTC-LOCEN), Roma, Italy
| | - Michael A. Arbib
- Neuroscience Program, USC Brain Project, Computer Science Department, University of Southern California, Los Angeles, California, United States of America
| | - Gianluca Baldassarre
- Laboratory of Computational Embodied Neuroscience, Institute of Cognitive Sciences and Technologies, National Research Council (CNR-ISTC-LOCEN), Roma, Italy
| |
Collapse
|
12
|
Antonietti A, Casellato C, Garrido JA, Luque NR, Naveros F, Ros E, DAngelo E, Pedrocchi A. Spiking Neural Network With Distributed Plasticity Reproduces Cerebellar Learning in Eye Blink Conditioning Paradigms. IEEE Trans Biomed Eng 2016; 63:210-9. [DOI: 10.1109/tbme.2015.2485301] [Citation(s) in RCA: 39] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
13
|
Maffei G, Santos-Pata D, Marcos E, Sánchez-Fibla M, Verschure PFMJ. An embodied biologically constrained model of foraging: from classical and operant conditioning to adaptive real-world behavior in DAC-X. Neural Netw 2015; 72:88-108. [PMID: 26585942 DOI: 10.1016/j.neunet.2015.10.004] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2015] [Revised: 10/08/2015] [Accepted: 10/08/2015] [Indexed: 01/08/2023]
Abstract
Animals successfully forage within new environments by learning, simulating and adapting to their surroundings. The functions behind such goal-oriented behavior can be decomposed into 5 top-level objectives: 'how', 'why', 'what', 'where', 'when' (H4W). The paradigms of classical and operant conditioning describe some of the behavioral aspects found in foraging. However, it remains unclear how the organization of their underlying neural principles account for these complex behaviors. We address this problem from the perspective of the Distributed Adaptive Control theory of mind and brain (DAC) that interprets these two paradigms as expressing properties of core functional subsystems of a layered architecture. In particular, we propose DAC-X, a novel cognitive architecture that unifies the theoretical principles of DAC with biologically constrained computational models of several areas of the mammalian brain. DAC-X supports complex foraging strategies through the progressive acquisition, retention and expression of task-dependent information and associated shaping of action, from exploration to goal-oriented deliberation. We benchmark DAC-X using a robot-based hoarding task including the main perceptual and cognitive aspects of animal foraging. We show that efficient goal-oriented behavior results from the interaction of parallel learning mechanisms accounting for motor adaptation, spatial encoding and decision-making. Together, our results suggest that the H4W problem can be solved by DAC-X building on the insights from the study of classical and operant conditioning. Finally, we discuss the advantages and limitations of the proposed biologically constrained and embodied approach towards the study of cognition and the relation of DAC-X to other cognitive architectures.
Collapse
Affiliation(s)
- Giovanni Maffei
- Laboratory of Synthetic, Perceptive, Emotive and Cognitive Systems (SPECS), Center of Autonomous Systems and Neurorobotics, Universitat Pompeu Fabra (UPF), Barcelona, Spain
| | - Diogo Santos-Pata
- Laboratory of Synthetic, Perceptive, Emotive and Cognitive Systems (SPECS), Center of Autonomous Systems and Neurorobotics, Universitat Pompeu Fabra (UPF), Barcelona, Spain
| | - Encarni Marcos
- Laboratory of Synthetic, Perceptive, Emotive and Cognitive Systems (SPECS), Center of Autonomous Systems and Neurorobotics, Universitat Pompeu Fabra (UPF), Barcelona, Spain
| | - Marti Sánchez-Fibla
- Laboratory of Synthetic, Perceptive, Emotive and Cognitive Systems (SPECS), Center of Autonomous Systems and Neurorobotics, Universitat Pompeu Fabra (UPF), Barcelona, Spain
| | - Paul F M J Verschure
- Laboratory of Synthetic, Perceptive, Emotive and Cognitive Systems (SPECS), Center of Autonomous Systems and Neurorobotics, Universitat Pompeu Fabra (UPF), Barcelona, Spain; Institució Catalana de Recerca i Estudis Avançats (ICREA), Barcelona, Spain.
| |
Collapse
|
14
|
Purkinje cell activity during classical conditioning with different conditional stimuli explains central tenet of Rescorla–Wagner model [corrected]. Proc Natl Acad Sci U S A 2015; 112:14060-5. [PMID: 26504227 DOI: 10.1073/pnas.1516986112] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/11/2023] Open
Abstract
A central tenet of Rescorla and Wagner's model of associative learning is that the reinforcement value of a paired trial diminishes as the associative strength between the presented stimuli increases. Despite its fundamental importance to behavioral sciences, the neural mechanisms underlying the model have not been fully explored. Here, we present findings that, taken together, can explain why a stronger association leads to a reduced reinforcement value, within the context of eyeblink conditioning. Specifically, we show that learned pause responses in Purkinje cells, which trigger adaptively timed conditioned eyeblinks, suppress the unconditional stimulus (US) signal in a graded manner. Furthermore, by examining how Purkinje cells respond to two distinct conditional stimuli and to a compound stimulus, we provide evidence that could potentially help explain the somewhat counterintuitive overexpectation phenomenon, which was derived from the Rescorla-Wagner model.
Collapse
|
15
|
Multiple timescales of body schema reorganization due to plastic surgery. Hum Mov Sci 2015; 42:54-70. [DOI: 10.1016/j.humov.2015.04.009] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2015] [Revised: 04/09/2015] [Accepted: 04/12/2015] [Indexed: 01/07/2023]
|
16
|
|
17
|
More gain less pain: balance control learning shifts the activation patterns of leg and neck muscles and increases muscular parsimony. Exp Brain Res 2015; 233:2103-14. [DOI: 10.1007/s00221-015-4281-1] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2014] [Accepted: 04/06/2015] [Indexed: 12/20/2022]
|
18
|
Casellato C, Antonietti A, Garrido JA, Carrillo RR, Luque NR, Ros E, Pedrocchi A, D'Angelo E. Adaptive robotic control driven by a versatile spiking cerebellar network. PLoS One 2014; 9:e112265. [PMID: 25390365 PMCID: PMC4229206 DOI: 10.1371/journal.pone.0112265] [Citation(s) in RCA: 58] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2014] [Accepted: 09/11/2014] [Indexed: 11/29/2022] Open
Abstract
The cerebellum is involved in a large number of different neural processes, especially in associative learning and in fine motor control. To develop a comprehensive theory of sensorimotor learning and control, it is crucial to determine the neural basis of coding and plasticity embedded into the cerebellar neural circuit and how they are translated into behavioral outcomes in learning paradigms. Learning has to be inferred from the interaction of an embodied system with its real environment, and the same cerebellar principles derived from cell physiology have to be able to drive a variety of tasks of different nature, calling for complex timing and movement patterns. We have coupled a realistic cerebellar spiking neural network (SNN) with a real robot and challenged it in multiple diverse sensorimotor tasks. Encoding and decoding strategies based on neuronal firing rates were applied. Adaptive motor control protocols with acquisition and extinction phases have been designed and tested, including an associative Pavlovian task (Eye blinking classical conditioning), a vestibulo-ocular task and a perturbed arm reaching task operating in closed-loop. The SNN processed in real-time mossy fiber inputs as arbitrary contextual signals, irrespective of whether they conveyed a tone, a vestibular stimulus or the position of a limb. A bidirectional long-term plasticity rule implemented at parallel fibers-Purkinje cell synapses modulated the output activity in the deep cerebellar nuclei. In all tasks, the neurorobot learned to adjust timing and gain of the motor responses by tuning its output discharge. It succeeded in reproducing how human biological systems acquire, extinguish and express knowledge of a noisy and changing world. By varying stimuli and perturbations patterns, real-time control robustness and generalizability were validated. The implicit spiking dynamics of the cerebellar model fulfill timing, prediction and learning functions.
Collapse
Affiliation(s)
- Claudia Casellato
- NeuroEngineering and Medical Robotics Laboratory, Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milano, Italy
| | - Alberto Antonietti
- NeuroEngineering and Medical Robotics Laboratory, Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milano, Italy; Brain Connectivity Center, Istituto di Ricovero e Cura a Carattere Scientifico Istituto Neurologico Nazionale Casimiro Mondino, Pavia, Italy
| | - Jesus A Garrido
- Brain Connectivity Center, Istituto di Ricovero e Cura a Carattere Scientifico Istituto Neurologico Nazionale Casimiro Mondino, Pavia, Italy; Department of Brain and Behavioral Sciences, University of Pavia, Pavia, Italy
| | - Richard R Carrillo
- Department of Computer Architecture and Technology, Escuela Técnica Superior de Ingegnerías Informática y de Telecomunicación, University of Granada, Granada, Spain
| | - Niceto R Luque
- Department of Computer Architecture and Technology, Escuela Técnica Superior de Ingegnerías Informática y de Telecomunicación, University of Granada, Granada, Spain
| | - Eduardo Ros
- Department of Computer Architecture and Technology, Escuela Técnica Superior de Ingegnerías Informática y de Telecomunicación, University of Granada, Granada, Spain
| | - Alessandra Pedrocchi
- NeuroEngineering and Medical Robotics Laboratory, Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milano, Italy
| | - Egidio D'Angelo
- Brain Connectivity Center, Istituto di Ricovero e Cura a Carattere Scientifico Istituto Neurologico Nazionale Casimiro Mondino, Pavia, Italy; Department of Brain and Behavioral Sciences, University of Pavia, Pavia, Italy
| |
Collapse
|
19
|
Verschure PFMJ, Pennartz CMA, Pezzulo G. The why, what, where, when and how of goal-directed choice: neuronal and computational principles. Philos Trans R Soc Lond B Biol Sci 2014; 369:20130483. [PMID: 25267825 PMCID: PMC4186236 DOI: 10.1098/rstb.2013.0483] [Citation(s) in RCA: 75] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/06/2023] Open
Abstract
The central problems that goal-directed animals must solve are: 'What do I need and Why, Where and When can this be obtained, and How do I get it?' or the H4W problem. Here, we elucidate the principles underlying the neuronal solutions to H4W using a combination of neurobiological and neurorobotic approaches. First, we analyse H4W from a system-level perspective by mapping its objectives onto the Distributed Adaptive Control embodied cognitive architecture which sees the generation of adaptive action in the real world as the primary task of the brain rather than optimally solving abstract problems. We next map this functional decomposition to the architecture of the rodent brain to test its consistency. Following this approach, we propose that the mammalian brain solves the H4W problem on the basis of multiple kinds of outcome predictions, integrating central representations of needs and drives (e.g. hypothalamus), valence (e.g. amygdala), world, self and task state spaces (e.g. neocortex, hippocampus and prefrontal cortex, respectively) combined with multi-modal selection (e.g. basal ganglia). In our analysis, goal-directed behaviour results from a well-structured architecture in which goals are bootstrapped on the basis of predefined needs, valence and multiple learning, memory and planning mechanisms rather than being generated by a singular computation.
Collapse
Affiliation(s)
- Paul F M J Verschure
- Laboratory of Synthetic, Perceptive, Emotive and Cognitive Systems (SPECS), Center of Autonomous Systems and Neurorobotics, Universitat Pompeu Fabra (UPF), Barcelona, Spain Institució Catalana de Recerca i Estudis Avançats (ICREA), Barcelona, Spain
| | | | - Giovanni Pezzulo
- Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy
| |
Collapse
|
20
|
Dasgupta S, Wörgötter F, Manoonpong P. Neuromodulatory adaptive combination of correlation-based learning in cerebellum and reward-based learning in basal ganglia for goal-directed behavior control. Front Neural Circuits 2014; 8:126. [PMID: 25389391 PMCID: PMC4211401 DOI: 10.3389/fncir.2014.00126] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2014] [Accepted: 09/30/2014] [Indexed: 12/30/2022] Open
Abstract
Goal-directed decision making in biological systems is broadly based on associations between conditional and unconditional stimuli. This can be further classified as classical conditioning (correlation-based learning) and operant conditioning (reward-based learning). A number of computational and experimental studies have well established the role of the basal ganglia in reward-based learning, where as the cerebellum plays an important role in developing specific conditioned responses. Although viewed as distinct learning systems, recent animal experiments point toward their complementary role in behavioral learning, and also show the existence of substantial two-way communication between these two brain structures. Based on this notion of co-operative learning, in this paper we hypothesize that the basal ganglia and cerebellar learning systems work in parallel and interact with each other. We envision that such an interaction is influenced by reward modulated heterosynaptic plasticity (RMHP) rule at the thalamus, guiding the overall goal directed behavior. Using a recurrent neural network actor-critic model of the basal ganglia and a feed-forward correlation-based learning model of the cerebellum, we demonstrate that the RMHP rule can effectively balance the outcomes of the two learning systems. This is tested using simulated environments of increasing complexity with a four-wheeled robot in a foraging task in both static and dynamic configurations. Although modeled with a simplified level of biological abstraction, we clearly demonstrate that such a RMHP induced combinatorial learning mechanism, leads to stabler and faster learning of goal-directed behaviors, in comparison to the individual systems. Thus, in this paper we provide a computational model for adaptive combination of the basal ganglia and cerebellum learning systems by way of neuromodulated plasticity for goal-directed decision making in biological and bio-mimetic organisms.
Collapse
Affiliation(s)
- Sakyasingha Dasgupta
- Institute for Physics - Biophysics, George-August-UniversityGöttingen, Germany
- Bernstein Center for Computational Neuroscience, George-August-UniversityGöttingen, Germany
| | - Florentin Wörgötter
- Institute for Physics - Biophysics, George-August-UniversityGöttingen, Germany
- Bernstein Center for Computational Neuroscience, George-August-UniversityGöttingen, Germany
| | - Poramate Manoonpong
- Bernstein Center for Computational Neuroscience, George-August-UniversityGöttingen, Germany
- Center for Biorobotics, Maersk Mc-Kinney Møller Institute, University of Southern DenmarkOdense, Denmark
| |
Collapse
|
21
|
Herreros I, Giovannucci A, Taub AH, Hogri R, Magal A, Bamford S, Prueckl R, Verschure PFMJ. A Cerebellar Neuroprosthetic System: Computational Architecture and in vivo Test. Front Bioeng Biotechnol 2014; 2:14. [PMID: 25152887 PMCID: PMC4126458 DOI: 10.3389/fbioe.2014.00014] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2013] [Accepted: 05/04/2014] [Indexed: 11/13/2022] Open
Abstract
Emulating the input–output functions performed by a brain structure opens the possibility for developing neuroprosthetic systems that replace damaged neuronal circuits. Here, we demonstrate the feasibility of this approach by replacing the cerebellar circuit responsible for the acquisition and extinction of motor memories. Specifically, we show that a rat can undergo acquisition, retention, and extinction of the eye-blink reflex even though the biological circuit responsible for this task has been chemically inactivated via anesthesia. This is achieved by first developing a computational model of the cerebellar microcircuit involved in the acquisition of conditioned reflexes and training it with synthetic data generated based on physiological recordings. Secondly, the cerebellar model is interfaced with the brain of an anesthetized rat, connecting the model’s inputs and outputs to afferent and efferent cerebellar structures. As a result, we show that the anesthetized rat, equipped with our neuroprosthetic system, can be classically conditioned to the acquisition of an eye-blink response. However, non-stationarities in the recorded biological signals limit the performance of the cerebellar model. Thus, we introduce an updated cerebellar model and validate it with physiological recordings showing that learning becomes stable and reliable. The resulting system represents an important step toward replacing lost functions of the central nervous system via neuroprosthetics, obtained by integrating a synthetic circuit with the afferent and efferent pathways of a damaged brain region. These results also embody an early example of science-based medicine, where on the one hand the neuroprosthetic system directly validates a theory of cerebellar learning that informed the design of the system, and on the other one it takes a step toward the development of neuro-prostheses that could recover lost learning functions in animals and, in the longer term, humans.
Collapse
Affiliation(s)
- Ivan Herreros
- Synthetic Perceptive, Emotive and Cognitive Systems group (SPECS), Universitat Pompeu Fabra , Barcelona , Spain
| | - Andrea Giovannucci
- Synthetic Perceptive, Emotive and Cognitive Systems group (SPECS), Universitat Pompeu Fabra , Barcelona , Spain
| | - Aryeh H Taub
- Psychobiology Research Unit, Tel Aviv University , Tel Aviv , Israel
| | - Roni Hogri
- Psychobiology Research Unit, Tel Aviv University , Tel Aviv , Israel
| | - Ari Magal
- Psychobiology Research Unit, Tel Aviv University , Tel Aviv , Israel
| | - Sim Bamford
- Physics Laboratory, Istituto Superiore di Sanità , Rome , Italy
| | | | - Paul F M J Verschure
- Synthetic Perceptive, Emotive and Cognitive Systems group (SPECS), Universitat Pompeu Fabra , Barcelona , Spain ; Institució Catalana de Recerca i Estudis Avançats , Barcelona , Spain
| |
Collapse
|
22
|
Optimization of the Anticipatory Reflexes of a Computational Model of the Cerebellum. BIOMIMETIC AND BIOHYBRID SYSTEMS 2014. [DOI: 10.1007/978-3-319-09435-9_2] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
23
|
Maffei G, Sanchez-Fibla M, Herreros I, Verschure PFMJ. Acquisition of Synergistic Motor Responses through Cerebellar Learning in a Robotic Postural Task. BIOMIMETIC AND BIOHYBRID SYSTEMS 2014. [DOI: 10.1007/978-3-319-09435-9_18] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
|
24
|
Maffei G, Sanchez-Fibla M, Herreros I, Verschure PFMJ. The Role of a Cerebellum-Driven Perceptual Prediction within a Robotic Postural Task. FROM ANIMALS TO ANIMATS 13 2014. [DOI: 10.1007/978-3-319-08864-8_8] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
25
|
Decorrelation learning in the cerebellum: computational analysis and experimental questions. PROGRESS IN BRAIN RESEARCH 2014; 210:157-92. [PMID: 24916293 DOI: 10.1016/b978-0-444-63356-9.00007-8] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/08/2023]
Abstract
Many cerebellar models use a form of synaptic plasticity that implements decorrelation learning. Parallel fibers carrying signals positively correlated with climbing-fiber input have their synapses weakened (long-term depression), whereas those carrying signals negatively correlated with climbing input have their synapses strengthened (long-term potentiation). Learning therefore ceases when all parallel-fiber signals have been decorrelated from climbing-fiber input. This is a computationally powerful rule for supervised learning and can be cast in a spike-timing dependent plasticity form for comparison with experimental evidence. Decorrelation learning is particularly well suited to sensory prediction, for example, in the reafference problem where external sensory signals are interfered with by reafferent signals from the organism's own movements, and the required circuit appears similar to the one found to mediate classical eye blink conditioning. However, for certain stimuli, avoidance is a much better option than simple prediction, and decorrelation learning can also be used to acquire appropriate avoidance movements. One example of a stimulus to be avoided is retinal slip that degrades visual processing, and decorrelation learning appears to play a role in the vestibulo-ocular reflex that stabilizes gaze in the face of unpredicted head movements. Decorrelation learning is thus suitable for both sensory prediction and motor control. It may also be well suited for generic spatial and temporal coordination, because of its ability to remove the unwanted side effects of movement. Finally, because it can be used with any kind of time-varying signal, the cerebellum could play a role in cognitive processing.
Collapse
|
26
|
Rasmussen A, Hesslow G. Feedback control of learning by the cerebello-olivary pathway. PROGRESS IN BRAIN RESEARCH 2014; 210:103-19. [PMID: 24916291 DOI: 10.1016/b978-0-444-63356-9.00005-4] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
The ability to anticipate future events and to modify erroneous anticipatory actions is crucial for the survival of any organism. Both theoretical and empirical lines of evidence implicate the cerebellum in this ability. It is often suggested that the cerebellum acquires "expectations" or "internal models." However, except in a metaphorical sense, the cerebellum, which consists of a set of interconnected nerve cells, cannot contain "internal models" or "have expectations." In this chapter, we try to untangle these metaphors by translating them back into neurophysiological cause and effect relationships. We approach this task from within the paradigm of classical conditioning, in which a subject, through repeated presentations of a conditional stimulus, followed by an unconditional stimulus, acquires a conditioned response. Importantly, the conditioned response is timed so that it anticipates the unconditioned response. Available neurophysiological evidence suggests that Purkinje cells, in the cerebellar cortex, generate the conditioned response. In addition, Purkinje cells provide negative feedback to the inferior olive, which is a relay for the unconditional stimulus, via the nucleo-olivary pathway. Purkinje cells can therefore regulate the intensity of the signal derived from the unconditional stimulus, which, in turn, decides subsequent plasticity. Hence, as learning progresses, the olivary signal will become weaker and weaker due to increasing negative feedback from Purkinje cells. Thus, in an important sense, learning-induced changes in Purkinje cell activity constitute an "expectation" or "anticipation" of a future event (the unconditional stimulus), and, consistent with theoretical models, future learning depends on the accuracy of this expectation.
Collapse
Affiliation(s)
- Anders Rasmussen
- Department of Experimental Medical Science, Lund University, Lund, Sweden.
| | - Germund Hesslow
- Department of Experimental Medical Science, Lund University, Lund, Sweden
| |
Collapse
|
27
|
Dean P, Anderson S, Porrill J, Jörntell H. An adaptive filter model of cerebellar zone C3 as a basis for safe limb control? J Physiol 2013; 591:5459-74. [PMID: 23836690 DOI: 10.1113/jphysiol.2013.261545] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/15/2023] Open
Abstract
The review asks how the adaptive filter model of the cerebellum might be relevant to experimental work on zone C3, one of the most extensively studied regions of cerebellar cortex. As far as features of the cerebellar microcircuit are concerned, the model appears to fit very well with electrophysiological discoveries concerning the importance of molecular layer interneurons and their plasticity, the significance of long-term potentiation and the striking number of silent parallel fibre synapses. Regarding external connectivity and functionality, a key feature of the adaptive filter model is its use of the decorrelation algorithm, which renders it uniquely suited to problems of sensory noise cancellation. However, this capacity can be extended to the avoidance of sensory interference, by appropriate movements of, for example, the eyes in the vestibulo-ocular reflex. Avoidance becomes particularly important when painful signals are involved, and as the climbing fibre input to zone C3 is extremely responsive to nociceptive stimuli, it is proposed that one function of this zone is the avoidance of pain by, for example, adjusting movements of the body to avoid self-harm. This hypothesis appears consistent with evidence from humans and animals concerning the role of the intermediate cerebellum in classically conditioned withdrawal reflexes, but further experiments focusing on conditioned avoidance are required to test the hypothesis more stringently. The proposed architecture may also be useful for automatic self-adjusting damage avoidance in robots, an important consideration for next generation 'soft' robots designed to interact with people.
Collapse
Affiliation(s)
- Paul Dean
- P. Dean: Department of Psychology, University of Sheffield, Western Bank, Sheffield S10 2TP, UK.
| | | | | | | |
Collapse
|
28
|
|