1
|
Abstract
The cerebellum has a well-established role in controlling motor functions, including coordination, posture, and the learning of skilled movements. The mechanisms for how it carries out motor behavior remain under intense investigation. Interestingly though, in recent years the mechanisms of cerebellar function have faced additional scrutiny since nonmotor behaviors may also be controlled by the cerebellum. With such complexity arising, there is now a pressing need to better understand how cerebellar structure, function, and behavior intersect to influence behaviors that are dynamically called upon as an animal experiences its environment. Here, we discuss recent experimental work that frames possible neural mechanisms for how the cerebellum shapes disparate behaviors and why its dysfunction is catastrophic in hereditary and acquired conditions-both motor and nonmotor. For these reasons, the cerebellum might be the ideal therapeutic target.
Collapse
Affiliation(s)
- Linda H Kim
- Jan and Dan Duncan Neurological Research Institute, Texas Children's Hospital, Houston, Texas, USA
- Department of Pathology & Immunology, Baylor College of Medicine, Houston, Texas, USA;
| | - Detlef H Heck
- Center for Cerebellar Network Structure and Function in Health and Disease, University of Minnesota, Duluth, Minnesota, USA
- Department of Biomedical Sciences, University of Minnesota Medical School, Duluth, Minnesota, USA
| | - Roy V Sillitoe
- Departments of Neuroscience and Pediatrics, Program in Developmental Biology, and Development, Disease Models & Therapeutics Graduate Program, Baylor College of Medicine, Houston, Texas, USA
- Jan and Dan Duncan Neurological Research Institute, Texas Children's Hospital, Houston, Texas, USA
- Department of Pathology & Immunology, Baylor College of Medicine, Houston, Texas, USA;
| |
Collapse
|
2
|
Runyun ŞL, van Wassenhove V, Balci F. Altered temporal awareness during Covid-19 pandemic. PSYCHOLOGICAL RESEARCH 2024:10.1007/s00426-024-02004-0. [PMID: 39034344 DOI: 10.1007/s00426-024-02004-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2023] [Accepted: 07/05/2024] [Indexed: 07/23/2024]
Abstract
Social isolation during the COVID-19 pandemic had profound effects on human well-being. A handful of studies have focused on how time perception was altered during the COVID-19 pandemic, while no study has tested whether temporal metacognition is also affected by the lockdown. We examined the impact of long-term social isolation during the COVID-19 pandemic on the ability to monitor errors in timing performance. We recruited 1232 participants from 12 countries during lockdown, 211 of which were retested "post-pandemic" for within-group comparisons. We also tested a new group of 331 participants during the "post-pandemic" period and compared their data to those of 1232 participants tested during the lockdown (between-group comparison). Participants produced a 3600 ms target interval and assessed the magnitude and direction of their time production error. Both within and between-group comparisons showed reduced metric error monitoring performance during the lockdown, even after controlling for government-imposed stringency indices. A higher level of reported social isolation also predicted reduced temporal error monitoring ability. Participants produced longer duration during lockdown compared to post-lockdown (again controlling for government stringency indices). We reason that these effects may be underlain by altered biological and behavioral rhythms during social isolation experienced during the COVID-19 pandemic. Understanding these effects is crucial for a more complete characterization of the cognitive consequences of long-term social isolation.
Collapse
Affiliation(s)
- Şerife Leman Runyun
- Department of Psychology, Koç University, Istanbul, Turkey
- Department of Psychology, Northeastern University, 360 Huntington Ave, 125 NI, Boston, MA, 02115, USA
| | - Virginie van Wassenhove
- Cognitive Neuroimaging Unit, CEA, INSERM, CNRS, Université Paris-Saclay, NeuroSpin, Gif/Yvette, 91191, France
| | - Fuat Balci
- Department of Psychology, Koç University, Istanbul, Turkey.
- Department of Biological Sciences, University of Manitoba, 50 Sifton Road, Winnipeg, MB, R3T 2M5, Canada.
| |
Collapse
|
3
|
Silva NT, Ramírez-Buriticá J, Pritchett DL, Carey MR. Climbing fibers provide essential instructive signals for associative learning. Nat Neurosci 2024; 27:940-951. [PMID: 38565684 PMCID: PMC11088996 DOI: 10.1038/s41593-024-01594-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2022] [Accepted: 02/05/2024] [Indexed: 04/04/2024]
Abstract
Supervised learning depends on instructive signals that shape the output of neural circuits to support learned changes in behavior. Climbing fiber (CF) inputs to the cerebellar cortex represent one of the strongest candidates in the vertebrate brain for conveying neural instructive signals. However, recent studies have shown that Purkinje cell stimulation can also drive cerebellar learning and the relative importance of these two neuron types in providing instructive signals for cerebellum-dependent behaviors remains unresolved. In the present study we used cell-type-specific perturbations of various cerebellar circuit elements to systematically evaluate their contributions to delay eyeblink conditioning in mice. Our findings reveal that, although optogenetic stimulation of either CFs or Purkinje cells can drive learning under some conditions, even subtle reductions in CF signaling completely block learning to natural stimuli. We conclude that CFs and corresponding Purkinje cell complex spike events provide essential instructive signals for associative cerebellar learning.
Collapse
Affiliation(s)
- N Tatiana Silva
- Neuroscience Program, Champalimaud Center for the Unknown, Lisbon, Portugal
| | | | - Dominique L Pritchett
- Neuroscience Program, Champalimaud Center for the Unknown, Lisbon, Portugal.
- Biology Department, Howard University, Washington, DC, USA.
| | - Megan R Carey
- Neuroscience Program, Champalimaud Center for the Unknown, Lisbon, Portugal.
| |
Collapse
|
4
|
Pi JS, Fakharian MA, Hage P, Sedaghat-Nejad E, Muller SZ, Shadmehr R. The olivary input to the cerebellum dissociates sensory events from movement plans. Proc Natl Acad Sci U S A 2024; 121:e2318849121. [PMID: 38630714 PMCID: PMC11047103 DOI: 10.1073/pnas.2318849121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2023] [Accepted: 03/19/2024] [Indexed: 04/19/2024] Open
Abstract
Neurons in the inferior olive are thought to anatomically organize the Purkinje cells (P-cells) of the cerebellum into computational modules, but what is computed by each module? Here, we designed a saccade task in marmosets that dissociated sensory events from motor events and then recorded the complex and simple spikes of hundreds of P-cells. We found that when a visual target was presented at a random location, the olive reported the direction of that sensory event to one group of P-cells, but not to a second group. However, just before movement onset, it reported the direction of the planned movement to both groups, even if that movement was not toward the target. At the end of the movement if the subject experienced an error but chose to withhold the corrective movement, only the first group received information about the sensory prediction error. We organized the P-cells based on the information content of their olivary input and found that in the group that received sensory information, the simple spikes were suppressed during fixation, then produced a burst before saccade onset in a direction consistent with assisting the movement. In the second group, the simple spikes were not suppressed during fixation but burst near saccade deceleration in a direction consistent with stopping the movement. Thus, the olive differentiated the P-cells based on whether they would receive sensory or motor information, and this defined their contributions to control of movements as well as holding still.
Collapse
Affiliation(s)
- Jay S. Pi
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, MA21205
| | - Mohammad Amin Fakharian
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, MA21205
| | - Paul Hage
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, MA21205
| | - Ehsan Sedaghat-Nejad
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, MA21205
| | - Salomon Z. Muller
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, NY10027
| | - Reza Shadmehr
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, MA21205
| |
Collapse
|
5
|
Wang T, Ivry RB. A cerebellar population coding model for sensorimotor learning. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.07.04.547720. [PMID: 37461557 PMCID: PMC10349940 DOI: 10.1101/2023.07.04.547720] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/26/2023]
Abstract
The cerebellum is crucial for sensorimotor adaptation, using error information to keep the sensorimotor system well-calibrated. Here we introduce a population-coding model to explain how cerebellar-dependent learning is modulated by contextual variation. The model consists of a two-layer network, designed to capture activity in both the cerebellar cortex and deep cerebellar nuclei. A core feature of the model is that within each layer, the processing units are tuned to both movement direction and the direction of movement error. The model captures a large range of contextual effects including interference from prior learning and the influence of error uncertainty and volatility. While these effects have traditionally been taken to indicate meta learning or context-dependent memory within the adaptation system, our results show that they are emergent properties that arise from the population dynamics within the cerebellum. Our results provide a novel framework to understand how the nervous system responds to variable environments.
Collapse
Affiliation(s)
- Tianhe Wang
- Department of Psychology and Helen Wills Neuroscience Institute, University of California, Berkeley, California
| | - Richard B. Ivry
- Department of Psychology and Helen Wills Neuroscience Institute, University of California, Berkeley, California
| |
Collapse
|
6
|
Hadjiosif AM, Abraham G, Ranjan T, Smith MA. Subtle Visual Latency Can Profoundly Impair Implicit Sensorimotor Learning. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.03.14.585093. [PMID: 38558971 PMCID: PMC10980026 DOI: 10.1101/2024.03.14.585093] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
Short sub-100ms visual feedback latencies are common in many types of human-computer interactions yet are known to markedly reduce performance in a wide variety of motor tasks from simple pointing to operating surgical robotics. These latencies are also present in the computer-based experiments used to study the sensorimotor learning that underlies the acquisition of motor performance. Inspired by neurophysiological findings showing that cerebellar LTD and cortical LTP would both be disrupted by sub-100ms latencies, we hypothesized that implicit sensorimotor learning may be particularly sensitive to these short latencies. Remarkably, we find that improving latency by just 60ms, from 85 to 25ms in latency-optimized experiments, increases implicit learning by 50% and proportionally decreases explicit learning, resulting in a dramatic reorganization of sensorimotor memory. We go on to show that implicit sensorimotor learning is considerably more sensitive to latencies in the sub-100ms range than at higher latencies, in line with the latency-specific neural plasticity that has been observed. This suggests a clear benefit for latency reduction in computer-based training that involves implicit sensorimotor learning and that across-study differences in implicit motor learning might often be explained by disparities in feedback latency.
Collapse
|
7
|
Geminiani A, Casellato C, Boele HJ, Pedrocchi A, De Zeeuw CI, D’Angelo E. Mesoscale simulations predict the role of synergistic cerebellar plasticity during classical eyeblink conditioning. PLoS Comput Biol 2024; 20:e1011277. [PMID: 38574161 PMCID: PMC11060558 DOI: 10.1371/journal.pcbi.1011277] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2023] [Revised: 04/30/2024] [Accepted: 02/12/2024] [Indexed: 04/06/2024] Open
Abstract
According to the motor learning theory by Albus and Ito, synaptic depression at the parallel fibre to Purkinje cells synapse (pf-PC) is the main substrate responsible for learning sensorimotor contingencies under climbing fibre control. However, recent experimental evidence challenges this relatively monopolistic view of cerebellar learning. Bidirectional plasticity appears crucial for learning, in which different microzones can undergo opposite changes of synaptic strength (e.g. downbound microzones-more likely depression, upbound microzones-more likely potentiation), and multiple forms of plasticity have been identified, distributed over different cerebellar circuit synapses. Here, we have simulated classical eyeblink conditioning (CEBC) using an advanced spiking cerebellar model embedding downbound and upbound modules that are subject to multiple plasticity rules. Simulations indicate that synaptic plasticity regulates the cascade of precise spiking patterns spreading throughout the cerebellar cortex and cerebellar nuclei. CEBC was supported by plasticity at the pf-PC synapses as well as at the synapses of the molecular layer interneurons (MLIs), but only the combined switch-off of both sites of plasticity compromised learning significantly. By differentially engaging climbing fibre information and related forms of synaptic plasticity, both microzones contributed to generate a well-timed conditioned response, but it was the downbound module that played the major role in this process. The outcomes of our simulations closely align with the behavioural and electrophysiological phenotypes of mutant mice suffering from cell-specific mutations that affect processing of their PC and/or MLI synapses. Our data highlight that a synergy of bidirectional plasticity rules distributed across the cerebellum can facilitate finetuning of adaptive associative behaviours at a high spatiotemporal resolution.
Collapse
Affiliation(s)
- Alice Geminiani
- Department of Brain and Behavioral Sciences, University of Pavia, Pavia, Italy
| | - Claudia Casellato
- Department of Brain and Behavioral Sciences, University of Pavia, Pavia, Italy
- Digital Neuroscience Center, IRCCS Mondino Foundation, Pavia, Italy
| | - Henk-Jan Boele
- Department of Neuroscience, Erasmus MC, Rotterdam, The Netherlands
- Neuroscience Institute, Princeton University, Washington Road, Princeton, New Jersey, United States of America
| | - Alessandra Pedrocchi
- NearLab, Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, Italy
| | - Chris I. De Zeeuw
- Department of Neuroscience, Erasmus MC, Rotterdam, The Netherlands
- Netherlands Institute for Neuroscience, Amsterdam, The Netherlands
| | - Egidio D’Angelo
- Department of Brain and Behavioral Sciences, University of Pavia, Pavia, Italy
- Digital Neuroscience Center, IRCCS Mondino Foundation, Pavia, Italy
| |
Collapse
|
8
|
Sendhilnathan N, Bostan AC, Strick PL, Goldberg ME. A cerebro-cerebellar network for learning visuomotor associations. Nat Commun 2024; 15:2519. [PMID: 38514616 PMCID: PMC10957870 DOI: 10.1038/s41467-024-46281-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2023] [Accepted: 02/16/2024] [Indexed: 03/23/2024] Open
Abstract
Consensus is rapidly building to support a role for the cerebellum beyond motor function, but its contributions to non-motor learning remain poorly understood. Here, we provide behavioral, anatomical and computational evidence to demonstrate a causal role for the primate posterior lateral cerebellum in learning new visuomotor associations. Reversible inactivation of the posterior lateral cerebellum of male monkeys impeded the learning of new visuomotor associations, but had no effect on movement parameters, or on well-practiced performance of the same task. Using retrograde transneuronal transport of rabies virus, we identified a distinct cerebro-cerebellar network linking Purkinje cells in the posterior lateral cerebellum with a region of the prefrontal cortex that is critical in learning visuomotor associations. Together, these results demonstrate a causal role for the primate posterior lateral cerebellum in non-motor, reinforcement learning.
Collapse
Affiliation(s)
- Naveen Sendhilnathan
- Doctoral program in Neurobiology and Behavior, Columbia University, New York, NY, USA.
- Dept. of Neuroscience, Mahoney Center for Brain and Behavior Research, Zuckerman Mind, Brain, and Behavior Institute, Columbia University, New York, NY, USA.
| | - Andreea C Bostan
- Department of Neurobiology, Systems Neuroscience Center, and Brain Institute, University of Pittsburgh, Pittsburgh, PA, USA.
| | - Peter L Strick
- Department of Neurobiology, Systems Neuroscience Center, and Brain Institute, University of Pittsburgh, Pittsburgh, PA, USA
| | - Michael E Goldberg
- Dept. of Neuroscience, Mahoney Center for Brain and Behavior Research, Zuckerman Mind, Brain, and Behavior Institute, Columbia University, New York, NY, USA
- Kavli Institute for Brain Science, Columbia University, New York, NY, USA
- Dept. of Neurology, Psychiatry, and Ophthalmology, Columbia University College of Physicians and Surgeons, New York, NY, USA
| |
Collapse
|
9
|
Jang J, Shadmehr R, Albert ST. A software tool for at-home measurement of sensorimotor adaptation. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.12.12.571359. [PMID: 38168264 PMCID: PMC10760058 DOI: 10.1101/2023.12.12.571359] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/05/2024]
Abstract
Sensorimotor adaptation is traditionally studied in well-controlled laboratory settings with specialized equipment. However, recent public health concerns such as the COVID-19 pandemic, as well as a desire to recruit a more diverse study population, have led the motor control community to consider at-home study designs. At-home motor control experiments are still rare because of the requirement to write software that can be easily used by anyone on any platform. To this end, we developed software that runs locally on a personal computer. The software provides audiovisual instructions and measures the ability of the subject to control the cursor in the context of visuomotor perturbations. We tested the software on a group of at-home participants and asked whether the adaptation principles inferred from in-lab measurements were reproducible in the at-home setting. For example, we manipulated the perturbations to test whether there were changes in adaptation rates (savings and interference), whether adaptation was associated with multiple timescales of memory (spontaneous recovery), and whether we could selectively suppress subconscious learning (delayed feedback, perturbation variability) or explicit strategies (limited reaction time). We found remarkable similarity between in-lab and at-home behaviors across these experimental conditions. Thus, we developed a software tool that can be used by research teams with little or no programming experience to study mechanisms of adaptation in an at-home setting.
Collapse
Affiliation(s)
- Jihoon Jang
- Laboratory for Computational Motor Control, Department of Biomedical Engineering Johns Hopkins School of Medicine, Baltimore MD
| | - Reza Shadmehr
- Laboratory for Computational Motor Control, Department of Biomedical Engineering Johns Hopkins School of Medicine, Baltimore MD
| | - Scott T Albert
- Laboratory for Computational Motor Control, Department of Biomedical Engineering Johns Hopkins School of Medicine, Baltimore MD
| |
Collapse
|
10
|
Friedenberger Z, Harkin E, Tóth K, Naud R. Silences, spikes and bursts: Three-part knot of the neural code. J Physiol 2023; 601:5165-5193. [PMID: 37889516 DOI: 10.1113/jp281510] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2023] [Accepted: 09/28/2023] [Indexed: 10/28/2023] Open
Abstract
When a neuron breaks silence, it can emit action potentials in a number of patterns. Some responses are so sudden and intense that electrophysiologists felt the need to single them out, labelling action potentials emitted at a particularly high frequency with a metonym - bursts. Is there more to bursts than a figure of speech? After all, sudden bouts of high-frequency firing are expected to occur whenever inputs surge. The burst coding hypothesis advances that the neural code has three syllables: silences, spikes and bursts. We review evidence supporting this ternary code in terms of devoted mechanisms for burst generation, synaptic transmission and synaptic plasticity. We also review the learning and attention theories for which such a triad is beneficial.
Collapse
Affiliation(s)
- Zachary Friedenberger
- Brain and Mind Institute, Department of Cellular and Molecular Medicine, University of Ottawa, Ottawa, Ontario, Canada
- Centre for Neural Dynamics and Artifical Intelligence, Department of Physics, University of Ottawa, Ottawa, Ontario, Ottawa
| | - Emerson Harkin
- Brain and Mind Institute, Department of Cellular and Molecular Medicine, University of Ottawa, Ottawa, Ontario, Canada
| | - Katalin Tóth
- Brain and Mind Institute, Department of Cellular and Molecular Medicine, University of Ottawa, Ottawa, Ontario, Canada
| | - Richard Naud
- Brain and Mind Institute, Department of Cellular and Molecular Medicine, University of Ottawa, Ottawa, Ontario, Canada
- Centre for Neural Dynamics and Artifical Intelligence, Department of Physics, University of Ottawa, Ottawa, Ontario, Ottawa
| |
Collapse
|
11
|
Muller SZ, Pi JS, Hage P, Fakharian MA, Sedaghat-Nejad E, Shadmehr R. Complex spikes perturb movements and reveal the sensorimotor map of Purkinje cells. Curr Biol 2023; 33:4869-4879.e3. [PMID: 37858343 PMCID: PMC10751015 DOI: 10.1016/j.cub.2023.09.062] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Revised: 07/05/2023] [Accepted: 09/25/2023] [Indexed: 10/21/2023]
Abstract
Computations that are performed by the cerebellar cortex are transmitted via simple spikes of Purkinje cells (P-cells) to downstream structures, but because P-cells are many synapses away from muscles, we do not know the relationship between modulation of simple spikes and control of behavior. Here, we recorded the spiking activities of hundreds of P-cells in the oculomotor vermis of marmosets during saccadic eye movements and found that following the presentation of a visual stimulus, the olivary input to a P-cell coarsely described the direction and amplitude of the visual stimulus as well as the upcoming movement. Occasionally, the complex spike occurred just before saccade onset, suppressing the P-cell's simple spikes and disrupting its output during that saccade. Remarkably, this brief suppression of simple spikes altered the saccade's trajectory by pulling the eyes toward the part of the visual space that was preferentially encoded by the olivary input to that P-cell. Thus, there is an alignment between the sensory space encoded by the complex spikes and the behavior conveyed by the simple spikes: a reduction in simple spikes is a signal to bias the ongoing movement toward the part of the sensory space preferentially encoded by the olivary input to that P-cell.
Collapse
Affiliation(s)
- Salomon Z Muller
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, NY 10027, USA.
| | - Jay S Pi
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, MD 21205, USA
| | - Paul Hage
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, MD 21205, USA
| | - Mohammad Amin Fakharian
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, MD 21205, USA
| | - Ehsan Sedaghat-Nejad
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, MD 21205, USA
| | - Reza Shadmehr
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, MD 21205, USA.
| |
Collapse
|
12
|
Wallace DM, Benyamini M, Nason-Tomaszewski SR, Costello JT, Cubillos LH, Mender MJ, Temmar H, Willsey MS, Patil PG, Chestek CA, Zacksenhouse M. Error detection and correction in intracortical brain-machine interfaces controlling two finger groups. J Neural Eng 2023; 20:046037. [PMID: 37567222 PMCID: PMC10594236 DOI: 10.1088/1741-2552/acef95] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Revised: 08/01/2023] [Accepted: 08/11/2023] [Indexed: 08/13/2023]
Abstract
Objective.While brain-machine interfaces (BMIs) are promising technologies that could provide direct pathways for controlling the external world and thus regaining motor capabilities, their effectiveness is hampered by decoding errors. Previous research has demonstrated the detection and correction of BMI outcome errors, which occur at the end of trials. Here we focus on continuous detection and correction of BMI execution errors, which occur during real-time movements.Approach.Two adult male rhesus macaques were implanted with Utah arrays in the motor cortex. The monkeys performed single or two-finger group BMI tasks where a Kalman filter decoded binned spiking-band power into intended finger kinematics. Neural activity was analyzed to determine how it depends not only on the kinematics of the fingers, but also on the distance of each finger-group to its target. We developed a method to detect erroneous movements, i.e. consistent movements away from the target, from the same neural activity used by the Kalman filter. Detected errors were corrected by a simple stopping strategy, and the effect on performance was evaluated.Mainresults.First we show that including distance to target explains significantly more variance of the recorded neural activity. Then, for the first time, we demonstrate that neural activity in motor cortex can be used to detect execution errors during BMI controlled movements. Keeping false positive rate below5%, it was possible to achieve mean true positive rate of28.1%online. Despite requiring 200 ms to detect and react to suspected errors, we were able to achieve a significant improvement in task performance via reduced orbiting time of one finger group.Significance.Neural activity recorded in motor cortex for BMI control can be used to detect and correct BMI errors and thus to improve performance. Further improvements may be obtained by enhancing classification and correction strategies.
Collapse
Affiliation(s)
- Dylan M Wallace
- Department of Robotics, University of Michigan, Ann Arbor, MI, United States of America
| | - Miri Benyamini
- BCI for Rehabilitation Lab., Faculty of Mechanical Engineering, Technion - Israel Institute of Technology, Haifa, Israel
| | - Samuel R Nason-Tomaszewski
- Cortical Neural Prosthetics Lab., Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States of America
| | - Joseph T Costello
- Department of Electrical and Computer Engineering, University of Michigan, Ann Arbor, MI, United States of America
| | - Luis H Cubillos
- Department of Robotics, University of Michigan, Ann Arbor, MI, United States of America
| | - Matthew J Mender
- Cortical Neural Prosthetics Lab., Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States of America
| | - Hisham Temmar
- Cortical Neural Prosthetics Lab., Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States of America
| | - Matthew S Willsey
- Cortical Neural Prosthetics Lab., Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States of America
- Department of Neurosurgery, University of Michigan, Ann Arbor, MI, United States of America
| | - Parag G Patil
- Cortical Neural Prosthetics Lab., Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States of America
- Department of Neurosurgery, University of Michigan, Ann Arbor, MI, United States of America
| | - Cynthia A Chestek
- Department of Robotics, University of Michigan, Ann Arbor, MI, United States of America
- Cortical Neural Prosthetics Lab., Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States of America
- Department of Electrical and Computer Engineering, University of Michigan, Ann Arbor, MI, United States of America
| | - Miriam Zacksenhouse
- BCI for Rehabilitation Lab., Faculty of Mechanical Engineering, Technion - Israel Institute of Technology, Haifa, Israel
| |
Collapse
|
13
|
Iwane F, Dash D, Salamanca-Giron RF, Hayward W, Bönstrup M, Buch ER, Cohen LG. Combined low-frequency brain oscillatory activity and behavior predict future errors in human motor skill. Curr Biol 2023; 33:3145-3154.e5. [PMID: 37442139 DOI: 10.1016/j.cub.2023.06.040] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2023] [Revised: 03/24/2023] [Accepted: 06/13/2023] [Indexed: 07/15/2023]
Abstract
Human skills are composed of sequences of individual actions performed with utmost precision. When occasional errors occur, they may have serious consequences, for example, when pilots are manually landing a plane. In such cases, the ability to predict an error before it occurs would clearly be advantageous. Here, we asked whether it is possible to predict future errors in a keyboard procedural human motor skill. We report that prolonged keypress transition times (KTTs), reflecting slower speed, and anomalous delta-band oscillatory activity in cingulate-entorhinal-precuneus brain regions precede upcoming errors in skill. Combined anomalous low-frequency activity and prolonged KTTs predicted up to 70% of future errors. Decoding strength (posterior probability of error) increased progressively approaching the errors. We conclude that it is possible to predict future individual errors in skill sequential performance.
Collapse
Affiliation(s)
- Fumiaki Iwane
- Human Cortical Physiology and Neurorehabilitation Section, NINDS, NIH, Bethesda, MD 20892, USA
| | - Debadatta Dash
- Human Cortical Physiology and Neurorehabilitation Section, NINDS, NIH, Bethesda, MD 20892, USA
| | | | - William Hayward
- Human Cortical Physiology and Neurorehabilitation Section, NINDS, NIH, Bethesda, MD 20892, USA
| | - Marlene Bönstrup
- Department of Neurology, University of Leipzig Medical Center, 04103 Leipzig, Germany
| | - Ethan R Buch
- Human Cortical Physiology and Neurorehabilitation Section, NINDS, NIH, Bethesda, MD 20892, USA
| | - Leonardo G Cohen
- Human Cortical Physiology and Neurorehabilitation Section, NINDS, NIH, Bethesda, MD 20892, USA.
| |
Collapse
|
14
|
Herzfeld DJ, Joshua M, Lisberger SG. Rate versus synchrony codes for cerebellar control of motor behavior. Neuron 2023; 111:2448-2460.e6. [PMID: 37536289 PMCID: PMC10424531 DOI: 10.1016/j.neuron.2023.07.002] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2023] [Revised: 05/24/2023] [Accepted: 07/05/2023] [Indexed: 08/05/2023]
Abstract
Information transmission between neural populations could occur through either coordinated changes in firing rates or the precise transmission of spike timing. We investigate the code for information transmission from a part of the cerebellar cortex that is crucial for the accurate execution of a quantifiable motor behavior. Simultaneous recordings from Purkinje cell pairs in the cerebellum of rhesus macaques reveal how these cells coordinate their activity to drive smooth pursuit eye movements. Purkinje cells show millisecond-scale coordination of spikes (synchrony), but the level of synchrony is small and insufficient to impact the firing of downstream vestibular nucleus neurons. Analysis of previous metrics that purported to reveal Purkinje cell synchrony demonstrates that these metrics conflate changes in firing rate and neuron-neuron covariance. We conclude that the output of the cerebellar cortex uses primarily a rate rather than a synchrony code to drive the activity of downstream neurons and thus control motor behavior.
Collapse
Affiliation(s)
- David J Herzfeld
- Department of Neurobiology, Duke University School of Medicine, Durham, NC 27710, USA.
| | - Mati Joshua
- Edmond & Lily Safra Center for Brain Sciences, The Hebrew University of Jerusalem, Jerusalem, Israel
| | - Stephen G Lisberger
- Department of Neurobiology, Duke University School of Medicine, Durham, NC 27710, USA
| |
Collapse
|
15
|
Masselink J, Cheviet A, Froment-Tilikete C, Pélisson D, Lappe M. A triple distinction of cerebellar function for oculomotor learning and fatigue compensation. PLoS Comput Biol 2023; 19:e1011322. [PMID: 37540726 PMCID: PMC10456158 DOI: 10.1371/journal.pcbi.1011322] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2022] [Revised: 08/25/2023] [Accepted: 07/02/2023] [Indexed: 08/06/2023] Open
Abstract
The cerebellum implements error-based motor learning via synaptic gain adaptation of an inverse model, i.e. the mapping of a spatial movement goal onto a motor command. Recently, we modeled the motor and perceptual changes during learning of saccadic eye movements, showing that learning is actually a threefold process. Besides motor recalibration of (1) the inverse model, learning also comprises perceptual recalibration of (2) the visuospatial target map and (3) of a forward dynamics model that estimates the saccade size from corollary discharge. Yet, the site of perceptual recalibration remains unclear. Here we dissociate cerebellar contributions to the three stages of learning by modeling the learning data of eight cerebellar patients and eight healthy controls. Results showed that cerebellar pathology restrains short-term recalibration of the inverse model while the forward dynamics model is well informed about the reduced saccade change. Adaptation of the visuospatial target map trended in learning direction only in control subjects, yet without reaching significance. Moreover, some patients showed a tendency for uncompensated oculomotor fatigue caused by insufficient upregulation of saccade duration. According to our model, this could induce long-term perceptual compensation, consistent with the overestimation of target eccentricity found in the patients' baseline data. We conclude that the cerebellum mediates short-term adaptation of the inverse model, especially by control of saccade duration, while the forward dynamics model was not affected by cerebellar pathology.
Collapse
Affiliation(s)
- Jana Masselink
- Institute for Psychology & Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, Münster, Germany
| | - Alexis Cheviet
- IMPACT Team, Lyon Neuroscience Research Center, University Claude Bernard Lyon 1, Bron cedex, France
- Department of Psychology, Durham University, South Road, Durham, United Kingdom
| | - Caroline Froment-Tilikete
- IMPACT Team, Lyon Neuroscience Research Center, University Claude Bernard Lyon 1, Bron cedex, France
- Hospices Civils de Lyon—Pierre-Wertheimer Hospital, Neuro-Ophtalmology Unit, Bron cedex, France
| | - Denis Pélisson
- IMPACT Team, Lyon Neuroscience Research Center, University Claude Bernard Lyon 1, Bron cedex, France
| | - Markus Lappe
- Institute for Psychology & Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, Münster, Germany
| |
Collapse
|
16
|
Albert ST, Blaum EC, Blustein DH. Sensory prediction error drives subconscious motor learning outside of the laboratory. J Neurophysiol 2023; 130:427-435. [PMID: 37435648 DOI: 10.1152/jn.00110.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2023] [Revised: 06/13/2023] [Accepted: 07/03/2023] [Indexed: 07/13/2023] Open
Abstract
Sensorimotor adaptation is supported by at least two parallel learning systems: an intentionally controlled explicit strategy and an involuntary implicit learning system. Past work focused on constrained reaches or finger movements in laboratory environments has shown subconscious learning systems to be driven in part by sensory prediction error (SPE), i.e., the mismatch between the realized and expected outcome of an action. We designed a ball rolling task to explore whether SPEs can drive implicit motor adaptation during complex whole body movements that impart physical motion on external objects. After applying a visual shift, participants rapidly adapted their rolling angles to reduce the error between the ball and the target. We removed all visual feedback and told participants to aim their throw directly toward the primary target, revealing an unintentional 5.06° implicit adjustment to reach angles that decayed over time. To determine whether this implicit adaptation was driven by SPE, we gave participants a second aiming target that would "solve" the visual shift, as in the study by Mazzoni and Krakauer (Mazzoni P, Krakauer JW. J Neurosci 26: 3642-3645, 2006). Remarkably, after rapidly reducing ball-rolling error to zero (due to enhancements in strategic aiming), the additional aiming target caused rolling angles to deviate beyond the primary target by 3.15°. This involuntary overcompensation, which worsened task performance, is a hallmark of SPE-driven implicit learning. These results show that SPE-driven implicit processes, previously observed within simplified finger or planar reaching movements, actively contribute to motor adaptation in more complex naturalistic skill-based tasks.NEW & NOTEWORTHY Implicit and explicit learning systems have been detected using simple, constrained movements inside the laboratory. How these systems impact movements during complex whole body, skill-based tasks has not been established. Here, we demonstrate that sensory prediction errors significantly impact how a person updates their movements, replicating findings from the laboratory in an unconstrained ball-rolling task. This real-world validation is an important step toward explaining how subconscious learning helps humans execute common motor skills in dynamic environments.
Collapse
Affiliation(s)
- Scott T Albert
- Neuroscience Center, UNC Chapel Hill, Chapel Hill, North Carolina, United States
| | - Emily C Blaum
- Neuroscience Program, Rhodes College, Memphis, Tennessee, United States
| | - Daniel H Blustein
- Department of Psychology, Acadia University, Wolfville, Nova Scotia, Canada
| |
Collapse
|
17
|
Nashef A, Spindle MS, Calame DJ, Person AL. A dual Purkinje cell rate and synchrony code sculpts reach kinematics. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.07.12.548720. [PMID: 37503038 PMCID: PMC10370034 DOI: 10.1101/2023.07.12.548720] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/29/2023]
Abstract
Cerebellar Purkinje cells (PCs) encode movement kinematics in their population firing rates. Firing rate suppression is hypothesized to disinhibit neurons in the cerebellar nuclei, promoting adaptive movement adjustments. Debates persist, however, about whether a second disinhibitory mechanism, PC simple spike synchrony, is a relevant population code. We addressed this question by relating PC rate and synchrony patterns recorded with high density probes, to mouse reach kinematics. We discovered behavioral correlates of PC synchrony that align with a known causal relationship between activity in cerebellar output. Reach deceleration was positively correlated with both Purkinje firing rate decreases and synchrony, consistent with both mechanisms disinhibiting target neurons, which are known to adjust reach velocity. Direct tests of the contribution of each coding scheme to nuclear firing using dynamic clamp, combining physiological rate and synchrony patterns ex vivo, confirmed that physiological levels of PC simple spike synchrony are highly facilitatory for nuclear firing. These findings suggest that PC firing rate and synchrony collaborate to exert fine control of movement.
Collapse
Affiliation(s)
- Abdulraheem Nashef
- Department of Physiology and Biophysics, Anschutz Medical Campus, University of Colorado, Aurora, 80045, CO, USA
| | - Michael S Spindle
- Department of Physiology and Biophysics, Anschutz Medical Campus, University of Colorado, Aurora, 80045, CO, USA
| | - Dylan J Calame
- Department of Physiology and Biophysics, Anschutz Medical Campus, University of Colorado, Aurora, 80045, CO, USA
| | - Abigail L Person
- Department of Physiology and Biophysics, Anschutz Medical Campus, University of Colorado, Aurora, 80045, CO, USA
| |
Collapse
|
18
|
Cuevas Rivera D, Kiebel S. The effects of probabilistic context inference on motor adaptation. PLoS One 2023; 18:e0286749. [PMID: 37399219 DOI: 10.1371/journal.pone.0286749] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2022] [Accepted: 05/23/2023] [Indexed: 07/05/2023] Open
Abstract
Humans have been shown to adapt their movements when a sudden or gradual change to the dynamics of the environment are introduced, a phenomenon called motor adaptation. If the change is reverted, the adaptation is also quickly reverted. Humans are also able to adapt to multiple changes in dynamics presented separately, and to be able to switch between adapted movements on the fly. Such switching relies on contextual information which is often noisy or misleading, affecting the switch between known adaptations. Recently, computational models for motor adaptation and context inference have been introduced, which contain components for context inference and Bayesian motor adaptation. These models were used to show the effects of context inference on learning rates across different experiments. We expanded on these works by using a simplified version of the recently-introduced COIN model to show that the effects of context inference on motor adaptation and control go even further than previously shown. Here, we used this model to simulate classical motor adaptation experiments from previous works and showed that context inference, and how it is affected by the presence and reliability of feedback, effect a host of behavioral phenomena that had so far required multiple hypothesized mechanisms, lacking a unified explanation. Concretely, we show that the reliability of direct contextual information, as well as noisy sensory feedback, typical of many experiments, effect measurable changes in switching-task behavior, as well as in action selection, that stem directly from probabilistic context inference.
Collapse
Affiliation(s)
- Dario Cuevas Rivera
- Chair of Cognitive Computational Neuroscience, Faculty of Psychology, Technische Universität Dresden, Dresden, Germany
- Centre for Tactile Internet with Human-in-the-Loop (CeTI), Dresden, Germany
| | - Stefan Kiebel
- Chair of Cognitive Computational Neuroscience, Faculty of Psychology, Technische Universität Dresden, Dresden, Germany
- Centre for Tactile Internet with Human-in-the-Loop (CeTI), Dresden, Germany
| |
Collapse
|
19
|
Calame DJ, Becker MI, Person AL. Cerebellar associative learning underlies skilled reach adaptation. Nat Neurosci 2023:10.1038/s41593-023-01347-y. [PMID: 37248339 DOI: 10.1038/s41593-023-01347-y] [Citation(s) in RCA: 13] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2021] [Accepted: 04/24/2023] [Indexed: 05/31/2023]
Abstract
The cerebellum is hypothesized to refine movement through online adjustments. We examined how such predictive control may be generated using a mouse reach paradigm, testing whether the cerebellum uses within-reach information as a predictor to adjust reach kinematics. We first identified a population-level response in Purkinje cells that scales inversely with reach velocity, pointing to the cerebellar cortex as a potential site linking kinematic predictors and anticipatory control. Next, we showed that mice can learn to compensate for a predictable reach perturbation caused by repeated, closed-loop optogenetic stimulation of pontocerebellar mossy fiber inputs. Both neural and behavioral readouts showed adaptation to position-locked mossy fiber perturbations and exhibited aftereffects when stimulation was removed. Surprisingly, position-randomized stimulation schedules drove partial adaptation but no opposing aftereffects. A model that recapitulated these findings suggests that the cerebellum may decipher cause-and-effect relationships through time-dependent generalization mechanisms.
Collapse
Affiliation(s)
- Dylan J Calame
- Neuroscience Graduate Program, University of Colorado School of Medicine, Aurora, CO, USA
- Medical Scientist Training Program, University of Colorado School of Medicine, Aurora, CO, USA
| | - Matthew I Becker
- Neuroscience Graduate Program, University of Colorado School of Medicine, Aurora, CO, USA
- Medical Scientist Training Program, University of Colorado School of Medicine, Aurora, CO, USA
| | - Abigail L Person
- Department of Physiology and Biophysics, University of Colorado School of Medicine, Aurora, CO, USA.
| |
Collapse
|
20
|
Markanday A, Hong S, Inoue J, De Schutter E, Thier P. Multidimensional cerebellar computations for flexible kinematic control of movements. Nat Commun 2023; 14:2548. [PMID: 37137897 PMCID: PMC10156706 DOI: 10.1038/s41467-023-37981-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2022] [Accepted: 04/07/2023] [Indexed: 05/05/2023] Open
Abstract
Both the environment and our body keep changing dynamically. Hence, ensuring movement precision requires adaptation to multiple demands occurring simultaneously. Here we show that the cerebellum performs the necessary multi-dimensional computations for the flexible control of different movement parameters depending on the prevailing context. This conclusion is based on the identification of a manifold-like activity in both mossy fibers (MFs, network input) and Purkinje cells (PCs, output), recorded from monkeys performing a saccade task. Unlike MFs, the PC manifolds developed selective representations of individual movement parameters. Error feedback-driven climbing fiber input modulated the PC manifolds to predict specific, error type-dependent changes in subsequent actions. Furthermore, a feed-forward network model that simulated MF-to-PC transformations revealed that amplification and restructuring of the lesser variability in the MF activity is a pivotal circuit mechanism. Therefore, the flexible control of movements by the cerebellum crucially depends on its capacity for multi-dimensional computations.
Collapse
Affiliation(s)
- Akshay Markanday
- Hertie Institute for Clinical Brain Research, Eberhard Karls University Tübingen, Tübingen, Germany
| | - Sungho Hong
- Computational Neuroscience Unit, Okinawa Institute of Science and Technology, Okinawa, Japan
| | - Junya Inoue
- Hertie Institute for Clinical Brain Research, Eberhard Karls University Tübingen, Tübingen, Germany
| | - Erik De Schutter
- Computational Neuroscience Unit, Okinawa Institute of Science and Technology, Okinawa, Japan
| | - Peter Thier
- Hertie Institute for Clinical Brain Research, Eberhard Karls University Tübingen, Tübingen, Germany.
| |
Collapse
|
21
|
Muller SZ, Pi JS, Hage P, Fakharian MA, Sedaghat-Nejad E, Shadmehr R. Complex spikes perturb movements, revealing the sensorimotor map of Purkinje cells. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.04.16.537034. [PMID: 37090615 PMCID: PMC10120735 DOI: 10.1101/2023.04.16.537034] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/25/2023]
Abstract
The cerebellar cortex performs computations that are critical for control of our actions, and then transmits that information via simple spikes of Purkinje cells (P-cells) to downstream structures. However, because P-cells are many synapses away from muscles, we do not know how their output affects behavior. Furthermore, we do not know the level of abstraction, i.e., the coordinate system of the P-cell's output. Here, we recorded spiking activities of hundreds of P-cells in the oculomotor vermis of marmosets during saccadic eye movements and found that following the presentation of a visual stimulus, the olivary input to a P-cell encoded a probabilistic signal that coarsely described both the direction and the amplitude of that stimulus. When this input was present, the resulting complex spike briefly suppressed the P-cell's simple spikes, disrupting the P-cell's output during that saccade. Remarkably, this brief suppression altered the saccade's trajectory by pulling the eyes toward the part of the visual space that was preferentially encoded by the olivary input to that P-cell. Thus, analysis of behavior in the milliseconds following a complex spike unmasked how the P-cell's output influenced behavior: the preferred location in the coordinates of the visual system as conveyed probabilistically from the inferior olive to a P-cell defined the action in the coordinates of the motor system for which that P-cell's simple spikes directed behavior.
Collapse
Affiliation(s)
- Salomon Z. Muller
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, NY USA
| | - Jay S. Pi
- Laboratory for Computational Motor Control, Dept. of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, Maryland USA
| | - Paul Hage
- Laboratory for Computational Motor Control, Dept. of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, Maryland USA
| | - Mohammad Amin Fakharian
- Laboratory for Computational Motor Control, Dept. of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, Maryland USA
| | - Ehsan Sedaghat-Nejad
- Laboratory for Computational Motor Control, Dept. of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, Maryland USA
| | - Reza Shadmehr
- Laboratory for Computational Motor Control, Dept. of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, Maryland USA
| |
Collapse
|
22
|
Marciniak Dg Agra K, Dg Agra P. F = ma. Is the macaque brain Newtonian? Cogn Neuropsychol 2023; 39:376-408. [PMID: 37045793 DOI: 10.1080/02643294.2023.2191843] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/14/2023]
Abstract
Intuitive Physics, the ability to anticipate how the physical events involving mass objects unfold in time and space, is a central component of intelligent systems. Intuitive physics is a promising tool for gaining insight into mechanisms that generalize across species because both humans and non-human primates are subject to the same physical constraints when engaging with the environment. Physical reasoning abilities are widely present within the animal kingdom, but monkeys, with acute 3D vision and a high level of dexterity, appreciate and manipulate the physical world in much the same way humans do.
Collapse
Affiliation(s)
- Karolina Marciniak Dg Agra
- The Rockefeller University, Laboratory of Neural Circuits, New York, NY, USA
- Center for Brain, Minds and Machines, Cambridge, MA, USA
| | - Pedro Dg Agra
- The Rockefeller University, Laboratory of Neural Circuits, New York, NY, USA
- Center for Brain, Minds and Machines, Cambridge, MA, USA
| |
Collapse
|
23
|
Tyralla S, Pomè A, Zimmermann E. Motor recalibration of visual and saccadic maps. Proc Biol Sci 2023; 290:20222566. [PMID: 36855869 PMCID: PMC9975659 DOI: 10.1098/rspb.2022.2566] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2022] [Accepted: 02/07/2023] [Indexed: 03/02/2023] Open
Abstract
How does the brain maintain an accurate visual representation of external space? Movement errors following saccade execution provide sufficient information to recalibrate motor and visual space. Here, we asked whether spatial information for vision and saccades is processed in shared or in separate resources. We used saccade adaptation to modify both, saccade amplitudes and visual mislocalization. After saccade adaptation was induced, we compared participants' saccadic and perceptual localization before and after we inserted 'no error' trials. In these trials, we clamped the post-saccadic error online to the predicted endpoints of saccades. In separate experiments, we either annulled the retinal or the prediction error. We also varied the number of 'no error' trials across conditions. In all conditions, we found that saccade adaptation remained undisturbed by the insertion of 'no error' trials. However, mislocalization decreased as a function of the number of trials in which zero retinal error was displayed. When the prediction error was clamped to zero, no mislocalization was observed at all. The results demonstrate the post-saccadic error is used separately to recalibrate visual and saccadic space.
Collapse
Affiliation(s)
- Sandra Tyralla
- Institute for Experimental Psychology, Heinrich Heine University Düsseldorf, Germany
| | - Antonella Pomè
- Institute for Experimental Psychology, Heinrich Heine University Düsseldorf, Germany
| | - Eckart Zimmermann
- Institute for Experimental Psychology, Heinrich Heine University Düsseldorf, Germany
| |
Collapse
|
24
|
Herzfeld DJ, Joshua M, Lisberger SG. Rate versus synchrony codes for cerebellar control of motor behavior. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.02.17.529019. [PMID: 36824885 PMCID: PMC9949136 DOI: 10.1101/2023.02.17.529019] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/20/2023]
Abstract
UNLABELLED Control of movement requires the coordination of multiple brain areas, each containing populations of neurons that receive inputs, process these inputs via recurrent dynamics, and then relay the processed information to downstream populations. Information transmission between neural populations could occur through either coordinated changes in firing rates or the precise transmission of spike timing. We investigate the nature of the code for transmission of signals to downstream areas from a part of the cerebellar cortex that is crucial for the accurate execution of a quantifiable motor behavior. Simultaneous recordings from Purkinje cell pairs in the cerebellar flocculus of rhesus macaques revealed how these cells coordinate their activity to drive smooth pursuit eye movements. Purkinje cells show millisecond-scale coordination of spikes (synchrony), but the level of synchrony is small and likely insufficient to impact the firing of downstream neurons in the vestibular nucleus. Further, analysis of previous metrics for assaying Purkinje cell synchrony demonstrates that these metrics conflate changes in firing rate and neuron-neuron covariance. We conclude that the output of the cerebellar cortex uses primarily a rate code rather than synchrony code to drive activity of downstream neurons and thus control motor behavior. IMPACT STATEMENT Information transmission in the brain can occur via changes in firing rate or via the precise timing of spikes. Simultaneous recordings from pairs of Purkinje cells in the floccular complex reveals that information transmission out of the cerebellar cortex relies almost exclusively on changes in firing rates rather than millisecond-scale coordination of spike timing across the Purkinje cell population.
Collapse
Affiliation(s)
- David J. Herzfeld
- Department of Neurobiology, Duke University School of Medicine, Durham, NC, USA
| | - Mati Joshua
- Edmond & Lily Safra Center for Brain Sciences, The Hebrew University of Jerusalem, Jerusalem, Israel
| | | |
Collapse
|
25
|
The deep cerebellar nuclei to striatum disynaptic connection contributes to skilled forelimb movement. Cell Rep 2023; 42:112000. [PMID: 36656714 DOI: 10.1016/j.celrep.2023.112000] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2022] [Revised: 12/20/2022] [Accepted: 01/04/2023] [Indexed: 01/20/2023] Open
Abstract
Cerebellar-thalamo-striatal synaptic communication has been implicated in a wide range of behaviors, including goal-directed actions, and is altered in cerebellar dystonia. However, its detailed connectivity through the thalamus and its contribution to the execution of forelimb movements is unclear. Here, we use trans-synaptic and retrograde tracing, ex vivo slice recordings, and optogenetic inhibitions during the execution of unidirectional or sequential joystick displacements to demonstrate that the deep cerebellar nuclei (DCN) influence the dorsal striatum with a very high probability. We show that this mainly occurs through the centrolateral (CL), parafascicular (PF), and ventrolateral (VL) nuclei of the thalamus, observing that the DCN→VL and DCN→CL pathways contribute to the execution of unidirectional forelimb displacements while the DCN→PF and DCN→thalamo→striatal pathways contribute to the appropriate execution of forelimb reaching and sequential displacements. These findings highlight specific contributions of the different cerebellar-thalamo-striatal paths to the control of skilled forelimb movement.
Collapse
|
26
|
Weightman M, Lalji N, Lin CHS, Galea JM, Jenkinson N, Miall RC. Short duration event related cerebellar TDCS enhances visuomotor adaptation. Brain Stimul 2023; 16:431-441. [PMID: 36720304 DOI: 10.1016/j.brs.2023.01.1673] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2022] [Revised: 01/24/2023] [Accepted: 01/24/2023] [Indexed: 01/30/2023] Open
Abstract
BACKGROUND Transcranial direct current stimulation (TDCS) is typically applied before or during a task, for periods ranging from 5 to 30 min. HYPOTHESIS We hypothesise that briefer stimulation epochs synchronous with individual task actions may be more effective. METHODS In two separate experiments, we applied brief bursts of event-related anodal stimulation (erTDCS) to the cerebellum during a visuomotor adaptation task. RESULTS The first study demonstrated that 1 s duration erTDCS time-locked to the participants' reaching actions enhanced adaptation significantly better than sham. A close replication in the second study demonstrated 0.5 s erTDCS synchronous with the reaching actions again resulted in better adaptation than standard TDCS, significantly better than sham. Stimulation either during the inter-trial intervals between movements or after movement, during assessment of visual feedback, had no significant effect. Because short duration stimulation with rapid onset and offset is more readily perceived by the participants, we additionally show that a non-electrical vibrotactile stimulation of the scalp, presented with the same timing as the erTDCS, had no significant effect. CONCLUSIONS We conclude that short duration, event related, anodal TDCS targeting the cerebellum enhances motor adaptation compared to the standard model. We discuss possible mechanisms of action and speculate on neural learning processes that may be involved.
Collapse
Affiliation(s)
- Matthew Weightman
- School of Sport, Exercise and Rehabilitation Sciences, University of Birmingham, UK; School of Psychology, University of Birmingham, UK
| | - Neeraj Lalji
- School of Psychology, University of Birmingham, UK
| | - Chin-Hsuan Sophie Lin
- Cognitive Neuroscience and Computational Psychiatry Lab, University of Melbourne, Australia
| | | | - Ned Jenkinson
- School of Sport, Exercise and Rehabilitation Sciences, University of Birmingham, UK
| | | |
Collapse
|
27
|
Zhu F, Grier HA, Tandon R, Cai C, Agarwal A, Giovannucci A, Kaufman MT, Pandarinath C. A deep learning framework for inference of single-trial neural population dynamics from calcium imaging with subframe temporal resolution. Nat Neurosci 2022; 25:1724-1734. [PMID: 36424431 PMCID: PMC9825112 DOI: 10.1038/s41593-022-01189-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2021] [Accepted: 09/23/2022] [Indexed: 11/26/2022]
Abstract
In many areas of the brain, neural populations act as a coordinated network whose state is tied to behavior on a millisecond timescale. Two-photon (2p) calcium imaging is a powerful tool to probe such network-scale phenomena. However, estimating the network state and dynamics from 2p measurements has proven challenging because of noise, inherent nonlinearities and limitations on temporal resolution. Here we describe Recurrent Autoencoder for Discovering Imaged Calcium Latents (RADICaL), a deep learning method to overcome these limitations at the population level. RADICaL extends methods that exploit dynamics in spiking activity for application to deconvolved calcium signals, whose statistics and temporal dynamics are quite distinct from electrophysiologically recorded spikes. It incorporates a new network training strategy that capitalizes on the timing of 2p sampling to recover network dynamics with high temporal precision. In synthetic tests, RADICaL infers the network state more accurately than previous methods, particularly for high-frequency components. In 2p recordings from sensorimotor areas in mice performing a forelimb reach task, RADICaL infers network state with close correspondence to single-trial variations in behavior and maintains high-quality inference even when neuronal populations are substantially reduced.
Collapse
Affiliation(s)
- Feng Zhu
- Wallace H. Coulter Department of Biomedical Engineering, Emory University and Georgia Institute of Technology, Atlanta, GA, USA
- Neuroscience Graduate Program, Graduate Division of Biological and Biomedical Sciences, Emory University, Atlanta, GA, USA
| | - Harrison A Grier
- Committee on Computational Neuroscience, The University of Chicago, Chicago, IL, USA
| | - Raghav Tandon
- Wallace H. Coulter Department of Biomedical Engineering, Emory University and Georgia Institute of Technology, Atlanta, GA, USA
| | - Changjia Cai
- Joint Biomedical Engineering Department, University of North Carolina at Chapel Hill and North Carolina State University, Chapel Hill, NC, USA
| | | | - Andrea Giovannucci
- Joint Biomedical Engineering Department, University of North Carolina at Chapel Hill and North Carolina State University, Chapel Hill, NC, USA.
- Neuroscience Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
- Closed-Loop Engineering for Advanced Rehabilitation (CLEAR), North Carolina State University, Raleigh, NC, USA.
| | - Matthew T Kaufman
- Department of Organismal Biology and Anatomy, The University of Chicago, Chicago, IL, USA.
- Neuroscience Institute, The University of Chicago, Chicago, IL, USA.
| | - Chethan Pandarinath
- Wallace H. Coulter Department of Biomedical Engineering, Emory University and Georgia Institute of Technology, Atlanta, GA, USA.
- Department of Neurosurgery, Emory University, Atlanta, GA, USA.
- Center for Machine Learning, Georgia Institute of Technology, Atlanta, GA, USA.
| |
Collapse
|
28
|
Bao S, Lei Y. Memory decay and generalization following distinct motor learning mechanisms. J Neurophysiol 2022; 128:1534-1545. [PMID: 36321731 DOI: 10.1152/jn.00105.2022] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022] Open
Abstract
Motor skill learning is considered to arise out of contributions from multiple learning mechanisms, including error-based learning (EBL), use-dependent learning (UDL), and reinforcement learning (RL). These learning mechanisms exhibit dissociable roles and engage different neural circuits during skill acquisition. However, it remains largely unknown how a newly formed motor memory acquired through each learning mechanism decays over time and whether distinct learning mechanisms produce different generalization patterns. Here, we used variants of reaching paradigms that dissociated these learning mechanisms to examine the time course of memory decay following each learning and the generalization patterns of each learning. We found that motor memories acquired through these learning mechanisms decayed as a function of time. Notably, 15 min, 6 h, and 24 h after acquisition, the memory of EBL decayed much greater than that of RL. The memory acquired through UDL faded away within a few minutes. Motor memories formed through EBL and RL for given movement directions generalized to untrained movement directions, with the generalization of EBL being greater than that of RL. In contrast, motor memory of UDL could not generalize to untrained movement directions. These results suggest that distinct learning mechanisms exhibit different patterns of memory decay and generalization.NEW & NOTEWORTHY Motor skill learning is likely to involve error-based learning, use-dependent plasticity, and operant reinforcement. Here, we showed that these dissociable learning mechanisms exhibited distinct patterns of memory decay and generalization. With a better understanding of the characteristics of these learning mechanisms, it becomes possible to regulate each learning process separately to improve neurological rehabilitation.
Collapse
Affiliation(s)
- Shancheng Bao
- Department of Kinesiology & Sport Management, Texas A&M University, College Station, Texas
| | - Yuming Lei
- Department of Kinesiology & Sport Management, Texas A&M University, College Station, Texas
| |
Collapse
|
29
|
Nettekoven C, Mitchell L, Clarke WT, Emir U, Campbell J, Johansen-Berg H, Jenkinson N, Stagg CJ. Cerebellar GABA Change during Visuomotor Adaptation Relates to Adaptation Performance and Cerebellar Network Connectivity: A Magnetic Resonance Spectroscopic Imaging Study. J Neurosci 2022; 42:7721-7732. [PMID: 36414012 PMCID: PMC9581563 DOI: 10.1523/jneurosci.0096-22.2022] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2022] [Revised: 06/09/2022] [Accepted: 06/16/2022] [Indexed: 12/15/2022] Open
Abstract
Motor adaptation is crucial for performing accurate movements in a changing environment and relies on the cerebellum. Although cerebellar involvement has been well characterized, the neurochemical changes in the cerebellum underpinning human motor adaptation remain unknown. We used a novel magnetic resonance spectroscopic imaging (MRSI) technique to measure changes in the inhibitory neurotransmitter GABA in the human cerebellum during visuomotor adaptation. Participants (n = 17, six female) used their right hand to adapt to a rotated cursor in the scanner, compared with a control task requiring no adaptation. We spatially resolved adaptation-driven GABA changes at the cerebellar nuclei and cerebellar cortex in the left and the right cerebellar hemisphere independently and found that simple right-hand movements increase GABA in the right cerebellar nuclei and decreases GABA in the left. When isolating adaptation-driven GABA changes, we found that GABA in the left cerebellar nuclei and the right cerebellar nuclei diverged, although GABA change from baseline at the right cerebellar nuclei was not different from zero at the group level. Early adaptation-driven GABA fluctuations in the right cerebellar nuclei correlated with adaptation performance. Participants showing greater GABA decrease adapted better, suggesting early GABA change is behaviorally relevant. Early GABA change also correlated with functional connectivity change in a cerebellar network. Participants showing greater decreases in GABA showed greater strength increases in cerebellar network connectivity. Results were specific to GABA, to adaptation, and to the cerebellar network. This study provides first evidence for plastic changes in cerebellar neurochemistry during motor adaptation. Characterizing these naturally occurring neurochemical changes may provide a basis for developing therapeutic interventions to facilitate human motor adaptation.SIGNIFICANCE STATEMENT Despite motor adaptation being fundamental to maintaining accurate movements, its neurochemical basis remains poorly understood, perhaps because measuring neurochemicals in the human cerebellum is technically challenging. Using a novel magnetic resonance spectroscopic imaging method, this study provides evidence for GABA changes in the left compared with the right cerebellar nuclei driven by both simple movement and motor adaptation. Although right cerebellar GABA changes were not significantly different from zero at the group level, the adaptation-driven GABA fluctuations in the right cerebellar nuclei correlated with adaptation performance and with functional connectivity change in a cerebellar network. These results show the first evidence for plastic changes in cerebellar neurochemistry during a cerebellar learning task. This provides the basis for developing therapeutic interventions that facilitate these naturally occurring changes to amplify cerebellar-dependent learning.
Collapse
Affiliation(s)
- Caroline Nettekoven
- Wellcome Centre for Integrative Neuroimaging, Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford OX3 9DU UK
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford OX3 7JX, UK
- Medical Research Council Brain Network Dynamics Unit, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford OX1 3TH UK
- Department of Psychiatry, University of Oxford, Oxford OX3 7JX UK
| | - Leah Mitchell
- Wellcome Centre for Integrative Neuroimaging, Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford OX3 9DU UK
| | - William T Clarke
- Wellcome Centre for Integrative Neuroimaging, Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford OX3 9DU UK
- Medical Research Council Brain Network Dynamics Unit, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford OX1 3TH UK
| | - Uzay Emir
- School of Health Sciences, Purdue University, Purdue, Indiana 47907
| | - Jon Campbell
- Wellcome Centre for Integrative Neuroimaging, Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford OX3 9DU UK
| | - Heidi Johansen-Berg
- Wellcome Centre for Integrative Neuroimaging, Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford OX3 9DU UK
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford OX3 7JX, UK
| | - Ned Jenkinson
- School of Sport, Exercise and Rehabilitation Sciences, University of Birmingham, Birmingham B15 2TT UK
| | - Charlotte J Stagg
- Wellcome Centre for Integrative Neuroimaging, Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford OX3 9DU UK
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford OX3 7JX, UK
| |
Collapse
|
30
|
Avraham G, Taylor JA, Breska A, Ivry RB, McDougle SD. Contextual effects in sensorimotor adaptation adhere to associative learning rules. eLife 2022; 11:e75801. [PMID: 36197002 PMCID: PMC9635873 DOI: 10.7554/elife.75801] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2021] [Accepted: 10/04/2022] [Indexed: 11/20/2022] Open
Abstract
Traditional associative learning tasks focus on the formation of associations between salient events and arbitrary stimuli that predict those events. This is exemplified in cerebellar-dependent delay eyeblink conditioning, where arbitrary cues such as a tone or light act as conditioned stimuli (CSs) that predict aversive sensations at the cornea (unconditioned stimulus [US]). Here, we ask if a similar framework could be applied to another type of cerebellar-dependent sensorimotor learning - sensorimotor adaptation. Models of sensorimotor adaptation posit that the introduction of an environmental perturbation results in an error signal that is used to update an internal model of a sensorimotor map for motor planning. Here, we take a step toward an integrative account of these two forms of cerebellar-dependent learning, examining the relevance of core concepts from associative learning for sensorimotor adaptation. Using a visuomotor adaptation reaching task, we paired movement-related feedback (US) with neutral auditory or visual contextual cues that served as CSs. Trial-by-trial changes in feedforward movement kinematics exhibited three key signatures of associative learning: differential conditioning, sensitivity to the CS-US interval, and compound conditioning. Moreover, after compound conditioning, a robust negative correlation was observed between responses to the two elemental CSs of the compound (i.e. overshadowing), consistent with the additivity principle posited by theories of associative learning. The existence of associative learning effects in sensorimotor adaptation provides a proof-of-concept for linking cerebellar-dependent learning paradigms within a common theoretical framework.
Collapse
Affiliation(s)
- Guy Avraham
- Department of Psychology, University of California, BerkeleyBerkeleyUnited States
- Helen Wills Neuroscience Institute, University of California, BerkeleyBerkeleyUnited States
| | - Jordan A Taylor
- Department of Psychology, Princeton UniversityPrincetonUnited States
| | - Assaf Breska
- Department of Psychology, University of California, BerkeleyBerkeleyUnited States
- Helen Wills Neuroscience Institute, University of California, BerkeleyBerkeleyUnited States
- Max Planck Institute for Biological CyberneticsTübingenGermany
| | - Richard B Ivry
- Department of Psychology, University of California, BerkeleyBerkeleyUnited States
- Helen Wills Neuroscience Institute, University of California, BerkeleyBerkeleyUnited States
| | | |
Collapse
|
31
|
Fruzzetti L, Kalidindi HT, Antonietti A, Alessandro C, Geminiani A, Casellato C, Falotico E, D’Angelo E. Dual STDP processes at Purkinje cells contribute to distinct improvements in accuracy and speed of saccadic eye movements. PLoS Comput Biol 2022; 18:e1010564. [PMID: 36194625 PMCID: PMC9565489 DOI: 10.1371/journal.pcbi.1010564] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2022] [Revised: 10/14/2022] [Accepted: 09/13/2022] [Indexed: 11/18/2022] Open
Abstract
Saccadic eye-movements play a crucial role in visuo-motor control by allowing rapid foveation onto new targets. However, the neural processes governing saccades adaptation are not fully understood. Saccades, due to the short-time of execution (20-100 ms) and the absence of sensory information for online feedback control, must be controlled in a ballistic manner. Incomplete measurements of the movement trajectory, such as the visual endpoint error, are supposedly used to form internal predictions about the movement kinematics resulting in predictive control. In order to characterize the synaptic and neural circuit mechanisms underlying predictive saccadic control, we have reconstructed the saccadic system in a digital controller embedding a spiking neural network of the cerebellum with spike timing-dependent plasticity (STDP) rules driving parallel fiber-Purkinje cell long-term potentiation and depression (LTP and LTD). This model implements a control policy based on a dual plasticity mechanism, resulting in the identification of the roles of LTP and LTD in regulating the overall quality of saccade kinematics: it turns out that LTD increases the accuracy by decreasing visual error and LTP increases the peak speed. The control policy also required cerebellar PCs to be divided into two subpopulations, characterized by burst or pause responses. To our knowledge, this is the first model that explains in mechanistic terms the visual error and peak speed regulation of ballistic eye movements in forward mode exploiting spike-timing to regulate firing in different populations of the neuronal network. This elementary model of saccades could be extended and applied to other more complex cases in which single jerks are concatenated to compose articulated and coordinated movements.
Collapse
Affiliation(s)
- Lorenzo Fruzzetti
- The BioRobotics Institute, Scuola Superiore Sant’Anna, Pontedera (Pisa), Italy
- Department of Excellence in Robotics and AI, Scuola Superiore Sant’Anna, Pisa, Italy
| | - Hari Teja Kalidindi
- Institute of Information and Communication Technologies, Electronics and Applied Mathematics, Universite Catholique de Louvain, Ottignies-Louvain-la-Neuve, Belgium
- Institute of Neuroscience, Universite Catholique de Louvain, Ottignies-Louvain-la-Neuve, Belgium
- * E-mail: (HK); (EF)
| | - Alberto Antonietti
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milano, Italy
| | - Cristiano Alessandro
- Department of Brain and Behavioral Sciences, University of Pavia, Italy
- School of Medicine and Surgery/Sport and Exercise Medicine, University of Milano-Bicocca, Milan, Italy
| | - Alice Geminiani
- Department of Brain and Behavioral Sciences, University of Pavia, Italy
| | - Claudia Casellato
- Department of Brain and Behavioral Sciences, University of Pavia, Italy
| | - Egidio Falotico
- The BioRobotics Institute, Scuola Superiore Sant’Anna, Pontedera (Pisa), Italy
- Department of Excellence in Robotics and AI, Scuola Superiore Sant’Anna, Pisa, Italy
- * E-mail: (HK); (EF)
| | - Egidio D’Angelo
- Department of Brain and Behavioral Sciences, University of Pavia, Italy
- IRCCS Mondino Foundation, Pavia, Italy
| |
Collapse
|
32
|
Yang S, Wang J, Zhang N, Deng B, Pang Y, Azghadi MR. CerebelluMorphic: Large-Scale Neuromorphic Model and Architecture for Supervised Motor Learning. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2022; 33:4398-4412. [PMID: 33621181 DOI: 10.1109/tnnls.2021.3057070] [Citation(s) in RCA: 37] [Impact Index Per Article: 18.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
The cerebellum plays a vital role in motor learning and control with supervised learning capability, while neuromorphic engineering devises diverse approaches to high-performance computation inspired by biological neural systems. This article presents a large-scale cerebellar network model for supervised learning, as well as a cerebellum-inspired neuromorphic architecture to map the cerebellar anatomical structure into the large-scale model. Our multinucleus model and its underpinning architecture contain approximately 3.5 million neurons, upscaling state-of-the-art neuromorphic designs by over 34 times. Besides, the proposed model and architecture incorporate 3411k granule cells, introducing a 284 times increase compared to a previous study including only 12k cells. This large scaling induces more biologically plausible cerebellar divergence/convergence ratios, which results in better mimicking biology. In order to verify the functionality of our proposed model and demonstrate its strong biomimicry, a reconfigurable neuromorphic system is used, on which our developed architecture is realized to replicate cerebellar dynamics during the optokinetic response. In addition, our neuromorphic architecture is used to analyze the dynamical synchronization within the Purkinje cells, revealing the effects of firing rates of mossy fibers on the resonance dynamics of Purkinje cells. Our experiments show that real-time operation can be realized, with a system throughput of up to 4.70 times larger than previous works with high synaptic event rate. These results suggest that the proposed work provides both a theoretical basis and a neuromorphic engineering perspective for brain-inspired computing and the further exploration of cerebellar learning.
Collapse
|
33
|
Métais C, Nicolas J, Diarra M, Cheviet A, Koun E, Pélisson D. Neural substrates of saccadic adaptation: Plastic changes versus error processing and forward versus backward learning. Neuroimage 2022; 262:119556. [PMID: 35964865 DOI: 10.1016/j.neuroimage.2022.119556] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2022] [Revised: 08/09/2022] [Accepted: 08/10/2022] [Indexed: 11/28/2022] Open
Abstract
Previous behavioral, clinical, and neuroimaging studies suggest that the neural substrates of adaptation of saccadic eye movements involve, beyond the central role of the cerebellum, several, still incompletely determined, cortical areas. Furthermore, no neuroimaging study has yet tackled the differences between saccade lengthening ("forward adaptation") and shortening ("backward adaptation") and neither between their two main components, i.e. error processing and oculomotor changes. The present fMRI study was designed to fill these gaps. Blood-oxygen-level-dependent (BOLD) signal and eye movements of 24 healthy volunteers were acquired while performing reactive saccades under 4 conditions repeated in short blocks of 16 trials: systematic target jump during the saccade and in the saccade direction (forward: FW) or in the opposite direction (backward: BW), randomly directed FW or BW target jump during the saccade (random: RND) and no intra-saccadic target jump (stationary: STA). BOLD signals were analyzed both through general linear model (GLM) approaches applied at the whole-brain level and through sensitive Multi-Variate Pattern Analyses (MVPA) applied to 34 regions of interest (ROIs) identified from independent 'Saccade Localizer' functional data. Oculomotor data were consistent with successful induction of forward and backward adaptation in FW and BW blocks, respectively. The different analyses of voxel activation patterns (MVPAs) disclosed the involvement of 1) a set of ROIs specifically related to adaptation in the right occipital cortex, right and left MT/MST, right FEF and right pallidum; 2) several ROIs specifically involved in error signal processing in the left occipital cortex, left PEF, left precuneus, Medial Cingulate cortex (MCC), left inferior and right superior cerebellum; 3) ROIs specific to the direction of adaptation in the occipital cortex and MT/MST (left and right hemispheres for FW and BW, respectively) and in the pallidum of the right hemisphere (FW). The involvement of the left PEF and of the (left and right) occipital cortex were further supported and qualified by the whole brain GLM analysis: clusters of increased activity were found in PEF for the RND versus STA contrast (related to error processing) and in the left (right) occipital cortex for the FW (BW) versus STA contrasts [related to the FW (BW) direction of error and/or adaptation]. The present study both adds complementary data to the growing literature supporting a role of the cerebral cortex in saccadic adaptation through feedback and feedforward relationships with the cerebellum and provides the basis for improving conceptual frameworks of oculomotor plasticity and of its link with spatial cognition.
Collapse
Affiliation(s)
- Camille Métais
- IMPACT Team, Lyon Neuroscience Research Center, INSERM U1028; CNRS UMR5292; University Claude Bernard Lyon 1; 16, av. du Doyen Lépine, 69676, Bron cedex, France
| | - Judith Nicolas
- IMPACT Team, Lyon Neuroscience Research Center, INSERM U1028; CNRS UMR5292; University Claude Bernard Lyon 1; 16, av. du Doyen Lépine, 69676, Bron cedex, France; Department of Movement Sciences, Movement Control and Neuroplasticity Research Group, KU Leuven, 3001, Leuven, Belgium
| | - Moussa Diarra
- IMPACT Team, Lyon Neuroscience Research Center, INSERM U1028; CNRS UMR5292; University Claude Bernard Lyon 1; 16, av. du Doyen Lépine, 69676, Bron cedex, France; Université Bourgogne Franche-Comté, LEAD - CNRS UMR5022, Université de Bourgogne, Pôle AAFE, 11 Esplanade Erasme, 21000, Dijon, France
| | - Alexis Cheviet
- IMPACT Team, Lyon Neuroscience Research Center, INSERM U1028; CNRS UMR5292; University Claude Bernard Lyon 1; 16, av. du Doyen Lépine, 69676, Bron cedex, France
| | - Eric Koun
- IMPACT Team, Lyon Neuroscience Research Center, INSERM U1028; CNRS UMR5292; University Claude Bernard Lyon 1; 16, av. du Doyen Lépine, 69676, Bron cedex, France
| | - Denis Pélisson
- IMPACT Team, Lyon Neuroscience Research Center, INSERM U1028; CNRS UMR5292; University Claude Bernard Lyon 1; 16, av. du Doyen Lépine, 69676, Bron cedex, France.
| |
Collapse
|
34
|
F Amil A, Rubio Ballester B, Maier M, F M J Verschure P. Chronic use of cannabis might impair sensory error processing in the cerebellum through endocannabinoid dysregulation. Addict Behav 2022; 131:107297. [PMID: 35417840 DOI: 10.1016/j.addbeh.2022.107297] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2020] [Revised: 09/08/2021] [Accepted: 02/25/2022] [Indexed: 11/20/2022]
Abstract
Chronic use of cannabis leads to both motor deficits and the downregulation of CB1 receptors (CB1R) in the cerebellum. In turn, cerebellar damage is often related to impairments in motor learning and control. Further, a recent motor learning task that measures cerebellar-dependent adaptation has been shown to distinguish well between healthy subjects and chronic cannabis users. Thus, the deteriorating effects of chronic cannabis use in motor performance point to cerebellar adaptation as a key process to explain such deficits. We review the literature relating chronic cannabis use, the endocannabinoid system in the cerebellum, and different forms of cerebellar-dependent motor learning, to suggest that CB1R downregulation leads to a generalized underestimation and misprocessing of the sensory errors driving synaptic updates in the cerebellar cortex. Further, we test our hypothesis with a computational model performing a motor adaptation task and reproduce the behavioral effect of decreased implicit adaptation that appears to be a sign of chronic cannabis use. Finally, we discuss the potential of our hypothesis to explain similar phenomena related to motor impairments following chronic alcohol dependency.
Collapse
Affiliation(s)
- Adrián F Amil
- Institute for Bioengineering of Catalonia (IBEC), Barcelona, Spain; Universitat Pompeu Fabra (UPF), Barcelona, Spain.
| | | | - Martina Maier
- Institute for Bioengineering of Catalonia (IBEC), Barcelona, Spain.
| | - Paul F M J Verschure
- Donders Center for Neuroscience (DCN) - Radboud University, Nijmegen, The Netherlands.
| |
Collapse
|
35
|
Avila E, Flierman NA, Holland PJ, Roelfsema PR, Frens MA, Badura A, De Zeeuw CI. Purkinje Cell Activity in the Medial and Lateral Cerebellum During Suppression of Voluntary Eye Movements in Rhesus Macaques. Front Cell Neurosci 2022; 16:863181. [PMID: 35573834 PMCID: PMC9096024 DOI: 10.3389/fncel.2022.863181] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2022] [Accepted: 03/29/2022] [Indexed: 11/21/2022] Open
Abstract
Volitional suppression of responses to distracting external stimuli enables us to achieve our goals. This volitional inhibition of a specific behavior is supposed to be mainly mediated by the cerebral cortex. However, recent evidence supports the involvement of the cerebellum in this process. It is currently not known whether different parts of the cerebellar cortex play differential or synergistic roles in the planning and execution of this behavior. Here, we measured Purkinje cell (PC) responses in the medial and lateral cerebellum in two rhesus macaques during pro- and anti-saccade tasks. During an antisaccade trial, non-human primates (NHPs) were instructed to make a saccadic eye movement away from a target, rather than toward it, as in prosaccade trials. Our data show that the cerebellum plays an important role not only during the execution of the saccades but also during the volitional inhibition of eye movements toward the target. Simple spike (SS) modulation during the instruction and execution periods of pro- and anti-saccades was prominent in PCs of both the medial and lateral cerebellum. However, only the SS activity in the lateral cerebellar cortex contained information about stimulus identity and showed a strong reciprocal interaction with complex spikes (CSs). Moreover, the SS activity of different PC groups modulated bidirectionally in both of regions, but the PCs that showed facilitating and suppressive activity were predominantly associated with instruction and execution, respectively. These findings show that different cerebellar regions and PC groups contribute to goal-directed behavior and volitional inhibition, but with different propensities, highlighting the rich repertoire of the cerebellar control in executive functions.
Collapse
Affiliation(s)
- Eric Avila
- Netherlands Institute for Neuroscience, Amsterdam, Netherlands
- Department of Neuroscience, Erasmus MC, Rotterdam, Netherlands
| | - Nico A. Flierman
- Netherlands Institute for Neuroscience, Amsterdam, Netherlands
- Department of Neuroscience, Erasmus MC, Rotterdam, Netherlands
| | - Peter J. Holland
- School of Psychology, University of Birmingham, Birmingham, United Kingdom
| | - Pieter R. Roelfsema
- Netherlands Institute for Neuroscience, Amsterdam, Netherlands
- Department of Integrative Neurophysiology, VU University, Amsterdam, Netherlands
- Department of Psychiatry, Academic Medical Centre, Amsterdam, Netherlands
| | | | - Aleksandra Badura
- Netherlands Institute for Neuroscience, Amsterdam, Netherlands
- Department of Neuroscience, Erasmus MC, Rotterdam, Netherlands
- *Correspondence: Aleksandra Badura,
| | - Chris I. De Zeeuw
- Netherlands Institute for Neuroscience, Amsterdam, Netherlands
- Department of Neuroscience, Erasmus MC, Rotterdam, Netherlands
- Chris I. De Zeeuw,
| |
Collapse
|
36
|
Sedaghat-Nejad E, Pi JS, Hage P, Fakharian MA, Shadmehr R. Synchronous spiking of cerebellar Purkinje cells during control of movements. Proc Natl Acad Sci U S A 2022; 119:e2118954119. [PMID: 35349338 PMCID: PMC9168948 DOI: 10.1073/pnas.2118954119] [Citation(s) in RCA: 25] [Impact Index Per Article: 12.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2021] [Accepted: 02/13/2022] [Indexed: 11/18/2022] Open
Abstract
SignificanceThe information that one region of the brain transmits to another is usually viewed through the lens of firing rates. However, if the output neurons could vary the timing of their spikes, then, through synchronization, they would spotlight information that may be critical for control of behavior. Here we report that, in the cerebellum, Purkinje cell populations that share a preference for error convey, to the nucleus, when to decelerate the movement, by reducing their firing rates and temporally synchronizing the remaining spikes.
Collapse
Affiliation(s)
- Ehsan Sedaghat-Nejad
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, MD 21205
| | - Jay S. Pi
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, MD 21205
| | - Paul Hage
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, MD 21205
| | - Mohammad Amin Fakharian
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, MD 21205
- School of Cognitive Sciences, Institute for Research in Fundamental Sciences, Tehran, 1956836484, Iran
| | - Reza Shadmehr
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, MD 21205
| |
Collapse
|
37
|
Tsay JS, Haith AM, Ivry RB, Kim HE. Interactions between sensory prediction error and task error during implicit motor learning. PLoS Comput Biol 2022; 18:e1010005. [PMID: 35320276 PMCID: PMC8979451 DOI: 10.1371/journal.pcbi.1010005] [Citation(s) in RCA: 35] [Impact Index Per Article: 17.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2021] [Revised: 04/04/2022] [Accepted: 03/09/2022] [Indexed: 01/11/2023] Open
Abstract
Implicit motor recalibration allows us to flexibly move in novel and changing environments. Conventionally, implicit recalibration is thought to be driven by errors in predicting the sensory outcome of movement (i.e., sensory prediction errors). However, recent studies have shown that implicit recalibration is also influenced by errors in achieving the movement goal (i.e., task errors). Exactly how sensory prediction errors and task errors interact to drive implicit recalibration and, in particular, whether task errors alone might be sufficient to drive implicit recalibration remain unknown. To test this, we induced task errors in the absence of sensory prediction errors by displacing the target mid-movement. We found that task errors alone failed to induce implicit recalibration. In additional experiments, we simultaneously varied the size of sensory prediction errors and task errors. We found that implicit recalibration driven by sensory prediction errors could be continuously modulated by task errors, revealing an unappreciated dependency between these two sources of error. Moreover, implicit recalibration was attenuated when the target was simply flickered in its original location, even though this manipulation did not affect task error - an effect likely attributed to attention being directed away from the feedback cursor. Taken as a whole, the results were accounted for by a computational model in which sensory prediction errors and task errors, modulated by attention, interact to determine the extent of implicit recalibration.
Collapse
Affiliation(s)
- Jonathan S. Tsay
- Department of Psychology, University of California, Berkeley, California, United States of America
- Helen Wills Neuroscience Institute, University of California, Berkeley, California, United States of America
- * E-mail: (JST); (HEK)
| | - Adrian M. Haith
- Department of Neurology, Johns Hopkins University, Baltimore, Maryland, United States of America
| | - Richard B. Ivry
- Department of Psychology, University of California, Berkeley, California, United States of America
- Helen Wills Neuroscience Institute, University of California, Berkeley, California, United States of America
| | - Hyosub E. Kim
- Department of Physical Therapy, University of Delaware, Newark, Delaware, United States of America
- Department of Psychological and Brain Sciences, University of Delaware, Newark, Delaware, United States of America
- * E-mail: (JST); (HEK)
| |
Collapse
|
38
|
Kostadinov D, Häusser M. Reward signals in the cerebellum: origins, targets, and functional implications. Neuron 2022; 110:1290-1303. [PMID: 35325616 DOI: 10.1016/j.neuron.2022.02.015] [Citation(s) in RCA: 34] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2021] [Revised: 12/22/2021] [Accepted: 02/16/2022] [Indexed: 12/14/2022]
Abstract
The cerebellum has long been proposed to play a role in cognitive function, although this has remained controversial. This idea has received renewed support with the recent discovery that signals associated with reward can be observed in the cerebellar circuitry, particularly in goal-directed learning tasks involving an interplay between the cerebellar cortex, basal ganglia, and cerebral cortex. Remarkably, a wide range of reward contingencies-including reward expectation, delivery, size, and omission-can be encoded by specific circuit elements in a manner that reflects the microzonal organization of the cerebellar cortex. The facts that reward signals have been observed in both the mossy fiber and climbing fiber input pathways to the cerebellar cortex and that their convergence may trigger plasticity in Purkinje cells suggest that these interactions may be crucial for the role of the cerebellar cortex in learned behavior. These findings strengthen the emerging consensus that the cerebellum plays a pivotal role in shaping cognitive processing and suggest that the cerebellum may combine both supervised learning and reinforcement learning to optimize goal-directed action. We make specific predictions about how cerebellar circuits can work in concert with the basal ganglia to guide different stages of learning.
Collapse
Affiliation(s)
- Dimitar Kostadinov
- Wolfson Institute for Biomedical Research and Department of Neuroscience, Physiology and Pharmacology, University College London, London, UK.
| | - Michael Häusser
- Wolfson Institute for Biomedical Research and Department of Neuroscience, Physiology and Pharmacology, University College London, London, UK.
| |
Collapse
|
39
|
The human vestibulo-ocular reflex and compensatory saccades in schwannoma patients before and after vestibular nerve section. Clin Neurophysiol 2022; 138:197-213. [DOI: 10.1016/j.clinph.2022.02.014] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2020] [Revised: 01/25/2022] [Accepted: 02/13/2022] [Indexed: 11/19/2022]
|
40
|
Elsherif M, Eldeeb M. Video head impulse test in bilateral vestibulopathy. Braz J Otorhinolaryngol 2022; 88:181-186. [PMID: 32605831 PMCID: PMC9422640 DOI: 10.1016/j.bjorl.2020.05.014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2020] [Revised: 05/05/2020] [Accepted: 05/20/2020] [Indexed: 11/06/2022] Open
Abstract
Introduction Bilateral vestibulopathy is a rare chronic condition with multiple etiologies. Bilateral vestibulopathy is characterized mainly by unsteadiness when walking or standing, which worsens in darkness, as well as oscillopsia. The degree of handicap caused by bilateral vestibulopathy is variable and remains controversial. Objectives To determine the value of the video Head Impulse Test in quantifying vestibular deficit and to establish its impact on the quality of life. Methods Twenty patients (mean age, 41.9 years; range 14–80 years) fulfilling the recent Barany criteria of bilateral vestibulopathy, responded to the Situational Vertigo Questionnaire and underwent vestibular examination including fixation, positional tests, oculomotor test battery and video head impulse test. Results The relation between each of the video head impulse test parameters and the scores from the questionnaire were statistically analyzed. We observed that patients with covert saccades on the video head impulse test were more likely to have a better quality of life than those with both covert and overt saccades, regardless of the vestibulo-ocular reflex gain in each semicircular canal. The presence of covert saccades was found to be associated with an improved quality of life regardless of the severity of vestibule ocular reflex-deficit. Our conclusion was that vestibule ocular reflex gain, measured by video head impulse test, does not quantify the severity of affection of quality of life in patients with bilateral vestibulopathy. Conclusion Covert saccades are strategies aiming at minimizing the blurring of vision during head movement, that is an adaptive mechanism that improves quality of life. Therefore, we recommend that video head impulse test should be a part of the routine diagnostic workup of bilateral vestibulopathy.
Collapse
Affiliation(s)
- Mayada Elsherif
- Alexandria University, Audiovestibular Unit, Department of Otorhinolaryngology, Egypt.
| | - Mirhan Eldeeb
- Alexandria University, Audiovestibular Unit, Department of Otorhinolaryngology, Egypt
| |
Collapse
|
41
|
Albert ST, Jang J, Modchalingam S, 't Hart BM, Henriques D, Lerner G, Della-Maggiore V, Haith AM, Krakauer JW, Shadmehr R. Competition between parallel sensorimotor learning systems. eLife 2022; 11:e65361. [PMID: 35225229 PMCID: PMC9068222 DOI: 10.7554/elife.65361] [Citation(s) in RCA: 22] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2020] [Accepted: 02/11/2022] [Indexed: 11/13/2022] Open
Abstract
Sensorimotor learning is supported by at least two parallel systems: a strategic process that benefits from explicit knowledge and an implicit process that adapts subconsciously. How do these systems interact? Does one system's contributions suppress the other, or do they operate independently? Here, we illustrate that during reaching, implicit and explicit systems both learn from visual target errors. This shared error leads to competition such that an increase in the explicit system's response siphons away resources that are needed for implicit adaptation, thus reducing its learning. As a result, steady-state implicit learning can vary across experimental conditions, due to changes in strategy. Furthermore, strategies can mask changes in implicit learning properties, such as its error sensitivity. These ideas, however, become more complex in conditions where subjects adapt using multiple visual landmarks, a situation which introduces learning from sensory prediction errors in addition to target errors. These two types of implicit errors can oppose each other, leading to another type of competition. Thus, during sensorimotor adaptation, implicit and explicit learning systems compete for a common resource: error.
Collapse
Affiliation(s)
- Scott T Albert
- Department of Biomedical Engineering, Johns Hopkins School of MedicineBaltimoreUnited States
- Neuroscience Center, University of North CarolinaChapel HillUnited States
| | - Jihoon Jang
- Department of Biomedical Engineering, Johns Hopkins School of MedicineBaltimoreUnited States
- Vanderbilt University School of MedicineNashvilleUnited States
| | | | | | - Denise Henriques
- Department of Kinesiology and Health Science, York UniversityTorontoCanada
| | - Gonzalo Lerner
- IFIBIO Houssay, Deparamento de Fisiología y Biofísia, Facultad de Medicina, Universidad de Buenos AiresBuenos AiresArgentina
| | - Valeria Della-Maggiore
- IFIBIO Houssay, Deparamento de Fisiología y Biofísia, Facultad de Medicina, Universidad de Buenos AiresBuenos AiresArgentina
| | - Adrian M Haith
- Department of Neurology, Johns Hopkins School of MedicineBaltimoreUnited States
| | - John W Krakauer
- Department of Neurology, Johns Hopkins School of MedicineBaltimoreUnited States
- Department of Neuroscience, Johns Hopkins School of MedicineBaltimoreUnited States
- The Santa Fe InstituteSanta FeUnited States
| | - Reza Shadmehr
- Department of Biomedical Engineering, Johns Hopkins School of MedicineBaltimoreUnited States
| |
Collapse
|
42
|
Romano V, Zhai P, van der Horst A, Mazza R, Jacobs T, Bauer S, Wang X, White JJ, De Zeeuw CI. Olivocerebellar control of movement symmetry. Curr Biol 2022; 32:654-670.e4. [PMID: 35016009 DOI: 10.1016/j.cub.2021.12.020] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2021] [Revised: 10/26/2021] [Accepted: 12/08/2021] [Indexed: 01/02/2023]
Abstract
Coordination of bilateral movements is essential for a large variety of animal behaviors. The olivocerebellar system is critical for the control of movement, but its role in bilateral coordination has yet to be elucidated. Here, we examined whether Purkinje cells encode and influence synchronicity of left-right whisker movements. We found that complex spike activity is correlated with a prominent left-right symmetry of spontaneous whisker movements within parts, but not all, of Crus1 and Crus2. Optogenetic stimulation of climbing fibers in the areas with high and low correlations resulted in symmetric and asymmetric whisker movements, respectively. Moreover, when simple spike frequency prior to the complex spike was higher, the complex spike-related symmetric whisker protractions were larger. This finding alludes to a role for rebound activity in the cerebellar nuclei, which indeed turned out to be enhanced during symmetric protractions. Tracer injections suggest that regions associated with symmetric whisker movements are anatomically connected to the contralateral cerebellar hemisphere. Together, these data point toward the existence of modules on both sides of the cerebellar cortex that can differentially promote or reduce the symmetry of left and right movements in a context-dependent fashion.
Collapse
Affiliation(s)
- Vincenzo Romano
- Department of Neuroscience, Erasmus MC, Rotterdam, the Netherlands.
| | - Peipei Zhai
- Department of Neuroscience, Erasmus MC, Rotterdam, the Netherlands
| | | | - Roberta Mazza
- Department of Neuroscience, Erasmus MC, Rotterdam, the Netherlands
| | - Thomas Jacobs
- Department of Neuroscience, Erasmus MC, Rotterdam, the Netherlands
| | - Staf Bauer
- Department of Neuroscience, Erasmus MC, Rotterdam, the Netherlands
| | - Xiaolu Wang
- Department of Neuroscience, Erasmus MC, Rotterdam, the Netherlands
| | - Joshua J White
- Department of Neuroscience, Erasmus MC, Rotterdam, the Netherlands
| | - C I De Zeeuw
- Department of Neuroscience, Erasmus MC, Rotterdam, the Netherlands; Netherlands Institute for Neuroscience, Royal Academy of Arts and Sciences, Amsterdam, the Netherlands.
| |
Collapse
|
43
|
Robinson DA. Neurophysiology, pathology and models of rapid eye movements. PROGRESS IN BRAIN RESEARCH 2022; 267:287-317. [PMID: 35074059 DOI: 10.1016/bs.pbr.2021.10.014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
This chapter discusses the premotor neural mechanisms that control horizontal saccadic eye movements. Oculomotoneurons carry a pulse-step signal that underlies the pulse-step force driving the overdamped plant. The pulse and step are both generated by a common signal, arising from medium-lead burst neurons in the pons. Their burst signal encodes saccadic eye velocity, while the number of spikes in the burst relates to the saccade amplitude. The step component, which encodes the eye position, is obtained by neural integration of the burst. Several oculomotor neural disorders can be explained by impairments in the binocular push-pull organization of this pulse-step mechanism. Plasticity of the pulse-step control, e.g., in response to muscle weakening, is mediated by cerebellar vermis and flocculus. Saccadic offset may be controlled, either by active braking, or by an exponential slide signal. The neurophysiology is summarized by a quantitative model, in which the firing rate of burst neurons is controlled by a dynamic negative feedback loop that carries the instantaneous eye position signal from the neural integrator. This signal is compared with a desired eye-position command in the head from higher centers, and the resulting dynamic motor error drives the high-gain burst cells. Instability of the system is prevented by the mutual inhibitory interaction between burst cells and omnipause neurons. The model explains many features of normal saccades, but also accounts for pathologies and abnormalities like dynamic overshoots and saccade oscillations.
Collapse
Affiliation(s)
- David A Robinson
- Late Professor of Ophthalmology, Biomedical Engineering and Neuroscience, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| |
Collapse
|
44
|
Robinson DA. Neurophysiology of the saccadic system: The reticular formation. PROGRESS IN BRAIN RESEARCH 2022; 267:355-378. [PMID: 35074062 DOI: 10.1016/bs.pbr.2021.10.017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
This chapter discusses the neurophysiology and function of subcortical circuits and cortical areas involved in saccade generation. While cells within the different nuclei of the brainstem reticular formation shape the temporal details of ipsiversive horizontal and vertical/cyclotorsional saccade components, the cerebellar flocculus, vermis and fastigial nucleus are thought to modulate these saccadic waveforms. Burst neurons in the deep layers of the superior colliculus encode the saccade vector in the contralateral field by a localized population in a motor-error map. The complexity of the saccadic system is evident in the different subclasses of SC cells, ranging from purely visual, to visual-motor, purely motor, and quasi-visual cells. Movement-related activity in all SC cells is dissociated from the retinotopic visual activity. The chapter further discusses neurophysiological findings obtained from the substantia nigra (pars reticulata), the medial thalamus, the frontal eye fields, the supplementary motor area and the parietal lobes, discussing the ever more complex response patterns of their neurons in relation to saccades.
Collapse
Affiliation(s)
- David A Robinson
- Late Professor of Ophthalmology, Biomedical Engineering and Neuroscience, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| |
Collapse
|
45
|
Tsay JS, Kim H, Haith AM, Ivry RB. Understanding implicit sensorimotor adaptation as a process of proprioceptive re-alignment. eLife 2022; 11:76639. [PMID: 35969491 PMCID: PMC9377801 DOI: 10.7554/elife.76639] [Citation(s) in RCA: 35] [Impact Index Per Article: 17.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2021] [Accepted: 07/13/2022] [Indexed: 01/11/2023] Open
Abstract
Multiple learning processes contribute to successful goal-directed actions in the face of changing physiological states, biomechanical constraints, and environmental contexts. Amongst these processes, implicit sensorimotor adaptation is of primary importance, ensuring that movements remain well-calibrated and accurate. A large body of work on reaching movements has emphasized how adaptation centers on an iterative process designed to minimize visual errors. The role of proprioception has been largely neglected, thought to play a passive role in which proprioception is affected by the visual error but does not directly contribute to adaptation. Here, we present an alternative to this visuo-centric framework, outlining a model in which implicit adaptation acts to minimize a proprioceptive error, the distance between the perceived hand position and its intended goal. This proprioceptive re-alignment model (PReMo) is consistent with many phenomena that have previously been interpreted in terms of learning from visual errors, and offers a parsimonious account of numerous unexplained phenomena. Cognizant that the evidence for PReMo rests on correlational studies, we highlight core predictions to be tested in future experiments, as well as note potential challenges for a proprioceptive-based perspective on implicit adaptation.
Collapse
Affiliation(s)
- Jonathan S Tsay
- Department of Psychology, University of California, BerkeleyBerkeleyUnited States,Helen Wills Neuroscience Institute, University of California, BerkeleyBerkeleyUnited States
| | - Hyosub Kim
- Department of Physical Therapy, University of DelawareNewarkUnited States,Department of Psychological and Brain Sciences, University of DelawareNewarkUnited States
| | - Adrian M Haith
- Department of Neurology, Johns Hopkins UniversityBaltimoreUnited States
| | - Richard B Ivry
- Department of Psychology, University of California, BerkeleyBerkeleyUnited States,Helen Wills Neuroscience Institute, University of California, BerkeleyBerkeleyUnited States
| |
Collapse
|
46
|
Dawidowicz G, Shaine Y, Mawase F. Separation of multiple motor memories through implicit and explicit processes. J Neurophysiol 2021; 127:329-340. [PMID: 34936513 DOI: 10.1152/jn.00245.2021] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Acquisition of multiple motor skills without interference is a remarkable ability in daily life. During adaptation to opposing perturbations, a common paradigm to study this ability, each perturbation can be successfully learned when a contextual follow-through movement is associated with the direction of the perturbation. It is still unclear, however, to what extent this learning engages the cognitive explicit process and the implicit process. Here, we untangled the individual contributions of the explicit and implicit components while participants learned opposing visuomotor perturbations, with a second unperturbed follow-through movement. In Exp. 1 we replicated previous adaptation results and showed that follow-through movements also allow learning for opposing visuomotor rotations. For one group of participants in Exp. 2 we isolated strategic explicit learning, while for another group we isolated the implicit component. Our data showed that opposing perturbations could be fully learned by explicit strategies; but when strategy was restricted, distinct implicit processes contributed to learning. In Exp.3, we examined whether learning is influenced by the disparity between the follow-through contexts. We found that the location of follow-through targets had little effect on total learning, yet it led to more instances in which participants failed to learn the task. In Exp. 4, we explored the generalization capability to untrained targets. Participants showed near-flat generalization of the implicit and explicit processes. Overall, our results indicate that follow-through contextual cues might activate, in part, top-down cognitive factors that influence not only the dynamics of the explicit learning, but also the implicit process.
Collapse
Affiliation(s)
- Gefen Dawidowicz
- Faculty of Biomedical Engineering, Technion - Israel Institute of Technology, Israel
| | - Yuval Shaine
- Faculty of Biomedical Engineering, Technion - Israel Institute of Technology, Israel
| | - Firas Mawase
- Faculty of Biomedical Engineering, Technion - Israel Institute of Technology, Israel
| |
Collapse
|
47
|
Bina L, Romano V, Hoogland TM, Bosman LWJ, De Zeeuw CI. Purkinje cells translate subjective salience into readiness to act and choice performance. Cell Rep 2021; 37:110116. [PMID: 34910904 DOI: 10.1016/j.celrep.2021.110116] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2020] [Revised: 07/06/2021] [Accepted: 11/19/2021] [Indexed: 11/28/2022] Open
Abstract
The brain selectively allocates attention from a continuous stream of sensory input. This process is typically attributed to computations in distinct regions of the forebrain and midbrain. Here, we explore whether cerebellar Purkinje cells encode information about the selection of sensory inputs and could thereby contribute to non-motor forms of learning. We show that complex spikes of individual Purkinje cells change the sensory modality they encode to reflect changes in the perceived salience of sensory input. Comparisons with mouse models deficient in cerebellar plasticity suggest that changes in complex spike activity instruct potentiation of Purkinje cells simple spike firing, which is required for efficient learning. Our findings suggest that during learning, climbing fibers do not directly guide motor output, but rather contribute to a general readiness to act via changes in simple spike activity, thereby bridging the sequence from non-motor to motor functions.
Collapse
Affiliation(s)
- Lorenzo Bina
- Department of Neuroscience, Erasmus MC, Rotterdam 3000 CA, the Netherlands
| | - Vincenzo Romano
- Department of Neuroscience, Erasmus MC, Rotterdam 3000 CA, the Netherlands
| | - Tycho M Hoogland
- Department of Neuroscience, Erasmus MC, Rotterdam 3000 CA, the Netherlands; Netherlands Institute for Neuroscience, Royal Academy of Arts and Sciences, Amsterdam 1105 BA, the Netherlands
| | - Laurens W J Bosman
- Department of Neuroscience, Erasmus MC, Rotterdam 3000 CA, the Netherlands.
| | - Chris I De Zeeuw
- Department of Neuroscience, Erasmus MC, Rotterdam 3000 CA, the Netherlands; Netherlands Institute for Neuroscience, Royal Academy of Arts and Sciences, Amsterdam 1105 BA, the Netherlands.
| |
Collapse
|
48
|
Gilbert M. The Shape of Data: a Theory of the Representation of Information in the Cerebellar Cortex. THE CEREBELLUM 2021; 21:976-986. [PMID: 34902112 PMCID: PMC9596575 DOI: 10.1007/s12311-021-01352-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Accepted: 11/28/2021] [Indexed: 11/30/2022]
Abstract
This paper presents a model of rate coding in the cerebellar cortex. The pathway of input to output of the cerebellum forms an anatomically repeating, functionally modular network, whose basic wiring is preserved across vertebrate taxa. Each network is bisected centrally by a functionally defined cell group, a microzone, which forms part of the cerebellar circuit. Input to a network may be from tens of thousands of concurrently active mossy fibres. The model claims to quantify the conversion of input rates into the code received by a microzone. Recoding on entry converts input rates into an internal code which is homogenised in the functional equivalent of an imaginary plane, occupied by the centrally positioned microzone. Homogenised means the code exists in any random sample of parallel fibre signals over a minimum number. The nature of the code and the regimented architecture of the cerebellar cortex mean that the threshold can be represented by space so that the threshold can be met by the physical dimensions of the Purkinje cell dendritic arbour and planar interneuron networks. As a result, the whole population of a microzone receives the same code. This is part of a mechanism which orchestrates functionally indivisible behaviour of the cerebellar circuit and is necessary for coordinated control of the output cells of the circuit. In this model, fine control of Purkinje cells is by input rates to the system and not by learning so that it is in conflict with the for-years-dominant supervised learning model.
Collapse
Affiliation(s)
- Mike Gilbert
- School of Psychology, University of Birmingham, Birmingham, UK.
| |
Collapse
|
49
|
Sendhilnathan N, Ipata A, Goldberg ME. Mid-lateral cerebellar complex spikes encode multiple independent reward-related signals during reinforcement learning. Nat Commun 2021; 12:6475. [PMID: 34753927 PMCID: PMC8578621 DOI: 10.1038/s41467-021-26338-0] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2020] [Accepted: 10/01/2021] [Indexed: 11/29/2022] Open
Abstract
Although the cerebellum has been implicated in simple reward-based learning recently, the role of complex spikes (CS) and simple spikes (SS), their interaction and their relationship to complex reinforcement learning and decision making is still unclear. Here we show that in a context where a non-human primate learned to make novel visuomotor associations, classifying CS responses based on their SS properties revealed distinct cell-type specific encoding of the probability of failure after the stimulus onset and the non-human primate's decision. In a different context, CS from the same cerebellar area also responded in a cell-type and learning independent manner to the stimulus that signaled the beginning of the trial. Both types of CS signals were independent of changes in any motor kinematics and were unlikely to instruct the concurrent SS activity through an error based mechanism, suggesting the presence of context dependent, flexible, multiple independent channels of neural encoding by CS and SS. This diversity in neural information encoding in the mid-lateral cerebellum, depending on the context and learning state, is well suited to promote exploration and acquisition of wide range of cognitive behaviors that entail flexible stimulus-action-reward relationships but not necessarily motor learning.
Collapse
Affiliation(s)
- Naveen Sendhilnathan
- Doctoral Program in Neurobiology and Behavior, Columbia University, New York, NY, USA.
- Department of Neuroscience, Columbia University, New York, NY, USA.
- Mahoney Center for Brain and Behavior Research, Columbia University, New York, NY, USA.
- Zuckerman Mind, Brain, and Behavior Institute, Columbia University, New York, NY, USA.
- New York State Psychiatric Institute, New York, NY, USA.
| | - Anna Ipata
- Department of Neuroscience, Columbia University, New York, NY, USA
- Mahoney Center for Brain and Behavior Research, Columbia University, New York, NY, USA
- Zuckerman Mind, Brain, and Behavior Institute, Columbia University, New York, NY, USA
- New York State Psychiatric Institute, New York, NY, USA
| | - Michael E Goldberg
- Department of Neuroscience, Columbia University, New York, NY, USA.
- Mahoney Center for Brain and Behavior Research, Columbia University, New York, NY, USA.
- Zuckerman Mind, Brain, and Behavior Institute, Columbia University, New York, NY, USA.
- New York State Psychiatric Institute, New York, NY, USA.
- Kavli Institute for Brain Science, Columbia University, New York, NY, USA.
- Department of Neurology, Psychiatry, and Ophthalmology, Columbia University College of Physicians and Surgeons, New York, NY, USA.
| |
Collapse
|
50
|
Raichin A, Shkedy Rabani A, Shmuelof L. Motor skill training without online visual feedback enhances feedforward control. J Neurophysiol 2021; 126:1604-1613. [PMID: 34525324 DOI: 10.1152/jn.00145.2021] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Motor skill learning involves improvement in feedforward control, the ability to execute a motor plan more reliably, and feedback control, the ability to adjust the motor plan on the fly. The dependence between these control components and the association between training conditions and their improvement have not been directly examined. This study characterizes the contribution of feedforward and feedback control components to motor skill learning using the arc-pointing task (APT), a drawing task that requires high motor acuity. In experiment 1, the performance of three groups of subjects was tested before and after training with online visual feedback (OF group), with knowledge of performance feedback that was presented after movement completion (KP group), and with both online and KP feedback (KP + OF group). Although the improvement of the OF group was not different from the improvement of the KP + OF group, comparison of the KP and KP + OF groups revealed an advantage to the KP group in the fast test speed, suggesting that training without online feedback leads to a greater improvement in feedforward control. In experiment 2, subject's improvement was examined using test probes for estimating feedback and feedforward control. Both KP + OF and KP groups showed improvement in feedforward and feedback conditions with a trend toward a greater improvement of the KP group. Our results suggest that online visual feedback suppresses improvement in feedforward control during motor skill learning.NEW & NOTEWORTHY Becoming a skillful player requires both executing reliable movements and being able to efficiently control them online. We study here how training with and without online visual feedback affects feedforward and feedback control improvement in a drawing task that requires high precision. We show that training with online feedback suppresses improvement in feedforward control and leads to inferior performance in fast movements.
Collapse
Affiliation(s)
- Adi Raichin
- Department of Cognitive and Brain Sciences, Ben-Gurion University of the Negev, Beer-Sheva, Israel
| | - Anat Shkedy Rabani
- Department of Cognitive and Brain Sciences, Ben-Gurion University of the Negev, Beer-Sheva, Israel
| | - Lior Shmuelof
- Department of Cognitive and Brain Sciences, Ben-Gurion University of the Negev, Beer-Sheva, Israel.,The Zlotowski Center for Neuroscience, Ben-Gurion University of the Negev, Beer-Sheva, Israel
| |
Collapse
|