1
|
Tsay JS, Kim HE, McDougle SD, Taylor JA, Haith A, Avraham G, Krakauer JW, Collins AGE, Ivry RB. Fundamental processes in sensorimotor learning: Reasoning, refinement, and retrieval. eLife 2024; 13:e91839. [PMID: 39087986 PMCID: PMC11293869 DOI: 10.7554/elife.91839] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2023] [Accepted: 07/22/2024] [Indexed: 08/02/2024] Open
Abstract
Motor learning is often viewed as a unitary process that operates outside of conscious awareness. This perspective has led to the development of sophisticated models designed to elucidate the mechanisms of implicit sensorimotor learning. In this review, we argue for a broader perspective, emphasizing the contribution of explicit strategies to sensorimotor learning tasks. Furthermore, we propose a theoretical framework for motor learning that consists of three fundamental processes: reasoning, the process of understanding action-outcome relationships; refinement, the process of optimizing sensorimotor and cognitive parameters to achieve motor goals; and retrieval, the process of inferring the context and recalling a control policy. We anticipate that this '3R' framework for understanding how complex movements are learned will open exciting avenues for future research at the intersection between cognition and action.
Collapse
Affiliation(s)
- Jonathan S Tsay
- Department of Psychology, Carnegie Mellon UniversityPittsburghUnited States
- Neuroscience Institute, Carnegie Mellon UniversityPittsburgUnited States
| | - Hyosub E Kim
- School of Kinesiology, University of British ColumbiaVancouverCanada
| | | | - Jordan A Taylor
- Department of Psychology, Princeton UniversityPrincetonUnited States
| | - Adrian Haith
- Department of Neurology, Johns Hopkins UniversityBaltimoreUnited States
| | - Guy Avraham
- Department of Psychology, University of California BerkeleyBerkeleyUnited States
- Helen Wills Neuroscience Institute, University of California BerkeleyBerkeleyUnited States
| | - John W Krakauer
- Department of Neurology, Johns Hopkins UniversityBaltimoreUnited States
- Department of Neuroscience, Johns Hopkins UniversityBaltimoreUnited States
- Santa Fe InstituteSanta FeUnited States
| | - Anne GE Collins
- Department of Psychology, University of California BerkeleyBerkeleyUnited States
- Helen Wills Neuroscience Institute, University of California BerkeleyBerkeleyUnited States
| | - Richard B Ivry
- Department of Psychology, University of California BerkeleyBerkeleyUnited States
- Helen Wills Neuroscience Institute, University of California BerkeleyBerkeleyUnited States
| |
Collapse
|
2
|
Zhang Z, Wang H, Zhang T, Nie Z, Wei K. Perceptual error based on Bayesian cue combination drives implicit motor adaptation. eLife 2024; 13:RP94608. [PMID: 38963410 PMCID: PMC11223768 DOI: 10.7554/elife.94608] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/05/2024] Open
Abstract
The sensorimotor system can recalibrate itself without our conscious awareness, a type of procedural learning whose computational mechanism remains undefined. Recent findings on implicit motor adaptation, such as over-learning from small perturbations and fast saturation for increasing perturbation size, challenge existing theories based on sensory errors. We argue that perceptual error, arising from the optimal combination of movement-related cues, is the primary driver of implicit adaptation. Central to our theory is the increasing sensory uncertainty of visual cues with increasing perturbations, which was validated through perceptual psychophysics (Experiment 1). Our theory predicts the learning dynamics of implicit adaptation across a spectrum of perturbation sizes on a trial-by-trial basis (Experiment 2). It explains proprioception changes and their relation to visual perturbation (Experiment 3). By modulating visual uncertainty in perturbation, we induced unique adaptation responses in line with our model predictions (Experiment 4). Overall, our perceptual error framework outperforms existing models based on sensory errors, suggesting that perceptual error in locating one's effector, supported by Bayesian cue integration, underpins the sensorimotor system's implicit adaptation.
Collapse
Affiliation(s)
- Zhaoran Zhang
- School of Psychological and Cognitive Sciences, Peking UniversityBeijingChina
| | - Huijun Wang
- School of Psychological and Cognitive Sciences, Peking UniversityBeijingChina
| | - Tianyang Zhang
- School of Psychological and Cognitive Sciences, Peking UniversityBeijingChina
| | - Zixuan Nie
- School of Psychological and Cognitive Sciences, Peking UniversityBeijingChina
| | - Kunlin Wei
- School of Psychological and Cognitive Sciences, Peking UniversityBeijingChina
- Beijing Key Laboratory of Behavior and Mental HealthBeijingChina
- Peking-Tsinghua Center for Life Sciences, Peking UniversityBeijingChina
- National Key Laboratory of General Artificial IntelligenceBeijingChina
| |
Collapse
|
3
|
Forano M, Franklin DW. Reward actively engages both implicit and explicit components in dual force field adaptation. J Neurophysiol 2024; 132:1-22. [PMID: 38717332 DOI: 10.1152/jn.00307.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2023] [Revised: 04/08/2024] [Accepted: 05/06/2024] [Indexed: 06/26/2024] Open
Abstract
Motor learning occurs through multiple mechanisms, including unsupervised, supervised (error based), and reinforcement (reward based) learning. Although studies have shown that reward leads to an overall better motor adaptation, the specific processes by which reward influences adaptation are still unclear. Here, we examine how the presence of reward affects dual adaptation to novel dynamics and distinguish its influence on implicit and explicit learning. Participants adapted to two opposing force fields in an adaptation/deadaptation/error-clamp paradigm, where five levels of reward (a score and a digital face) were provided as participants reduced their lateral error. Both reward and control (no reward provided) groups simultaneously adapted to both opposing force fields, exhibiting a similar final level of adaptation, which was primarily implicit. Triple-rate models fit to the adaptation process found higher learning rates in the fast and slow processes and a slightly increased fast retention rate for the reward group. Whereas differences in the slow learning rate were only driven by implicit learning, the large difference in the fast learning rate was mainly explicit. Overall, we confirm previous work showing that reward increases learning rates, extending this to dual-adaptation experiments and demonstrating that reward influences both implicit and explicit adaptation. Specifically, we show that reward acts primarily explicitly on the fast learning rate and implicitly on the slow learning rates.NEW & NOTEWORTHY Here we show that rewarding participants' performance during dual force field adaptation primarily affects the initial rate of learning and the early timescales of adaptation, with little effect on the final adaptation level. However, reward affects both explicit and implicit components of adaptation. Whereas the learning rate of the slow process is increased implicitly, the fast learning and retention rates are increased through both implicit components and the use of explicit strategies.
Collapse
Affiliation(s)
- Marion Forano
- Neuromuscular Diagnostics, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany
- Department of Orthopaedics and Sports Orthopaedics, Klinikum Rechts der Isar, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany
| | - David W Franklin
- Neuromuscular Diagnostics, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany
- Munich Institute of Robotics and Machine Intelligence (MIRMI), Technical University of Munich, Munich, Germany
- Munich Data Science Institute (MDSI), Technical University of Munich, Munich, Germany
| |
Collapse
|
4
|
Diao H, Ma J, Jia Y, Jia H, Wei K. Abnormalities in motor adaptation to different types of perturbations in schizophreniaperturbations in schizophrenia. Schizophr Res 2024; 267:291-300. [PMID: 38599141 DOI: 10.1016/j.schres.2024.03.051] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/04/2023] [Revised: 03/20/2024] [Accepted: 03/31/2024] [Indexed: 04/12/2024]
Abstract
Schizophrenia is a mental health disorder that often includes psychomotor disturbances, impacting how individuals adjust their motor output based on the cause of motor errors. While previous motor adaptation studies on individuals with schizophrenia have largely focused on large and consistent perturbations induced by abrupt experimental manipulations, such as donning prism goggles, the adaptation process to random perturbations, either caused by intrinsic motor noise or external disturbances, has not been examined - despite its ecological relevance. Here, we used a unified behavioral task paradigm to examine motor adaptation to perturbations of three causal structures among individuals in the remission stage of schizophrenia, youth with ultra-high risk of psychosis, adults with active symptoms, and age-matched controls. Results showed that individuals with schizophrenia had reduced trial-by-trial adaptation and large error variance when adapting to their own motor noise. When adapting to random but salient perturbations, they showed intact adaptation and normal causal inference of errors. This contrasted with reduced adaptation to large yet consistent perturbations, which could reflect difficulties in forming cognitive strategies rather than the often-assumed impairments in procedural learning or sense of agency. Furthermore, the observed adaptation effects were correlated with the severity of positive symptoms across the diagnosis groups. Our findings suggest that individuals with schizophrenia face challenges in accommodating intrinsic perturbations when motor errors are ambiguous but adapt with intact causal attribution when errors are salient.
Collapse
Affiliation(s)
- Henan Diao
- Beijing Key Laboratory of Behavior and Mental Health, School of Psychological and Cognitive Sciences, Peking University, Beijing 100080, China; Key Laboratory of Machine Perception (Ministry of Education), Peking University, Beijing 10080, China
| | - Jiajun Ma
- Beijing Key Laboratory of Behavior and Mental Health, School of Psychological and Cognitive Sciences, Peking University, Beijing 100080, China; Key Laboratory of Machine Perception (Ministry of Education), Peking University, Beijing 10080, China
| | - Yuan Jia
- The National Clinical Research Center for Mental Disorders, Beijing Key Laboratory of Mental Disorders, Beijing Anding Hospital, Capital Medical University, Beijing 100088, China; Advanced Innovation Center for Human Brain Protection, Capital Medical University, Beijing 100088, China
| | - Hongxiao Jia
- The National Clinical Research Center for Mental Disorders, Beijing Key Laboratory of Mental Disorders, Beijing Anding Hospital, Capital Medical University, Beijing 100088, China; Advanced Innovation Center for Human Brain Protection, Capital Medical University, Beijing 100088, China.
| | - Kunlin Wei
- Beijing Key Laboratory of Behavior and Mental Health, School of Psychological and Cognitive Sciences, Peking University, Beijing 100080, China; Key Laboratory of Machine Perception (Ministry of Education), Peking University, Beijing 10080, China.
| |
Collapse
|
5
|
Modchalingam S, Ayala MN, Henriques DYP. Movement-goal relevant object shape properties act as poor but viable cues for the attribution of motor errors to external objects. PLoS One 2024; 19:e0300020. [PMID: 38547216 PMCID: PMC10977729 DOI: 10.1371/journal.pone.0300020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Accepted: 02/21/2024] [Indexed: 04/02/2024] Open
Abstract
When a context change is detected during motor learning, motor memories-internal models for executing movements within some context-may be created or existing motor memories may be activated and modified. Assigning credit to plausible causes of errors can allow for fast retrieval and activation of a motor memory, or a combination of motor memories, when the presence of such causes is detected. Features of the movement-context intrinsic to the movement dynamics, such as posture of the end effector, are often effective cues for detecting context change whereas features extrinsic to the movement dynamics, such as the colour of an object being moved, are often not. These extrinsic cues are typically not relevant to the motor task at hand and can be safely ignored by the motor system. We conducted two experiments testing if extrinsic but movement-goal relevant object-shape cues during an object-transport task can act as viable contextual cues for error assignment to the object, and the creation of new, object-shape-associated motor memories. In the first experiment we find that despite the object-shape cues, errors are primarily attributed to the hand transporting the object. In a second experiment, we find participants can execute differing movements cued by the object shape in a dual adaptation task, but the extent of adaptation is small, suggesting that movement-goal relevant object-shape properties are poor but viable cues for creating context specific motor memories.
Collapse
Affiliation(s)
- Shanaathanan Modchalingam
- Centre for Vision Research, York University, Toronto, Ontario, Canada
- School of Kinesiology and Health Science, York University, Toronto, Ontario, Canada
| | - Maria N. Ayala
- Centre for Vision Research, York University, Toronto, Ontario, Canada
- Department of Psychology, York University, Toronto, Ontario, Canada
| | - Denise Y. P. Henriques
- Centre for Vision Research, York University, Toronto, Ontario, Canada
- School of Kinesiology and Health Science, York University, Toronto, Ontario, Canada
| |
Collapse
|
6
|
Magnard J, Macaulay TR, Schroeder ET, Laine C, Gordon J, Schweighofer N. Initial development of skill with a reversed bicycle and a case series of experienced riders. Sci Rep 2024; 14:4334. [PMID: 38383561 PMCID: PMC10881966 DOI: 10.1038/s41598-024-54595-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Accepted: 02/14/2024] [Indexed: 02/23/2024] Open
Abstract
Riding a bicycle is considered a durable skill that cannot be forgotten. Here, novice participants practiced riding a reversed bicycle, in which a reversing gear inverted the handlebar's rotation. Although learning to ride the reversed bicycle was possible, it was slow, highly variable, implicit, and followed an S-shape pattern. In the initial learning phase, failed attempts to ride the normal bicycle indicated strong interference between the two bicycle skills. While additional practice decreased this interference effect, a subset of learners could not ride either bicycle after eight sessions of practice. Experienced riders who performed extensive practice could switch bicycles without failed attempts and exhibited similar performance (i.e., similar handlebar oscillations) on both bicycles. However, their performance on the normal bicycle was worse than that of the novice bicycle riders at baseline. In conclusion, "unlearning" of the normal bicycle skill precedes the initial learning of the reversed bicycle skill, and a signature of such unlearning is still present following extensive practice.
Collapse
Affiliation(s)
- Justine Magnard
- Biokinesiology and Physical Therapy, University of Southern California, Los Angeles, CA, USA
- Faculté des Sciences de la Motricité, Université Libre de Bruxelles, Bruxelles, Belgium
| | - Timothy R Macaulay
- Biokinesiology and Physical Therapy, University of Southern California, Los Angeles, CA, USA
- KBR, Houston, TX, USA
| | - E Todd Schroeder
- Biokinesiology and Physical Therapy, University of Southern California, Los Angeles, CA, USA
| | - Christopher Laine
- Occupational Science and Occupational Therapy, University of Southern California, Los Angeles, CA, USA
| | - James Gordon
- Biokinesiology and Physical Therapy, University of Southern California, Los Angeles, CA, USA
| | - Nicolas Schweighofer
- Biokinesiology and Physical Therapy, University of Southern California, Los Angeles, CA, USA.
| |
Collapse
|
7
|
Barry MLLR, Gerstner W. Fast adaptation to rule switching using neuronal surprise. PLoS Comput Biol 2024; 20:e1011839. [PMID: 38377112 PMCID: PMC10906910 DOI: 10.1371/journal.pcbi.1011839] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2022] [Revised: 03/01/2024] [Accepted: 01/18/2024] [Indexed: 02/22/2024] Open
Abstract
In humans and animals, surprise is a physiological reaction to an unexpected event, but how surprise can be linked to plausible models of neuronal activity is an open problem. We propose a self-supervised spiking neural network model where a surprise signal is extracted from an increase in neural activity after an imbalance of excitation and inhibition. The surprise signal modulates synaptic plasticity via a three-factor learning rule which increases plasticity at moments of surprise. The surprise signal remains small when transitions between sensory events follow a previously learned rule but increases immediately after rule switching. In a spiking network with several modules, previously learned rules are protected against overwriting, as long as the number of modules is larger than the total number of rules-making a step towards solving the stability-plasticity dilemma in neuroscience. Our model relates the subjective notion of surprise to specific predictions on the circuit level.
Collapse
Affiliation(s)
- Martin L. L. R. Barry
- School of Computer and Communication Sciences and School of Life Sciences, Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Wulfram Gerstner
- School of Computer and Communication Sciences and School of Life Sciences, Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| |
Collapse
|
8
|
Leib R, Howard IS, Millard M, Franklin DW. Behavioral Motor Performance. Compr Physiol 2023; 14:5179-5224. [PMID: 38158372 DOI: 10.1002/cphy.c220032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2024]
Abstract
The human sensorimotor control system has exceptional abilities to perform skillful actions. We easily switch between strenuous tasks that involve brute force, such as lifting a heavy sewing machine, and delicate movements such as threading a needle in the same machine. Using a structure with different control architectures, the motor system is capable of updating its ability to perform through our daily interaction with the fluctuating environment. However, there are issues that make this a difficult computational problem for the brain to solve. The brain needs to control a nonlinear, nonstationary neuromuscular system, with redundant and occasionally undesired degrees of freedom, in an uncertain environment using a body in which information transmission is subject to delays and noise. To gain insight into the mechanisms of motor control, here we survey movement laws and invariances that shape our everyday motion. We then examine the major solutions to each of these problems in the three parts of the sensorimotor control system, sensing, planning, and acting. We focus on how the sensory system, the control architectures, and the structure and operation of the muscles serve as complementary mechanisms to overcome deviations and disturbances to motor behavior and give rise to skillful motor performance. We conclude with possible future research directions based on suggested links between the operation of the sensorimotor system across the movement stages. © 2024 American Physiological Society. Compr Physiol 14:5179-5224, 2024.
Collapse
Affiliation(s)
- Raz Leib
- Neuromuscular Diagnostics, TUM School of Medicine and Health, Department of Health and Sport Sciences, Technical University of Munich, Munich, Germany
| | - Ian S Howard
- School of Engineering, Computing and Mathematics, University of Plymouth, Plymouth, UK
| | - Matthew Millard
- Institute of Sport and Movement Science, University of Stuttgart, Stuttgart, Germany
- Institute of Engineering and Computational Mechanics, University of Stuttgart, Stuttgart, Germany
| | - David W Franklin
- Neuromuscular Diagnostics, TUM School of Medicine and Health, Department of Health and Sport Sciences, Technical University of Munich, Munich, Germany
- Munich Institute of Robotics and Machine Intelligence (MIRMI), Technical University of Munich, Munich, Germany
- Munich Data Science Institute (MDSI), Technical University of Munich, Munich, Germany
| |
Collapse
|
9
|
Mizes KGC, Lindsey J, Escola GS, Ölveczky BP. Motor cortex is required for flexible but not automatic motor sequences. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.09.05.556348. [PMID: 37732225 PMCID: PMC10508748 DOI: 10.1101/2023.09.05.556348] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/22/2023]
Abstract
How motor cortex contributes to motor sequence execution is much debated, with studies supporting disparate views. Here we probe the degree to which motor cortex's engagement depends on task demands, specifically whether its role differs for highly practiced, or 'automatic', sequences versus flexible sequences informed by external events. To test this, we trained rats to generate three-element motor sequences either by overtraining them on a single sequence or by having them follow instructive visual cues. Lesioning motor cortex revealed that it is necessary for flexible cue-driven motor sequences but dispensable for single automatic behaviors trained in isolation. However, when an automatic motor sequence was practiced alongside the flexible task, it became motor cortex-dependent, suggesting that subcortical consolidation of an automatic motor sequence is delayed or prevented when the same sequence is produced also in a flexible context. A simple neural network model recapitulated these results and explained the underlying circuit mechanisms. Our results critically delineate the role of motor cortex in motor sequence execution, describing the condition under which it is engaged and the functions it fulfills, thus reconciling seemingly conflicting views about motor cortex's role in motor sequence generation.
Collapse
Affiliation(s)
- Kevin G. C. Mizes
- Program in Biophysics, Harvard University, Cambridge, MA 02138,
USA
- Department of Organismic and Evolutionary Biology and Center for
Brain Science, Harvard University, Cambridge, MA, USA
| | - Jack Lindsey
- Zuckerman Mind Brain and Behavior Institute, Columbia
University, New York, NY, 10027, USA
| | - G. Sean Escola
- Zuckerman Mind Brain and Behavior Institute, Columbia
University, New York, NY, 10027, USA
- Department of Psychiatry, Columbia University, New York, NY,
10032, USA
| | - Bence P. Ölveczky
- Department of Organismic and Evolutionary Biology and Center for
Brain Science, Harvard University, Cambridge, MA, USA
| |
Collapse
|
10
|
Heald JB, Wolpert DM, Lengyel M. The Computational and Neural Bases of Context-Dependent Learning. Annu Rev Neurosci 2023; 46:233-258. [PMID: 36972611 PMCID: PMC10348919 DOI: 10.1146/annurev-neuro-092322-100402] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/29/2023]
Abstract
Flexible behavior requires the creation, updating, and expression of memories to depend on context. While the neural underpinnings of each of these processes have been intensively studied, recent advances in computational modeling revealed a key challenge in context-dependent learning that had been largely ignored previously: Under naturalistic conditions, context is typically uncertain, necessitating contextual inference. We review a theoretical approach to formalizing context-dependent learning in the face of contextual uncertainty and the core computations it requires. We show how this approach begins to organize a large body of disparate experimental observations, from multiple levels of brain organization (including circuits, systems, and behavior) and multiple brain regions (most prominently the prefrontal cortex, the hippocampus, and motor cortices), into a coherent framework. We argue that contextual inference may also be key to understanding continual learning in the brain. This theory-driven perspective places contextual inference as a core component of learning.
Collapse
Affiliation(s)
- James B Heald
- Department of Neuroscience and Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY, USA; ,
| | - Daniel M Wolpert
- Department of Neuroscience and Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY, USA; ,
- Computational and Biological Learning Lab, Department of Engineering, University of Cambridge, Cambridge, United Kingdom;
| | - Máté Lengyel
- Computational and Biological Learning Lab, Department of Engineering, University of Cambridge, Cambridge, United Kingdom;
- Center for Cognitive Computation, Department of Cognitive Science, Central European University, Budapest, Hungary
| |
Collapse
|
11
|
Cuevas Rivera D, Kiebel S. The effects of probabilistic context inference on motor adaptation. PLoS One 2023; 18:e0286749. [PMID: 37399219 DOI: 10.1371/journal.pone.0286749] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2022] [Accepted: 05/23/2023] [Indexed: 07/05/2023] Open
Abstract
Humans have been shown to adapt their movements when a sudden or gradual change to the dynamics of the environment are introduced, a phenomenon called motor adaptation. If the change is reverted, the adaptation is also quickly reverted. Humans are also able to adapt to multiple changes in dynamics presented separately, and to be able to switch between adapted movements on the fly. Such switching relies on contextual information which is often noisy or misleading, affecting the switch between known adaptations. Recently, computational models for motor adaptation and context inference have been introduced, which contain components for context inference and Bayesian motor adaptation. These models were used to show the effects of context inference on learning rates across different experiments. We expanded on these works by using a simplified version of the recently-introduced COIN model to show that the effects of context inference on motor adaptation and control go even further than previously shown. Here, we used this model to simulate classical motor adaptation experiments from previous works and showed that context inference, and how it is affected by the presence and reliability of feedback, effect a host of behavioral phenomena that had so far required multiple hypothesized mechanisms, lacking a unified explanation. Concretely, we show that the reliability of direct contextual information, as well as noisy sensory feedback, typical of many experiments, effect measurable changes in switching-task behavior, as well as in action selection, that stem directly from probabilistic context inference.
Collapse
Affiliation(s)
- Dario Cuevas Rivera
- Chair of Cognitive Computational Neuroscience, Faculty of Psychology, Technische Universität Dresden, Dresden, Germany
- Centre for Tactile Internet with Human-in-the-Loop (CeTI), Dresden, Germany
| | - Stefan Kiebel
- Chair of Cognitive Computational Neuroscience, Faculty of Psychology, Technische Universität Dresden, Dresden, Germany
- Centre for Tactile Internet with Human-in-the-Loop (CeTI), Dresden, Germany
| |
Collapse
|
12
|
Heald JB, Lengyel M, Wolpert DM. Contextual inference in learning and memory. Trends Cogn Sci 2023; 27:43-64. [PMID: 36435674 PMCID: PMC9789331 DOI: 10.1016/j.tics.2022.10.004] [Citation(s) in RCA: 10] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2022] [Revised: 10/11/2022] [Accepted: 10/12/2022] [Indexed: 11/25/2022]
Abstract
Context is widely regarded as a major determinant of learning and memory across numerous domains, including classical and instrumental conditioning, episodic memory, economic decision-making, and motor learning. However, studies across these domains remain disconnected due to the lack of a unifying framework formalizing the concept of context and its role in learning. Here, we develop a unified vernacular allowing direct comparisons between different domains of contextual learning. This leads to a Bayesian model positing that context is unobserved and needs to be inferred. Contextual inference then controls the creation, expression, and updating of memories. This theoretical approach reveals two distinct components that underlie adaptation, proper and apparent learning, respectively referring to the creation and updating of memories versus time-varying adjustments in their expression. We review a number of extensions of the basic Bayesian model that allow it to account for increasingly complex forms of contextual learning.
Collapse
Affiliation(s)
- James B Heald
- Department of Neuroscience, Columbia University, New York, NY 10027, USA; Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY 10027, USA.
| | - Máté Lengyel
- Computational and Biological Learning Lab, Department of Engineering, University of Cambridge, Cambridge, UK; Center for Cognitive Computation, Department of Cognitive Science, Central European University, Budapest, Hungary.
| | - Daniel M Wolpert
- Department of Neuroscience, Columbia University, New York, NY 10027, USA; Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY 10027, USA; Computational and Biological Learning Lab, Department of Engineering, University of Cambridge, Cambridge, UK.
| |
Collapse
|
13
|
Loeb GE. Remembrance of things perceived: Adding thalamocortical function to artificial neural networks. Front Integr Neurosci 2023; 17:1108271. [PMID: 36959924 PMCID: PMC10027940 DOI: 10.3389/fnint.2023.1108271] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2022] [Accepted: 02/13/2023] [Indexed: 03/09/2023] Open
Abstract
Recent research has illuminated the complexity and importance of the thalamocortical system but it has been difficult to identify what computational functions it performs. Meanwhile, deep-learning artificial neural networks (ANNs) based on bio-inspired models of purely cortical circuits have achieved surprising success solving sophisticated cognitive problems associated historically with human intelligence. Nevertheless, the limitations and shortcomings of artificial intelligence (AI) based on such ANNs are becoming increasingly clear. This review considers how the addition of thalamocortical connectivity and its putative functions related to cortical attention might address some of those shortcomings. Such bio-inspired models are now providing both testable theories of biological cognition and improved AI technology, much of which is happening outside the usual academic venues.
Collapse
|
14
|
Donegan D, Kanzler CM, Büscher J, Viskaitis P, Bracey EF, Lambercy O, Burdakov D. Hypothalamic Control of Forelimb Motor Adaptation. J Neurosci 2022; 42:6243-6257. [PMID: 35790405 PMCID: PMC9374158 DOI: 10.1523/jneurosci.0705-22.2022] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2022] [Revised: 05/13/2022] [Accepted: 06/12/2022] [Indexed: 11/21/2022] Open
Abstract
The ability to perform skilled arm movements is central to everyday life, as limb impairments in common neurologic disorders such as stroke demonstrate. Skilled arm movements require adaptation of motor commands based on discrepancies between desired and actual movements, called sensory errors. Studies in humans show that this involves predictive and reactive movement adaptations to the errors, and also requires a general motivation to move. How these distinct aspects map onto defined neural signals remains unclear, because of a shortage of equivalent studies in experimental animal models that permit neural-level insights. Therefore, we adapted robotic technology used in human studies to mice, enabling insights into the neural underpinnings of motivational, reactive, and predictive aspects of motor adaptation. Here, we show that forelimb motor adaptation is regulated by neurons previously implicated in motivation and arousal, but not in forelimb motor control: the hypothalamic orexin/hypocretin neurons (HONs). By studying goal-oriented mouse-robot interactions in male mice, we found distinct HON signals occur during forelimb movements and motor adaptation. Temporally-delimited optosilencing of these movement-associated HON signals impaired sensory error-based motor adaptation. Unexpectedly, optosilencing affected neither task reward or execution rates, nor motor performance in tasks that did not require adaptation, indicating that the temporally-defined HON signals studied here were distinct from signals governing general task engagement or sensorimotor control. Collectively, these results reveal a hypothalamic neural substrate regulating forelimb motor adaptation.SIGNIFICANCE STATEMENT The ability to perform skilled, adaptable movements is a fundamental part of daily life, and is impaired in common neurologic diseases such as stroke. Maintaining motor adaptation is thus of great interest, but the necessary brain components remain incompletely identified. We found that impaired motor adaptation results from disruption of cells not previously implicated in this pathology: hypothalamic orexin/hypocretin neurons (HONs). We show that temporally confined HON signals are associated with skilled movements. Without these newly-identified signals, a resistance to movement that is normally rapidly overcome leads to prolonged movement impairment. These results identify natural brain signals that enable rapid and effective motor adaptation.
Collapse
Affiliation(s)
- Dane Donegan
- Neurobehavioral Dynamics Laboratory, Department of Health Sciences and Technology, Eidgenössische Technische Hochschule Zürich, Schwerzenbach 8603, Switzerland
| | - Christoph M Kanzler
- Rehabilitation Engineering Laboratory (RELab), Department of Health Sciences and Technology, Eidgenössische Technische Hochschule Zürich, Zürich 8008, Switzerland
| | - Julia Büscher
- Neurobehavioral Dynamics Laboratory, Department of Health Sciences and Technology, Eidgenössische Technische Hochschule Zürich, Schwerzenbach 8603, Switzerland
| | - Paulius Viskaitis
- Neurobehavioral Dynamics Laboratory, Department of Health Sciences and Technology, Eidgenössische Technische Hochschule Zürich, Schwerzenbach 8603, Switzerland
| | - Ed F Bracey
- Neurobehavioral Dynamics Laboratory, Department of Health Sciences and Technology, Eidgenössische Technische Hochschule Zürich, Schwerzenbach 8603, Switzerland
| | - Olivier Lambercy
- Rehabilitation Engineering Laboratory (RELab), Department of Health Sciences and Technology, Eidgenössische Technische Hochschule Zürich, Zürich 8008, Switzerland
| | - Denis Burdakov
- Neurobehavioral Dynamics Laboratory, Department of Health Sciences and Technology, Eidgenössische Technische Hochschule Zürich, Schwerzenbach 8603, Switzerland
| |
Collapse
|
15
|
Chen L, Zhang L, Wang Z, Gu B, Zhang X, Ming D. The Effects of Sensory Threshold Somatosensory Electrical Stimulation on Users With Different MI-BCI Performance. Front Neurosci 2022; 16:909434. [PMID: 35784856 PMCID: PMC9247255 DOI: 10.3389/fnins.2022.909434] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2022] [Accepted: 05/23/2022] [Indexed: 11/13/2022] Open
Abstract
Motor imagery-based brain-computer interface (MI-BCI) has been largely studied to improve motor learning and promote motor recovery. However, the difficulty in performing MI limits the widespread application of MI-BCI. It has been suggested that the usage of sensory threshold somatosensory electrical stimulation (st-SES) is a promising way to guide participants on MI tasks, but it is still unclear whether st-SES is effective for all users. In the present study, we aimed to examine the effects of st-SES on the MI-BCI performance in two BCI groups (High Performers and Low Performers). Twenty healthy participants were recruited to perform MI and resting tasks with EEG recordings. These tasks were modulated with or without st-SES. We demonstrated that st-SES improved the performance of MI-BCI in the Low Performers, but led to a decrease in the accuracy of MI-BCI in the High Performers. Furthermore, for the Low Performers, the combination of st-SES and MI resulted in significantly greater event-related desynchronization (ERD) and sample entropy of sensorimotor rhythm than MI alone. However, the ERD and sample entropy values of MI did not change significantly during the st-SES intervention in the High Performers. Moreover, we found that st-SES had an effect on the functional connectivity of the fronto-parietal network in the alpha band of Low Performers and the beta band of High Performers, respectively. Our results demonstrated that somatosensory input based on st-SES was only beneficial for sensorimotor cortical activation and MI-BCI performance in the Low Performers, but not in the High Performers. These findings help to optimize guidance strategies to adapt to different categories of users in the practical application of MI-BCI.
Collapse
Affiliation(s)
- Long Chen
- Department of Biomedical Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Lei Zhang
- Department of Biomedical Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Zhongpeng Wang
- Department of Biomedical Engineering, College of Precision Instruments & Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Bin Gu
- Department of Biomedical Engineering, College of Precision Instruments & Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Xin Zhang
- Department of Biomedical Engineering, College of Precision Instruments & Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Dong Ming
- Department of Biomedical Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- Department of Biomedical Engineering, College of Precision Instruments & Optoelectronics Engineering, Tianjin University, Tianjin, China
| |
Collapse
|
16
|
The decay and consolidation of effector-independent motor memories. Sci Rep 2022; 12:3131. [PMID: 35210478 PMCID: PMC8873205 DOI: 10.1038/s41598-022-07032-7] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2021] [Accepted: 02/01/2022] [Indexed: 11/08/2022] Open
Abstract
Learning a motor adaptation task produces intrinsically unstable or transient motor memories. Despite the presence of effector-independent motor memories following the learning of novel environmental dynamics, it remains largely unknown how those memory traces decay in different contexts and whether an "offline" consolidation period protects memories against decay. Here, we exploit inter-effector transfer to address these questions. We found that newly acquired motor memories formed with one effector could be partially retrieved by the untrained effector to enhance its performance when the decay occurred with the passage of time or "washout" trials on which error feedback was provided. The decay of motor memories was slower following "error-free" trials, on which errors were artificially clamped to zero or removed, compared with "washout" trials. However, effector-independent memory components were abolished following movements made in the absence of task errors, resulting in no transfer gains. The brain can stabilize motor memories during daytime wakefulness. We found that 6 h of wakeful resting increased the resistance of effector-independent memories to decay. Collectively, our results suggest that the decay of effector-independent motor memories is context-dependent, and offline processing preserves those memories against decay, leading to improvements of the subsequent inter-effector transfer.
Collapse
|
17
|
Moore RT, Cluff T. Individual Differences in Sensorimotor Adaptation Are Conserved Over Time and Across Force-Field Tasks. Front Hum Neurosci 2021; 15:692181. [PMID: 34916916 PMCID: PMC8669441 DOI: 10.3389/fnhum.2021.692181] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2021] [Accepted: 11/02/2021] [Indexed: 11/23/2022] Open
Abstract
Sensorimotor adaptation enables the nervous system to modify actions for different conditions and environments. Many studies have investigated factors that influence adaptation at the group level. There is growing recognition that individuals vary in their ability to adapt motor skills and that a better understanding of individual differences in adaptation may inform how motor skills are taught and rehabilitated. Here we examined individual differences in the adaptation of upper-limb reaching movements. We quantified the extent to which participants adapted their movements to a velocity-dependent force field during an initial session, at 24 h, and again 1-week later. Participants (n = 28) displayed savings, which was expressed as greater initial adaptation when re-exposed to the force field. Individual differences in adaptation across various stages of the experiment displayed weak-strong reliability, such that individuals who adapted to a greater extent in the initial session tended to do so when re-exposed to the force field. Our second experiment investigated if individual differences in adaptation are also present when participants adapt to different force fields or a force field and visuomotor rotation. Separate groups of participants adapted to position- and velocity-dependent force fields (Experiment 2a; n = 20) or a velocity-dependent force field and visuomotor rotation in a single session (Experiment 2b; n = 20). Participants who adapted to a greater extent to velocity-dependent forces tended to show a greater extent of adaptation when exposed to position-dependent forces. In contrast, correlations were weak between various stages of adaptation to the force-field and visuomotor rotation. Collectively, our study reveals individual differences in adaptation that are reliable across repeated exposure to the same force field and present when adapting to different force fields.
Collapse
Affiliation(s)
- Robert T Moore
- Cumming School of Medicine, University of Calgary, Calgary, AB, Canada.,Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada
| | - Tyler Cluff
- Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada.,Faculty of Kinesiology, University of Calgary, Calgary, AB, Canada
| |
Collapse
|
18
|
Contextual inference underlies the learning of sensorimotor repertoires. Nature 2021; 600:489-493. [PMID: 34819674 DOI: 10.1038/s41586-021-04129-3] [Citation(s) in RCA: 59] [Impact Index Per Article: 19.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2020] [Accepted: 10/13/2021] [Indexed: 11/09/2022]
Abstract
ASBTRACT Humans spend a lifetime learning, storing and refining a repertoire of motor memories. For example, through experience, we become proficient at manipulating a large range of objects with distinct dynamical properties. However, it is unknown what principle underlies how our continuous stream of sensorimotor experience is segmented into separate memories and how we adapt and use this growing repertoire. Here we develop a theory of motor learning based on the key principle that memory creation, updating and expression are all controlled by a single computation-contextual inference. Our theory reveals that adaptation can arise both by creating and updating memories (proper learning) and by changing how existing memories are differentially expressed (apparent learning). This insight enables us to account for key features of motor learning that had no unified explanation: spontaneous recovery1, savings2, anterograde interference3, how environmental consistency affects learning rate4,5 and the distinction between explicit and implicit learning6. Critically, our theory also predicts new phenomena-evoked recovery and context-dependent single-trial learning-which we confirm experimentally. These results suggest that contextual inference, rather than classical single-context mechanisms1,4,7-9, is the key principle underlying how a diverse set of experiences is reflected in our motor behaviour.
Collapse
|
19
|
Forano M, Schween R, Taylor JA, Hegele M, Franklin DW. Direct and indirect cues can enable dual adaptation, but through different learning processes. J Neurophysiol 2021; 126:1490-1506. [PMID: 34550024 DOI: 10.1152/jn.00166.2021] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Switching between motor tasks requires accurate adjustments for changes in dynamics (grasping a cup) or sensorimotor transformations (moving a computer mouse). Dual-adaptation studies have investigated how learning of context-dependent dynamics or transformations is enabled by sensory cues. However, certain cues, such as color, have shown mixed results. We propose that these mixed results may arise from two major classes of cues: "direct" cues, which are part of the dynamic state and "indirect" cues, which are not. We hypothesized that explicit strategies would primarily account for the adaptation of an indirect color cue but would be limited to simple tasks, whereas a direct visual separation cue would allow implicit adaptation regardless of task complexity. To test this idea, we investigated the relative contribution of implicit and explicit learning in relation to contextual cue type (colored or visually shifted workspace) and task complexity (1 or 8 targets) in a dual-adaptation task. We found that the visual workspace location cue enabled adaptation across conditions primarily through implicit adaptation. In contrast, we found that the color cue was largely ineffective for dual adaptation, except in a small subset of participants who appeared to use explicit strategies. Our study suggests that the previously inconclusive role of color cues in dual adaptation may be explained by differential contribution of explicit strategies across conditions.NEW & NOTEWORTHY We present evidence that learning of context-dependent dynamics proceeds via different processes depending on the type of sensory cue used to signal the context. Visual workspace location enabled learning different dynamics implicitly, presumably because it directly enters the dynamic state estimate. In contrast, a color cue was only successful where learners were apparently able to leverage explicit strategies to account for changed dynamics. This suggests a unification for the previously inconclusive role of color cues.
Collapse
Affiliation(s)
- Marion Forano
- Department of Sport and Health Sciences, Technical University of Munich, Munich, Germany
| | - Raphael Schween
- Department of Psychology and Sport Science, Justus Liebig University, Giessen, Germany.,Department of Psychology, Philipps-University, Marburg, Germany
| | - Jordan A Taylor
- Department of Psychology, Princeton University, Princeton, New Jersey
| | - Mathias Hegele
- Department of Psychology and Sport Science, Justus Liebig University, Giessen, Germany.,Center for Mind, Brain and Behavior, Universities of Marburg and Giessen, Marburg and Giessen, Germany
| | - David W Franklin
- Department of Sport and Health Sciences, Technical University of Munich, Munich, Germany.,Munich Institute of Robotics and Machine Intelligence, Technical University of Munich, Munich, Germany.,Munich Data Science Institute, Technical University of Munich, Munich, Germany
| |
Collapse
|
20
|
Wang L, Zobeiri OA, Millar JL, Souza Silva W, Schubert MC, Cullen KE. Continuous Head Motion is a Greater Motor Control Challenge than Transient Head Motion in Patients with Loss of Vestibular Function. Neurorehabil Neural Repair 2021; 35:890-902. [PMID: 34365845 DOI: 10.1177/15459683211034758] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Background. The vestibular system is vital for gaze stability via the vestibulo-ocular reflex, which generates compensatory eye motion in the direction opposite to head motion. Consequently, individuals with peripheral vestibular loss demonstrate impaired gaze stability that reduces functional capacity and quality of life. To facilitate patients' compensatory strategies, two classes of gaze stabilization exercises are often prescribed: (i) transient (eg, ballistic) and (ii) continuous. However, the relative benefits of these two classes of exercises are not well understood. Objective. To quantify head motion kinematics in patients with vestibular loss while they performed both classes of exercises. Methods. Using inertial measurement units, head movements of 18 vestibular schwannoma patients were measured before and after surgical deafferentation and compared with age-matched controls. Results. We found that the head movement during both classes of exercises paralleled those of natural head movement recorded during daily activities. However, head movement patterns were more informative for continuous than transient exercises in distinguishing patients from healthy controls. Specifically, we observed coupling between kinematic measures in control subjects that was absent in patients for continuous but not transient head motion exercises. In addition, kinematic measures (eg, cycle duration) were predictive of standard clinical measures for continuous but not transient head motion exercises. Conclusions. Our data suggest that performing continuous head motion is a greater motor control challenge than transient head motion in patients with less reliable vestibular feedback during the sub-acute stage of recovery, which may also prove to be a reliable measure of progression in vestibular rehabilitation protocols.
Collapse
Affiliation(s)
- Lin Wang
- Department of Biomedical Engineering, 1466Johns Hopkins University, Baltimore, MD, USA
| | - Omid A Zobeiri
- Department of Biomedical Engineering, McGill University, Montreal, QC, Canada
| | - Jennifer L Millar
- Department of Physical Medicine and Rehabilitation, Johns Hopkins University1466School of Medicine, Baltimore, MD, USA
| | - Wagner Souza Silva
- Department of Biomedical Engineering, 1466Johns Hopkins University, Baltimore, MD, USA.,Department of Physical Medicine and Rehabilitation, Johns Hopkins University1466School of Medicine, Baltimore, MD, USA
| | - Michael C Schubert
- Department of Physical Medicine and Rehabilitation, Johns Hopkins University1466School of Medicine, Baltimore, MD, USA.,Department of Otolaryngology-Head and Neck Surgery, 1466Johns Hopkins University1466School of Medicine, Baltimore, USA
| | - Kathleen E Cullen
- Department of Biomedical Engineering, 1466Johns Hopkins University, Baltimore, MD, USA.,Department of Otolaryngology-Head and Neck Surgery, 1466Johns Hopkins University1466School of Medicine, Baltimore, USA.,Department of Neuroscience, Johns Hopkins University1466School of Medicine, Baltimore, USA.,Kavli Neuroscience Discovery Institute, 1466Johns Hopkins University, Baltimore, MD, USA
| |
Collapse
|
21
|
Tanamachi K, Izawa J, Yamamoto S, Ishii D, Yozu A, Kohno Y. Experience of After-Effect of Memory Update Reduces Sensitivity to Errors During Sensory-Motor Adaptation Task. Front Hum Neurosci 2021; 15:602405. [PMID: 33790749 PMCID: PMC8005521 DOI: 10.3389/fnhum.2021.602405] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2020] [Accepted: 02/12/2021] [Indexed: 11/13/2022] Open
Abstract
Motor learning is the process of updating motor commands in response to a trajectory error induced by a perturbation to the body or vision. The brain has a great capability to accelerate learning by increasing the sensitivity of the memory update to the perceived trajectory errors. Conventional theory suggests that the statistics of perturbations or the statistics of the experienced errors induced by the external perturbations determine the learning speeds. However, the potential effect of another type of error perception, a self-generated error as a result of motor command updates (i.e., an aftereffect), on the learning speeds has not been examined yet. In this study, we dissociated the two kinds of errors by controlling the perception of the aftereffect using a channel-force environment. One group experienced errors due to the aftereffect of the learning process, while the other did not. We found that the participants who perceived the aftereffect of the memory updates exhibited a significant decrease in error-sensitivity, whereas the participants who did not perceive the aftereffect did not show an increase or decrease in error-sensitivity. This suggests that the perception of the aftereffect of learning attenuated updating the motor commands from the perceived errors. Thus, both self-generated and externally induced errors may modulate learning speeds.
Collapse
Affiliation(s)
- Kenya Tanamachi
- Graduate School of Health Sciences, Ibaraki Prefectural University of Health Sciences, Ibaraki, Japan
| | - Jun Izawa
- Faculty of Engineering, Information and Systems, University of Tsukuba, Ibaraki, Japan
| | - Satoshi Yamamoto
- Department of Physical Therapy, Ibaraki Prefectural University of Health Sciences, Ibaraki, Japan
| | - Daisuke Ishii
- Center of Medical Science, Ibaraki Prefectural University of Health Sciences, Ibaraki, Japan.,Department of Cognitive Behavioral Physiology, Chiba University Graduate School of Medicine, Chiba, Japan
| | - Arito Yozu
- Center of Medical Science, Ibaraki Prefectural University of Health Sciences, Ibaraki, Japan.,Department of Precision Engineering, The University of Tokyo, Tokyo, Japan
| | - Yutaka Kohno
- Center of Medical Science, Ibaraki Prefectural University of Health Sciences, Ibaraki, Japan
| |
Collapse
|
22
|
Avraham G, Morehead JR, Kim HE, Ivry RB. Reexposure to a sensorimotor perturbation produces opposite effects on explicit and implicit learning processes. PLoS Biol 2021; 19:e3001147. [PMID: 33667219 PMCID: PMC7968744 DOI: 10.1371/journal.pbio.3001147] [Citation(s) in RCA: 36] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2020] [Revised: 03/17/2021] [Accepted: 02/15/2021] [Indexed: 12/31/2022] Open
Abstract
The motor system demonstrates an exquisite ability to adapt to changes in the environment and to quickly reset when these changes prove transient. If similar environmental changes are encountered in the future, learning may be faster, a phenomenon known as savings. In studies of sensorimotor learning, a central component of savings is attributed to the explicit recall of the task structure and appropriate compensatory strategies. Whether implicit adaptation also contributes to savings remains subject to debate. We tackled this question by measuring, in parallel, explicit and implicit adaptive responses in a visuomotor rotation task, employing a protocol that typically elicits savings. While the initial rate of learning was faster in the second exposure to the perturbation, an analysis decomposing the 2 processes showed the benefit to be solely associated with explicit re-aiming. Surprisingly, we found a significant decrease after relearning in aftereffect magnitudes during no-feedback trials, a direct measure of implicit adaptation. In a second experiment, we isolated implicit adaptation using clamped visual feedback, a method known to eliminate the contribution of explicit learning processes. Consistent with the results of the first experiment, participants exhibited a marked reduction in the adaptation function, as well as an attenuated aftereffect when relearning from the clamped feedback. Motivated by these results, we reanalyzed data from prior studies and observed a consistent, yet unappreciated pattern of attenuation of implicit adaptation during relearning. These results indicate that explicit and implicit sensorimotor processes exhibit opposite effects upon relearning: Explicit learning shows savings, while implicit adaptation becomes attenuated.
Collapse
Affiliation(s)
- Guy Avraham
- Department of Psychology, University of California, Berkeley, Berkeley, California, United States of America
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, California, United States of America
| | - J. Ryan Morehead
- School of Psychology, University of Leeds, Leeds, United Kingdom
- John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, Massachusetts, United States of America
| | - Hyosub E. Kim
- Department of Physical Therapy, University of Delaware, Newark, Delaware, United States of America
- Department of Psychological and Brain Sciences, University of Delaware, Newark, Delaware, United States of America
| | - Richard B. Ivry
- Department of Psychology, University of California, Berkeley, Berkeley, California, United States of America
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, California, United States of America
| |
Collapse
|
23
|
Rocha K, Marinho V, Magalhães F, Carvalho V, Fernandes T, Ayres M, Crespo E, Velasques B, Ribeiro P, Cagy M, Bastos VH, Gupta DS, Teixeira S. Unskilled shooters improve both accuracy and grouping shot having as reference skilled shooters cortical area: An EEG and tDCS study. Physiol Behav 2020; 224:113036. [PMID: 32598941 DOI: 10.1016/j.physbeh.2020.113036] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2020] [Revised: 06/24/2020] [Accepted: 06/25/2020] [Indexed: 12/18/2022]
Abstract
Transcranial direct current stimulation (tDCS) has been used as a non-invasive method for enhanced motor and cognitive abilities. However, no previous study has investigated if the tDCS application in unskilled shooters on cortical sites, selected based on the cortical activity of skilled shooters, improves the accuracy and shot grouping. Sixty participants were selected, which included 10 skilled shooters and 50 unskilled shooters. After we identified the right dorsolateral prefrontal cortex (DLPFC) as the area with the highest activity in skilled shooters, we applied anodal tDCS over the right DLPFC in the unskilled shooters under two conditions: sham-tDCS (placebo) and real-tDCS (anodal tDCS). We also analyzed electroencephalography. Our results indicated that anodal tDCS application enhanced the shot accuracy (p = 0.001). Furthermore, the beta power in the EEG recording was higher in the left DLPFC, left and right parietal cortex (p = 0,001) after applying anodal tDCS, while the low-gamma power was higher in the right DLPFC in sham-tDCS (p = 0.001) and right parietal cortex after anodal-tDCS (p = 0.001). Our findings indicate that anodal tDCS can improve accuracy and shot grouping when applied over the unskilled shooters' right DLPFC. Furthermore, beta and low-gamma bands are influenced by anodal tDCS over the right DLPFC, which may be predictive of skill improvement.
Collapse
Affiliation(s)
- Kaline Rocha
- Neuro-innovation Technology & Brain Mapping Laboratory, Federal University of Delta of Parnaíba, Parnaíba, Brazil; The Northeast Biotechnology Network, Federal University of Piauí, Teresina, Brazil.
| | - Victor Marinho
- Neuro-innovation Technology & Brain Mapping Laboratory, Federal University of Delta of Parnaíba, Parnaíba, Brazil; The Northeast Biotechnology Network, Federal University of Piauí, Teresina, Brazil
| | - Francisco Magalhães
- Neuro-innovation Technology & Brain Mapping Laboratory, Federal University of Delta of Parnaíba, Parnaíba, Brazil; The Northeast Biotechnology Network, Federal University of Piauí, Teresina, Brazil
| | - Valécia Carvalho
- Neuro-innovation Technology & Brain Mapping Laboratory, Federal University of Delta of Parnaíba, Parnaíba, Brazil; The Northeast Biotechnology Network, Federal University of Piauí, Teresina, Brazil
| | - Thayaná Fernandes
- Neuro-innovation Technology & Brain Mapping Laboratory, Federal University of Delta of Parnaíba, Parnaíba, Brazil
| | - Marcos Ayres
- Neuro-innovation Technology & Brain Mapping Laboratory, Federal University of Delta of Parnaíba, Parnaíba, Brazil; The Northeast Biotechnology Network, Federal University of Piauí, Teresina, Brazil
| | - Eric Crespo
- Neuro-innovation Technology & Brain Mapping Laboratory, Federal University of Delta of Parnaíba, Parnaíba, Brazil
| | - Bruna Velasques
- Brain Mapping and Sensory Motor Integration Laboratory, Institute of Psychiatry of Federal University of Rio de Janeiro, Rio de Janeiro, Brazil
| | - Pedro Ribeiro
- Brain Mapping and Sensory Motor Integration Laboratory, Institute of Psychiatry of Federal University of Rio de Janeiro, Rio de Janeiro, Brazil
| | - Mauricio Cagy
- Biomedical Engineering Program, Federal University of Rio de Janeiro, Rio de Janeiro, Brazil
| | - Victor Hugo Bastos
- The Northeast Biotechnology Network, Federal University of Piauí, Teresina, Brazil; Brain Mapping and Functionality Laboratory, Federal University of Delta do Parnaíba, Parnaíba, Brazil
| | - Daya S Gupta
- Department of Biology, Camden County College, Blackwood, NJ, United States
| | - Silmar Teixeira
- Neuro-innovation Technology & Brain Mapping Laboratory, Federal University of Delta of Parnaíba, Parnaíba, Brazil; The Northeast Biotechnology Network, Federal University of Piauí, Teresina, Brazil
| |
Collapse
|
24
|
Wang C, Winstein C, D'Argenio DZ, Schweighofer N. The Efficiency, Efficacy, and Retention of Task Practice in Chronic Stroke. Neurorehabil Neural Repair 2020; 34:881-890. [PMID: 32830617 DOI: 10.1177/1545968320948609] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
In motor skill learning, larger doses of practice lead to greater efficacy of practice, lower efficiency of practice, and better long-term retention. Whether such learning principles apply to motor practice after stroke is unclear. Here, we developed novel mixed-effects models of the change in the perceived quality of arm movements during and following task practice. The models were fitted to data from a recent randomized controlled trial of the effect of dose of task practice in chronic stroke. Analysis of the models' learning and retention rates demonstrated an increase in efficacy of practice with greater doses, a decrease in efficiency of practice with both additional dosages and additional bouts of training, and fast initial decay following practice. Two additional effects modulated retention: a positive "self-practice" effect, and a negative effect of dose. Our results further suggest that for patients with sufficient arm use post-practice, self-practice will further improve use.
Collapse
Affiliation(s)
- Chunji Wang
- Neuroscience Graduate Program, University of Southern California, Los Angeles, CA, USA
| | - Carolee Winstein
- Biokinesiology and Physical Therapy, University of Southern California, Los Angeles, CA, USA
| | - David Z D'Argenio
- Biomedical Engineering, University of Southern California, Los Angeles, CA, USA
| | - Nicolas Schweighofer
- Biokinesiology and Physical Therapy, University of Southern California, Los Angeles, CA, USA
| |
Collapse
|