1
|
Tsay JS, Kim HE, McDougle SD, Taylor JA, Haith A, Avraham G, Krakauer JW, Collins AGE, Ivry RB. Fundamental processes in sensorimotor learning: Reasoning, refinement, and retrieval. eLife 2024; 13:e91839. [PMID: 39087986 PMCID: PMC11293869 DOI: 10.7554/elife.91839] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2023] [Accepted: 07/22/2024] [Indexed: 08/02/2024] Open
Abstract
Motor learning is often viewed as a unitary process that operates outside of conscious awareness. This perspective has led to the development of sophisticated models designed to elucidate the mechanisms of implicit sensorimotor learning. In this review, we argue for a broader perspective, emphasizing the contribution of explicit strategies to sensorimotor learning tasks. Furthermore, we propose a theoretical framework for motor learning that consists of three fundamental processes: reasoning, the process of understanding action-outcome relationships; refinement, the process of optimizing sensorimotor and cognitive parameters to achieve motor goals; and retrieval, the process of inferring the context and recalling a control policy. We anticipate that this '3R' framework for understanding how complex movements are learned will open exciting avenues for future research at the intersection between cognition and action.
Collapse
Affiliation(s)
- Jonathan S Tsay
- Department of Psychology, Carnegie Mellon UniversityPittsburghUnited States
- Neuroscience Institute, Carnegie Mellon UniversityPittsburgUnited States
| | - Hyosub E Kim
- School of Kinesiology, University of British ColumbiaVancouverCanada
| | | | - Jordan A Taylor
- Department of Psychology, Princeton UniversityPrincetonUnited States
| | - Adrian Haith
- Department of Neurology, Johns Hopkins UniversityBaltimoreUnited States
| | - Guy Avraham
- Department of Psychology, University of California BerkeleyBerkeleyUnited States
- Helen Wills Neuroscience Institute, University of California BerkeleyBerkeleyUnited States
| | - John W Krakauer
- Department of Neurology, Johns Hopkins UniversityBaltimoreUnited States
- Department of Neuroscience, Johns Hopkins UniversityBaltimoreUnited States
- Santa Fe InstituteSanta FeUnited States
| | - Anne GE Collins
- Department of Psychology, University of California BerkeleyBerkeleyUnited States
- Helen Wills Neuroscience Institute, University of California BerkeleyBerkeleyUnited States
| | - Richard B Ivry
- Department of Psychology, University of California BerkeleyBerkeleyUnited States
- Helen Wills Neuroscience Institute, University of California BerkeleyBerkeleyUnited States
| |
Collapse
|
2
|
Diao H, Ma J, Jia Y, Jia H, Wei K. Abnormalities in motor adaptation to different types of perturbations in schizophreniaperturbations in schizophrenia. Schizophr Res 2024; 267:291-300. [PMID: 38599141 DOI: 10.1016/j.schres.2024.03.051] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/04/2023] [Revised: 03/20/2024] [Accepted: 03/31/2024] [Indexed: 04/12/2024]
Abstract
Schizophrenia is a mental health disorder that often includes psychomotor disturbances, impacting how individuals adjust their motor output based on the cause of motor errors. While previous motor adaptation studies on individuals with schizophrenia have largely focused on large and consistent perturbations induced by abrupt experimental manipulations, such as donning prism goggles, the adaptation process to random perturbations, either caused by intrinsic motor noise or external disturbances, has not been examined - despite its ecological relevance. Here, we used a unified behavioral task paradigm to examine motor adaptation to perturbations of three causal structures among individuals in the remission stage of schizophrenia, youth with ultra-high risk of psychosis, adults with active symptoms, and age-matched controls. Results showed that individuals with schizophrenia had reduced trial-by-trial adaptation and large error variance when adapting to their own motor noise. When adapting to random but salient perturbations, they showed intact adaptation and normal causal inference of errors. This contrasted with reduced adaptation to large yet consistent perturbations, which could reflect difficulties in forming cognitive strategies rather than the often-assumed impairments in procedural learning or sense of agency. Furthermore, the observed adaptation effects were correlated with the severity of positive symptoms across the diagnosis groups. Our findings suggest that individuals with schizophrenia face challenges in accommodating intrinsic perturbations when motor errors are ambiguous but adapt with intact causal attribution when errors are salient.
Collapse
Affiliation(s)
- Henan Diao
- Beijing Key Laboratory of Behavior and Mental Health, School of Psychological and Cognitive Sciences, Peking University, Beijing 100080, China; Key Laboratory of Machine Perception (Ministry of Education), Peking University, Beijing 10080, China
| | - Jiajun Ma
- Beijing Key Laboratory of Behavior and Mental Health, School of Psychological and Cognitive Sciences, Peking University, Beijing 100080, China; Key Laboratory of Machine Perception (Ministry of Education), Peking University, Beijing 10080, China
| | - Yuan Jia
- The National Clinical Research Center for Mental Disorders, Beijing Key Laboratory of Mental Disorders, Beijing Anding Hospital, Capital Medical University, Beijing 100088, China; Advanced Innovation Center for Human Brain Protection, Capital Medical University, Beijing 100088, China
| | - Hongxiao Jia
- The National Clinical Research Center for Mental Disorders, Beijing Key Laboratory of Mental Disorders, Beijing Anding Hospital, Capital Medical University, Beijing 100088, China; Advanced Innovation Center for Human Brain Protection, Capital Medical University, Beijing 100088, China.
| | - Kunlin Wei
- Beijing Key Laboratory of Behavior and Mental Health, School of Psychological and Cognitive Sciences, Peking University, Beijing 100080, China; Key Laboratory of Machine Perception (Ministry of Education), Peking University, Beijing 10080, China.
| |
Collapse
|
3
|
Gastrock RQ, 't Hart BM, Henriques DYP. Distinct learning, retention, and generalization patterns in de novo learning versus motor adaptation. Sci Rep 2024; 14:8906. [PMID: 38632252 PMCID: PMC11024091 DOI: 10.1038/s41598-024-59445-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2023] [Accepted: 04/10/2024] [Indexed: 04/19/2024] Open
Abstract
People correct for movement errors when acquiring new motor skills (de novo learning) or adapting well-known movements (motor adaptation). While de novo learning establishes new control policies, adaptation modifies existing ones, and previous work have distinguished behavioral and underlying brain mechanisms for each motor learning type. However, it is still unclear whether learning in each type interferes with the other. In study 1, we use a within-subjects design where participants train with both 30° visuomotor rotation and mirror reversal perturbations, to compare adaptation and de novo learning respectively. We find no perturbation order effects, and find no evidence for differences in learning rates and asymptotes for both perturbations. Explicit instructions also provide an advantage during early learning in both perturbations. However, mirror reversal learning shows larger inter-participant variability and slower movement initiation. Furthermore, we only observe reach aftereffects following rotation training. In study 2, we incorporate the mirror reversal in a browser-based task, to investigate under-studied de novo learning mechanisms like retention and generalization. Learning persists across three or more days, substantially transfers to the untrained hand, and to targets on both sides of the mirror axis. Our results extend insights for distinguishing motor skill acquisition from adapting well-known movements.
Collapse
Affiliation(s)
- Raphael Q Gastrock
- Centre for Vision Research, York University, Toronto, ON, M3J 1P3, Canada.
- Department of Psychology, York University, Toronto, ON, M3J 1P3, Canada.
| | | | - Denise Y P Henriques
- Centre for Vision Research, York University, Toronto, ON, M3J 1P3, Canada
- Department of Psychology, York University, Toronto, ON, M3J 1P3, Canada
- School of Kinesiology and Health Science, York University, Toronto, ON, M3J 1P3, Canada
| |
Collapse
|
4
|
Bansal A, 't Hart BM, Cauchan U, Eggert T, Straube A, Henriques DYP. Motor adaptation does not differ when a perturbation is introduced abruptly or gradually. Exp Brain Res 2023; 241:2577-2590. [PMID: 37690051 DOI: 10.1007/s00221-023-06699-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Accepted: 08/30/2023] [Indexed: 09/12/2023]
Abstract
People continuously adapt their movements to ever-changing circumstances, and particularly in skills training and rehabilitation, it is crucial that we understand how to optimize implicit adaptation in order for these processes to require as little conscious effort as possible. Although it is generally assumed that the way to do this is by introducing perturbations gradually, the literature is ambivalent on the effectiveness of this approach. Here, we tested whether there are differences in motor performance when adapting to an abrupt compared to a ramped visuomotor rotation. Using a within-subjects design, we tested this question under 3 different rotation sizes: 30-degrees, 45-degrees, and 60-degrees, as well as in 3 different populations: younger adults, older adults, and patients with mild cerebellar ataxia. We find no significant differences in either the behavioural outcomes, or model fits, between abrupt and gradual learning across any of the different conditions. Neither age, nor cerebellar ataxia had any significant effect on error-sensitivity either. These findings together indicate that error-sensitivity is not modulated by introducing a perturbation abruptly compared to gradually, and is also unaffected by age or mild cerebellar ataxia.
Collapse
Affiliation(s)
- Ambika Bansal
- Centre for Vision Research, York University, Toronto, 4700 Keele Street, Toronto, ON, M3J 1P3, Canada
- School of Kinesiology and Health Science, Centre for Vision Research, York University, 4700 Keele Street, Toronto, ON, M3J 1P3, Canada
| | - Bernard Marius 't Hart
- Centre for Vision Research, York University, Toronto, 4700 Keele Street, Toronto, ON, M3J 1P3, Canada.
| | - Udai Cauchan
- Centre for Vision Research, York University, Toronto, 4700 Keele Street, Toronto, ON, M3J 1P3, Canada
| | - Thomas Eggert
- Department of Neurology, LMU University Hospital, LMU Munich, Fraunhoferstr. 20, 82152, Planegg, Martinsried, Germany
| | - Andreas Straube
- Department of Neurology, LMU University Hospital LMU, Munich, Marchioninistr. 15, 81377, Munich, Germany
| | - Denise Y P Henriques
- Centre for Vision Research, York University, Toronto, 4700 Keele Street, Toronto, ON, M3J 1P3, Canada
- School of Kinesiology and Health Science, Centre for Vision Research, York University, 4700 Keele Street, Toronto, ON, M3J 1P3, Canada
| |
Collapse
|
5
|
Warburton M, Campagnoli C, Mon-Williams M, Mushtaq F, Morehead JR. Kinematic markers of skill in first-person shooter video games. PNAS NEXUS 2023; 2:pgad249. [PMID: 37564360 PMCID: PMC10411933 DOI: 10.1093/pnasnexus/pgad249] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Accepted: 07/24/2023] [Indexed: 08/12/2023]
Abstract
Video games present a unique opportunity to study motor skill. First-person shooter (FPS) games have particular utility because they require visually guided hand movements that are similar to widely studied planar reaching tasks. However, there is a need to ensure the tasks are equivalent if FPS games are to yield their potential as a powerful scientific tool for investigating sensorimotor control. Specifically, research is needed to ensure that differences in visual feedback of a movement do not affect motor learning between the two contexts. In traditional tasks, a movement will translate a cursor across a static background, whereas FPS games use movements to pan and tilt the view of the environment. To this end, we designed an online experiment where participants used their mouse or trackpad to shoot targets in both visual contexts. Kinematic analysis showed player movements were nearly identical between contexts, with highly correlated spatial and temporal metrics. This similarity suggests a shared internal model based on comparing predicted and observed displacement vectors rather than primary sensory feedback. A second experiment, modeled on FPS-style aim-trainer games, found movements exhibited classic invariant features described within the sensorimotor literature. We found the spatial metrics tested were significant predictors of overall task performance. More broadly, these results show that FPS games offer a novel, engaging, and compelling environment to study sensorimotor skill, providing the same precise kinematic metrics as traditional planar reaching tasks.
Collapse
Affiliation(s)
- Matthew Warburton
- School of Psychology, University of Leeds, Leeds, West Yorkshire, LS2 9JT, UK
| | - Carlo Campagnoli
- School of Psychology, University of Leeds, Leeds, West Yorkshire, LS2 9JT, UK
| | - Mark Mon-Williams
- School of Psychology, University of Leeds, Leeds, West Yorkshire, LS2 9JT, UK
- Bradford Institute for Health Research, Bradford Hospitals National Health Service Trust, Bradford, BD9 6RJ, UK
- National Centre for Optics, Vision and Eye Care, University of South-Eastern Norway, Kongsberg 3616, Viken, Norway
| | - Faisal Mushtaq
- School of Psychology, University of Leeds, Leeds, West Yorkshire, LS2 9JT, UK
- Centre for Immersive Technologies, University of Leeds, Leeds, West Yorkshire, LS2 9JT, UK
| | - J Ryan Morehead
- School of Psychology, University of Leeds, Leeds, West Yorkshire, LS2 9JT, UK
- Centre for Immersive Technologies, University of Leeds, Leeds, West Yorkshire, LS2 9JT, UK
| |
Collapse
|
6
|
Sugiyama T, Schweighofer N, Izawa J. Reinforcement learning establishes a minimal metacognitive process to monitor and control motor learning performance. Nat Commun 2023; 14:3988. [PMID: 37422476 PMCID: PMC10329706 DOI: 10.1038/s41467-023-39536-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2022] [Accepted: 06/16/2023] [Indexed: 07/10/2023] Open
Abstract
Humans and animals develop learning-to-learn strategies throughout their lives to accelerate learning. One theory suggests that this is achieved by a metacognitive process of controlling and monitoring learning. Although such learning-to-learn is also observed in motor learning, the metacognitive aspect of learning regulation has not been considered in classical theories of motor learning. Here, we formulated a minimal mechanism of this process as reinforcement learning of motor learning properties, which regulates a policy for memory update in response to sensory prediction error while monitoring its performance. This theory was confirmed in human motor learning experiments, in which the subjective sense of learning-outcome association determined the direction of up- and down-regulation of both learning speed and memory retention. Thus, it provides a simple, unifying account for variations in learning speeds, where the reinforcement learning mechanism monitors and controls the motor learning process.
Collapse
Affiliation(s)
- Taisei Sugiyama
- Empowerment Informatics, University of Tsukuba, Tsukuba, Ibaraki, 305-8573, Japan
| | - Nicolas Schweighofer
- Biokinesiology and Physical Therapy, University of Southern California, Los Angeles, CA, 90089-9006, USA
| | - Jun Izawa
- Institute of Systems and Information Engineering, University of Tsukuba, Tsukuba, Ibaraki, 305-8573, Japan.
| |
Collapse
|
7
|
Standage DI, Areshenkoff CN, Gale DJ, Nashed JY, Flanagan JR, Gallivan JP. Whole-brain dynamics of human sensorimotor adaptation. Cereb Cortex 2023; 33:4761-4778. [PMID: 36245212 PMCID: PMC10110437 DOI: 10.1093/cercor/bhac378] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2022] [Revised: 08/26/2022] [Accepted: 08/27/2022] [Indexed: 11/13/2022] Open
Abstract
Humans vary greatly in their motor learning abilities, yet little is known about the neural processes that underlie this variability. We identified distinct profiles of human sensorimotor adaptation that emerged across 2 days of learning, linking these profiles to the dynamics of whole-brain functional networks early on the first day when cognitive strategies toward sensorimotor adaptation are believed to be most prominent. During early learning, greater recruitment of a network of higher-order brain regions, involving prefrontal and anterior temporal cortex, was associated with faster learning. At the same time, greater integration of this "cognitive network" with a sensorimotor network was associated with slower learning, consistent with the notion that cognitive strategies toward adaptation operate in parallel with implicit learning processes of the sensorimotor system. On the second day, greater recruitment of a network that included the hippocampus was associated with faster learning, consistent with the notion that declarative memory systems are involved with fast relearning of sensorimotor mappings. Together, these findings provide novel evidence for the role of higher-order brain systems in driving variability in adaptation.
Collapse
Affiliation(s)
- Dominic I Standage
- Centre for Neuroscience Studies, Queen’s University, Botterell Hall, 18 Stuart Street, Kingston, Ontario K7L 3N6, Canada
- Department of Biomedical and Molecular Sciences, Queen’s University, Kingston, Ontario, Canada
| | - Corson N Areshenkoff
- Centre for Neuroscience Studies, Queen’s University, Botterell Hall, 18 Stuart Street, Kingston, Ontario K7L 3N6, Canada
| | - Daniel J Gale
- Centre for Neuroscience Studies, Queen’s University, Botterell Hall, 18 Stuart Street, Kingston, Ontario K7L 3N6, Canada
| | - Joseph Y Nashed
- Centre for Neuroscience Studies, Queen’s University, Botterell Hall, 18 Stuart Street, Kingston, Ontario K7L 3N6, Canada
- Department of Biomedical and Molecular Sciences, Queen’s University, Kingston, Ontario, Canada
| | - J Randall Flanagan
- Centre for Neuroscience Studies, Queen’s University, Botterell Hall, 18 Stuart Street, Kingston, Ontario K7L 3N6, Canada
- Department of Psychology, Queen’s University, Humphrey Hall, 62 Arch Street, Kingston, Ontario K7L 3N6, Canada
| | - Jason P Gallivan
- Centre for Neuroscience Studies, Queen’s University, Botterell Hall, 18 Stuart Street, Kingston, Ontario K7L 3N6, Canada
- Department of Biomedical and Molecular Sciences, Queen’s University, Kingston, Ontario, Canada
- Department of Psychology, Queen’s University, Humphrey Hall, 62 Arch Street, Kingston, Ontario K7L 3N6, Canada
| |
Collapse
|
8
|
Moore RT, Cluff T. Individual Differences in Sensorimotor Adaptation Are Conserved Over Time and Across Force-Field Tasks. Front Hum Neurosci 2021; 15:692181. [PMID: 34916916 PMCID: PMC8669441 DOI: 10.3389/fnhum.2021.692181] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2021] [Accepted: 11/02/2021] [Indexed: 11/23/2022] Open
Abstract
Sensorimotor adaptation enables the nervous system to modify actions for different conditions and environments. Many studies have investigated factors that influence adaptation at the group level. There is growing recognition that individuals vary in their ability to adapt motor skills and that a better understanding of individual differences in adaptation may inform how motor skills are taught and rehabilitated. Here we examined individual differences in the adaptation of upper-limb reaching movements. We quantified the extent to which participants adapted their movements to a velocity-dependent force field during an initial session, at 24 h, and again 1-week later. Participants (n = 28) displayed savings, which was expressed as greater initial adaptation when re-exposed to the force field. Individual differences in adaptation across various stages of the experiment displayed weak-strong reliability, such that individuals who adapted to a greater extent in the initial session tended to do so when re-exposed to the force field. Our second experiment investigated if individual differences in adaptation are also present when participants adapt to different force fields or a force field and visuomotor rotation. Separate groups of participants adapted to position- and velocity-dependent force fields (Experiment 2a; n = 20) or a velocity-dependent force field and visuomotor rotation in a single session (Experiment 2b; n = 20). Participants who adapted to a greater extent to velocity-dependent forces tended to show a greater extent of adaptation when exposed to position-dependent forces. In contrast, correlations were weak between various stages of adaptation to the force-field and visuomotor rotation. Collectively, our study reveals individual differences in adaptation that are reliable across repeated exposure to the same force field and present when adapting to different force fields.
Collapse
Affiliation(s)
- Robert T Moore
- Cumming School of Medicine, University of Calgary, Calgary, AB, Canada.,Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada
| | - Tyler Cluff
- Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada.,Faculty of Kinesiology, University of Calgary, Calgary, AB, Canada
| |
Collapse
|