1
|
Vassiliadis P, Beanato E, Popa T, Windel F, Morishita T, Neufeld E, Duque J, Derosiere G, Wessel MJ, Hummel FC. Non-invasive stimulation of the human striatum disrupts reinforcement learning of motor skills. Nat Hum Behav 2024:10.1038/s41562-024-01901-z. [PMID: 38811696 DOI: 10.1038/s41562-024-01901-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2022] [Accepted: 04/23/2024] [Indexed: 05/31/2024]
Abstract
Reinforcement feedback can improve motor learning, but the underlying brain mechanisms remain underexplored. In particular, the causal contribution of specific patterns of oscillatory activity within the human striatum is unknown. To address this question, we exploited a recently developed non-invasive deep brain stimulation technique called transcranial temporal interference stimulation (tTIS) during reinforcement motor learning with concurrent neuroimaging, in a randomized, sham-controlled, double-blind study. Striatal tTIS applied at 80 Hz, but not at 20 Hz, abolished the benefits of reinforcement on motor learning. This effect was related to a selective modulation of neural activity within the striatum. Moreover, 80 Hz, but not 20 Hz, tTIS increased the neuromodulatory influence of the striatum on frontal areas involved in reinforcement motor learning. These results show that tTIS can non-invasively and selectively modulate a striatal mechanism involved in reinforcement learning, expanding our tools for the study of causal relationships between deep brain structures and human behaviour.
Collapse
Affiliation(s)
- Pierre Vassiliadis
- Defitech Chair of Clinical Neuroengineering, Neuro-X Institute, École Polytechnique Fédérale de Lausanne (EPFL), Geneva, Switzerland
- Defitech Chair of Clinical Neuroengineering, Neuro-X Institute, EPFL Valais, Clinique Romande de Réadaptation, Sion, Switzerland
- Institute of Neuroscience, Université Catholique de Louvain, Brussels, Belgium
| | - Elena Beanato
- Defitech Chair of Clinical Neuroengineering, Neuro-X Institute, École Polytechnique Fédérale de Lausanne (EPFL), Geneva, Switzerland
- Defitech Chair of Clinical Neuroengineering, Neuro-X Institute, EPFL Valais, Clinique Romande de Réadaptation, Sion, Switzerland
| | - Traian Popa
- Defitech Chair of Clinical Neuroengineering, Neuro-X Institute, École Polytechnique Fédérale de Lausanne (EPFL), Geneva, Switzerland
- Defitech Chair of Clinical Neuroengineering, Neuro-X Institute, EPFL Valais, Clinique Romande de Réadaptation, Sion, Switzerland
| | - Fabienne Windel
- Defitech Chair of Clinical Neuroengineering, Neuro-X Institute, École Polytechnique Fédérale de Lausanne (EPFL), Geneva, Switzerland
- Defitech Chair of Clinical Neuroengineering, Neuro-X Institute, EPFL Valais, Clinique Romande de Réadaptation, Sion, Switzerland
| | - Takuya Morishita
- Defitech Chair of Clinical Neuroengineering, Neuro-X Institute, École Polytechnique Fédérale de Lausanne (EPFL), Geneva, Switzerland
- Defitech Chair of Clinical Neuroengineering, Neuro-X Institute, EPFL Valais, Clinique Romande de Réadaptation, Sion, Switzerland
| | - Esra Neufeld
- Foundation for Research on Information Technologies in Society, Zurich, Switzerland
| | - Julie Duque
- Institute of Neuroscience, Université Catholique de Louvain, Brussels, Belgium
| | - Gerard Derosiere
- Institute of Neuroscience, Université Catholique de Louvain, Brussels, Belgium
- Lyon Neuroscience Research Center, Impact Team, Inserm U1028, CNRS UMR5292, Lyon 1 University, Bron, France
| | - Maximilian J Wessel
- Defitech Chair of Clinical Neuroengineering, Neuro-X Institute, École Polytechnique Fédérale de Lausanne (EPFL), Geneva, Switzerland
- Defitech Chair of Clinical Neuroengineering, Neuro-X Institute, EPFL Valais, Clinique Romande de Réadaptation, Sion, Switzerland
- Department of Neurology, University Hospital Würzburg, Würzburg, Germany
| | - Friedhelm C Hummel
- Defitech Chair of Clinical Neuroengineering, Neuro-X Institute, École Polytechnique Fédérale de Lausanne (EPFL), Geneva, Switzerland.
- Defitech Chair of Clinical Neuroengineering, Neuro-X Institute, EPFL Valais, Clinique Romande de Réadaptation, Sion, Switzerland.
- Clinical Neuroscience, University of Geneva Medical School, Geneva, Switzerland.
| |
Collapse
|
2
|
Hadjiosif AM, Abraham G, Ranjan T, Smith MA. Subtle Visual Latency Can Profoundly Impair Implicit Sensorimotor Learning. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.03.14.585093. [PMID: 38558971 PMCID: PMC10980026 DOI: 10.1101/2024.03.14.585093] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
Short sub-100ms visual feedback latencies are common in many types of human-computer interactions yet are known to markedly reduce performance in a wide variety of motor tasks from simple pointing to operating surgical robotics. These latencies are also present in the computer-based experiments used to study the sensorimotor learning that underlies the acquisition of motor performance. Inspired by neurophysiological findings showing that cerebellar LTD and cortical LTP would both be disrupted by sub-100ms latencies, we hypothesized that implicit sensorimotor learning may be particularly sensitive to these short latencies. Remarkably, we find that improving latency by just 60ms, from 85 to 25ms in latency-optimized experiments, increases implicit learning by 50% and proportionally decreases explicit learning, resulting in a dramatic reorganization of sensorimotor memory. We go on to show that implicit sensorimotor learning is considerably more sensitive to latencies in the sub-100ms range than at higher latencies, in line with the latency-specific neural plasticity that has been observed. This suggests a clear benefit for latency reduction in computer-based training that involves implicit sensorimotor learning and that across-study differences in implicit motor learning might often be explained by disparities in feedback latency.
Collapse
|
3
|
Zhao J, Zhang G, Xu D. The effect of reward on motor learning: different stage, different effect. Front Hum Neurosci 2024; 18:1381935. [PMID: 38532789 PMCID: PMC10963647 DOI: 10.3389/fnhum.2024.1381935] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2024] [Accepted: 02/29/2024] [Indexed: 03/28/2024] Open
Abstract
Motor learning is a prominent and extensively studied subject in rehabilitation following various types of neurological disorders. Motor repair and rehabilitation often extend over months and years post-injury with a slow pace of recovery, particularly affecting the fine movements of the distal extremities. This extended period can diminish the motivation and persistence of patients, a facet that has historically been overlooked in motor learning until recent years. Reward, including monetary compensation, social praise, video gaming, music, and virtual reality, is currently garnering heightened attention for its potential to enhance motor motivation and improve function. Numerous studies have examined the effects and attempted to explore potential mechanisms in various motor paradigms, yet they have yielded inconsistent or even contradictory results and conclusions. A comprehensive review is necessary to summarize studies on the effects of rewards on motor learning and to deduce a central pattern from these existing studies. Therefore, in this review, we initially outline a framework of motor learning considering two major types, two major components, and three stages. Subsequently, we summarize the effects of rewards on different stages of motor learning within the mentioned framework and analyze the underlying mechanisms at the level of behavior or neural circuit. Reward accelerates learning speed and enhances the extent of learning during the acquisition and consolidation stages, possibly by regulating the balance between the direct and indirect pathways (activating more D1-MSN than D2-MSN) of the ventral striatum and by increasing motor dynamics and kinematics. However, the effect varies depending on several experimental conditions. During the retention stage, there is a consensus that reward enhances both short-term and long-term memory retention in both types of motor learning, attributed to the LTP learning mechanism mediated by the VTA-M1 dopaminergic projection. Reward is a promising enhancer to bolster waning confidence and motivation, thereby increasing the efficiency of motor learning and rehabilitation. Further exploration of the circuit and functional connections between reward and the motor loop may provide a novel target for neural modulation to promote motor behavior.
Collapse
Affiliation(s)
- Jingwang Zhao
- School of Rehabilitation Science, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- Institute of Rehabilitation Medicine, Shanghai University of Traditional Chinese Medicine, Shanghai, China
| | - Guanghu Zhang
- School of Rehabilitation Science, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- Institute of Rehabilitation Medicine, Shanghai University of Traditional Chinese Medicine, Shanghai, China
| | - Dongsheng Xu
- School of Rehabilitation Science, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- Institute of Rehabilitation Medicine, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- Engineering Research Center of Traditional Chinese Medicine Intelligent Rehabilitation, Ministry of Education, Shanghai, China
- Department of Rehabilitation Medicine, Shuguang Hospital, Shanghai, China
| |
Collapse
|
4
|
Germanova K, Panidi K, Ivanov T, Novikov P, Ivanova GE, Villringer A, Nikulin VV, Nazarova M. Motor Decision-Making as a Common Denominator in Motor Pathology and a Possible Rehabilitation Target. Neurorehabil Neural Repair 2023; 37:577-586. [PMID: 37476957 DOI: 10.1177/15459683231186986] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/22/2023]
Abstract
Despite the substantial progress in motor rehabilitation, patient involvement and motivation remain major challenges. They are typically addressed with communicational and environmental strategies, as well as with improved goal-setting procedures. Here we suggest a new research direction and framework involving Neuroeconomics principles to investigate the role of Motor Decision-Making (MDM) parameters in motivational component and motor performance in rehabilitation. We argue that investigating NE principles could bring new approaches aimed at increasing active patient engagement in the rehabilitation process by introducing more movement choice, and adapting existing goal-setting procedures. We discuss possible MDM implementation strategies and illustrate possible research directions using examples of stroke and psychiatric disorders.
Collapse
Affiliation(s)
- K Germanova
- Centre for Cognition and Decision Making, Institute for Cognitive Neuroscience, HSE University, Russian Federation
- Laboratory of the neurovisceral integration and neuromodulation, National Medical Research Center for Therapy and Preventive Medicine of the Ministry of Healthcare of the Russian Federation, Moscow, Russian Federation
| | - K Panidi
- Centre for Cognition and Decision Making, Institute for Cognitive Neuroscience, HSE University, Russian Federation
| | - T Ivanov
- FSBI "Federal Center for Brain and Neurotechnologies" of FMBA of Russian Federation, Moscow, Russia
| | - P Novikov
- Centre for Cognition and Decision Making, Institute for Cognitive Neuroscience, HSE University, Russian Federation
| | - G E Ivanova
- FSBI "Federal Center for Brain and Neurotechnologies" of FMBA of Russian Federation, Moscow, Russia
| | - A Villringer
- Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - V V Nikulin
- Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - M Nazarova
- Centre for Cognition and Decision Making, Institute for Cognitive Neuroscience, HSE University, Russian Federation
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Boston, USA
| |
Collapse
|
5
|
Yadav G, Duque J. Reflecting on what is "skill" in human motor skill learning. Front Hum Neurosci 2023; 17:1117889. [PMID: 37484917 PMCID: PMC10356990 DOI: 10.3389/fnhum.2023.1117889] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2022] [Accepted: 06/16/2023] [Indexed: 07/25/2023] Open
Abstract
Humans have an exceptional ability to execute a variety of skilled movements. Researchers have been long interested in understanding behavioral and neurophysiological basis of human motor skill learning for advancing both fundamental neuroscientific knowledge and clinical outcomes. However, despite decades of work in this field there is a lack of consensus about what is meant by "skill" in skill learning. With an advent of various task paradigms testing human motor behavior and increasing heterogeneity in motor learning assessments methods, it is very crucial to identify key features of skill in order to avoid any ambiguity that may result in misinterpretation or over-generalization of findings, which could have serious implications for replication and translational research. In this review, we attempt to highlight the features of skill following a historical approach, considering the seminal work that led to the first definitions of skill and including some contemporary concepts emerging from human motor learning research. Overall, based on this literature, we emphasize that skill has some fundamental characteristics, such as- (i) optimal movement selection and execution, (ii) improved movement speed and accuracy, and (iii) reduced movement variability and error. These features of skill can emerge as a consequence of extensive practice/training/learning, thus resulting in an improved performance state beyond baseline levels. Finally we provide some examples of model tasks that can appropriately capture these features of skill, and conclude that any neuroscientific endeavor aimed at understanding the essence of skill in human motor skill learning should focus on these aspects.
Collapse
|