1
|
Iwane F, Dash D, Salamanca-Giron RF, Hayward W, Bönstrup M, Buch ER, Cohen LG. Combined low-frequency brain oscillatory activity and behavior predict future errors in human motor skill. Curr Biol 2023; 33:3145-3154.e5. [PMID: 37442139 DOI: 10.1016/j.cub.2023.06.040] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2023] [Revised: 03/24/2023] [Accepted: 06/13/2023] [Indexed: 07/15/2023]
Abstract
Human skills are composed of sequences of individual actions performed with utmost precision. When occasional errors occur, they may have serious consequences, for example, when pilots are manually landing a plane. In such cases, the ability to predict an error before it occurs would clearly be advantageous. Here, we asked whether it is possible to predict future errors in a keyboard procedural human motor skill. We report that prolonged keypress transition times (KTTs), reflecting slower speed, and anomalous delta-band oscillatory activity in cingulate-entorhinal-precuneus brain regions precede upcoming errors in skill. Combined anomalous low-frequency activity and prolonged KTTs predicted up to 70% of future errors. Decoding strength (posterior probability of error) increased progressively approaching the errors. We conclude that it is possible to predict future individual errors in skill sequential performance.
Collapse
Affiliation(s)
- Fumiaki Iwane
- Human Cortical Physiology and Neurorehabilitation Section, NINDS, NIH, Bethesda, MD 20892, USA
| | - Debadatta Dash
- Human Cortical Physiology and Neurorehabilitation Section, NINDS, NIH, Bethesda, MD 20892, USA
| | | | - William Hayward
- Human Cortical Physiology and Neurorehabilitation Section, NINDS, NIH, Bethesda, MD 20892, USA
| | - Marlene Bönstrup
- Department of Neurology, University of Leipzig Medical Center, 04103 Leipzig, Germany
| | - Ethan R Buch
- Human Cortical Physiology and Neurorehabilitation Section, NINDS, NIH, Bethesda, MD 20892, USA
| | - Leonardo G Cohen
- Human Cortical Physiology and Neurorehabilitation Section, NINDS, NIH, Bethesda, MD 20892, USA.
| |
Collapse
|
2
|
Teghipco A, Okada K, Murphy E, Hickok G. Predictive Coding and Internal Error Correction in Speech Production. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2023; 4:81-119. [PMID: 37229143 PMCID: PMC10205072 DOI: 10.1162/nol_a_00088] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/16/2022] [Accepted: 11/02/2022] [Indexed: 05/27/2023]
Abstract
Speech production involves the careful orchestration of sophisticated systems, yet overt speech errors rarely occur under naturalistic conditions. The present functional magnetic resonance imaging study sought neural evidence for internal error detection and correction by leveraging a tongue twister paradigm that induces the potential for speech errors while excluding any overt errors from analysis. Previous work using the same paradigm in the context of silently articulated and imagined speech production tasks has demonstrated forward predictive signals in auditory cortex during speech and presented suggestive evidence of internal error correction in left posterior middle temporal gyrus (pMTG) on the basis that this area tended toward showing a stronger response when potential speech errors are biased toward nonwords compared to words (Okada et al., 2018). The present study built on this prior work by attempting to replicate the forward prediction and lexicality effects in nearly twice as many participants but introduced novel stimuli designed to further tax internal error correction and detection mechanisms by biasing speech errors toward taboo words. The forward prediction effect was replicated. While no evidence was found for a significant difference in brain response as a function of lexical status of the potential speech error, biasing potential errors toward taboo words elicited significantly greater response in left pMTG than biasing errors toward (neutral) words. Other brain areas showed preferential response for taboo words as well but responded below baseline and were less likely to reflect language processing as indicated by a decoding analysis, implicating left pMTG in internal error correction.
Collapse
Affiliation(s)
- Alex Teghipco
- Department of Cognitive Sciences, University of California, Irvine, CA, USA
| | - Kayoko Okada
- Department of Psychology, Loyola Marymount University, Los Angeles, CA, USA
| | - Emma Murphy
- Department of Psychology, Loyola Marymount University, Los Angeles, CA, USA
| | - Gregory Hickok
- Department of Cognitive Sciences, University of California, Irvine, CA, USA
| |
Collapse
|
3
|
Walia P, Fu Y, Norfleet J, Schwaitzberg SD, Intes X, De S, Cavuoto L, Dutta A. Error-related brain state analysis using electroencephalography in conjunction with functional near-infrared spectroscopy during a complex surgical motor task. Brain Inform 2022; 9:29. [PMID: 36484977 PMCID: PMC9733771 DOI: 10.1186/s40708-022-00179-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2022] [Accepted: 11/14/2022] [Indexed: 12/13/2022] Open
Abstract
Error-based learning is one of the basic skill acquisition mechanisms that can be modeled as a perception-action system and investigated based on brain-behavior analysis during skill training. Here, the error-related chain of mental processes is postulated to depend on the skill level leading to a difference in the contextual switching of the brain states on error commission. Therefore, the objective of this paper was to compare error-related brain states, measured with multi-modal portable brain imaging, between experts and novices during the Fundamentals of Laparoscopic Surgery (FLS) "suturing and intracorporeal knot-tying" task (FLS complex task)-the most difficult among the five psychomotor FLS tasks. The multi-modal portable brain imaging combined functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG) for brain-behavior analysis in thirteen right-handed novice medical students and nine expert surgeons. The brain state changes were defined by quasi-stable EEG scalp topography (called microstates) changes using 32-channel EEG data acquired at 250 Hz. Six microstate prototypes were identified from the combined EEG data from experts and novices during the FLS complex task that explained 77.14% of the global variance. Analysis of variance (ANOVA) found that the proportion of the total time spent in different microstates during the 10-s error epoch was significantly affected by the skill level (p < 0.01), the microstate type (p < 0.01), and the interaction between the skill level and the microstate type (p < 0.01). Brain activation based on the slower oxyhemoglobin (HbO) changes corresponding to the EEG band power (1-40 Hz) changes were found using the regularized temporally embedded Canonical Correlation Analysis of the simultaneously acquired fNIRS-EEG signals. The HbO signal from the overlying the left inferior frontal gyrus-opercular part, left superior frontal gyrus-medial orbital, left postcentral gyrus, left superior temporal gyrus, right superior frontal gyrus-medial orbital cortical areas showed significant (p < 0.05) difference between experts and novices in the 10-s error epoch. We conclude that the difference in the error-related chain of mental processes was the activation of cognitive top-down attention-related brain areas, including left dorsolateral prefrontal/frontal eye field and left frontopolar brain regions, along with a 'focusing' effect of global suppression of hemodynamic activation in the experts, while the novices had a widespread stimulus(error)-driven hemodynamic activation without the 'focusing' effect.
Collapse
Affiliation(s)
- Pushpinder Walia
- grid.273335.30000 0004 1936 9887Neuroengineering and Informatics for Rehabilitation Laboratory, Department of Biomedical Engineering, University at Buffalo, Buffalo, USA
| | - Yaoyu Fu
- grid.273335.30000 0004 1936 9887Department of Industrial and Systems Engineering, University at Buffalo, Buffalo, USA
| | - Jack Norfleet
- U.S. Army Futures Command, Combat Capabilities Development Command Soldier Center STTC, Orlando, USA
| | - Steven D. Schwaitzberg
- grid.273335.30000 0004 1936 9887University at Buffalo School of Medicine and Biomedical Sciences, Buffalo, USA
| | - Xavier Intes
- grid.33647.350000 0001 2160 9198Center for Modeling, Simulation and Imaging in Medicine, Rensselaer Polytechnic Institute, Troy, NY USA ,grid.33647.350000 0001 2160 9198Department of Biomedical Engineering, Rensselaer Polytechnic Institute, Troy, USA
| | - Suvranu De
- grid.33647.350000 0001 2160 9198Center for Modeling, Simulation and Imaging in Medicine, Rensselaer Polytechnic Institute, Troy, NY USA ,grid.33647.350000 0001 2160 9198Department of Biomedical Engineering, Rensselaer Polytechnic Institute, Troy, USA
| | - Lora Cavuoto
- grid.273335.30000 0004 1936 9887Department of Industrial and Systems Engineering, University at Buffalo, Buffalo, USA
| | - Anirban Dutta
- grid.36511.300000 0004 0420 4262Neuroengineering and Informatics for Rehabilitation and Simulation-Based Learning, University of Lincoln, Lincoln, UK
| |
Collapse
|
4
|
Bianco R, Novembre G, Ringer H, Kohler N, Keller PE, Villringer A, Sammler D. Lateral Prefrontal Cortex Is a Hub for Music Production from Structural Rules to Movements. Cereb Cortex 2021; 32:3878-3895. [PMID: 34965579 PMCID: PMC9476625 DOI: 10.1093/cercor/bhab454] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2021] [Revised: 11/08/2021] [Accepted: 11/09/2021] [Indexed: 11/13/2022] Open
Abstract
Complex sequential behaviors, such as speaking or playing music, entail flexible rule-based chaining of single acts. However, it remains unclear how the brain translates abstract structural rules into movements. We combined music production with multimodal neuroimaging to dissociate high-level structural and low-level motor planning. Pianists played novel musical chord sequences on a muted MR-compatible piano by imitating a model hand on screen. Chord sequences were manipulated in terms of musical harmony and context length to assess structural planning, and in terms of fingers used for playing to assess motor planning. A model of probabilistic sequence processing confirmed temporally extended dependencies between chords, as opposed to local dependencies between movements. Violations of structural plans activated the left inferior frontal and middle temporal gyrus, and the fractional anisotropy of the ventral pathway connecting these two regions positively predicted behavioral measures of structural planning. A bilateral frontoparietal network was instead activated by violations of motor plans. Both structural and motor networks converged in lateral prefrontal cortex, with anterior regions contributing to musical structure building, and posterior areas to movement planning. These results establish a promising approach to study sequence production at different levels of action representation.
Collapse
Affiliation(s)
- Roberta Bianco
- UCL Ear Institute, University College London, London WC1X 8EE, UK.,Otto Hahn Research Group Neural Bases of Intonation in Speech and Music, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany
| | - Giacomo Novembre
- Neuroscience of Perception and Action Lab, Italian Institute of Technology (IIT), Rome 00161, Italy
| | - Hanna Ringer
- Otto Hahn Research Group Neural Bases of Intonation in Speech and Music, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany.,Institute of Psychology, University of Leipzig, Leipzig 04109, Germany
| | - Natalie Kohler
- Otto Hahn Research Group Neural Bases of Intonation in Speech and Music, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany.,Research Group Neurocognition of Music and Language, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main 60322, Germany
| | - Peter E Keller
- Department of Clinical Medicine, Center for Music in the Brain, Aarhus University, Aarhus 8000, Denmark.,The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Sydney, NSW 2751, Australia
| | - Arno Villringer
- Otto Hahn Research Group Neural Bases of Intonation in Speech and Music, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany
| | - Daniela Sammler
- Otto Hahn Research Group Neural Bases of Intonation in Speech and Music, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany.,Research Group Neurocognition of Music and Language, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main 60322, Germany
| |
Collapse
|
5
|
Mizuguchi N, Tsuchimoto S, Fujii H, Kato K, Nagami T, Kanosue K. Recognition capability of one's own skilled movement is dissociated from acquisition of motor skill memory. Sci Rep 2021; 11:16710. [PMID: 34408254 PMCID: PMC8373862 DOI: 10.1038/s41598-021-96381-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2021] [Accepted: 08/03/2021] [Indexed: 11/09/2022] Open
Abstract
When we have rehearsed a movement using an object, we can reproduce the movement without holding the object. However, the reproduced movement sometimes differs from the movement holding a real object, likely because movement recognition is inaccurate. In the present study, we tested whether the recognition capability was dissociated from the acquisition of motor skill memory. Twelve novices were asked to rotate two balls with their right hand as quickly as possible; they practiced the task for 29 days. To evaluate recognition capability, we calculated the difference in coordination pattern of all five digits between the ball-rotation movement and the reproduced movement without holding balls. The recognition capability did not change within the first day, but improved after one week of practice. On the other hand, performance of the ball rotation significantly improved within the first day. Since improvement of performance is likely associated with acquisition of motor skill memory, we suggest that recognition capability, which reflects the capability to cognitively access motor skill memory, was dissociated from the acquisition of motor skill memory. Therefore, recognition of one’s own skilled movement would rely on a hierarchical structure of acquisition of motor skill memory and cognitive access to that memory.
Collapse
Affiliation(s)
- Nobuaki Mizuguchi
- Research Organization of Science and Technology, Ritsumeikan University, 1-1-1 Noji-Higashi, Kusatsu, Shiga, 525-8577, Japan. .,Faculty of Sport Sciences, Waseda University, 2-579-15 Mikajima, Tokorozawa, Saitama, 359-1192, Japan.
| | - Shohei Tsuchimoto
- Division of System Neuroscience, National Institute for Physiological Sciences, Aichi, 444-8585, Japan
| | - Hirofumi Fujii
- Faculty of Sport Sciences, Waseda University, 2-579-15 Mikajima, Tokorozawa, Saitama, 359-1192, Japan
| | - Kouki Kato
- Faculty of Sport Sciences, Waseda University, 2-579-15 Mikajima, Tokorozawa, Saitama, 359-1192, Japan.,Physical Education Center, Nanzan University, 18 Yamazato, Aichi, 466-8673, Japan
| | - Tomoyuki Nagami
- Faculty of Sport Sciences, Waseda University, 2-579-15 Mikajima, Tokorozawa, Saitama, 359-1192, Japan.,College of Liberal Arts and Sciences, Kitasato University, 1-15-1 Kitazato, Minami-ku, Sagamihara, Kanagawa, 252-0373, Japan
| | - Kazuyuki Kanosue
- Faculty of Sport Sciences, Waseda University, 2-579-15 Mikajima, Tokorozawa, Saitama, 359-1192, Japan
| |
Collapse
|