1
|
Bolt NK, Loehr JD. Motor-related cortical oscillations distinguish one's own from a partner's contributions to a joint action. Biol Psychol 2024; 190:108804. [PMID: 38670429 DOI: 10.1016/j.biopsycho.2024.108804] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2023] [Revised: 04/13/2024] [Accepted: 04/19/2024] [Indexed: 04/28/2024]
Abstract
The ability to distinguish between one's own and others' actions is a requirement for successful joint action. Such a distinction might be supported by dissociable motor activity underlying each partner's individual contributions to the joint action. However, little research has directly compared motor activity associated with one's own vs. others' actions during joint action. The current study investigated whether motor-related cortical oscillations distinguish between self- and partner-produced actions when partners take turns producing taps to meet a joint timing goal. Across two experiments, the degree of beta suppression differentiated one's own from a partner's actions, with more suppression occurring during one's own actions than during a partner's actions. Self-partner differences in mu suppression were also evident, particularly when partners produced actions in succession. Increased beta suppression was also observed during partners' actions when they were followed by one's own actions, suggesting that the coordination demands imposed by the joint action could affect the pattern of beta reactivity during a turn-taking joint action. Together, these findings demonstrate that dynamic patterns of motor activity underpin successful joint action and that periods of distinct motor activity are associated with one's own contributions to a joint action.
Collapse
Affiliation(s)
- Nicole K Bolt
- Department of Psychology and Health Studies, University of Saskatchewan, Canada.
| | - Janeen D Loehr
- Department of Psychology and Health Studies, University of Saskatchewan, Canada
| |
Collapse
|
2
|
Paolini S, Bazzini MC, Ferrari L, Errante A, Fogassi L, Rizzolatti G, Fabbri-Destro M, Avanzini P, Nuara A. The importance of observing the master's hand: Action Observation Training promotes the acquisition of new musical skills. Front Neurol 2024; 15:1383053. [PMID: 38872813 PMCID: PMC11169796 DOI: 10.3389/fneur.2024.1383053] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2024] [Accepted: 05/15/2024] [Indexed: 06/15/2024] Open
Abstract
Introduction Via mirror mechanism, motor training approaches based on the alternation of action observation and execution (i.e., Action Observation Training-AOT) promote the acquisition of motor abilities. Previous studies showed that both visual and auditory stimuli may elicit a common motor representation of music-related gestures; however, the potentialities of AOT for the acquisition of musical skills are still underexplored. Methods Twenty-one music-naïve participants underwent two blocks of training: AOT and Key-light Observation Training (KOT). AOT consisted of the observation of a melodic sequence played on a keyboard with the right hand by an expert model, followed by participant's imitation. Observation and execution were repeated six consecutive times (T1-T6). KOT followed the same procedure, except for the visual content of the stimulus, depicting the sequential highlighting of the piano keys corresponding to the melody. The rate of correct notes (C), the trainee-model similarity of key-pressure strength (S), and the trainee-model consistency of note duration (R) were collected across T1-T6. Results Both AOT and KOT improved musical performance. Noteworthy, AOT showed a higher learning magnitude relative to KOT in terms of C and S. Discussion Action Observation Training promotes the acquisition of key elements of melodic sequences, encompassing not only the accurate sequencing of notes but also their expressive characteristics, such as key-pressure dynamics. The convergence of listening and observation of actions onto a shared motor representation not only explains several pedagogical approaches applied in all musical cultures worldwide, but also enhances the potential efficacy of current procedures for music training.
Collapse
Affiliation(s)
- Simone Paolini
- Dipartimento di Medicina e Chirurgia, Università di Parma, Parma, Italy
- Consiglio Nazionale Delle Ricerche, Istituto di Neuroscienze, Parma, Italy
| | | | - Laura Ferrari
- Consiglio Nazionale Delle Ricerche, Istituto di Neuroscienze, Parma, Italy
- School of Advanced Studies, Center for Neuroscience, Università di Camerino, Camerino, Italy
| | - Antonino Errante
- Dipartimento di Medicina e Chirurgia, Università di Parma, Parma, Italy
- Dipartimento Diagnostico, Unità di Neuroradiologia, Azienda Ospedaliero-Universitaria di Parma, Parma, Italy
| | - Leonardo Fogassi
- Dipartimento di Medicina e Chirurgia, Università di Parma, Parma, Italy
| | - Giacomo Rizzolatti
- Dipartimento di Medicina e Chirurgia, Università di Parma, Parma, Italy
- Consiglio Nazionale Delle Ricerche, Istituto di Neuroscienze, Parma, Italy
| | | | - Pietro Avanzini
- Consiglio Nazionale Delle Ricerche, Istituto di Neuroscienze, Parma, Italy
| | - Arturo Nuara
- Dipartimento di Medicina e Chirurgia, Università di Parma, Parma, Italy
| |
Collapse
|
3
|
Lee JH, Lee SE, Kwon YS. Exploring empathic engagement in immersive media: An EEG study on mu rhythm suppression in VR. PLoS One 2024; 19:e0303553. [PMID: 38758939 PMCID: PMC11101072 DOI: 10.1371/journal.pone.0303553] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2023] [Accepted: 04/27/2024] [Indexed: 05/19/2024] Open
Abstract
This study investigates the influence of immersive media, particularly Virtual Reality (VR), on empathic responses, in comparison to traditional television (TV), using electroencephalography (EEG). We employed mu rhythm suppression as a measurable neural marker to gauge empathic engagement, as its increase generally signifies heightened empathic responses. Our findings exhibit a greater mu rhythm suppression in VR conditions compared to TV conditions, suggesting a potential enhancement in empathic responses with VR. Furthermore, our results revealed that the strength of empathic responses was not confined to specific actions depicted in the video clips, underscoring the possibility of broader implications. This research contributes to the ongoing discourse on the effects of different media environments on empathic engagement, particularly emphasizing the unique role of immersive technologies such as VR. It invites further investigation into how such technologies can shape and potentially enhance the empathic experience.
Collapse
Affiliation(s)
- Jong-Hyun Lee
- Brain and Humanity Lab., Institute of Humanities, Seoul National University, Seoul, South Korea
| | - Sung Eun Lee
- Department of German Language & Literature, Seoul National University, Seoul, South Korea
| | - Young-Sung Kwon
- Department of Media & Communication, Dong-A University, Busan, South Korea
| |
Collapse
|
4
|
Dastgheib SS, Wang W, Kaufmann JM, Moratti S, Schweinberger SR. Mu-Suppression Neurofeedback Training Targeting the Mirror Neuron System: A Pilot Study. Appl Psychophysiol Biofeedback 2024:10.1007/s10484-024-09643-4. [PMID: 38739182 DOI: 10.1007/s10484-024-09643-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/14/2024]
Abstract
Neurofeedback training (NFT) is a promising adjuvant intervention method. The desynchronization of mu rhythm (8-13 Hz) in the electroencephalogram (EEG) over centro-parietal areas is known as a valid indicator of mirror neuron system (MNS) activation, which has been associated with social skills. Still, the effect of neurofeedback training on the MNS requires to be well investigated. The present study examined the possible impact of NFT with a mu suppression training protocol encompassing 15 NFT sessions (45 min each) on 16 healthy neurotypical participants. In separate pre- and post-training sessions, 64-channel EEG was recorded while participants (1) observed videos with various types of movements (including complex goal-directed hand movements and social interaction scenes) and (2) performed the "Reading the Mind in the Eyes Test" (RMET). EEG source reconstruction analysis revealed statistically significant mu suppression during hand movement observation across MNS-attributed fronto-parietal areas after NFT. The frequency analysis showed no significant mu suppression after NFT, despite the fact that numerical mu suppression appeared to be visible in a majority of participants during goal-directed hand movement observation. At the behavioral level, RMET accuracy scores did not suggest an effect of NFT on the ability to interpret subtle emotional expressions, although RMET response times were reduced after NFT. In conclusion, the present study exhibited preliminary and partial evidence that mu suppression NFT can induce mu suppression in MNS-attributed areas. More powerful experimental designs and longer training may be necessary to induce substantial and consistent mu suppression, particularly while observing social scenarios.
Collapse
Affiliation(s)
- Samaneh S Dastgheib
- Department for General Psychology and Cognitive Neuroscience, Institute of Psychology, Friedrich Schiller University of Jena, Am Steiger 3/1, 07743, Jena, Germany
- Social Potential in Autism Research Unit, Friedrich Schiller University of Jena, Am Steiger 3/1, 07743, Jena, Germany
- Center for Intervention and Research On Adaptive and Maladaptive Brain Circuits Underlying, Mental Health (C-I-R-C), Jena-Magdeburg-Halle, Germany
| | - Wenbo Wang
- Department for General Psychology and Cognitive Neuroscience, Institute of Psychology, Friedrich Schiller University of Jena, Am Steiger 3/1, 07743, Jena, Germany
- Social Potential in Autism Research Unit, Friedrich Schiller University of Jena, Am Steiger 3/1, 07743, Jena, Germany
- Center for Intervention and Research On Adaptive and Maladaptive Brain Circuits Underlying, Mental Health (C-I-R-C), Jena-Magdeburg-Halle, Germany
| | - Jürgen M Kaufmann
- Department for General Psychology and Cognitive Neuroscience, Institute of Psychology, Friedrich Schiller University of Jena, Am Steiger 3/1, 07743, Jena, Germany
- Social Potential in Autism Research Unit, Friedrich Schiller University of Jena, Am Steiger 3/1, 07743, Jena, Germany
| | - Stephan Moratti
- Department of Experimental Psychology, Complutense University of Madrid, Madrid, Spain
| | - Stefan R Schweinberger
- Department for General Psychology and Cognitive Neuroscience, Institute of Psychology, Friedrich Schiller University of Jena, Am Steiger 3/1, 07743, Jena, Germany.
- Social Potential in Autism Research Unit, Friedrich Schiller University of Jena, Am Steiger 3/1, 07743, Jena, Germany.
- German Center for Mental Health (DZPG), Jena-Magdeburg-Halle, Germany.
| |
Collapse
|
5
|
Tao X, Gao D, Zhang W, Liu T, Du B, Zhang S, Qin Y. A multimodal physiological dataset for driving behaviour analysis. Sci Data 2024; 11:378. [PMID: 38609440 PMCID: PMC11014944 DOI: 10.1038/s41597-024-03222-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Accepted: 04/03/2024] [Indexed: 04/14/2024] Open
Abstract
Physiological signal monitoring and driver behavior analysis have gained increasing attention in both fundamental research and applied research. This study involved the analysis of driving behavior using multimodal physiological data collected from 35 participants. The data included 59-channel EEG, single-channel ECG, 4-channel EMG, single-channel GSR, and eye movement data obtained via a six-degree-of-freedom driving simulator. We categorized driving behavior into five groups: smooth driving, acceleration, deceleration, lane changing, and turning. Through extensive experiments, we confirmed that both physiological and vehicle data met the requirements. Subsequently, we developed classification models, including linear discriminant analysis (LDA), MMPNet, and EEGNet, to demonstrate the correlation between physiological data and driving behaviors. Notably, we propose a multimodal physiological dataset for analyzing driving behavior(MPDB). The MPDB dataset's scale, accuracy, and multimodality provide unprecedented opportunities for researchers in the autonomous driving field and beyond. With this dataset, we will contribute to the field of traffic psychology and behavior.
Collapse
Affiliation(s)
- Xiaoming Tao
- Tsinghua University, Department of Electronic Engineering, Beijing, 100084, China
- Beijing National Research Center for Information Science and Technology (BNRist), 100084, Beijing, China
| | - Dingcheng Gao
- Tsinghua University, Department of Electronic Engineering, Beijing, 100084, China
- Beijing National Research Center for Information Science and Technology (BNRist), 100084, Beijing, China
| | - Wenqi Zhang
- Tsinghua University, Department of Electronic Engineering, Beijing, 100084, China
- Beijing National Research Center for Information Science and Technology (BNRist), 100084, Beijing, China
| | - Tianqi Liu
- Tsinghua University, Department of Electronic Engineering, Beijing, 100084, China
- Beijing National Research Center for Information Science and Technology (BNRist), 100084, Beijing, China
| | - Bing Du
- University of Science and Technology Beijing, School of Computer and Communication Engineering, Beijing, 100083, China
| | - Shanghang Zhang
- National Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University, Beijing, 100871, China
| | - Yanjun Qin
- Tsinghua University, Department of Electronic Engineering, Beijing, 100084, China.
- Beijing National Research Center for Information Science and Technology (BNRist), 100084, Beijing, China.
| |
Collapse
|
6
|
Zhang Y, Chen S, Peng Y, Yang X, Yang J. The Role of the Motor System in L1 and L2 Action Verb Processing for Chinese Learners of English: Evidence from Mu Rhythm Desynchronization. Behav Sci (Basel) 2024; 14:268. [PMID: 38667064 PMCID: PMC11047514 DOI: 10.3390/bs14040268] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2024] [Revised: 03/17/2024] [Accepted: 03/20/2024] [Indexed: 04/29/2024] Open
Abstract
The nature of semantic representation has long been a key question in linguistic research. The Embodied Cognition theory challenges the traditional view of language representation, stating that semantic information stems from the sensory-motor cortex, which is activated automatically during semantic processing. However, most of the evidence comes from monolingual studies; it remains unclear whether second-language (L2) comprehension involves different semantic representations or mirrors the pattern seen in first-language (L1) processing. Therefore, the present study investigated the role of the sensory-motor system in language processing via making Electroencephalography (EEG) recordings during the processing of L1 and L2 action verbs. The results showed that L1 (Chinese) action verbs generated higher mu-event-related desynchronization (ERD) than L1 abstract verbs in the early processing stage (250 ms after verb presentation), and the same phenomenon was also observed for L2 (English). The results also indicated that language modulated the processing of action verbs, with L1 action verbs eliciting stronger ERD than L2 action verbs. These results demonstrate that the sensory-motor cortex plays a crucial role in comprehending both L1 and L2 action verbs.
Collapse
Affiliation(s)
| | - Shifa Chen
- College of Foreign Languages, Ocean University of China, Qingdao 266100, China; (Y.Z.); (X.Y.); (J.Y.)
| | - Yule Peng
- College of Foreign Languages, Ocean University of China, Qingdao 266100, China; (Y.Z.); (X.Y.); (J.Y.)
| | | | | |
Collapse
|
7
|
Kitamura M, Yamamoto K, Oshima A, Kamibayashi K. Corticospinal excitability during observation of basketball free-throw movement: Effects of video playback speed and stimulus timing. PLoS One 2023; 18:e0292060. [PMID: 37768947 PMCID: PMC10538764 DOI: 10.1371/journal.pone.0292060] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2022] [Accepted: 09/12/2023] [Indexed: 09/30/2023] Open
Abstract
Transcranial magnetic stimulation studies have indicated that action observation (AO) modulates corticospinal excitability. Although a few previous studies have shown that the AO of simple motor movements at a slow playback speed facilitates corticospinal excitability more than that at normal playback speed, it is unclear if this effect occurs during the AO of sport-related complex movements. Therefore, we investigated the changes in the motor evoked potential (MEP) amplitudes of the flexor carpi radialis (FCR) and abductor digiti minimi (ADM) muscles during the AO of a basketball free-throw movement at three different playback speeds (100%, 75%, and 50% speeds). Additionally, we evaluated the effects of stimulus timing (holding the ball vs. releasing the ball for shooting) and motor expertise (expert basketball players vs. novices) on the MEP amplitude during the AO. Our results demonstrated that regardless of motor expertise, the MEP amplitude of the FCR muscle was significantly smaller in the 50% speed condition than in the 100% condition. In the ADM muscle, the MEP amplitude was significantly larger when the ball was held after dribbling than when the ball was released. Therefore, it is suggested that corticospinal excitability in specific muscles during the observation of complex whole-body movements is influenced by video playback speed and stimulus timing.
Collapse
Affiliation(s)
- Masaya Kitamura
- Graduate School of Health and Sports Science, Doshisha University, Kyotanabe, Kyoto, Japan
| | - Katsuya Yamamoto
- Graduate School of Health and Sports Science, Doshisha University, Kyotanabe, Kyoto, Japan
| | - Atsushi Oshima
- Graduate School of Health and Sports Science, Doshisha University, Kyotanabe, Kyoto, Japan
- Research Fellow of the Japan Society for the Promotion of Science, Chiyoda-ku, Tokyo, Japan
| | - Kiyotaka Kamibayashi
- Faculty of Health and Sports Science, Doshisha University, Kyotanabe, Kyoto, Japan
| |
Collapse
|
8
|
Langiulli N, Calbi M, Sbravatti V, Umiltà MA, Gallese V. The effect of Surround sound on embodiment and sense of presence in cinematic experience: a behavioral and HD-EEG study. Front Neurosci 2023; 17:1222472. [PMID: 37746143 PMCID: PMC10513788 DOI: 10.3389/fnins.2023.1222472] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2023] [Accepted: 08/14/2023] [Indexed: 09/26/2023] Open
Abstract
Although many studies have investigated spectators' cinematic experience, only a few of them explored the neurophysiological correlates of the sense of presence evoked by the spatial characteristics of audio delivery devices. Nevertheless, nowadays both the industrial and the consumer markets have been saturated by some forms of spatial audio format that enrich the audio-visual cinematic experience, reducing the gap between the real and the digitally mediated world. The increase in the immersive capabilities corresponds to the instauration of both the sense of presence and the psychological sense of being in the virtual environment and also embodied simulation mechanisms. While it is well-known that these mechanisms can be activated in the real world, it is hypothesized that they may be elicited even in a virtual acoustic spatial environment and could be modulated by the acoustic spatialization cues reproduced by sound systems. Hence, the present study aims to investigate the neural basis of the sense of presence evoked by different forms of mediation by testing different acoustic space sound delivery (Presentation modes: Monophonic, Stereo, and Surround). To these aims, a behavioral investigation and a high-density electroencephalographic (HD-EEG) study have been developed. A large set of ecological and heterogeneous stimuli extracted from feature films were used. Furthermore, participants were selected following the generalized listener selection procedure. We found a significantly higher event-related desynchronization (ERD) in the Surround Presentation mode when compared to the Monophonic Presentation mode both in Alpha and Low-Beta centro-parietal clusters. We discuss this result as an index of embodied simulation mechanisms that could be considered as a possible neurophysiological correlation of the instauration of the sense of presence.
Collapse
Affiliation(s)
- Nunzio Langiulli
- Unit of Neuroscience, Department of Medicine and Surgery, University of Parma, Parma, Italy
| | - Marta Calbi
- Department of Philosophy “Piero Martinetti”, State University of Milan, Milan, Italy
| | - Valerio Sbravatti
- Department of History, Anthropology, Religions, Arts and Performing Arts, Sapienza University of Rome, Rome, Italy
| | - Maria Alessandra Umiltà
- Department of Food and Drug, University of Parma, Parma, Italy
- Italian Academy for Advanced Studies in America at Columbia University, New York, NY, United States
| | - Vittorio Gallese
- Unit of Neuroscience, Department of Medicine and Surgery, University of Parma, Parma, Italy
- Italian Academy for Advanced Studies in America at Columbia University, New York, NY, United States
| |
Collapse
|
9
|
Pei H, Ma S, Yan W, Liu Z, Wang Y, Yang Z, Li Q, Yao D, Jiang S, Luo C, Yu L. Functional and structural networks decoupling in generalized tonic-clonic seizures and its reorganization by drugs. Epilepsia Open 2023; 8:1038-1048. [PMID: 37394869 PMCID: PMC10472403 DOI: 10.1002/epi4.12781] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2022] [Accepted: 06/27/2023] [Indexed: 07/04/2023] Open
Abstract
OBJECTIVE To investigate potential functional and structural large-scale network disturbances in untreated patients with generalized tonic-clonic seizures (GTCS) and the effects of antiseizure drugs. METHODS In this study, 41 patients with GTCS, comprising 21 untreated patients and 20 patients who received antiseizure medications (ASMs), and 29 healthy controls were recruited to construct large-scale brain networks based on resting-state functional magnetic resonance imaging and diffusion tensor imaging. Structural and functional connectivity and network-level weighted correlation probability (NWCP) were further investigated to identify network features that corresponded to response to ASMs. RESULTS Untreated patients showed more extensive enhancement of functional and structural connections than controls. Specifically, we observed abnormally enhanced connections between the default mode network (DMN) and the frontal-parietal network. In addition, treated patients showed similar functional connection strength to that of the control group. However, all patients exhibited similar structural network alterations. Moreover, the NWCP value was lower for connections within the DMN and between the DMN and other networks in the untreated patients; receiving ASMs could reverse this pattern. SIGNIFICANCE Our study identified alterations in structural and functional connectivity in patients with GTCS. The influence of ASMs may be more noticeable within the functional network; moreover, abnormalities in both the functional and structural coupling state may be improved by ASM treatment. Therefore, the coupling state of structural and functional connectivity may be used as an indicator of the efficacy of ASMs.
Collapse
Affiliation(s)
- Haonan Pei
- The Clinical Hospital of Chengdu Brain Science InstituteMOE Key Lab for NeuroinformationSchool of Life Science and TechnologyUniversity of Electronic Science and Technology of ChinaChengduChina
- Research Unit of NeuroInformation (2019RU035)Chinese Academy of Medical SciencesChengduChina
| | - Shuai Ma
- The Clinical Hospital of Chengdu Brain Science InstituteMOE Key Lab for NeuroinformationSchool of Life Science and TechnologyUniversity of Electronic Science and Technology of ChinaChengduChina
- Research Unit of NeuroInformation (2019RU035)Chinese Academy of Medical SciencesChengduChina
- Neurology DepartmentSichuan Academy of Medical Sciences & Sichuan Provincial People's Hospital, The Affiliated Hospital of University of Electronic Science and Technology of ChinaChengduChina
| | - Wei Yan
- The Clinical Hospital of Chengdu Brain Science InstituteMOE Key Lab for NeuroinformationSchool of Life Science and TechnologyUniversity of Electronic Science and Technology of ChinaChengduChina
- Research Unit of NeuroInformation (2019RU035)Chinese Academy of Medical SciencesChengduChina
| | - Zetao Liu
- The Clinical Hospital of Chengdu Brain Science InstituteMOE Key Lab for NeuroinformationSchool of Life Science and TechnologyUniversity of Electronic Science and Technology of ChinaChengduChina
- Research Unit of NeuroInformation (2019RU035)Chinese Academy of Medical SciencesChengduChina
| | - Yuehan Wang
- The Clinical Hospital of Chengdu Brain Science InstituteMOE Key Lab for NeuroinformationSchool of Life Science and TechnologyUniversity of Electronic Science and Technology of ChinaChengduChina
- Research Unit of NeuroInformation (2019RU035)Chinese Academy of Medical SciencesChengduChina
| | - Zhihuan Yang
- The Clinical Hospital of Chengdu Brain Science InstituteMOE Key Lab for NeuroinformationSchool of Life Science and TechnologyUniversity of Electronic Science and Technology of ChinaChengduChina
- Research Unit of NeuroInformation (2019RU035)Chinese Academy of Medical SciencesChengduChina
| | - Qifu Li
- Department of NeurologyThe First Affiliated Hospital of Hainan Medical UniversityHaikouChina
| | - Dezhong Yao
- The Clinical Hospital of Chengdu Brain Science InstituteMOE Key Lab for NeuroinformationSchool of Life Science and TechnologyUniversity of Electronic Science and Technology of ChinaChengduChina
- Research Unit of NeuroInformation (2019RU035)Chinese Academy of Medical SciencesChengduChina
- Department of NeurologyThe First Affiliated Hospital of Hainan Medical UniversityHaikouChina
- High‐Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan ProvinceUniversity of Electronic Science and Technology of ChinaChengduChina
| | - Sisi Jiang
- The Clinical Hospital of Chengdu Brain Science InstituteMOE Key Lab for NeuroinformationSchool of Life Science and TechnologyUniversity of Electronic Science and Technology of ChinaChengduChina
- Research Unit of NeuroInformation (2019RU035)Chinese Academy of Medical SciencesChengduChina
- High‐Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan ProvinceUniversity of Electronic Science and Technology of ChinaChengduChina
| | - Cheng Luo
- The Clinical Hospital of Chengdu Brain Science InstituteMOE Key Lab for NeuroinformationSchool of Life Science and TechnologyUniversity of Electronic Science and Technology of ChinaChengduChina
- Research Unit of NeuroInformation (2019RU035)Chinese Academy of Medical SciencesChengduChina
- High‐Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan ProvinceUniversity of Electronic Science and Technology of ChinaChengduChina
| | - Liang Yu
- Neurology DepartmentSichuan Academy of Medical Sciences & Sichuan Provincial People's Hospital, The Affiliated Hospital of University of Electronic Science and Technology of ChinaChengduChina
| |
Collapse
|
10
|
Bazzini MC, Nuara A, Branchini G, De Marco D, Ferrari L, Lanini MC, Paolini S, Scalona E, Avanzini P, Fabbri-Destro M. The capacity of action observation to drag the trainees' motor pattern toward the observed model. Sci Rep 2023; 13:9107. [PMID: 37277395 DOI: 10.1038/s41598-023-35664-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2022] [Accepted: 05/22/2023] [Indexed: 06/07/2023] Open
Abstract
Action Observation Training (AOT) promotes the acquisition of motor abilities. However, while the cortical modulations associated with the AOT efficacy are well known, few studies investigated the AOT peripheral neural correlates and whether their dynamics move towards the observed model during the training. We administered seventy-two participants (randomized into AOT and Control groups) with training for learning to grasp marbles with chopsticks. Execution practice was preceded by an observation session, in which AOT participants observed an expert performing the task, whereas controls observed landscape videos. Behavioral indices were measured, and three hand muscles' electromyographic (EMG) activity was recorded and compared with the expert. Behaviorally, both groups improved during the training, with AOT outperforming controls. The EMG trainee-model similarity also increased during the training, but only for the AOT group. When combining behavioral and EMG similarity findings, no global relationship emerged; however, behavioral improvements were "locally" predicted by the similarity gain in muscles and action phases more related to the specific motor act. These findings reveal that AOT plays a magnetic role in motor learning, attracting the trainee's motor pattern toward the observed model and paving the way for developing online monitoring tools and neurofeedback protocols.
Collapse
Affiliation(s)
- Maria Chiara Bazzini
- Consiglio Nazionale delle Ricerche, Istituto di Neuroscienze, Parma, Italy
- Dipartimento di Medicina e Chirurgia, Università degli Studi di Parma, Parma, Italy
| | - Arturo Nuara
- Consiglio Nazionale delle Ricerche, Istituto di Neuroscienze, Parma, Italy
- Dipartimento di Medicina e Chirurgia, Università degli Studi di Parma, Parma, Italy
| | - Giulio Branchini
- Dipartimento di Medicina e Chirurgia, Università degli Studi di Parma, Parma, Italy
| | - Doriana De Marco
- Dipartimento di Medicina e Chirurgia, Università degli Studi di Parma, Parma, Italy
| | - Laura Ferrari
- Consiglio Nazionale delle Ricerche, Istituto di Neuroscienze, Parma, Italy
- School of Advanced Studies, Università di Camerino, Camerino, Italy
| | - Maria Chiara Lanini
- Dipartimento di Medicina e Chirurgia, Università degli Studi di Parma, Parma, Italy
| | - Simone Paolini
- Consiglio Nazionale delle Ricerche, Istituto di Neuroscienze, Parma, Italy
- Dipartimento di Medicina e Chirurgia, Università degli Studi di Parma, Parma, Italy
| | - Emilia Scalona
- Consiglio Nazionale delle Ricerche, Istituto di Neuroscienze, Parma, Italy
- Dipartimento Specialità Medico-Chirurgiche, Scienze Radiologiche e Sanità Pubblica (DSMC), Università degli Studi di Brescia, Brescia, Italy
| | - Pietro Avanzini
- Consiglio Nazionale delle Ricerche, Istituto di Neuroscienze, Parma, Italy
- Istituto Clinico Humanitas, Humanitas Clinical and Research Center, Milan, Italy
| | | |
Collapse
|
11
|
Salo VC, Debnath R, Rowe ML, Fox NA. Experience with pointing gestures facilitates infant vocabulary growth through enhancement of sensorimotor brain activity. Dev Psychol 2023; 59:676-690. [PMID: 36480360 PMCID: PMC10038843 DOI: 10.1037/dev0001493] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
Exposure to communicative gestures, through their parents' use of gestures, is associated with infants' language development. However, the mechanisms supporting this link are not fully understood. In adults, sensorimotor brain activity occurs while processing communicative stimuli, including both spoken language and gestures. Using electroencephalogram (EEG) mu rhythm desynchronization (mu ERD), a marker of sensorimotor activity, we examined whether experimental manipulation of infants' exposure to gestures would affect language development, and specifically whether such an effect would be mediated by changes in sensorimotor brain activity. Mu ERD was measured in 10- to 12-month-old infants (N = 81; 42 male; 15% Hispanic, 62% White) recruited from counties surrounding a large mid-Atlantic university while they observed an experimenter gesturing toward or grasping an object. Half of the infants were randomized to receive increased gesture exposure through a parent-directed training. All 81 infants provided behavioral (infant and parent pointing and infant vocabulary) data prior to intervention and 72 provided behavioral data postintervention. Forty-two infants provided usable (post artifact removal) EEG data prior to intervention and 40 infants provided usable EEG data post-intervention. Twenty-nine infants provided usable EEG data at both sessions. Increased parent gesture due to the intervention was associated with increased infant right lateralized mu ERD at follow-up, but only while observing the experimenter gesturing not grasping. Increased mu ERD, again only while observing the experimenter gesture, was associated with increased infant receptive vocabulary. This is the first evidence suggesting that increasing exposure to gestures may impact infants' language development through an effect on sensorimotor brain activity. (PsycInfo Database Record (c) 2023 APA, all rights reserved).
Collapse
Affiliation(s)
- Virginia C Salo
- Child Development and Behavior Branch, Eunice Kennedy Shriver National Institute of Child Health and Human Development
| | - Ranjan Debnath
- Center for Behavioral Brain Sciences, Leibniz Institute for Neurobiology
| | | | - Nathan A Fox
- Department of Human Development and Quantitative Methodology, University of Maryland, College Park
| |
Collapse
|
12
|
Varlet M, Nozaradan S, Schmidt RC, Keller PE. Neural tracking of visual periodic motion. Eur J Neurosci 2023; 57:1081-1097. [PMID: 36788113 DOI: 10.1111/ejn.15934] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2021] [Revised: 02/10/2023] [Accepted: 02/10/2023] [Indexed: 02/16/2023]
Abstract
Periodicity is a fundamental property of biological systems, including human movement systems. Periodic movements support displacements of the body in the environment as well as interactions and communication between individuals. Here, we use electroencephalography (EEG) to investigate the neural tracking of visual periodic motion, and more specifically, the relevance of spatiotemporal information contained at and between their turning points. We compared EEG responses to visual sinusoidal oscillations versus nonlinear Rayleigh oscillations, which are both typical of human movements. These oscillations contain the same spatiotemporal information at their turning points but differ between turning points, with Rayleigh oscillations having an earlier peak velocity, shown to increase an individual's capacity to produce accurately synchronized movements. EEG analyses highlighted the relevance of spatiotemporal information between the turning points by showing that the brain precisely tracks subtle differences in velocity profiles, as indicated by earlier EEG responses for Rayleigh oscillations. The results suggest that the brain is particularly responsive to velocity peaks in visual periodic motion, supporting their role in conveying behaviorally relevant timing information at a neurophysiological level. The results also suggest key functions of neural oscillations in the Alpha and Beta frequency bands, particularly in the right hemisphere. Together, these findings provide insights into the neural mechanisms underpinning the processing of visual periodic motion and the critical role of velocity peaks in enabling proficient visuomotor synchronization.
Collapse
Affiliation(s)
- Manuel Varlet
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, Australia.,School of Psychology, Western Sydney University, Penrith, Australia
| | - Sylvie Nozaradan
- Institute of Neuroscience (IONS), Université catholique de Louvain (UCL), Brussels, Belgium
| | - Richard C Schmidt
- Department of Psychology, College of the Holy Cross, Worcester, Massachusetts, USA
| | - Peter E Keller
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, Australia.,Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Aarhus, Denmark
| |
Collapse
|
13
|
Zakaria Z, Idris Z, Abdul Halim S, Ghani ARI, Abdullah JM. Subthalamic Nucleus (STN)-Deep Brain Stimulation Reduces the Power of Mu and Beta Rhythms and Enhances Synchrony at the Motor Cortices in Parkinson's Disease: A Report of Two Cases. Cureus 2023; 15:e35057. [PMID: 36942168 PMCID: PMC10024512 DOI: 10.7759/cureus.35057] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/16/2023] [Indexed: 02/18/2023] Open
Abstract
The motor circuit in Parkinson's disease (PD) involves the basal ganglia, thalamus, motor cortex, and cerebellum. Hence, subthalamic nucleus (STN) or globus pallidus internus deep brain stimulation is commonly used in treating refractory Parkinson's patients. During the procedure, the local field potential (LPF) is commonly made along the trajectory of the STN. Two cases were assessed, where an electroencephalographic recording at the sensorimotor cortices was also performed with and without stimulation at the optimal STN electrode site. The 'on' stimulation state associated with clinical improvement correlated with a marked reduction in the late theta (7.5 Hz), alpha (10.5 Hz) (Mu wave), and beta (20 Hz) wave power. Besides, more synchronized and coherent brainwaves were noted when the stimulation was 'on'.
Collapse
Affiliation(s)
- Zaitun Zakaria
- Department of Neurosciences, School of Medical Sciences, Universiti Sains Malaysia (USM), Kota Bharu, MYS
| | - Zamzuri Idris
- Department of Neurosciences, School of Medical Sciences, Hospital Universiti Sains Malaysia (HUSM), Kota Bharu, MYS
- Department of Neurosciences, School of Medical Sciences, Universiti Sains Malaysia (USM), Kota Bharu, MYS
| | - Sanihah Abdul Halim
- Department of Medicine, School of Medical Sciences, Universiti Sains Malaysia (USM) Kubang Kerian, Kota Bharu, MYS
| | - Abdul Rahman Izaini Ghani
- Department of Neurosciences, School of Medical Sciences, Universiti Sains Malaysia (USM) Kubang Kerian, Kota Bharu, MYS
| | - Jafri M Abdullah
- Department of Neurosurgery, Universiti Sains Malaysia (USM) Health Campus, Kota Bharu, MYS
| |
Collapse
|
14
|
Nuara A, Bazzini MC, Cardellicchio P, Scalona E, De Marco D, Rizzolatti G, Fabbri-Destro M, Avanzini P. The value of corticospinal excitability and intracortical inhibition in predicting motor skill improvement driven by action observation. Neuroimage 2023; 266:119825. [PMID: 36543266 DOI: 10.1016/j.neuroimage.2022.119825] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2022] [Revised: 12/15/2022] [Accepted: 12/17/2022] [Indexed: 12/23/2022] Open
Abstract
The observation of other's actions represents an essential element for the acquisition of motor skills. While action observation is known to induce changes in the excitability of the motor cortices, whether such modulations may explain the amount of motor improvement driven by action observation training (AOT) remains to be addressed. Using transcranial magnetic stimulation (TMS), we first assessed in 41 volunteers the effect of action observation on corticospinal excitability, intracortical inhibition, and transcallosal inhibition. Subsequently, half of the participants (AOT-group) were asked to observe and then execute a right-hand dexterity task, while the controls had to observe a no-action video before practicing the same task. AOT participants showed greater performance improvement relative to controls. More importantly, the amount of improvement in the AOT group was predicted by the amplitude of corticospinal modulation during action observation and, even more, by the amount of intracortical inhibition induced by action observation. These relations were specific for the AOT group, while the same patterns were not found in controls. Taken together, our findings demonstrate that the efficacy of AOT in promoting motor learning is rooted in the capacity of action observation to modulate the trainee's motor system excitability, especially its intracortical inhibition. Our study not only enriches the picture of the neurophysiological effects induced by action observation onto the observer's motor excitability, but linking them to the efficacy of AOT, it also paves the way for the development of models predicting the outcome of training procedures based on the observation of other's actions.
Collapse
Affiliation(s)
- Arturo Nuara
- CNR Neuroscience Institute, via Volturno 39/E, Parma 43125, Italy.
| | | | - Pasquale Cardellicchio
- IIT@UniFe Center for Translational Neurophysiology, Istituto Italiano di Tecnologia, Ferrara, Italy
| | - Emilia Scalona
- CNR Neuroscience Institute, via Volturno 39/E, Parma 43125, Italy; Specialità Medico-Chirurgiche, Scienze Radiologiche e Sanità Pubblica (DSMC), Università degli studi di Brescia, Italia
| | - Doriana De Marco
- CNR Neuroscience Institute, via Volturno 39/E, Parma 43125, Italy
| | | | | | - Pietro Avanzini
- CNR Neuroscience Institute, via Volturno 39/E, Parma 43125, Italy; Istituto Clinico Humanitas, Humanitas Clinical and Research Center, Milan, Rozzano, Italy
| |
Collapse
|
15
|
Krol MA, Jellema T. Sensorimotor representation of observed dyadic actions with varying agent involvement: an EEG mu study. Cogn Neurosci 2023; 14:25-35. [PMID: 35699606 DOI: 10.1080/17588928.2022.2084605] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
Abstract
Observation of others' actions activates motor representations in sensorimotor cortex. Although action observation in the real-world often involves multiple agents displaying varying degrees of action involvement, most lab studies on action observation studied individual actions. We recorded EEG-mu suppression over sensorimotor cortex to investigate how the multi-agent nature of observed hand/arm actions is incorporated in sensorimotor action representations. Hereto we manipulated the extent of agent involvement in dyadic interactions presented in videos. In all clips two agents were present, of which agent-1 always performed the same action, while the involvement of agent-2 differed along three levels: (1) passive and uninvolved, (2) passively involved, (3) actively involved. Additionally, a no-action condition was presented. The occurrence of these four conditions was predictable thanks to cues at the start of each trial, which allowed to study possible mu anticipation effects. Dyadic interactions in which agent-2 was actively involved resulted in increased power suppression of the mu rhythm compared to dyadic interactions in which agent-2 was passively involved. The latter did not differ from actions in which agent-2 was present but not involved. No anticipation effects were found. The results suggest that the sensorimotor representation of a dyadic interaction takes into account the simultaneously performed bodily articulations of both agents, but no evidence was found for incorporation of their static articulated postures.
Collapse
Affiliation(s)
- Manon A Krol
- Donders Institute, Radboud University, Nijmegen, The Netherlands
| | | |
Collapse
|
16
|
Syrov N, Yakovlev L, Miroshnikov A, Kaplan A. Beyond passive observation: feedback anticipation and observation activate the mirror system in virtual finger movement control via P300-BCI. Front Hum Neurosci 2023; 17:1180056. [PMID: 37213933 PMCID: PMC10192585 DOI: 10.3389/fnhum.2023.1180056] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Accepted: 04/13/2023] [Indexed: 05/23/2023] Open
Abstract
Action observation (AO) is widely used as a post-stroke therapy to activate sensorimotor circuits through the mirror neuron system. However, passive observation is often considered to be less effective and less interactive than goal-directed movement observation, leading to the suggestion that observation of goal-directed actions may have stronger therapeutic potential, as goal-directed AO has been shown to activate mechanisms for monitoring action errors. Some studies have also suggested the use of AO as a form of Brain-computer interface (BCI) feedback. In this study, we investigated the potential for observation of virtual hand movements within a P300-based BCI as a feedback system to activate the mirror neuron system. We also explored the role of feedback anticipation and estimation mechanisms during movement observation. Twenty healthy subjects participated in the study. We analyzed event-related desynchronization and synchronization (ERD/S) of sensorimotor EEG rhythms and Error-related potentials (ErrPs) during observation of virtual hand finger flexion presented as feedback in the P300-BCI loop and compared the dynamics of ERD/S and ErrPs during observation of correct feedback and errors. We also analyzed these EEG markers during passive AO under two conditions: when subjects anticipated the action demonstration and when the action was unexpected. A pre-action mu-ERD was found both before passive AO and during action anticipation within the BCI loop. Furthermore, a significant increase in beta-ERS was found during AO within incorrect BCI feedback trials. We suggest that the BCI feedback may exaggerate the passive-AO effect, as it engages feedback anticipation and estimation mechanisms as well as movement error monitoring simultaneously. The results of this study provide insights into the potential of P300-BCI with AO-feedback as a tool for neurorehabilitation.
Collapse
Affiliation(s)
- Nikolay Syrov
- V. Zelman Center for Neurobiology and Brain Rehabilitation, Skolkovo Institute of Science and Technology, Moscow, Russia
- Baltic Center for Neurotechnology and Artificial Intelligence, Immanuel Kant Baltic Federal University, Kaliningrad, Russia
- *Correspondence: Nikolay Syrov,
| | - Lev Yakovlev
- V. Zelman Center for Neurobiology and Brain Rehabilitation, Skolkovo Institute of Science and Technology, Moscow, Russia
- Baltic Center for Neurotechnology and Artificial Intelligence, Immanuel Kant Baltic Federal University, Kaliningrad, Russia
| | - Andrei Miroshnikov
- Baltic Center for Neurotechnology and Artificial Intelligence, Immanuel Kant Baltic Federal University, Kaliningrad, Russia
| | - Alexander Kaplan
- V. Zelman Center for Neurobiology and Brain Rehabilitation, Skolkovo Institute of Science and Technology, Moscow, Russia
- Baltic Center for Neurotechnology and Artificial Intelligence, Immanuel Kant Baltic Federal University, Kaliningrad, Russia
- Department of Human and Animal Physiology, Faculty of Biology, Lomonosov Moscow State University, Moscow, Russia
| |
Collapse
|
17
|
Syrov N, Bredikhin D, Yakovlev L, Miroshnikov A, Kaplan A. Mu-desynchronization, N400 and corticospinal excitability during observation of natural and anatomically unnatural finger movements. Front Hum Neurosci 2022; 16:973229. [PMID: 36118966 PMCID: PMC9480608 DOI: 10.3389/fnhum.2022.973229] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2022] [Accepted: 08/15/2022] [Indexed: 11/25/2022] Open
Abstract
The action observation networks (AON) (or the mirror neuron system) are the neural underpinnings of visuomotor integration and play an important role in motor control. Besides, one of the main functions of the human mirror neuron system is recognition of observed actions and the prediction of its outcome through the comparison with the internal mental motor representation. Previous studies focused on the human mirror neurons (MNs) activation during object-oriented movements observation, therefore intransitive movements observation effects on MNs activity remains relatively little-studied. Moreover, the dependence of MNs activation on the biomechanical characteristics of observed movement and their biological plausibility remained highly underexplored. In this study we proposed that naturalness of observed intransitive movement can modulate the MNs activity. Event-related desynchronization (ERD) of sensorimotor electroencephalography (EEG) rhythms, N400 event-related potentials (ERPs) component and corticospinal excitability were investigated in twenty healthy volunteers during observation of simple non-transitive finger flexion that might be either biomechanically natural or unnatural when finger wriggled out toward the dorsal side of palm. We showed that both natural and unnatural movements caused mu/beta-desynchronization, which gradually increased during the flexion phase and returned to baseline while observation of extension. Desynchronization of the mu-rhythm was significantly higher during observation of the natural movements. At the same time, beta-rhythm was not found to be sensitive to the action naturalness. Also, observation of unnatural movements caused an increased amplitude of the N400 component registered in the centro-parietal regions. We suggest that the sensitivity of N400 to intransitive action observation with no explicit semantic context might imply the broader role of N400 sources within AON. Surprisingly, no changes in corticospinal excitability were found. This lack of excitability modulation by action observation could be related with dependence of the M1 activity on the observed movement phase.
Collapse
Affiliation(s)
- Nikolay Syrov
- Baltic Center for Artificial Intelligence and Neurotechnology, Immanuel Kant Baltic Federal University, Kaliningrad, Russia
- V. Zelman Center for Neurobiology and Brain Restoration, Skolkovo Institute of Science and Technology, Moscow, Russia
- *Correspondence: Nikolay Syrov,
| | - Dimitri Bredikhin
- Department of Human and Animal Physiology, Faculty of Biology, M. V. Lomonosov Moscow State University, Moscow, Russia
- Department of Psychology, Centre for Cognition and Decision Making, National Research University Higher School of Economics, Moscow, Russia
| | - Lev Yakovlev
- Baltic Center for Artificial Intelligence and Neurotechnology, Immanuel Kant Baltic Federal University, Kaliningrad, Russia
- V. Zelman Center for Neurobiology and Brain Restoration, Skolkovo Institute of Science and Technology, Moscow, Russia
| | - Andrei Miroshnikov
- Baltic Center for Artificial Intelligence and Neurotechnology, Immanuel Kant Baltic Federal University, Kaliningrad, Russia
| | - Alexander Kaplan
- Baltic Center for Artificial Intelligence and Neurotechnology, Immanuel Kant Baltic Federal University, Kaliningrad, Russia
- Department of Human and Animal Physiology, Faculty of Biology, M. V. Lomonosov Moscow State University, Moscow, Russia
| |
Collapse
|
18
|
Franceschini M, Ottaviani M, Romano P, Goffredo M, Pournajaf S, Lofrumento M, Proietti S, Sterpi I, Tricomi E, Tropea P, Corbo M, Fadiga L, Infarinato F. The Reaching Phase of Feeding and Self-Care Actions Optimizes Action Observation Effects in Chronic Stroke Subjects. Neurorehabil Neural Repair 2022; 36:574-586. [PMID: 36000699 DOI: 10.1177/15459683221110884] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND The Action Observation Therapy (AOT) is a well-established post-stroke rehabilitation treatment based on the theoretical framework of the Mirror Neuron System (MNS) activation. However, AOT protocols are still heterogeneous in terms of video contents of observed actions. OBJECTIVE The aim of this study was to analyze electroencephalographic (EEG) recordings in stroke patients during the observation of different videos of task-specific upper limb movements, and to define which category of actions can elicit a stronger cortical activation in the observer's brain. METHODS Signals were analyzed from 19 chronic stroke subjects observing customized videos that represented 3 different categories of upper limb actions: Finalized Actions, Non-Finalized Actions, and Control Videos. The Event-Related Desynchronization in the µ and β bands was chosen to identify the involvement of the cerebral cortex: the area of the normalized power spectral density was calculated for each category and, deepening, for the reaching and completion sub-phases of Finalized Actions. For descriptive purposes, the time course of averaged signal power was described. The Kruskal-Wallis test (P < .05) was applied. RESULTS The analysis showed a greater desynchronization when subjects observed Finalized Actions with respect to Non-Finalized in all recorded areas; Control videos provoked a synchronization in the same areas and frequency bands. The reaching phase of feeding and self-care actions evoked a greater suppression both in µ and β bands. CONCLUSIONS The observation of finalized arm movements seems to elicit the strongest activation of the MNS in chronic stroke patients. This finding may help the clinicians to design future AOT-based stroke rehabilitation protocols. CLINICAL TRIAL REGISTRATION Clinical Trial Registration-URL: http://www.clinicaltrials.gov. Unique identifier: NCT04047134.
Collapse
Affiliation(s)
- Marco Franceschini
- Department of Neurological and Rehabilitation Sciences, IRCCS San Raffaele Roma, Rome, Italy.,San Raffaele University, Rome, Italy
| | - Marco Ottaviani
- Department of Neurological and Rehabilitation Sciences, IRCCS San Raffaele Roma, Rome, Italy
| | - Paola Romano
- Department of Neurological and Rehabilitation Sciences, IRCCS San Raffaele Roma, Rome, Italy
| | - Michela Goffredo
- Department of Neurological and Rehabilitation Sciences, IRCCS San Raffaele Roma, Rome, Italy
| | - Sanaz Pournajaf
- Department of Neurological and Rehabilitation Sciences, IRCCS San Raffaele Roma, Rome, Italy
| | - Margherita Lofrumento
- Department of Neurorehabilitation Sciences, Casa di Cura del Policlinico di Milano, Milano, Italy
| | | | - Irma Sterpi
- Department of Neurorehabilitation Sciences, Casa di Cura del Policlinico di Milano, Milano, Italy
| | - Enrica Tricomi
- Department of Neurorehabilitation Sciences, Casa di Cura del Policlinico di Milano, Milano, Italy
| | - Peppino Tropea
- Department of Neurorehabilitation Sciences, Casa di Cura del Policlinico di Milano, Milano, Italy
| | - Massimo Corbo
- Department of Neurorehabilitation Sciences, Casa di Cura del Policlinico di Milano, Milano, Italy
| | - Luciano Fadiga
- Center for Translational Neurophysiology, Istituto Italiano di Tecnologia, Ferrara, Italy.,Section of Physiology, Department of Neuroscience and Rehabilitation, University of Ferrara, Ferrara, Italy
| | - Francesco Infarinato
- Department of Neurological and Rehabilitation Sciences, IRCCS San Raffaele Roma, Rome, Italy
| |
Collapse
|
19
|
Mustile M, Kourtis D, Edwards MG, Donaldson DI, Ietswaart M. The neural response is heightened when watching a person approaching compared to walking away: Evidence for dynamic social neuroscience. Neuropsychologia 2022; 175:108352. [PMID: 36007672 DOI: 10.1016/j.neuropsychologia.2022.108352] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2021] [Revised: 07/30/2022] [Accepted: 08/15/2022] [Indexed: 11/24/2022]
Abstract
The action observation network has been proposed to play a key role in predicting the action intentions (or goals) of others, thereby facilitating social interaction. Key information when interacting with others is whether someone (an agent) is moving towards or away from us, indicating whether we are likely to interact with the person. In addition, to determine the nature of a social interaction, we also need to take into consideration the distance of the agent relative to us as the observer. How this kind of information is processed within the brain is unknown, at least in part because prior studies have not involved live whole-body motion. Consequently, here we recorded mobile EEG in 18 healthy participants, assessing the neural response to the modulation of direction (walking towards or away) and distance (near vs. far distance) during the observation of an agent walking. We evaluated whether cortical alpha and beta oscillations were modulated differently by direction and distance during action observation. We found that alpha was only modulated by distance, with a stronger decrease of power when the agent was further away from the observer, regardless of direction. Critically, by contrast, beta was found to be modulated by both distance and direction, with a stronger decrease of power when the agent was near and facing the participant (walking towards) compared to when they were near but viewed from the back (walking away). Analysis revealed differences in both the timing and distribution of alpha and beta oscillations. We argue that these data suggest a full understanding of action observation requires a new dynamic neuroscience, investigating actual interactions between real people, in real world environments.
Collapse
Affiliation(s)
- Magda Mustile
- Psychology, Faculty of Natural Sciences, University of Stirling, Stirling, UK.
| | - Dimitrios Kourtis
- Psychology, Faculty of Natural Sciences, University of Stirling, Stirling, UK
| | - Martin G Edwards
- Institute of Research in the Psychological Sciences, Université Catholique de Louvain, Louvain- la- Neuve, Belgium
| | - David I Donaldson
- School of Psychology and Neuroscience, University of St Andrews, St. Andrews, UK
| | - Magdalena Ietswaart
- Psychology, Faculty of Natural Sciences, University of Stirling, Stirling, UK
| |
Collapse
|
20
|
Tibrewal N, Leeuwis N, Alimardani M. Classification of motor imagery EEG using deep learning increases performance in inefficient BCI users. PLoS One 2022; 17:e0268880. [PMID: 35867703 PMCID: PMC9307149 DOI: 10.1371/journal.pone.0268880] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2021] [Accepted: 05/11/2022] [Indexed: 11/19/2022] Open
Abstract
Motor Imagery Brain-Computer Interfaces (MI-BCIs) are AI-driven systems that capture brain activity patterns associated with mental imagination of movement and convert them into commands for external devices. Traditionally, MI-BCIs operate on Machine Learning (ML) algorithms, which require extensive signal processing and feature engineering to extract changes in sensorimotor rhythms (SMR). In recent years, Deep Learning (DL) models have gained popularity for EEG classification as they provide a solution for automatic extraction of spatio-temporal features in the signals. However, past BCI studies that employed DL models, only attempted them with a small group of participants, without investigating the effectiveness of this approach for different user groups such as inefficient users. BCI inefficiency is a known and unsolved problem within BCI literature, generally defined as the inability of the user to produce the desired SMR patterns for the BCI classifier. In this study, we evaluated the effectiveness of DL models in capturing MI features particularly in the inefficient users. EEG signals from 54 subjects who performed a MI task of left- or right-hand grasp were recorded to compare the performance of two classification approaches; a ML approach vs. a DL approach. In the ML approach, Common Spatial Patterns (CSP) was used for feature extraction and then Linear Discriminant Analysis (LDA) model was employed for binary classification of the MI task. In the DL approach, a Convolutional Neural Network (CNN) model was constructed on the raw EEG signals. Additionally, subjects were divided into high vs. low performers based on their online BCI accuracy and the difference between the two classifiers’ performance was compared between groups. Our results showed that the CNN model improved the classification accuracy for all subjects within the range of 2.37 to 28.28%, but more importantly, this improvement was significantly larger for low performers. Our findings show promise for employment of DL models on raw EEG signals in future MI-BCI systems, particularly for BCI inefficient users who are unable to produce desired sensorimotor patterns for conventional ML approaches.
Collapse
Affiliation(s)
- Navneet Tibrewal
- Department of Cognitive Science and Artificial Intelligence, Tilburg University, Tilburg, The Netherlands
| | - Nikki Leeuwis
- Department of Cognitive Science and Artificial Intelligence, Tilburg University, Tilburg, The Netherlands
- Research Department, Unravel Research, Utrecht, The Netherlands
| | - Maryam Alimardani
- Department of Cognitive Science and Artificial Intelligence, Tilburg University, Tilburg, The Netherlands
- * E-mail:
| |
Collapse
|
21
|
Krol MA, Jellema T. Sensorimotor anticipation of others' actions in real-world and video settings: modulation by level of engagement? Soc Neurosci 2022; 17:293-304. [PMID: 35613478 DOI: 10.1080/17470919.2022.2083229] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Abstract
Electroencephalography (EEG) studies investigating social cognition have used both video and real-world stimuli, often without a strong reasoning why one or the other was chosen. Video stimuli can be selected for practical reasons, while naturalistic real-world stimuli are ecologically valid. The current study investigated modulatory effects on EEG mu (8 - 13 Hz) suppression, directly prior to the onset - and during the course - of observed actions, related to real-world and video settings. Recordings were made over sensorimotor cortex and stimuli in both settings consisted of identical (un)predictable object-related grasping and placing actions. In both settings a very similar mu suppression was found during unfolding of the action, irrespective of predictability. However, mu suppression related to the anticipation of upcoming predictable actions was found exclusively in the real-world setting. Thus, even though the presentation setting does not seem to modulate mu suppression during action observation, it does affect the anticipation-related mu suppression. We discuss the possibility that this may be due to increased social engagement in real-world settings, which in particular affects anticipation. The findings emphasise the importance of using real-world stimuli to bring out the subtle, anticipatory, aspects related to action observation.
Collapse
Affiliation(s)
- Manon A Krol
- Donders Centre for Cognitive Neuroimaging, Kapittelweg 29, 6525 EN, Nijmegen, The Netherlands
| | - Tjeerd Jellema
- The University of Hull Department of Psychology, Cottingham Road, HU6 7RX, Hull, United Kingdom
| |
Collapse
|
22
|
Spaccasassi C, Zanon M, Borgomaneri S, Avenanti A. Mu rhythm and corticospinal excitability capture two different frames of motor resonance: A TMS/EEG co-registration study. Cortex 2022; 154:197-211. [DOI: 10.1016/j.cortex.2022.04.019] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2021] [Revised: 03/28/2022] [Accepted: 04/18/2022] [Indexed: 11/03/2022]
|
23
|
Vecchiato G, Del Vecchio M, Ambeck-Madsen J, Ascari L, Avanzini P. EEG–EMG coupling as a hybrid method for steering detection in car driving settings. Cogn Neurodyn 2022; 16:987-1002. [PMID: 36237409 PMCID: PMC9508316 DOI: 10.1007/s11571-021-09776-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2021] [Revised: 12/03/2021] [Accepted: 12/23/2021] [Indexed: 11/28/2022] Open
Abstract
AbstractUnderstanding mental processes in complex human behavior is a key issue in driving, representing a milestone for developing user-centered assistive driving devices. Here, we propose a hybrid method based on electroencephalographic (EEG) and electromyographic (EMG) signatures to distinguish left and right steering in driving scenarios. Twenty-four participants took part in the experiment consisting of recordings of 128-channel EEG and EMG activity from deltoids and forearm extensors in non-ecological and ecological steering tasks. Specifically, we identified the EEG mu rhythm modulation correlates with motor preparation of self-paced steering actions in the non-ecological task, while the concurrent EMG activity of the left (right) deltoids correlates with right (left) steering. Consequently, we exploited the mu rhythm de-synchronization resulting from the non-ecological task to detect the steering side using cross-correlation analysis with the ecological EMG signals. Results returned significant cross-correlation values showing the coupling between the non-ecological EEG feature and the muscular activity collected in ecological driving conditions. Moreover, such cross-correlation patterns discriminate the steering side earlier relative to the single EMG signal. This hybrid system overcomes the limitation of the EEG signals collected in ecological settings such as low reliability, accuracy, and adaptability, thus adding to the EMG the characteristic predictive power of the cerebral data. These results prove how it is possible to complement different physiological signals to control the level of assistance needed by the driver.
Collapse
Affiliation(s)
- Giovanni Vecchiato
- Institute of Neuroscience, National Research Council of Italy, Via Volturno 39/E, 43125 Parma, Italy
| | - Maria Del Vecchio
- Institute of Neuroscience, National Research Council of Italy, Via Volturno 39/E, 43125 Parma, Italy
| | | | - Luca Ascari
- Camlin Italy S.R.L., Parma, Italy
- Henesis s.r.l., 43123 Parma, Italy
| | - Pietro Avanzini
- Institute of Neuroscience, National Research Council of Italy, Via Volturno 39/E, 43125 Parma, Italy
| |
Collapse
|
24
|
Robust anticipation of continuous steering actions from electroencephalographic data during simulated driving. Sci Rep 2021; 11:23383. [PMID: 34862442 PMCID: PMC8642531 DOI: 10.1038/s41598-021-02750-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2021] [Accepted: 10/26/2021] [Indexed: 11/08/2022] Open
Abstract
Driving a car requires high cognitive demands, from sustained attention to perception and action planning. Recent research investigated the neural processes reflecting the planning of driving actions, aiming to better understand the factors leading to driving errors and to devise methodologies to anticipate and prevent such errors by monitoring the driver’s cognitive state and intention. While such anticipation was shown for discrete driving actions, such as emergency braking, there is no evidence for robust neural signatures of continuous action planning. This study aims to fill this gap by investigating continuous steering actions during a driving task in a car simulator with multimodal recordings of behavioural and electroencephalography (EEG) signals. System identification is used to assess whether robust neurophysiological signatures emerge before steering actions. Linear decoding models are then used to determine whether such cortical signals can predict continuous steering actions with progressively longer anticipation. Results point to significant EEG signatures of continuous action planning. Such neural signals show consistent dynamics across participants for anticipations up to 1 s, while individual-subject neural activity could reliably decode steering actions and predict future actions for anticipations up to 1.8 s. Finally, we use canonical correlation analysis to attempt disentangling brain and non-brain contributors to the EEG-based decoding. Our results suggest that low-frequency cortical dynamics are involved in the planning of steering actions and that EEG is sensitive to that neural activity. As a result, we propose a framework to investigate anticipatory neural activity in realistic continuous motor tasks.
Collapse
|
25
|
Harjunen VJ, Sjö P, Ahmed I, Saarinen A, Farmer H, Salminen M, Järvelä S, Ruonala A, Jacucci G, Ravaja N. Increasing Self-Other Similarity Modulates Ethnic Bias in Sensorimotor Resonance to Others' Pain. Soc Cogn Affect Neurosci 2021; 17:673-682. [PMID: 34669949 PMCID: PMC9250302 DOI: 10.1093/scan/nsab113] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2021] [Revised: 10/01/2021] [Accepted: 10/20/2021] [Indexed: 11/15/2022] Open
Abstract
The tendency to simulate the pain of others within our own sensorimotor systems is a vital component of empathy. However, this sensorimotor resonance is modulated by a multitude of social factors including similarity in bodily appearance, e.g. skin colour. The current study investigated whether increasing self-other similarity via virtual transfer to another colour body reduced ingroup bias in sensorimotor resonance. A sample of 58 white participants was momentarily transferred to either a black or a white body using virtual reality technology. We then employed electroencephalography (EEG) to examine event-related desynchronization (ERD) in the sensorimotor beta (13-23 Hz) oscillations while they viewed black, white, and violet photorealistic virtual agents being touched with a noxious or soft object. While the noxious treatment of a violet agent did not increase beta ERD, amplified beta ERD in response to black agent's noxious vs. soft treatment was found in perceivers transferred to black body. Transfer to the white body dismissed the effect. Further exploratory analysis implied that the pain-related beta ERD occurred only when the agent and the participant were of the same colour. The results suggest that even short-lasting changes in bodily resemblance can modulate sensorimotor resonance to others' perceived pain.
Collapse
Affiliation(s)
- Ville Johannes Harjunen
- Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Helsinki, Finland
| | - Petja Sjö
- Finnish Institute for Health and Welfare, Helsinki, Finland
| | - Imtiaj Ahmed
- Department of Computer Science, University of Helsinki, Helsinki, Finland
| | - Aino Saarinen
- Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Helsinki, Finland
| | - Harry Farmer
- School of Human Sciences, University of Greenwich, London, United Kingdom.,Institute of Cognitive Neuroscience, University College London, London, United Kingdom
| | - Mikko Salminen
- Gamification Group, Faculty of Information Technology and Communications, Tampere University, Tampere, Finland
| | - Simo Järvelä
- Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Helsinki, Finland.,Gamification Group, Faculty of Information Technology and Communications, Tampere University, Tampere, Finland
| | - Antti Ruonala
- Department of Computer Science, University of Helsinki, Helsinki, Finland
| | - Giulio Jacucci
- Department of Computer Science, University of Helsinki, Helsinki, Finland
| | - Niklas Ravaja
- Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Helsinki, Finland
| |
Collapse
|
26
|
Quandt LC, Kubicek E, Willis A, Lamberton J. Enhanced biological motion perception in deaf native signers. Neuropsychologia 2021; 161:107996. [PMID: 34425145 DOI: 10.1016/j.neuropsychologia.2021.107996] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2020] [Revised: 07/22/2021] [Accepted: 08/17/2021] [Indexed: 02/06/2023]
Abstract
We conducted two studies to test how deaf signed language users perceive biological motions. We created 18 Biological Motion point-light displays (PLDs) depicting everyday human actions, and 18 Scrambled control PLDs. First, we conducted an online behavioral rating survey, in which deaf and hearing raters identified the biological motion PLDs and rated how easy it was for them to identify the actions. Then, we conducted an EEG study in which Deaf Signers and Hearing Non-Signers watched both the Biological Motion PLDs and the Scrambled PLDs, and we computed the time-frequency responses within the theta, alpha, and beta EEG rhythms. From the behavioral rating task, we show that the deaf raters reported significantly less effort required for identifying the Biological motion PLDs, across all stimuli. The EEG results showed that the Deaf Signers showed theta, mu, and beta differentiation between Scrambled and Biological PLDs earlier and more consistently than Hearing Non-Signers. We conclude that native ASL users exhibit experience-dependent neuroplasticity in the domain of biological human motion perception.
Collapse
Affiliation(s)
- Lorna C Quandt
- Ph.D in Educational Neuroscience Program, Gallaudet University, 800 Florida Ave NE, Washington, D.C. 20002, USA.
| | - Emily Kubicek
- Ph.D in Educational Neuroscience Program, Gallaudet University, 800 Florida Ave NE, Washington, D.C. 20002, USA
| | - Athena Willis
- Ph.D in Educational Neuroscience Program, Gallaudet University, 800 Florida Ave NE, Washington, D.C. 20002, USA
| | - Jason Lamberton
- VL2 Center, Gallaudet University, 800 Florida Ave NE, Washington, D.C. 20002, USA
| |
Collapse
|
27
|
Foldes ST, Chandrasekaran S, Camerone J, Lowe J, Ramdeo R, Ebersole J, Bouton CE. Case Study: Mapping Evoked Fields in Primary Motor and Sensory Areas via Magnetoencephalography in Tetraplegia. Front Neurol 2021; 12:739693. [PMID: 34630308 PMCID: PMC8497881 DOI: 10.3389/fneur.2021.739693] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2021] [Accepted: 08/13/2021] [Indexed: 12/02/2022] Open
Abstract
Devices interfacing with the brain through implantation in cortical or subcortical structures have great potential for restoration and rehabilitation in patients with sensory or motor dysfunction. Typical implantation surgeries are planned based on maps of brain activity generated from intact function. However, mapping brain activity for planning implantation surgeries is challenging in the target population due to abnormal residual function and, increasingly often, existing MRI-incompatible implanted hardware. Here, we present methods and results for mapping impaired somatosensory and motor function in an individual with paralysis and an existing brain–computer interface (BCI) device. Magnetoencephalography (MEG) was used to directly map the neural activity evoked during transcutaneous electrical stimulation and attempted movement of the impaired hand. Evoked fields were found to align with the expected anatomy and somatotopic organization. This approach may be valuable for guiding implants in other applications, such as cortical stimulation for pain and to improve implant targeting to help reduce the craniotomy size.
Collapse
Affiliation(s)
- Stephen T Foldes
- Department of Neurology, Barrow Neurological Institute, Phoenix, AZ, United States
| | - Santosh Chandrasekaran
- Neural Bypass and Brain-Computer Interface Laboratory, Institute of Bioelectronic Medicine, Feinstein Institutes for Medical Research at Northwell Health, New York, NY, United States
| | - Joseph Camerone
- MEG Center, Overlook Medical Center, Atlantic Health, Summit, NJ, United States
| | - James Lowe
- MEG Center, Overlook Medical Center, Atlantic Health, Summit, NJ, United States
| | - Richard Ramdeo
- Neural Bypass and Brain-Computer Interface Laboratory, Institute of Bioelectronic Medicine, Feinstein Institutes for Medical Research at Northwell Health, New York, NY, United States
| | - John Ebersole
- MEG Center, Overlook Medical Center, Atlantic Health, Summit, NJ, United States
| | - Chad E Bouton
- Neural Bypass and Brain-Computer Interface Laboratory, Institute of Bioelectronic Medicine, Feinstein Institutes for Medical Research at Northwell Health, New York, NY, United States.,Department of Molecular Medicine, Hofstra-Northwell Medical School, New York, NY, United States
| |
Collapse
|
28
|
Shibuya S, Unenaka S, Shimada S, Ohki Y. Distinct modulation of mu and beta rhythm desynchronization during observation of embodied fake hand rotation. Neuropsychologia 2021; 159:107952. [PMID: 34252417 DOI: 10.1016/j.neuropsychologia.2021.107952] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2021] [Revised: 06/16/2021] [Accepted: 07/06/2021] [Indexed: 12/17/2022]
Abstract
The rubber hand illusion (RHI) is a phenomenon whereby participants recognize a fake hand as their own. Studies have examined the effects of observing fake hand movements after the RHI on brain sensorimotor activity, although results remain controversial. To address these discrepancies, we investigated the effects of observation of fake hand rotation after the RHI on sensorimotor mu (μ: 8-13 Hz) and beta (β: 15-25 Hz) rhythm event-related desynchronization (ERD) using electroencephalography (EEG). Questionnaire results and proprioceptive drift revealed that the RHI occurred in participants when their invisible hand and fake visible hand were stroked synchronously but not during asynchronous stroking. Independent component (IC) clustering from EEG data during movement observation identified three IC clusters, including the right sensorimotor, left sensorimotor, and left occipital cluster. In the right sensorimotor cluster, we observed distinct modulation of μ and β ERD during fake hand rotation. Illusory ownership over the fake hand enhanced μ ERD but inversely attenuated β ERD. Further, the extent of μ ERD correlated with proprioceptive drift, but not with questionnaire ratings, whereas the converse results were obtained for β ERD. No ownership-dependent ERD modulation was detected in the left sensorimotor cluster. Alpha (α: 8-13 Hz) rhythm ERD of the left occipital cluster was smaller in the synchronous condition than in the asynchronous condition, but α ERD was not correlated with questionnaire rating or drift. These findings suggest that observing embodied fake hand rotation induces distinct cortical processing in sensorimotor brain areas.
Collapse
Affiliation(s)
- Satoshi Shibuya
- Department of Integrative Physiology, Kyorin University School of Medicine, 6-20-2 Shinkawa, Mitaka, Tokyo, Japan.
| | - Satoshi Unenaka
- Department of Sport Education, School of Lifelong Sport, Hokusho University, 23 Bunkyodai, Ebetsu, Hokkaido, Japan
| | - Sotaro Shimada
- Department of Electronics and Bioinformatics, School of Science and Technology, Meiji University, 1-1-1 Higashi-Mita, Tama-ku, Kawasaki, Kanagawa, Japan
| | - Yukari Ohki
- Department of Integrative Physiology, Kyorin University School of Medicine, 6-20-2 Shinkawa, Mitaka, Tokyo, Japan
| |
Collapse
|
29
|
Increasing self-other bodily overlap increases sensorimotor resonance to others' pain. COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2021; 20:19-33. [PMID: 31190136 PMCID: PMC7012796 DOI: 10.3758/s13415-019-00724-0] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
Empathy for another person’s pain and feeling pain oneself seem to be accompanied by similar or shared neural responses. Such shared responses could be achieved by mapping the bodily states of others onto our own bodily representations. We investigated whether sensorimotor neural responses to the pain of others are increased when experimentally reducing perceived bodily distinction between the self and the other. Healthy adult participants watched video clips of the hands of ethnic ingroup or outgroup members being painfully penetrated by a needle syringe or touched by a cotton swab. Manipulating the video presentation to create a visuospatial overlap between the observer’s and the target’s hand increased the perceived bodily self-attribution of the target’s hand. For both ingroup and outgroup targets, this resulted in increased neural responses to the painful injections (compared with nonpainful contacts), as indexed by desynchronizations of central mu and beta scalp rhythms recorded using electroencephalography. Furthermore, these empathy-related neural activations were stronger in participants who reported stronger bodily self-attribution of the other person’s hand. Our findings provide further evidence that empathy for pain engages sensorimotor resonance mechanisms. They also indicate that reducing bodily self-other distinction may increase such resonance for ingroup as well as outgroup targets.
Collapse
|
30
|
Jelinčić V, Van Diest I, Torta DM, von Leupoldt A. The breathing brain: The potential of neural oscillations for the understanding of respiratory perception in health and disease. Psychophysiology 2021; 59:e13844. [PMID: 34009644 DOI: 10.1111/psyp.13844] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Revised: 04/21/2021] [Accepted: 04/23/2021] [Indexed: 11/30/2022]
Abstract
Dyspnea or breathlessness is a symptom occurring in multiple acute and chronic illnesses, however, the understanding of the neural mechanisms underlying its subjective experience is limited. In this topical review, we propose neural oscillatory dynamics and cross-frequency coupling as viable candidates for a neural mechanism underlying respiratory perception, and a technique warranting more attention in respiration research. With the evidence for the potential of neural oscillations in the study of normal and disordered breathing coming from disparate research fields with a limited history of interdisciplinary collaboration, the main objective of the review was to converge the existing research and suggest future directions. The existing findings show that distinct limbic and cortical activations, as measured by hemodynamic responses, underlie dyspnea, however, the time-scale of these activations is not well understood. The recent findings of oscillatory neural activity coupled with the respiratory rhythm could provide the solution to this problem, however, more research with a focus on dyspnea is needed. We also touch on the findings of distinct spectral patterns underlying the changes in breathing due to experimental manipulations, meditation and disease. Subsequently, we suggest general research directions and specific research designs to supplement the current knowledge using neural oscillation techniques. We argue for the benefits of interdisciplinary collaboration and the converging of neuroimaging and behavioral methods to best explain the emergence of the subjective and aversive individual experience of dyspnea.
Collapse
Affiliation(s)
- Valentina Jelinčić
- Research Group Health Psychology, Department of Psychology, KU Leuven, Leuven, Belgium
| | - Ilse Van Diest
- Research Group Health Psychology, Department of Psychology, KU Leuven, Leuven, Belgium
| | - Diana M Torta
- Research Group Health Psychology, Department of Psychology, KU Leuven, Leuven, Belgium
| | - Andreas von Leupoldt
- Research Group Health Psychology, Department of Psychology, KU Leuven, Leuven, Belgium
| |
Collapse
|
31
|
Momsen J, Gordon J, Wu YC, Coulson S. Event related spectral perturbations of gesture congruity: Visuospatial resources are recruited for multimodal discourse comprehension. BRAIN AND LANGUAGE 2021; 216:104916. [PMID: 33652372 DOI: 10.1016/j.bandl.2021.104916] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/16/2020] [Revised: 11/30/2020] [Accepted: 01/08/2021] [Indexed: 06/12/2023]
Abstract
Here we examine the role of visuospatial working memory (WM) during the comprehension of multimodal discourse with co-speech iconic gestures. EEG was recorded as healthy adults encoded either a sequence of one (low load) or four (high load) dot locations on a grid and rehearsed them until a free recall response was collected later in the trial. During the rehearsal period of the WM task, participants observed videos of a speaker describing objects in which half of the trials included semantically related co-speech gestures (congruent), and the other half included semantically unrelated gestures (incongruent). Discourse processing was indexed by oscillatory EEG activity in the alpha and beta bands during the videos. Across all participants, effects of speech and gesture incongruity were more evident in low load trials than in high load trials. Effects were also modulated by individual differences in visuospatial WM capacity. These data suggest visuospatial WM resources are recruited in the comprehension of multimodal discourse.
Collapse
Affiliation(s)
- Jacob Momsen
- Joint Doctoral Program Language and Communicative Disorders, San Diego State University and UC San Diego, United States
| | - Jared Gordon
- Cognitive Science Department, UC San Diego, United States
| | - Ying Choon Wu
- Swartz Center for Computational Neuroscience, UC San Diego, United States
| | - Seana Coulson
- Joint Doctoral Program Language and Communicative Disorders, San Diego State University and UC San Diego, United States; Cognitive Science Department, UC San Diego, United States.
| |
Collapse
|
32
|
Rizzolatti G, Fabbri-Destro M, Nuara A, Gatti R, Avanzini P. The role of mirror mechanism in the recovery, maintenance, and acquisition of motor abilities. Neurosci Biobehav Rev 2021; 127:404-423. [PMID: 33910057 DOI: 10.1016/j.neubiorev.2021.04.024] [Citation(s) in RCA: 34] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2020] [Revised: 03/12/2021] [Accepted: 04/20/2021] [Indexed: 10/21/2022]
Abstract
While it is well documented that the motor system is more than a mere implementer of motor actions, the possible applications of its cognitive side are still under-exploited, often remaining as poorly organized evidence. Here, we will collect evidence showing the value of action observation treatment (AOT) in the recovery of impaired motor abilities for a vast number of clinical conditions, spanning from traumatological patients to brain injuries and neurodegenerative diseases. Alongside, we will discuss the use of AOT in the maintenance of appropriate motor behavior in subjects at risk for events with dramatic physical consequences, like fall prevention in elderly people or injury prevention in sports. Finally, we will report that AOT can help to tune existing motor competencies in fields requiring precise motor control. We will connect all these diverse dots into the neurophysiological scenario offered by decades of research on the human mirror mechanism, discussing the potentialities for individualization. Empowered by modern technologies, AOT can impact individuals' safety and quality of life across the whole lifespan.
Collapse
Affiliation(s)
- Giacomo Rizzolatti
- Consiglio Nazionale delle Ricerche, Istituto di Neuroscienze, Parma, Italy
| | | | - Arturo Nuara
- Consiglio Nazionale delle Ricerche, Istituto di Neuroscienze, Parma, Italy; Università di Modena e Reggio Emilia, Dipartimento di Scienze Biomediche, Metaboliche, e Neuroscienze, Modena, Italy
| | - Roberto Gatti
- Istituto Clinico Humanitas, Humanitas Clinical and Research Center, Rozzano, Milan, Italy
| | - Pietro Avanzini
- Consiglio Nazionale delle Ricerche, Istituto di Neuroscienze, Parma, Italy; Istituto Clinico Humanitas, Humanitas Clinical and Research Center, Rozzano, Milan, Italy.
| |
Collapse
|
33
|
Cross KA, Malekmohammadi M, Woo Choi J, Pouratian N. Movement-related changes in pallidocortical synchrony differentiate action execution and observation in humans. Clin Neurophysiol 2021; 132:1990-2001. [PMID: 33980469 DOI: 10.1016/j.clinph.2021.03.037] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2020] [Revised: 02/02/2021] [Accepted: 03/15/2021] [Indexed: 01/21/2023]
Abstract
OBJECTIVE Suppression of local and network alpha and beta oscillations in the human basal ganglia-thalamocortical (BGTC) circuit is a prominent feature of movement, including suppression of local alpha/beta power, cross-region beta phase coupling, and cortical and subcortical phase-amplitude coupling (PAC). We hypothesized that network-level coupling is more directly related to movement execution than local power changes, given the role of pathological network hypersynchrony in movement disorders such as Parkinson disease (PD). Understanding the specificity of these movement-related signals is important for designing novel therapeutics. METHODS We recorded globus pallidus internus (GPi) and motor cortical local field potentials during movement execution, passive movement observation and rest in 12 patients with PD undergoing deep brain stimulator implantation. RESULTS Local alpha/beta power is suppressed in the globus pallidus and motor cortex during both action execution and action observation, although less so during action observation. In contrast, pallidocortical phase synchrony and GPi and motor cortical alpha/beta-gamma PAC are suppressed only during action execution. CONCLUSIONS The functional dissociation across tasks in pallidocortical network activity suggests a particularly important role of network coupling in motor execution. SIGNIFICANCE Network level recordings provide important specificity in differentiating motor behavior and may provide significant value for future closed loop therapies.
Collapse
Affiliation(s)
- Katy A Cross
- Department of Neurology, University of California, Los Angeles, USA.
| | | | - Jeong Woo Choi
- Department of Neurosurgery, University of California, Los Angeles, USA
| | - Nader Pouratian
- Department of Neurosurgery, University of California, Los Angeles, USA
| |
Collapse
|
34
|
Catrambone V, Averta G, Bianchi M, Valenza G. Toward brain-heart computer interfaces: a study on the classification of upper limb movements using multisystem directional estimates. J Neural Eng 2021; 18. [PMID: 33601354 DOI: 10.1088/1741-2552/abe7b9] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2020] [Accepted: 02/18/2021] [Indexed: 12/13/2022]
Abstract
OBJECTIVE Brain-computer interfaces (BCI) exploit computational features from brain signals to perform a given task. Despite recent neurophysiology and clinical findings indicating the crucial role of functional interplay between brain and cardiovascular dynamics in locomotion, heartbeat information remains to be included in common BCI systems. In this study, we exploit the multidimensional features of directional and functional interplay between electroencephalographic and heartbeat spectra to classify upper limb movements into three classes. APPROACH We gathered data from 26 healthy volunteers that performed 90 movements; the data were processed using a recently proposed framework for brain-heart interplay (BHI) assessment based on synthetic physiological data generation. Extracted BHI features were employed to classify, through sequential forward selection scheme and k-nearest neighbors algorithm, among resting state and three classes of movements according to the kind of interaction with objects. MAIN RESULTS The results demonstrated that the proposed brain-heart computer interface (BHCI) system could distinguish between rest and movement classes automatically with an average 90% of accuracy. SIGNIFICANCE Further, this study provides neurophysiology insights indicating the crucial role of functional interplay originating at the cortical level onto the heart in the upper limb neural control. The inclusion of functional BHI insights might substantially improve the neuroscientific knowledge about motor control, and this may lead to advanced BHCI systems performances.
Collapse
Affiliation(s)
- Vincenzo Catrambone
- Research Center E. Piaggio, Information Engineering, University of Pisa School of Engineering, Largo L. Lazzarino,1, Pisa, Italy, 56126, ITALY
| | - Giuseppe Averta
- Research Center E. Piaggio, Information Engineering, University of Pisa School of Engineering, Largo L. Lazzarino, 1, Pisa, Italy, 56126, ITALY
| | - Matteo Bianchi
- Research Center E. Piaggio, Information Engineering, University of Pisa School of Engineering, Largo L. Lazzarino, 1, Pisa, Toscana, 56126, ITALY
| | - Gaetano Valenza
- Research Center E. Piaggio, Information Engineering, University of Pisa School of Engineering, Largo L. Lazzarino, 1, Pisa, Toscana, 56126, ITALY
| |
Collapse
|
35
|
Shearer DA, Leeworthy S, Jones S, Rickards E, Blake M, Heirene RM, Gross MJ, Bruton AM. There Is an "Eye" in Team: Exploring the Interplay Between Emotion, Gaze Behavior, and Collective Efficacy in Team Sport Settings. Front Sports Act Living 2020; 2:18. [PMID: 33345012 PMCID: PMC7739631 DOI: 10.3389/fspor.2020.00018] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2019] [Accepted: 02/17/2020] [Indexed: 11/18/2022] Open
Abstract
Little is understood about the attentional mechanisms that lead to perceptions of collective efficacy. This paper presents two studies that address this lack of understanding. Study one examined participant's (N = 59) attentional processes relating to positive, neutral, or negative emotional facial photographs, when instructed to select their “most confident” or “least confident” team. Eye gaze metrics of first fixation duration (FFD), fixation duration (FD), and fixation count (FC) were measured alongside individual perceptions of collective efficacy and emotional valence of the teams selected. Participants had shorter FFD, longer FD, and more FC on positive faces when instructed to select their most confident team (p < 0.05). Collective efficacy and emotional valence were significantly greater when participants selected their most confident team (p < 0.05). Study two explored the influence of video content familiarity of team-based observation interventions on attentional processes and collective efficacy in interdependent team-sport athletes (N = 34). When participants were exposed to familiar (own team/sport) and unfamiliar (unknown team/sport) team-based performance video, eye tracking data revealed similar gaze behaviors for the two conditions in terms of areas of interest. However, collective efficacy increased most for the familiar condition. Study one results indicate that the emotional expressions of team members influence both where and for how long we look at potential team members, and that conspecifics' emotional expression impacts on our perceptions of collective efficacy. For Study two, given the apparent greater increase in collective efficacy for the familiar condition, the similar attentional processes evident for familiar and unfamiliar team footage suggests that differences in meaning of the observed content dictates collective efficacy perceptions. Across both studies, the findings indicate the importance of positive emotional vicarious experiences when using team-based observation interventions to improve collective efficacy in teams.
Collapse
Affiliation(s)
- David A Shearer
- School of Psychology and Therapeutic Studies, University of South Wales, Treforest, United Kingdom.,Welsh Institute of Performance Science, Swansea, United Kingdom
| | - Shona Leeworthy
- School of Psychology and Therapeutic Studies, University of South Wales, Treforest, United Kingdom
| | - Sarah Jones
- School of Psychology and Therapeutic Studies, University of South Wales, Treforest, United Kingdom
| | - Emma Rickards
- School of Psychology and Therapeutic Studies, University of South Wales, Treforest, United Kingdom
| | - Mason Blake
- Sport and Exercise Science Research Centre, Department of Life Sciences, Whitelands College, University of Roehampton, London, United Kingdom
| | - Robert M Heirene
- Brain and Mind Centre, School of Psychology, University of Sydney, Sydney, NSW, Australia
| | - Mike J Gross
- School of Psychology and Therapeutic Studies, University of South Wales, Treforest, United Kingdom.,Welsh Institute of Performance Science, Swansea, United Kingdom
| | - Adam M Bruton
- Sport and Exercise Science Research Centre, Department of Life Sciences, Whitelands College, University of Roehampton, London, United Kingdom
| |
Collapse
|
36
|
He Y, Luell S, Muralikrishnan R, Straube B, Nagels A. Gesture's body orientation modulates the N400 for visual sentences primed by gestures. Hum Brain Mapp 2020; 41:4901-4911. [PMID: 32808721 PMCID: PMC7643362 DOI: 10.1002/hbm.25166] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2020] [Revised: 07/16/2020] [Accepted: 07/23/2020] [Indexed: 01/08/2023] Open
Abstract
Body orientation of gesture entails social-communicative intention, and may thus influence how gestures are perceived and comprehended together with auditory speech during face-to-face communication. To date, despite the emergence of neuroscientific literature on the role of body orientation on hand action perception, limited studies have directly investigated the role of body orientation in the interaction between gesture and language. To address this research question, we carried out an electroencephalography (EEG) experiment presenting to participants (n = 21) videos of frontal and lateral communicative hand gestures of 5 s (e.g., raising a hand), followed by visually presented sentences that are either congruent or incongruent with the gesture (e.g., "the mountain is high/low…"). Participants underwent a semantic probe task, judging whether a target word is related or unrelated to the gesture-sentence event. EEG results suggest that, during the perception phase of handgestures, while both frontal and lateral gestures elicited a power decrease in both the alpha (8-12 Hz) and the beta (16-24 Hz) bands, lateral versus frontal gestures elicited reduced power decrease in the beta band, source-located to the medial prefrontal cortex. For sentence comprehension, at the critical word whose meaning is congruent/incongruent with the gesture prime, frontal gestures elicited an N400 effect for gesture-sentence incongruency. More importantly, this incongruency effect was significantly reduced for lateral gestures. These findings suggest that body orientation plays an important role in gesture perception, and that its inferred social-communicative intention may influence gesture-language interaction at semantic level.
Collapse
Affiliation(s)
- Yifei He
- Department of Psychiatry and PsychotherapyPhilipps‐University MarburgMarburgGermany
| | - Svenja Luell
- Department of General LinguisticsJohannes‐Gutenberg University MainzMainzGermany
| | - R. Muralikrishnan
- Department of NeuroscienceMax Planck Institute for Empirical AestheticsFrankfurtGermany
| | - Benjamin Straube
- Department of Psychiatry and PsychotherapyPhilipps‐University MarburgMarburgGermany
| | - Arne Nagels
- Department of General LinguisticsJohannes‐Gutenberg University MainzMainzGermany
| |
Collapse
|
37
|
Schultz BG, Biau E, Kotz SA. An open-source toolbox for measuring dynamic video framerates and synchronizing video stimuli with neural and behavioral responses. J Neurosci Methods 2020; 343:108830. [DOI: 10.1016/j.jneumeth.2020.108830] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2020] [Revised: 06/21/2020] [Accepted: 06/23/2020] [Indexed: 11/28/2022]
|
38
|
Garakh Z, Novototsky-Vlasov V, Larionova E, Zaytseva Y. Mu rhythm separation from the mix with alpha rhythm: Principal component analyses and factor topography. J Neurosci Methods 2020; 346:108892. [PMID: 32763271 DOI: 10.1016/j.jneumeth.2020.108892] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2019] [Revised: 07/29/2020] [Accepted: 08/01/2020] [Indexed: 10/23/2022]
Abstract
BACKGROUND EEG mu rhythm suppression is assessed in experiments on the execution, observation and imagination of movements. It is utilised for studying of actions, language, empathy in healthy individuals and preservation of sensorimotor system functions in patients with schizophrenia and autism spectrum disorders. While EEG alpha and mu rhythms are recorded in the same frequency range (8-13 Hz), their specification becomes a serious issue. THE NEW METHOD: is based on the spatial and functional characteristics of the mu wave, which are: (1) the mu rhythm is located over the sensorimotor cortex; (2) it desynchronises during movement processing and does not respond on the eyes opening. In EEG recordings, we analysed the mu rhythm under conditions with eyes opened and eyes closed (baseline), and during a motor imagery task with eyes closed. EEG recordings were processed by principal component analysis (PCA). RESULTS The analysis of EEG data with the proposed approach revealed the maximum spectral power of mu rhythm localised in the sensorimotor areas. During motor imagery, mu rhythm was suppressed more in frontal and central sites than in occipital sites, whereas alpha rhythm was suppressed more in parietal and occipital sites. Mu rhythm desynchronization in sensorimotor sites during motor imagery was greater than alpha rhythm desynchronization. The proposed method enabled EEG mu rhythm separation from its mix with alpha rhythm. CONCLUSIONS EEG mu rhythm separation with the proposed method satisfies its classical definition.
Collapse
Affiliation(s)
- Zhanna Garakh
- Institute of Higher Nervous Activity and Neurophysiology of Russian Academy of Science, Moscow, Russian Federation
| | - Vladimir Novototsky-Vlasov
- Institute of Higher Nervous Activity and Neurophysiology of Russian Academy of Science, Moscow, Russian Federation; Serbsky National Medical Research Centre for Psychiatry and Narcology, Moscow, Russian Federation
| | - Ekaterina Larionova
- Institute of Higher Nervous Activity and Neurophysiology of Russian Academy of Science, Moscow, Russian Federation
| | - Yuliya Zaytseva
- National Institute of Mental Health, Klecany, Czech Republic; Department of Psychiatry and Medical Psychology, 3rd Faculty of Medicine, Charles University in Prague, Prague, Czech Republic; Human Science Centre, Institute of Medical Psychology, Ludwig-Maximilian University, Munich, Germany.
| |
Collapse
|
39
|
Xiong X, Yu Z, Ma T, Luo N, Wang H, Lu X, Fan H. Weighted Brain Network Metrics for Decoding Action Intention Understanding Based on EEG. Front Hum Neurosci 2020; 14:232. [PMID: 32714168 PMCID: PMC7343772 DOI: 10.3389/fnhum.2020.00232] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2020] [Accepted: 05/27/2020] [Indexed: 11/23/2022] Open
Abstract
Background: Understanding the action intentions of others is important for social and human-robot interactions. Recently, many state-of-the-art approaches have been proposed for decoding action intention understanding. Although these methods have some advantages, it is still necessary to design other tools that can more efficiently classify the action intention understanding signals. New Method: Based on EEG, we first applied phase lag index (PLI) and weighted phase lag index (WPLI) to construct functional connectivity matrices in five frequency bands and 63 micro-time windows, then calculated nine graph metrics from these matrices and subsequently used the network metrics as features to classify different brain signals related to action intention understanding. Results: Compared with the single methods (PLI or WPLI), the combination method (PLI+WPLI) demonstrates some overwhelming victories. Most of the average classification accuracies exceed 70%, and some of them approach 80%. In statistical tests of brain network, many significantly different edges appear in the frontal, occipital, parietal, and temporal regions. Conclusions: Weighted brain networks can effectively retain data information. The integrated method proposed in this study is extremely effective for investigating action intention understanding. Both the mirror neuron and mentalizing systems participate as collaborators in the process of action intention understanding.
Collapse
Affiliation(s)
- Xingliang Xiong
- Key Laboratory of Child Development and Learning Science of Ministry of Education, School of Biological Science & Medical Engineering, Southeast University, Nanjing, China
| | - Zhenhua Yu
- College of Computer Science and Technology, Xi'an University of Science and Technology, Xi'an, China
| | - Tian Ma
- College of Computer Science and Technology, Xi'an University of Science and Technology, Xi'an, China
| | - Ning Luo
- Institute of Software, Chinese Academy of Sciences, Beijing, China
| | - Haixian Wang
- Key Laboratory of Child Development and Learning Science of Ministry of Education, School of Biological Science & Medical Engineering, Southeast University, Nanjing, China
- *Correspondence: Haixian Wang
| | - Xuesong Lu
- Department of Rehabilitation, Zhongda Hospital, Southeast University, Nanjing, China
- Xuesong Lu
| | - Hui Fan
- Co-innovation Center of Shandong Colleges and Universities: Future Intelligent Computing, Shandong Technology and Business University, Yantai, China
| |
Collapse
|
40
|
Confais J, Malfait N, Brochier T, Riehle A, Kilavik BE. Is there an Intrinsic Relationship between LFP Beta Oscillation Amplitude and Firing Rate of Individual Neurons in Macaque Motor Cortex? Cereb Cortex Commun 2020; 1:tgaa017. [PMID: 34296095 PMCID: PMC8152857 DOI: 10.1093/texcom/tgaa017] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2020] [Revised: 03/25/2020] [Accepted: 05/07/2020] [Indexed: 11/18/2022] Open
Abstract
The properties of motor cortical local field potential (LFP) beta oscillations have been extensively studied. Their relationship to the local neuronal spiking activity was also addressed. Yet, whether there is an intrinsic relationship between the amplitude of beta oscillations and the firing rate of individual neurons remains controversial. Some studies suggest a mapping of spike rate onto beta amplitude, while others find no systematic relationship. To help resolve this controversy, we quantified in macaque motor cortex the correlation between beta amplitude and neuronal spike count during visuomotor behavior. First, in an analysis termed “task-related correlation”, single-trial data obtained across all trial epochs were included. These correlations were significant in up to 32% of cases and often strong. However, a trial-shuffling control analysis recombining beta amplitudes and spike counts from different trials revealed these task-related correlations to reflect systematic, yet independent, modulations of the 2 signals with the task. Second, in an analysis termed “trial-by-trial correlation”, only data from fixed trial epochs were included, and correlations were calculated across trials. Trial-by-trial correlations were weak and rarely significant. We conclude that there is no intrinsic relationship between the firing rate of individual neurons and LFP beta oscillation amplitude in macaque motor cortex.
Collapse
Affiliation(s)
- Joachim Confais
- Institut de Neurosciences de la Timone (INT), UMR 7289, CNRS, Aix-Marseille Université, Marseille 13005, France.,Cynbiose, Marcy l'Étoile 69280, France
| | - Nicole Malfait
- Institut de Neurosciences de la Timone (INT), UMR 7289, CNRS, Aix-Marseille Université, Marseille 13005, France
| | - Thomas Brochier
- Institut de Neurosciences de la Timone (INT), UMR 7289, CNRS, Aix-Marseille Université, Marseille 13005, France
| | - Alexa Riehle
- Institut de Neurosciences de la Timone (INT), UMR 7289, CNRS, Aix-Marseille Université, Marseille 13005, France.,Institute of Neuroscience and Medicine (INM-6), Jülich Research Centre, Jülich 52428, Germany
| | - Bjørg Elisabeth Kilavik
- Institut de Neurosciences de la Timone (INT), UMR 7289, CNRS, Aix-Marseille Université, Marseille 13005, France
| |
Collapse
|
41
|
Xiong X, Yu Z, Ma T, Wang H, Lu X, Fan H. Classifying action intention understanding EEG signals based on weighted brain network metric features. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2020.101893] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
42
|
Ikeda Y, Nishimura Y, Shin N, Higuchi S. A study of EEG mu neurofeedback during action observation. Exp Brain Res 2020; 238:1277-1284. [PMID: 32303811 DOI: 10.1007/s00221-020-05808-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2019] [Accepted: 04/10/2020] [Indexed: 11/29/2022]
Abstract
The mirror system is a brain network that gets activated during action performance and observation. Brain mu waves have been used as a mirror system activity index; however, mu rhythm is prone to contamination by occipital alpha wave activity, thus raising a concern regarding its reliability as an index of the mirror system activity. In this study, we investigated whether mu suppression can be used as an index of neurofeedback training, which influences mirror system activities. Participants observed videos of hand movement under three different conditions: central mu feedback (muFB), occipital alpha feedback (aFB), and simple observation without any feedback (OBS). Results showed that at the 4-5 min mark, mu wave was most significantly suppressed in the central site at muFB. We thus demonstrated the possibility of increasing mu wave suppression in feedback training using a specific stimulus such as motion observation.
Collapse
Affiliation(s)
- Yuki Ikeda
- Graduate School of Integrated Frontier Sciences, Kyushu University, 4-9-1 Shiobaru, Minami-Ku, Fukuoka, Japan. .,Research Fellow of the Japan Society for the Promotion of Science, Kojimachi Business Center Building, 5-3-1 Kojimachi, Chiyoda-ku, Tokyo, Japan.
| | - Yuki Nishimura
- Graduate School of Integrated Frontier Sciences, Kyushu University, 4-9-1 Shiobaru, Minami-Ku, Fukuoka, Japan.,Research Fellow of the Japan Society for the Promotion of Science, Kojimachi Business Center Building, 5-3-1 Kojimachi, Chiyoda-ku, Tokyo, Japan.,National Institute of Occupational Safety and Health, Nagao 6-21-1, Tama-ku, Kawasaki, 214-8585, Japan
| | - Nakyeong Shin
- Graduate School of Integrated Frontier Sciences, Kyushu University, 4-9-1 Shiobaru, Minami-Ku, Fukuoka, Japan
| | - Shigekazu Higuchi
- Faculty of Design, Kyushu University, 4-9-1 Shiobaru, Minami-Ku, Fukuoka, Japan
| |
Collapse
|
43
|
De Marco D, Scalona E, Bazzini MC, Avanzini P, Fabbri-Destro M. Observer-Agent Kinematic Similarity Facilitates Action Intention Decoding. Sci Rep 2020; 10:2605. [PMID: 32054915 PMCID: PMC7018748 DOI: 10.1038/s41598-020-59176-z] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2019] [Accepted: 01/22/2020] [Indexed: 11/12/2022] Open
Abstract
It is well known that the kinematics of an action is modulated by the underlying motor intention. In turn, kinematics serves as a cue also during action observation, providing hints about the intention of the observed action. However, an open question is whether decoding others’ intentions on the basis of their kinematics depends solely on how much the kinematics varies across different actions, or rather it is also influenced by its similarity with the observer motor repertoire. The execution of reach-to-grasp and place actions, differing for target size and context, was recorded in terms of upper-limb kinematics in 21 volunteers and in an actor. Volunteers had later to observe the sole reach-to-grasp phase of the actor’s actions, and predict the underlying intention. The potential benefit of the kinematic actor-participant similarity for recognition accuracy was evaluated. In execution, both target size and context modulated specific kinematic parameters. More importantly, although participants performed above chance in intention recognition, the similarity of motor patterns positively correlated with recognition accuracy. Overall, these data indicate that kinematic similarity exerts a facilitative role in intention recognition, providing further support to the view of action intention recognition as a visuo-motor process grounded in motor resonance.
Collapse
Affiliation(s)
- Doriana De Marco
- Consiglio Nazionale delle Ricerche (CNR), Istituto di Neuroscienze, sede di Parma, Italy.
| | - Emilia Scalona
- Consiglio Nazionale delle Ricerche (CNR), Istituto di Neuroscienze, sede di Parma, Italy
| | - Maria Chiara Bazzini
- Consiglio Nazionale delle Ricerche (CNR), Istituto di Neuroscienze, sede di Parma, Italy
| | - Pietro Avanzini
- Consiglio Nazionale delle Ricerche (CNR), Istituto di Neuroscienze, sede di Parma, Italy
| | | |
Collapse
|
44
|
Gianelli C, Kühne K, Lo Presti S, Mencaraglia S, Dalla Volta R. Action processing in the motor system: Transcranial Magnetic Stimulation (TMS) evidence of shared mechanisms in the visual and linguistic modalities. Brain Cogn 2020; 139:105510. [PMID: 31923805 DOI: 10.1016/j.bandc.2019.105510] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2019] [Revised: 11/26/2019] [Accepted: 12/09/2019] [Indexed: 11/17/2022]
Abstract
In two experiments, we compared the dynamics of corticospinal excitability when processing visually or linguistically presented tool-oriented hand actions in native speakers and sequential bilinguals. In a third experiment we used the same procedure to test non-motor, low-level stimuli, i.e. scrambled images and pseudo-words. Stimuli were presented in sequence: pictures (tool + tool-oriented hand action or their scrambled counterpart) and words (tool noun + tool-action verb or pseudo-words). Experiment 1 presented German linguistic stimuli to native speakers, while Experiment 2 presented English stimuli to non-natives. Experiment 3 tested Italian native speakers. Single-pulse trascranial magnetic stimulation (spTMS) was applied to the left motor cortex at five different timings: baseline, 200 ms after tool/noun onset, 150, 350 and 500 ms after hand/verb onset with motor-evoked potentials (MEPs) recorded from the first dorsal interosseous (FDI) and abductor digiti minimi (ADM) muscles. We report strong similarities in the dynamics of corticospinal excitability across the visual and linguistic modalities. MEPs' suppression started as early as 150 ms and lasted for the duration of stimulus presentation (500 ms). Moreover, we show that this modulation is absent for stimuli with no motor content. Overall, our study supports the notion of a core, overarching system of action semantics shared by different modalities.
Collapse
Affiliation(s)
- Claudia Gianelli
- Division of Cognitive Sciences, University of Potsdam, Germany; IUSS, University School of Advanced Studies, Pavia, Italy.
| | - Katharina Kühne
- Division of Cognitive Sciences, University of Potsdam, Germany
| | - Sara Lo Presti
- IUSS, University School of Advanced Studies, Pavia, Italy
| | | | - Riccardo Dalla Volta
- Department of Medical and Surgical Sciences, Università Magna Graecia, Catanzaro, Italy.
| |
Collapse
|
45
|
Festante F, Ferrari PF, Thorpe SG, Buchanan RW, Fox NA. Intranasal oxytocin enhances EEG mu rhythm desynchronization during execution and observation of social action: An exploratory study. Psychoneuroendocrinology 2020; 111:104467. [PMID: 31630052 PMCID: PMC6897365 DOI: 10.1016/j.psyneuen.2019.104467] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/27/2018] [Revised: 09/22/2019] [Accepted: 09/24/2019] [Indexed: 01/09/2023]
Abstract
Intranasal administration of oxytocin (OT) has been found to facilitate prosocial behaviors, emotion recognition and cooperation between individuals. Recent electroencephalography (EEG) investigations have reported enhanced mu rhythm (alpha: 8-13 Hz; beta: 15-25 Hz) desynchronization during the observation of biological motion and stimuli probing social synchrony after the administration of intranasal OT. This hormone may therefore target a network of cortical circuits involved in higher cognitive functions, including the mirror neuron system (MNS). Here, in a double-blind, placebo-controlled, between-subjects exploratory study, we investigated whether intranasal OT modulates the cortical activity from sensorimotor areas during the observation and the execution of social and non-social grasping actions. Participants underwent EEG testing after receiving a single dose (24 IU) of either intranasal OT or placebo. Results revealed an enhancement of alpha - but not beta - desynchronization during observation and execution of social grasps, especially over central and parietal electrodes, in participants who received OT (OT group). No differences between the social and non-social condition were found in the control group (CTRL group). Moreover, we found a significant difference over the cortical central-parietal region between the OT and CTRL group only within the social condition. These results suggest a possible action of intranasal OT on sensorimotor circuits involved in social perception and action understanding, which might contribute to facilitate the prosocial effects typically reported by behavioral studies.
Collapse
Affiliation(s)
- Fabrizia Festante
- Department of Developmental Neuroscience, IRCCS Fondazione Stella Maris, 56128, Pisa, Italy,Department of Medicine and Surgery, University of Parma, 43125, Parma, Italy
| | - Pier Francesco Ferrari
- Department of Medicine and Surgery, University of Parma, 43125, Parma, Italy,Institut des Sciences Cognitives Marc Jeannerod, CNRS, Bron, Cedex 69675, France
| | - Samuel G. Thorpe
- Department of Human Development and Quantitative Methodology, University of Maryland, College Park, MD 20740, USA
| | - Robert W. Buchanan
- Maryland Psychiatric Research Center, University of Maryland School of Medicine, Baltimore, MD 21228, USA
| | - Nathan A. Fox
- Department of Human Development and Quantitative Methodology, University of Maryland, College Park, MD 20740, USA
| |
Collapse
|
46
|
Tassinari CA. An electroencephalographer recalls the history of the Federation on the 70th anniversary of its journal, Clinical Neurophysiology. Clin Neurophysiol 2019; 130:2258-2263. [PMID: 31761715 DOI: 10.1016/j.clinph.2019.10.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2019] [Accepted: 10/25/2019] [Indexed: 11/26/2022]
Affiliation(s)
- Carlo Alberto Tassinari
- Università degli Studi di Bologna, Italy; Centro Ricerca per le Epilessie in età Pediatrica (CREP), Verona, Italy.
| |
Collapse
|
47
|
Rimbert S, Zaepffel M, Riff P, Adam P, Bougrain L. Hypnotic State Modulates Sensorimotor Beta Rhythms During Real Movement and Motor Imagery. Front Psychol 2019; 10:2341. [PMID: 31695643 PMCID: PMC6817584 DOI: 10.3389/fpsyg.2019.02341] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2019] [Accepted: 10/01/2019] [Indexed: 11/13/2022] Open
Abstract
Hypnosis techniques are currently used in the medical field and directly influences the patient's state of relaxation, perception of the body, and its visual imagination. There is evidence to suggest that a hypnotic state may help patients to better achieve tasks of motor imagination, which is central in the rehabilitation protocols after a stroke. However, the hypnosis techniques could also alter activity in the motor cortex. To the best of our knowledge, the impact of hypnosis on the EEG signal during a movement or an imagined movement is poorly investigated. In particular, how event-related desynchronization (ERD) and event-related synchronization (ERS) patterns would be modulated for different motor tasks may provide a better understanding of the potential benefits of hypnosis for stroke rehabilitation. To investigate this purpose, we recorded EEG signals from 23 healthy volunteers who performed real movements and motor imageries in a closed eye condition. Our results suggest that the state of hypnosis changes the sensorimotor beta rhythm during the ERD phase but maintains the ERS phase in the mu and beta frequency band, suggesting a different activation of the motor cortex in a hypnotized state.
Collapse
Affiliation(s)
| | | | - Pierre Riff
- Université de Lorraine, CNRS, Inria, LORIA, Nancy, France
| | - Perrine Adam
- Hemodialysis Department, University Hospital of Strasbourg, Strasbourg, France
| | | |
Collapse
|
48
|
Catrambone V, Greco A, Averta G, Bianchi M, Vanello I, Bicchi A, Valenza G, Scilingo EP. EEG Processing to Discriminate Transitive-Intransitive Motor Imagery Tasks: Preliminary Evidences using Support Vector Machines. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2019; 2018:231-234. [PMID: 30440380 DOI: 10.1109/embc.2018.8512239] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
It is known that brain dynamics significantly changes during motor imagery tasks of upper limb involving different kind of interactions with an object. Nevertheless, an automatic discrimination of transitive (i.e., actions involving an object) and intransitive (i.e., meaningful gestures that do not include the use of objects) imaginary actions using EEG dynamics has not been performed yet. In this study we exploit measures of EEG spectra to automatically discern between imaginary transitive and intransitive movements of the upper limb. To this end, nonlinear support vector machine algorithms are used to properly combine EEG-derived features, while a recursive feature elimination procedure highlights the most discriminant cortical regions and associated EEG frequency oscillations. Results show the significance of $\gamma ( 30 -45$ Hz) oscillations over the fronto-occipital and ipsilateral-parietal areas for the automatic classification of transitive-intransitive imaginary upper limb movements with a satisfactory accuracy of 70.97%.
Collapse
|
49
|
Krol MA, Schutter DJLG, Jellema T. Sensorimotor cortex activation during anticipation of upcoming predictable but not unpredictable actions. Soc Neurosci 2019; 15:214-226. [PMID: 31587597 DOI: 10.1080/17470919.2019.1674688] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
The mirror neuron system (MNS) becomes active during action execution and action observation, which is presumably reflected by reductions in mu (8-13 Hz) activity in the electroencephalogram over the sensorimotor cortex. The function of the MNS is still fiercely debated. The current study aimed to investigate a role of the MNS in anticipating others' actions by examining whether the MNS was activated - indexed by mu power suppression - prior to the onset of observed actions when the onset and type of action could be predicted on the basis of environmental cues. Young adults performed and observed cued grasping and placing actions in a card game in a real-life setting, while the predictability of the observed actions was manipulated using rules. Significant mu suppression, relative to within-trial baseline activity, was found both prior to and during executed actions, but also during action observation, and, crucially, prior to observed actions provided they were predictable. No anticipatory mu reductions were found prior to unpredictable observed actions. These results suggest top-down modulation of MNS activity by conceptual knowledge. This is the first study to demonstrate mu suppression prior to action onset - possibly reflecting MNS anticipatory activity - by explicitly manipulating predictability.
Collapse
Affiliation(s)
- Manon A Krol
- Department of Psychology, University of Hull, Hull, UK.,Center for Autism Research Excellence, Boston University, Boston, MA, USA
| | | | | |
Collapse
|
50
|
Kubicek E, Quandt LC. Sensorimotor system engagement during ASL sign perception: An EEG study in deaf signers and hearing non-signers. Cortex 2019; 119:457-469. [PMID: 31505437 DOI: 10.1016/j.cortex.2019.07.016] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2019] [Revised: 06/04/2019] [Accepted: 07/29/2019] [Indexed: 10/26/2022]
Abstract
When a person observes someone else performing an action, the observer's sensorimotor cortex activates as if the observer is the one performing the action, a phenomenon known as action simulation. While this process has been well-established for basic (e.g., grasping) and complex (e.g., dancing) actions, it remains unknown if the framework of action simulation is applicable to visual languages such as American Sign Language (ASL). We conducted an EEG experiment with deaf signers and hearing non-signers to compare overall sensorimotor EEG between groups, and to test whether sensorimotor systems are differentially sensitive to signs that are produced with one hand ("1H") or two hands ("2H"). We predicted greater alpha and beta event-related desynchronization (previously correlated with action simulation) during the perception of 2H ASL signs compared to 1H ASL signs, due to greater demands on sensorimotor processing systems required for producing two-handed actions. We recorded EEG from both groups as they observed videos of ASL signs, half 1H and half 2H. Event-related spectral perturbations (ERSPs) in the alpha and beta ranges were computed for the two conditions at central electrode sites overlying the sensorimotor cortex. Sensorimotor EEG responses in both Hearing and Deaf groups were sensitive to the observed gross motor characteristics of the observed signs. We show for the first time that despite hearing non-signers showing overall more sensorimotor cortex involvement during sign observation, mirroring-related processes are in fact involved when deaf signers observe signs.
Collapse
Affiliation(s)
- Emily Kubicek
- Educational Neuroscience Program, Gallaudet University, Washington, DC, USA
| | - Lorna C Quandt
- Educational Neuroscience Program, Gallaudet University, Washington, DC, USA; Department of Psychology, Gallaudet University, Washington, DC, USA.
| |
Collapse
|