1
|
Meng J, Zhao Y, Wang K, Sun J, Yi W, Xu F, Xu M, Ming D. Rhythmic temporal prediction enhances neural representations of movement intention for brain-computer interface. J Neural Eng 2023; 20:066004. [PMID: 37875107 DOI: 10.1088/1741-2552/ad0650] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Accepted: 10/24/2023] [Indexed: 10/26/2023]
Abstract
Objective.Detecting movement intention is a typical use of brain-computer interfaces (BCI). However, as an endogenous electroencephalography (EEG) feature, the neural representation of movement is insufficient for improving motor-based BCI. This study aimed to develop a new movement augmentation BCI encoding paradigm by incorporating the cognitive function of rhythmic temporal prediction, and test the feasibility of this new paradigm in optimizing detections of movement intention.Methods.A visual-motion synchronization task was designed with two movement intentions (left vs. right) and three rhythmic temporal prediction conditions (1000 ms vs. 1500 ms vs. no temporal prediction). Behavioural and EEG data of 24 healthy participants were recorded. Event-related potentials (ERPs), event-related spectral perturbation induced by left- and right-finger movements, the common spatial pattern (CSP) and support vector machine, Riemann tangent space algorithm and logistic regression were used and compared across the three temporal prediction conditions, aiming to test the impact of temporal prediction on movement detection.Results.Behavioural results showed significantly smaller deviation time for 1000 ms and 1500 ms conditions. ERP analyses revealed 1000 ms and 1500 ms conditions led to rhythmic oscillations with a time lag in contralateral and ipsilateral areas of movement. Compared with no temporal prediction, 1000 ms condition exhibited greater beta event-related desynchronization (ERD) lateralization in motor area (P< 0.001) and larger beta ERD in frontal area (P< 0.001). 1000 ms condition achieved an averaged left-right decoding accuracy of 89.71% using CSP and 97.30% using Riemann tangent space, both significantly higher than no temporal prediction. Moreover, movement and temporal information can be decoded simultaneously, achieving 88.51% four-classification accuracy.Significance.The results not only confirm the effectiveness of rhythmic temporal prediction in enhancing detection ability of motor-based BCI, but also highlight the dual encodings of movement and temporal information within a single BCI paradigm, which is promising to expand the range of intentions that can be decoded by the BCI.
Collapse
Affiliation(s)
- Jiayuan Meng
- The Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin 300392, People's Republic of China
| | - Yingru Zhao
- The Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
| | - Kun Wang
- The Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin 300392, People's Republic of China
| | - Jinsong Sun
- The Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
| | - Weibo Yi
- Beijing Machine and Equipment Institute, Beijing, People's Republic of China
| | - Fangzhou Xu
- International School for Optoelectronic Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan, People's Republic of China
| | - Minpeng Xu
- The Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin 300392, People's Republic of China
- International School for Optoelectronic Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan, People's Republic of China
| | - Dong Ming
- The Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin 300392, People's Republic of China
| |
Collapse
|
2
|
Proietti R, Pezzulo G, Tessari A. An active inference model of hierarchical action understanding, learning and imitation. Phys Life Rev 2023; 46:92-118. [PMID: 37354642 DOI: 10.1016/j.plrev.2023.05.012] [Citation(s) in RCA: 12] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2023] [Accepted: 05/31/2023] [Indexed: 06/26/2023]
Abstract
We advance a novel active inference model of the cognitive processing that underlies the acquisition of a hierarchical action repertoire and its use for observation, understanding and imitation. We illustrate the model in four simulations of a tennis learner who observes a teacher performing tennis shots, forms hierarchical representations of the observed actions, and imitates them. Our simulations show that the agent's oculomotor activity implements an active information sampling strategy that permits inferring the kinematic aspects of the observed movement, which lie at the lowest level of the action hierarchy. In turn, this low-level kinematic inference supports higher-level inferences about deeper aspects of the observed actions: proximal goals and intentions. Finally, the inferred action representations can steer imitative responses, but interfere with the execution of different actions. Our simulations show that hierarchical active inference provides a unified account of action observation, understanding, learning and imitation and helps explain the neurobiological underpinnings of visuomotor cognition, including the multiple routes for action understanding in the dorsal and ventral streams and mirror mechanisms.
Collapse
Affiliation(s)
| | - Giovanni Pezzulo
- Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy.
| | - Alessia Tessari
- Department of Psychology, University of Bologna, Italy; Alma Mater Research Institute for Human-Centered Artificial Intelligence, University of Bologna, Bologna, Italy
| |
Collapse
|
3
|
Albergoni A, Biggio M, Faelli E, Pesce A, Ruggeri P, Avanzino L, Bove M, Bisio A. Sensorimotor expertise influences perceptual weight judgments during observation of a sport-specific gesture. Front Sports Act Living 2023; 5:1148812. [PMID: 37426895 PMCID: PMC10323826 DOI: 10.3389/fspor.2023.1148812] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2023] [Accepted: 06/12/2023] [Indexed: 07/11/2023] Open
Abstract
This study aimed to investigate the role of sensorimotor expertise in evaluating relative weight of a lifted object during the observation of a sport-specific gesture, namely the deadlift. Fifty-six participants, assigned to three groups according to their experience in weight lifting, powerlifters, CrossFit® practitioners and naïve participants (controls), performed a perceptual weight judgments task. Participants observed videos showing a powerlifter executing a deadlift at the 80%, 90% and 100% of 1 repetition maximum (1RM) and answered a question about the weight of the lifted object. Participants' response accuracy and variability were evaluated. Findings showed that powerlifters were more accurate than controls. No differences appeared between powerlifter and CrossFit® practitioners, and between CrossFit® practitioners and controls. Response variability was similar in the three groups. These findings suggest that a fine sensorimotor expertise specific for the observed gesture is crucial to detect the weight of the object displayed in the observed movement, since it might allow detecting small changes in the observed movement kinematics, which we speculate are at the basis of the object weight recognition.
Collapse
Affiliation(s)
- Andrea Albergoni
- Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics and Maternal Child Health, Università degli Studi di Genova, Genoa, Italy
- Centro Polifunzionale di Scienze Motorie, Università degli Studi di Genova, Genoa, Italy
| | - Monica Biggio
- Section of Human Physiology, Department of Experimental Medicine, Università degli Studi di Genova, Genoa, Italy
| | - Emanuela Faelli
- Centro Polifunzionale di Scienze Motorie, Università degli Studi di Genova, Genoa, Italy
- Section of Human Physiology, Department of Experimental Medicine, Università degli Studi di Genova, Genoa, Italy
| | - Andrea Pesce
- Section of Human Physiology, Department of Experimental Medicine, Università degli Studi di Genova, Genoa, Italy
| | - Piero Ruggeri
- Centro Polifunzionale di Scienze Motorie, Università degli Studi di Genova, Genoa, Italy
- Section of Human Physiology, Department of Experimental Medicine, Università degli Studi di Genova, Genoa, Italy
| | - Laura Avanzino
- Section of Human Physiology, Department of Experimental Medicine, Università degli Studi di Genova, Genoa, Italy
- IRCCS Policlinico San Martino, Genoa, Italy
| | - Marco Bove
- Section of Human Physiology, Department of Experimental Medicine, Università degli Studi di Genova, Genoa, Italy
- IRCCS Policlinico San Martino, Genoa, Italy
| | - Ambra Bisio
- Centro Polifunzionale di Scienze Motorie, Università degli Studi di Genova, Genoa, Italy
- Section of Human Physiology, Department of Experimental Medicine, Università degli Studi di Genova, Genoa, Italy
| |
Collapse
|
4
|
Musco MA, Zazzera E, Paulesu E, Sacheli LM. Error observation as a window on performance monitoring in social contexts? A systematic review. Neurosci Biobehav Rev 2023; 147:105077. [PMID: 36758826 DOI: 10.1016/j.neubiorev.2023.105077] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2022] [Revised: 01/31/2023] [Accepted: 02/03/2023] [Indexed: 02/10/2023]
Abstract
Living in a social world requires social monitoring, i.e., the ability to keep track of others' actions and mistakes. Here, we demonstrate the good reliability of the behavioral and neurophysiological indexes ascribed to social monitoring. We also show that no consensus exists on the cognitive bases of this phenomenology and discuss three alternative hypotheses: (i) the direct matching hypothesis, postulating that observed errors are processed through automatic simulation; (ii) the attentional hypothesis, considering errors as unexpected events that take resources away from task processing; and (iii) the goal representation hypothesis, which weighs social error monitoring depending on how relevant the other's task is to the observer's goals. To date, evidence on the role played by factors that could help to disentangle these hypotheses (e.g., the human vs. non-human nature of the actor, the error rate, and the reward context) is insufficient, although the goal representation hypothesis seems to receive more support. Theory-driven experimental designs are needed to enlighten this debate and clarify the role of error monitoring during interactive exchanges.
Collapse
Affiliation(s)
- Margherita Adelaide Musco
- Department of Psychology and Milan Center for Neuroscience (NeuroMi), University of Milano-Bicocca, Piazza dell'Ateneo Nuovo 1, 20126 Milan, Italy.
| | - Elisa Zazzera
- Department of Psychology and Milan Center for Neuroscience (NeuroMi), University of Milano-Bicocca, Piazza dell'Ateneo Nuovo 1, 20126 Milan, Italy
| | - Eraldo Paulesu
- Department of Psychology and Milan Center for Neuroscience (NeuroMi), University of Milano-Bicocca, Piazza dell'Ateneo Nuovo 1, 20126 Milan, Italy; IRCCS Istituto Ortopedico Galeazzi, via Riccardo Galeazzi 4, 20161 Milano, Italy
| | - Lucia Maria Sacheli
- Department of Psychology and Milan Center for Neuroscience (NeuroMi), University of Milano-Bicocca, Piazza dell'Ateneo Nuovo 1, 20126 Milan, Italy.
| |
Collapse
|
5
|
Canepa P, Papaxanthis C, Bisio A, Biggio M, Paizis C, Faelli E, Avanzino L, Bove M. Motor Cortical Excitability Changes in Preparation to Concentric and Eccentric Movements. Neuroscience 2021; 475:73-82. [PMID: 34425159 DOI: 10.1016/j.neuroscience.2021.08.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2021] [Revised: 08/11/2021] [Accepted: 08/13/2021] [Indexed: 10/20/2022]
Abstract
Specific neural mechanisms operate at corticospinal levels during eccentric and concentric contractions. Here, we investigated the difference in corticospinal excitability (CSE) when preparing these two types of contraction. In this study we enrolled 16 healthy participants. They were asked to perform an instructed-delay reaction time (RT) task involving a concentric or an eccentric contraction of the right first dorsal interosseus muscle, as a response to a proprioceptive cue (Go signal) presented 1 s after a warning signal. We tested CSE at different time points ranging from 300 ms before up to 40 ms after a Go signal. CSE increased 300-150 ms before the Go signal for both contractions. Interestingly, significant changes in CSE in the time interval around the Go signal (from -150 ms to +40 ms) were only revealed in eccentric contraction. We observed a significant decrease in excitability immediately before the Go cue (Pre_50) and a significant increase 40 ms after it (Post_40) with respect to the MEPs recorded at Pre_150. Finally, CSE in eccentric contraction was lower before the Go cue (Pre_50) and greater after it (Post_40) compared to the concentric contraction. A similar result was also found in NoMov paradigm, used to disentangle the effects induced by movement preparation from those induced by the movement preparation linked to the proprioceptive cue. We could conclude that different neural mechanisms observed during concentric and eccentric contractions are mirrored with a different time-specific modulation of CSE in the preparatory phase to the movement.
Collapse
Affiliation(s)
- Patrizio Canepa
- Department of Experimental Medicine, Section of Human Physiology, and Centro Polifunzionale di Scienze Motorie, University of Genoa, Genoa, Italy; Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics and Maternal Child Health, University of Genoa, Genoa, Italy; INSERM UMR1093-CAPS, UFR des Sciences du Sport, University of Bourgogne Franche-Comté, Dijon, France
| | - Charalambos Papaxanthis
- INSERM UMR1093-CAPS, UFR des Sciences du Sport, University of Bourgogne Franche-Comté, Dijon, France
| | - Ambra Bisio
- Department of Experimental Medicine, Section of Human Physiology, and Centro Polifunzionale di Scienze Motorie, University of Genoa, Genoa, Italy
| | - Monica Biggio
- Department of Experimental Medicine, Section of Human Physiology, and Centro Polifunzionale di Scienze Motorie, University of Genoa, Genoa, Italy
| | - Christos Paizis
- INSERM UMR1093-CAPS, UFR des Sciences du Sport, University of Bourgogne Franche-Comté, Dijon, France; Centre for Performance Expertise, CAPS, U1093 INSERM, University of Bourgogne Franche-Comté, Faculty of Sport Sciences, Dijon, France
| | - Emanuela Faelli
- Department of Experimental Medicine, Section of Human Physiology, and Centro Polifunzionale di Scienze Motorie, University of Genoa, Genoa, Italy
| | - Laura Avanzino
- Department of Experimental Medicine, Section of Human Physiology, and Centro Polifunzionale di Scienze Motorie, University of Genoa, Genoa, Italy; Ospedale Policlinico San Martino-IRCCS, Genoa, Italy
| | - Marco Bove
- Department of Experimental Medicine, Section of Human Physiology, and Centro Polifunzionale di Scienze Motorie, University of Genoa, Genoa, Italy; Ospedale Policlinico San Martino-IRCCS, Genoa, Italy.
| |
Collapse
|
6
|
Kemmerer D. What modulates the Mirror Neuron System during action observation?: Multiple factors involving the action, the actor, the observer, the relationship between actor and observer, and the context. Prog Neurobiol 2021; 205:102128. [PMID: 34343630 DOI: 10.1016/j.pneurobio.2021.102128] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2021] [Revised: 06/23/2021] [Accepted: 07/29/2021] [Indexed: 01/03/2023]
Abstract
Seeing an agent perform an action typically triggers a motor simulation of that action in the observer's Mirror Neuron System (MNS). Over the past few years, it has become increasingly clear that during action observation the patterns and strengths of responses in the MNS are modulated by multiple factors. The first aim of this paper is therefore to provide the most comprehensive survey to date of these factors. To that end, 22 distinct factors are described, broken down into the following sets: six involving the action; two involving the actor; nine involving the observer; four involving the relationship between actor and observer; and one involving the context. The second aim is to consider the implications of these findings for four prominent theoretical models of the MNS: the Direct Matching Model; the Predictive Coding Model; the Value-Driven Model; and the Associative Model. These assessments suggest that although each model is supported by a wide range of findings, each one is also challenged by other findings and relatively unaffected by still others. Hence, there is now a pressing need for a richer, more inclusive model that is better able to account for all of the modulatory factors that have been identified so far.
Collapse
Affiliation(s)
- David Kemmerer
- Department of Psychological Sciences, Department of Speech, Language, and Hearing Sciences, Lyles-Porter Hall, Purdue University, 715 Clinic Drive, United States.
| |
Collapse
|