Characterizing the Action-Observation Network Through Functional Near-Infrared Spectroscopy: A Review

Awareness of embodiment enhances enjoyment and engages sensorimotor cortices

Whether in performing arts, sporting, or everyday contexts, when we watch others move, we tend to enjoy bodies moving in synchrony. Our enjoyment of body movements is further enhanced by our own prior experience with performing those movements, or our 'embodied experience'. The relationships between movement synchrony and enjoyment, as well as embodied experience and movement enjoyment, are well known. The interaction between enjoyment of movements, synchrony, and embodiment is less well understood, and may be central for developing new approaches for enriching social interaction. To examine the interplay between movement enjoyment, synchrony, and embodiment, we asked participants to copy another person's movements as accurately as possible, thereby gaining embodied experience of movement sequences. Participants then viewed other dyads performing the same or different sequences synchronously, and we assessed participants' recognition of having performed these sequences, as well as their enjoyment of each movement sequence. We used functional near-infrared spectroscopy to measure cortical activation over frontotemporal sensorimotor regions while participants performed and viewed movements. We found that enjoyment was greatest when participants had mirrored the sequence and recognised it, suggesting that awareness of embodiment may be central to enjoyment of synchronous movements. Exploratory analyses of relationships between cortical activation and enjoyment and recognition implicated the sensorimotor cortices, which subserve action observation and aesthetic processing. These findings hold implications for clinical research and therapies seeking to foster successful social interaction.

Live vs video interaction: sensorimotor and visual cortical oscillations during action observation

Increasingly, in the field of communication, education, and business, people are switching to video interaction, and interlocutors frequently complain that the perception of nonverbal information and concentration suffer. We investigated this issue by analyzing electroencephalogram (EEG) oscillations of the sensorimotor (mu rhythm) and visual (alpha rhythm) cortex of the brain in an experiment with action observation live and on video. The mu rhythm reflects the activity of the mirror neuron system, and the occipital alpha rhythm shows the level of visual attention. We used 32-channel EEG recorded during live and video action observation in 83 healthy volunteers. The ICA method was used for selecting the mu- and alpha-components; the Fourier Transform was used to calculate the suppression index relative to the baseline (stationary demonstrator) of the rhythms. The main range of the mu rhythm was indeed sensitive to social movement and was highly dependent on the conditions of interaction-live or video. The upper mu-range appeared to be less sensitive to the conditions, but more sensitive to different movements. The alpha rhythm did not depend on the type of movement; however, a live performance initially caused a stronger concentration of visual attention. Thus, subtle social and nonverbal perceptions may suffer in remote video interactions.

Unlocking the neural mechanisms of consumer loan evaluations: an fNIRS and ML-based consumer neuroscience study

Introduction

This study conducts a comprehensive exploration of the neurocognitive processes underlying consumer credit decision-making using cutting-edge techniques from neuroscience and machine learning (ML). Employing functional Near-Infrared Spectroscopy (fNIRS), the research examines the hemodynamic responses of participants while evaluating diverse credit offers.

Methods

The experimental phase of this study investigates the hemodynamic responses collected from 39 healthy participants with respect to different loan offers. This study integrates fNIRS data with advanced ML algorithms, specifically Extreme Gradient Boosting, CatBoost, Extra Tree Classifier, and Light Gradient Boosted Machine, to predict participants' credit decisions based on prefrontal cortex (PFC) activation patterns.

Results

Findings reveal distinctive PFC regions correlating with credit behaviors, including the dorsolateral prefrontal cortex (dlPFC) associated with strategic decision-making, the orbitofrontal cortex (OFC) linked to emotional valuations, and the ventromedial prefrontal cortex (vmPFC) reflecting brand integration and reward processing. Notably, the right dorsomedial prefrontal cortex (dmPFC) and the right vmPFC contribute to positive credit preferences.

Discussion

This interdisciplinary approach bridges neuroscience, machine learning and finance, offering unprecedented insights into the neural mechanisms guiding financial choices regarding different loan offers. The study's predictive model holds promise for refining financial services and illuminating human financial behavior within the burgeoning field of neurofinance. The work exemplifies the potential of interdisciplinary research to enhance our understanding of human financial decision-making.

Unraveling neural pathways of political engagement: bridging neuromarketing and political science for understanding voter behavior and political leader perception

Introduction

Political neuromarketing is an emerging interdisciplinary field integrating marketing, neuroscience, and psychology to decipher voter behavior and political leader perception. This interdisciplinary field offers novel techniques to understand complex phenomena such as voter engagement, political leadership, and party branding.

Methods

This study aims to understand the neural activation patterns of voters when they are exposed to political leaders using functional near-infrared spectroscopy (fNIRS) and machine learning methods. We recruited participants and recorded their brain activity using fNIRS when they were exposed to images of different political leaders.

Results

This neuroimaging method (fNIRS) reveals brain regions central to brand perception, including the dorsolateral prefrontal cortex (dlPFC), the dorsomedial prefrontal cortex (dmPFC), and the ventromedial prefrontal cortex (vmPFC). Machine learning methods were used to predict the participants' perceptions of leaders based on their brain activity. The study has identified the brain regions that are involved in processing political stimuli and making judgments about political leaders. Within this study, the best-performing machine learning model, LightGBM, achieved a highest accuracy score of 0.78, underscoring its efficacy in predicting voters' perceptions of political leaders based on the brain activity of the former.

Discussion

The findings from this study provide new insights into the neural basis of political decision-making and the development of effective political marketing campaigns while bridging neuromarketing, political science, and machine learning, in turn enabling predictive insights into voter preferences and behavior.

Total sleep deprivation reduces the table tennis anticipation performance of young men: A functional magnetic resonance imaging study

This study explored whether and how sleep deprivation (SD) affects sport-related anticipation. Twenty table tennis players and 28 non-athletes completed a table tennis anticipation task before and after 36 h SD. Functional magnetic resonance imaging (fMRI) data were acquired simultaneously. The results showed that, compared with the non-athletes, table tennis players had higher neural efficiency, manifested by their higher anticipation accuracy and lower frontal lobe activation. SD impaired anticipation performance, accompanied by decreased activation of the occipital and temporal lobes. Compensatory activation occurred in the left hippocampus and orbital part of the right inferior frontal gyrus (IFG) after SD in the table tennis player group, but not in the non-athlete group. The decreased accuracy of non-athletes was positively correlated with decreased activation of orbital part of the right IFG. This study's findings improve the understanding of the cognitive neuroscience mechanisms by which SD affects sport-related anticipation.

Effects of movement congruence on motor resonance in early Parkinson's disease

The observation of action seems to involve the generation of the internal representation of that same action in the observer, a process named motor resonance (MR). The objective of this study was to verify whether an experimental paradigm of action observation in a laboratory context could elicit cortical motor activation in 21 early Parkinson's disease (PD) patients compared to 22 controls. Participants were instructed to simply observe (observation-only session) or to respond (Time-to-contact detection session) at the instant the agent performed a grasping action toward a graspable or ungraspable object. We used functional near-infrared spectroscopy with 20 channels on the motor and premotor brain areas and event-related desynchronization of alpha-mu rhythm. In both groups, response times were more accurate in graspable than ungraspable object trials, suggesting that motor resonance is present in PD patients. In the Time-to-contact detection session, the oxyhemoglobin levels and alpha-mu desynchronization prevailed in the graspable object trials rather than in the ungraspable ones. This study demonstrates the preservation of MR mechanisms in early PD patients. The action observation finalized to a consequent movement can activate cortical networks in patients with early PD, suggesting early rehabilitation interventions taking into account specific observation paradigms preceding motor production.

Cortical activation of neuromuscular electrical stimulation synchronized mirror neuron rehabilitation strategies: an fNIRS study

Background

The mirror neuron system (MNS) plays a key role in the neural mechanism underlying motor learning and neural plasticity. Action observation (AO), action execution (AE), and a combination of both, known as action imitation (AI), are the most commonly used rehabilitation strategies based on MNS. It is possible to enhance the cortical activation area and amplitude by combining traditional neuromuscular electrical stimulation (NMES) with other top-down and active rehabilitation strategies based on the MNS theory.

Objective

This study aimed to explore the cortical activation patterns induced by NMES synchronized with rehabilitation strategies based on MNS, namely NMES+AO, NMES+AE, and NMES+AI. In addition, the study aimed to assess the feasibility of these three novel rehabilitative treatments in order to provide insights and evidence for the design, implementation, and application of brain-computer interfaces.

Methods

A total of 70 healthy adults were recruited from July 2022 to February 2023, and 66 of them were finally included in the analysis. The cortical activation patterns during NMES+AO, NMES+AE, and NMES+AI were detected using the functional Near-Infrared Spectroscopy (fNIRS) technique. The action to be observed, executed, or imitated was right wrist and hand extension, and two square-shaped NMES electrodes were placed on the right extensor digitorum communis. A block design was adopted to evaluate the activation intensity of the left MNS brain regions.

Results

General linear model results showed that compared with the control condition, the number of channels significantly activated (PFDR < 0.05) in the NMES+AO, NMES+AE, and NMES+AI conditions were 3, 9, and 9, respectively. Region of interest (ROI) analysis showed that 2 ROIs were significantly activated (PFDR < 0.05) in the NMES+AO condition, including BA6 and BA44; 5 ROIs were significantly activated in the NMES+AE condition, including BA6, BA40, BA44, BA45, and BA46; and 6 ROIs were significantly activated in the NMES+AI condition, including BA6, BA7, BA40, BA44, BA45, and BA46.

Conclusion

The MNS was activated during neuromuscular electrical stimulation combined with an AO, AE, and AI intervention. The synchronous application of NMES and mirror neuron rehabilitation strategies is feasible in clinical rehabilitation. The fNIRS signal patterns observed in this study could be used to develop brain-computer interface and neurofeedback therapy rehabilitation devices.

Ultra-high field fMRI identifies an action-observation network in the common marmoset

The observation of others' actions activates a network of temporal, parietal and premotor/prefrontal areas in macaque monkeys and humans. This action-observation network (AON) has been shown to play important roles in social action monitoring, learning by imitation, and social cognition in both species. It is unclear whether a similar network exists in New-World primates, which separated from Old-Word primates ~35 million years ago. Here we used ultra-high field fMRI at 9.4 T in awake common marmosets (Callithrix jacchus) while they watched videos depicting goal-directed (grasping food) or non-goal-directed actions. The observation of goal-directed actions activates a temporo-parieto-frontal network, including areas 6 and 45 in premotor/prefrontal cortices, areas PGa-IPa, FST and TE in occipito-temporal region and areas V6A, MIP, LIP and PG in the occipito-parietal cortex. These results show overlap with the humans and macaques' AON, demonstrating the existence of an evolutionarily conserved network that likely predates the separation of Old and New-World primates.

Simultaneous multimodal fNIRS-EEG recordings reveal new insights in neural activity during motor execution, observation, and imagery

Motor execution, observation, and imagery are important skills used in motor learning and rehabilitation. The neural mechanisms underlying these cognitive-motor processes are still poorly understood. We used a simultaneous recording of functional near-infrared spectroscopy (fNIRS) and electroencephalogram (EEG) to elucidate the differences in neural activity across three conditions requiring these processes. Additionally, we used a new method called structured sparse multiset Canonical Correlation Analysis (ssmCCA) to fuse the fNIRS and EEG data and determine the brain regions of neural activity consistently detected by both modalities. Unimodal analyses revealed differentiated activation between conditions; however, the activated regions did not fully overlap across the two modalities (fNIRS: left angular gyrus, right supramarginal gyrus, as well as right superior and inferior parietal lobes; EEG: bilateral central, right frontal, and parietal). These discrepancies might be because fNIRS and EEG detect different signals. Using fused fNIRS-EEG data, we consistently found activation over the left inferior parietal lobe, superior marginal gyrus, and post-central gyrus during all three conditions, suggesting that our multimodal approach identifies a shared neural region associated with the Action Observation Network (AON). This study highlights the strengths of using the multimodal fNIRS-EEG fusion technique for studying AON. Neural researchers should consider using the multimodal approach to validate their findings.

Mu-desynchronization, N400 and corticospinal excitability during observation of natural and anatomically unnatural finger movements

The action observation networks (AON) (or the mirror neuron system) are the neural underpinnings of visuomotor integration and play an important role in motor control. Besides, one of the main functions of the human mirror neuron system is recognition of observed actions and the prediction of its outcome through the comparison with the internal mental motor representation. Previous studies focused on the human mirror neurons (MNs) activation during object-oriented movements observation, therefore intransitive movements observation effects on MNs activity remains relatively little-studied. Moreover, the dependence of MNs activation on the biomechanical characteristics of observed movement and their biological plausibility remained highly underexplored. In this study we proposed that naturalness of observed intransitive movement can modulate the MNs activity. Event-related desynchronization (ERD) of sensorimotor electroencephalography (EEG) rhythms, N400 event-related potentials (ERPs) component and corticospinal excitability were investigated in twenty healthy volunteers during observation of simple non-transitive finger flexion that might be either biomechanically natural or unnatural when finger wriggled out toward the dorsal side of palm. We showed that both natural and unnatural movements caused mu/beta-desynchronization, which gradually increased during the flexion phase and returned to baseline while observation of extension. Desynchronization of the mu-rhythm was significantly higher during observation of the natural movements. At the same time, beta-rhythm was not found to be sensitive to the action naturalness. Also, observation of unnatural movements caused an increased amplitude of the N400 component registered in the centro-parietal regions. We suggest that the sensitivity of N400 to intransitive action observation with no explicit semantic context might imply the broader role of N400 sources within AON. Surprisingly, no changes in corticospinal excitability were found. This lack of excitability modulation by action observation could be related with dependence of the M1 activity on the observed movement phase.

Structured sparse multiset canonical correlation analysis of simultaneous fNIRS and EEG provides new insights into the human action-observation network

The action observation network (AON) is a network of brain regions involved in the execution and observation of a given action. The AON has been investigated in humans using mostly electroencephalogram (EEG) and functional magnetic resonance imaging (fMRI), but shared neural correlates of action observation and action execution are still unclear due to lack of ecologically valid neuroimaging measures. In this study, we used concurrent EEG and functional Near Infrared Spectroscopy (fNIRS) to examine the AON during a live-action observation and execution paradigm. We developed structured sparse multiset canonical correlation analysis (ssmCCA) to perform EEG-fNIRS data fusion. MCCA is a generalization of CCA to more than two sets of variables and is commonly used in medical multimodal data fusion. However, mCCA suffers from multi-collinearity, high dimensionality, unimodal feature selection, and loss of spatial information in interpreting the results. A limited number of participants (small sample size) is another problem in mCCA, which leads to overfitted models. Here, we adopted graph-guided (structured) fused least absolute shrinkage and selection operator (LASSO) penalty to mCCA to conduct feature selection, incorporating structural information amongst the variables (i.e., brain regions). Benefitting from concurrent recordings of brain hemodynamic and electrophysiological responses, the proposed ssmCCA finds linear transforms of each modality such that the correlation between their projections is maximized. Our analysis of 21 right-handed participants indicated that the left inferior parietal region was active during both action execution and action observation. Our findings provide new insights into the neural correlates of AON which are more fine-tuned than the results from each individual EEG or fNIRS analysis and validate the use of ssmCCA to fuse EEG and fNIRS datasets.

Observation and motor imagery balance tasks evaluation: An fNIRS feasibility study

In this study, we aimed at exploring the feasibility of functional near-infrared spectroscopy (fNIRS) for studying the observation and/or motor imagination of various postural tasks. Thirteen healthy adult subjects followed five trials of static and dynamic standing balance tasks, throughout three different experimental setups of action observation (AO), a combination of action observation and motor imagery (AO+MI), and motor imagery (MI). During static and dynamic standing tasks, both the AO+MI and MI experiments revealed that many channels in prefrontal or motor regions are significantly activated while the AO experiment showed almost no significant increase in activations in most of the channels. The contrast between static and dynamic standing tasks showed that with more demanding balance tasks, relative higher activation patterns were observed, particularly during AO and in AO+MI experiments in the frontopolar area. Moreover, the AO+MI experiment revealed a significant difference in premotor and supplementary motor cortices that are related to balance control. Furthermore, it has been observed that the AO+MI experiment induced relatively higher activation patterns in comparison to AO or MI alone. Remarkably, the results of this work match its counterpart from previous functional magnetic resonance imaging studies. Therefore, they may pave the way for using the fNIRS as a diagnostic tool for evaluating the performance of the non-physical balance training during the rehabilitation period of temporally immobilized patients.

An fNIRS Study of Brain Lateralization During Observation and Execution of a Fine Motor Task

Brain activity in the action observation network (AON) is lateralized during action execution, with greater activation in the contralateral hemisphere to the side of the body used to perform the task. However, it is unknown whether the AON is also lateralized when watching another person perform an action. In this study, we use fNIRS to measure brain activity over the left and right cortex while participants completed actions with their left and right hands and watched an actor complete action with their left and right hands. We show that while activation is lateralized when the participants themselves are moving, brain lateralization is not affected by the side of the body when the participant is observing another person's action. In addition, we demonstrate that individual differences in hand preference and dexterity between the right and left hands are related to brain lateralization patterns.

Cerebral hemodynamic response during a live action-observation and action-execution task: A fNIRS study

Although many studies have examined the location of the action observation network (AON) in human adults, the shared neural correlates of action-observation and action-execution are still unclear partially due to lack of ecologically valid neuroimaging measures. In this study, we aim to demonstrate the feasibility of using functional near infrared spectroscopy (fNIRS) to measure the neural correlates of action-observation and action execution regions during a live task. Thirty adults reached for objects or observed an experimenter reaching for objects while their cerebral hemodynamic responses including oxy-hemoglobin (HbO) and deoxy-hemoglobin (HbR) were recorded in the sensorimotor and parietal regions. Our results indicated that the parietal regions, including bilateral superior parietal lobule (SPL), bilateral inferior parietal lobule (IPL), right supra-marginal region (SMG) and right angular gyrus (AG) share neural activity during action-observation and action-execution. Our findings confirm the applicability of fNIRS for the study of the AON and lay the foundation for future work with developmental and clinical populations.

Using Functional Connectivity to Examine the Correlation between Mirror Neuron Network and Autistic Traits in a Typically Developing Sample: A fNIRS Study

Mirror neuron network (MNN) is associated with one's ability to recognize and interpret others' actions and emotions and has a crucial role in cognition, perception, and social interaction. MNN connectivity and its relation to social attributes, such as autistic traits have not been thoroughly examined. This study aimed to investigate functional connectivity in the MNN and assess relationship between MNN connectivity and subclinical autistic traits in neurotypical adults. Hemodynamic responses, including oxy- and deoxy-hemoglobin were measured in the central and parietal cortex of 30 healthy participants using a 24-channel functional Near-Infrared spectroscopy (fNIRS) system during a live action-observation and action-execution task. Functional connectivity was derived from oxy-hemoglobin data. Connections with significantly greater connectivity in both tasks were assigned to MNN connectivity. Correlation between connectivity and autistic traits were performed using Pearson correlation. Connections within the right precentral, right supramarginal, left inferior parietal, left postcentral, and between left supramarginal-left angular regions were identified as MNN connections. In addition, individuals with higher subclinical autistic traits present higher connectivity in both action-execution and action-observation conditions. Positive correlation between MNN connectivity and subclinical autistic traits can be used in future studies to investigate MNN in a developing population with autism spectrum disorder.