Motor activity and imagery modulate the body-selective region in the occipital-temporal area: a near-infrared spectroscopy study

Feasibility study of functional near-infrared spectroscopy in the ventral visual pathway for real-life applications

Significance

fNIRS-based neuroenhancement depends on the feasible detection of hemodynamic responses in target brain regions. Using the lateral occipital complex (LOC) and the fusiform face area (FFA) in the ventral visual pathway as neurofeedback targets boosts performance in visual recognition. However, the feasibility of utilizing fNIRS to detect LOC and FFA activity in adults remains to be validated as the depth of these regions may exceed the detection limit of fNIRS.

Aim

This study aims to investigate the feasibility of using fNIRS to measure hemodynamic responses in the ventral visual pathway, specifically in the LOC and FFA, in adults.

Approach

We recorded the hemodynamic activities of the LOC and FFA regions in 35 subjects using a portable eight-channel fNIRS instrument. A standard one-back object and face recognition task was employed to elicit selective brain responses in the LOC and FFA regions. The placement of fNIRS optodes for LOC and FFA detection was guided by our group's transcranial brain atlas (TBA).

Results

Our findings revealed selective activation of the LOC target channel (CH2) in response to objects, whereas the FFA target channel (CH7) did not exhibit selective activation in response to faces.

Conclusions

Our findings indicate that, although fNIRS detection has limitations in capturing FFA activity, the LOC region emerges as a viable target for fNIRS-based detection. Furthermore, our results advocate for the adoption of the TBA-based method for setting the LOC target channel, offering a promising solution for optrode placement. This feasibility study stands as the inaugural validation of fNIRS for detecting cortical activity in the ventral visual pathway, underscoring its ecological validity. We suggest that our findings establish a pivotal technical groundwork for prospective real-life applications of fNIRS-based research.

A neural signature for combined action observation and motor imagery? An fNIRS study into prefrontal activation, automatic imitation, and self-other perceptions

INTRODUCTION

Research indicates that both observed and imagined actions can be represented in the brain as two parallel sensorimotor representations. One proposal is that higher order cognitive processes would align these two hypothetical action simulations.

METHODS

We investigated this hypothesis using an automatic imitation paradigm, with functional near-infrared spectroscopy recordings over the prefrontal cortex during different motor simulation states. On each trial, participants (n = 14) observed a picture of a rhythmical action (instructed action) followed by a distractor movie showing the same or different action. Participants then executed the instructed action. Distractor actions were manipulated to be fast or slow, and instructions were manipulated during distractor presentation: action observation (AO), combined action observation and motor imagery (AO+MI) and observe to imitate (intentional imitation). A pure motor imagery (MI) condition was also included.

RESULTS

Kinematic analyses showed that although distractor speed effects were significant under all instructions (shorter mean cycle times in execution for fast compared to slow trials), this imitation bias was significantly stronger for combined AO+MI than both AO and MI, and stronger for intentional imitation than the other three automatic imitation conditions. In the left prefrontal cortex, cerebral oxygenation was significantly greater for combined AO+MI than all other instructions. Participants reported that their representation of the self overlapped with the observed model significantly more during AO+MI than AO.

CONCLUSION

Left prefrontal activation may therefore be a neural signature of AO+MI, supporting attentional switching between concurrent representations of self (MI, top-down) and other (AO, bottom-up) to increase imitation and perceived closeness.

Distance-based functional criticality in the human brain: intelligence and emotional intelligence

Background

Anatomical distance has been identified as a key factor in the organizational principles of the human brain. On the other hand, criticality was proposed to accommodate the multiscale properties of human brain dynamics, and functional criticality based on resting-state functional magnetic resonance imaging (rfMRI) is a sensitive neuroimaging marker for human brain dynamics. Hence, to explore the effects of anatomical distance of the human brain on behaviors in terms of functional criticality, we proposed a revised algorithm of functional criticality called the distance-based vertex-wise index of functional criticality, and assessed this algorithm compared with the original neighborhood-based functional criticality.

Results

We recruited two groups of healthy participants, including young adults and middle-aged participants, for a total of 60 datasets including rfMRI and intelligence as well as emotional intelligence to study how human brain functional criticalities at different spatial scales contribute to individual behaviors. Furthermore, we defined the average distance between the particular behavioral map and vertices with significant functional connectivity as connectivity distance. Our results demonstrated that intelligence and emotional intelligence mapped to different brain regions at different ages. Additionally, intelligence was related to a wider distance range compared to emotional intelligence.

Conclusions

For different age groups, our findings not only provided a linkage between intelligence/emotional intelligence and functional criticality but also quantitatively characterized individual behaviors in terms of anatomical distance.

Differences in perceived durations between plausible biological and non-biological stimuli

Visual motion stimuli can sometimes distort our perception of time. This effect is dependent on the apparent speed of the moving stimulus, where faster stimuli are usually perceived lasting longer than slower stimuli. Although it has been shown that neural and cognitive processing of biological motion stimuli differ from non-biological motion stimuli, no study has yet investigated whether perceived durations of biological stimuli differ from non-biological stimuli across different speeds. Here, a prospective temporal reproduction task was used to assess that question. Biological motion stimuli consisted of a human silhouette running in place. Non-biological motion stimuli consisted of a rectangle moving in a pendular way. Amount and plausibility of movement for each stimulus and frame-rate (speed) were evaluated by an independent group of participants. Although the amount of movement perceived was positively correlated to frame rate both for biological and non-biological stimuli, movie clips involving biological motion stimuli were judged to last longer than non-biological motion stimuli only at frame rates for which movement was rated as plausible. These results suggest that plausible representations of biomechanical movement induce additional temporal distortions to those modulated by increases in stimulus speed. Moreover, most studies reporting neural and cognitive differences in the processing of biological and non-biological motion stimuli acquired neurophysiological data using fMRI. Here, we report differences in the processing of biological and non-biological motion stimuli across different speeds using functional near-infrared spectroscopy (fNIRS), a less costly and portable form of neurophysiological data acquisition.

Neural Processing and Production of Gesture in Children and Adolescents With Autism Spectrum Disorder

Individuals with autism spectrum disorder (ASD) demonstrate impairments in non-verbal communication, including gesturing and imitation deficits. Reduced sensitivity to biological motion (BM) in ASD may impair processing of dynamic social cues like gestures, which in turn may impede encoding and subsequent performance of these actions. Using both an fMRI task involving observation of action gestures and a charade style paradigm assessing gesture performance, this study examined the brain-behavior relationships between neural activity during gesture processing, gesturing abilities and social symptomology in a group of children and adolescents with and without ASD. Compared to typically developing (TD) controls, participants with ASD showed atypical sensitivity to movement in right posterior superior temporal sulcus (pSTS), a region implicated in action processing, and had poorer overall gesture performance with specific deficits in hand posture. The TD group showed associations between neural activity, gesture performance and social skills, that were weak or non-significant in the ASD group. These findings suggest that those with ASD demonstrate abnormalities in both processing and production of gestures and may reflect dysfunction in the mechanism underlying perception-action coupling resulting in atypical development of social and communicative skills.

Transitive Versus Intransitive Complex Gesture Representation: A Comparison Between Execution, Observation and Imagination by fNIRS

The aim of the present study was to examine cortical correlates of motor execution, motor observation and motor imagery of hand complex gestures, in particular by comparing meaningful gestures implying the use of an object (transitive action) or not (intransitive action). Functional near-infrared spectroscopy (fNIRS) was used to verify the presence of partial overlapping between some cortical areas involved in those different tasks. Participants were instructed to observe videos of transitive vs. intransitive gestures and then to execute or imagine them. Gesture execution was associated to greater brain activity (increased oxygenated hemoglobin levels) with respect to observation and imagination in motor areas (premotor cortex, PMC; primary sensorimotor cortex, SM1). In contrast, the posterior parietal cortex (PPC) was more relevantly involved in both execution and observation tasks compared to gesture imagination. Moreover, execution and observation of transitive gestures seemed primarily supported by similar parietal posterior areas when compared with intransitive gestures, which do not imply the presence on a object.

Following during physically-coupled joint action engages motion area MT+/V5

Interpersonal coordination during joint action depends on the perception of the partner's movements. In many such situations - for example, while moving furniture together or dancing a tango - there are kinesthetic interactions between the partners due to the forces shared between them that allow them to directly perceive one another's movements. Joint action of this type often involves a contrast between the roles of leader and follower, where the leader imparts forces onto the follower, and the follower has to be responsive to these force-cues during movement. We carried out a novel 2-person functional MRI study with trained couple dancers engaged in bimanual contact with an experimenter standing next to the bore of the magnet, where the two alternated between being the leader and follower of joint improvised movements, all with the eyes closed. One brain area that was unexpectedly more active during following than leading was the region of MT+/V5. While classically described as an area for processing visual motion, it has more recently been shown to be responsive to tactile motion as well. We suggest that MT+/V5 responds to motion based on force-cues during joint haptic interaction, most especially when a follower responds to force-cues coming from a leader's movements.

The Lateral Occipito-temporal Cortex Is Involved in the Mental Manipulation of Body Part Imagery

The lateral occipito-temporal cortex (LOTC), including the extrastriate body area, is known to be involved in the perception of body parts. Although still controversial, recent studies have demonstrated the role of the LOTC in higher-level body-related cognition in humans. This study consisted of two experiments (E1 and E2). The first (E1) was an exploratory experiment to find the neural correlate of the mental manipulation of body part imagery, in which brain cerebral glucose metabolic rates and the performance of mental rotation of the hand were measured in 100 subjects who exhibited a range of symptoms of cognitive decline. In E1, we found that the level of glucose metabolism in the right LOTC was significantly correlated with performance in a task involving mental manipulation of the hand. Next, in E2, we performed a randomized, double-blind, controlled intervention study (clinical trial number: UMIN 000018310) in younger healthy adults to test whether right occipital (corresponding to the right LOTC) anodal stimulation using transcranial direct current stimulation (tDCS) could enhance the mental manipulation of the hand. In E2, we demonstrated a significant effect of tDCS on the accuracy rate in a task involving mental manipulation of the hand. Although further study is necessary to answer the question of whether these results are specific for the mental manipulation of body parts but not non-body parts, E1 demonstrated a possible role of the LOTC in carrying out the body mental manipulation task in patients with dementia, and E2 suggested the possible effect of tDCS on this task in healthy subjects.

fNIRS measure of transitive and intransitive gesture execution, observation and imagination in ecological setting: A pilot study

To explore the presence of differential cortical hemodynamic activations related to cognitive components of actions, we performed a fNIRS (functional Near-Infrared Spectroscopy) study during Observation (O), Execution (E) and Imagination (I) of complex and meaningful (transitive and intransitive) gestures in ecological setting. A pilot sample of 5 healthy adults underwent an event-related study consisting of these 3 different conditions, with O set as first and followed by a randomized presentation of E or I. fNIRS measurements were performed using a 24 channel array of optodes (8 light injectors and 8 detectors) placed over the contralateral central, centro-parietal, parietal and temporal areas. Results showed that the premotor (PMC) and the sensory-motor cortices (SM1) were recruited selectively during E, with levels of oxygenated hemoglobin (oxy-Hb) higher than the other conditions, while the posterior parietal cortex (PPC) showed increased oxy-Hb levels for both E and O. These data suggest that variations in hemodynamic responses can be attributed to different neural processes underpinning these tasks, with PMC and SM1 being more involved in action preparation and performance, and PPC prevalently dedicated to attentive processes related to the execution and observation of limb movements.

Covert enaction at work: Recording the continuous movements of visuospatial attention to visible or imagined targets by means of Steady-State Visual Evoked Potentials (SSVEPs)

Whereas overt visuospatial attention is customarily measured with eye tracking, covert attention is assessed by various methods. Here we exploited Steady-State Visual Evoked Potentials (SSVEPs) - the oscillatory responses of the visual cortex to incoming flickering stimuli - to record the movements of covert visuospatial attention in a way operatively similar to eye tracking (attention tracking), which allowed us to compare motion observation and motion extrapolation with and without eye movements. Observers fixated a central dot and covertly tracked a target oscillating horizontally and sinusoidally. In the background, the left and the right halves of the screen flickered at two different frequencies, generating two SSVEPs in occipital regions whose size varied reciprocally as observers attended to the moving target. The two signals were combined into a single quantity that was modulated at the target frequency in a quasi-sinusoidal way, often clearly visible in single trials. The modulation continued almost unchanged when the target was switched off and observers mentally extrapolated its motion in imagery, and also when observers pointed their finger at the moving target during covert tracking, or imagined doing so. The amplitude of modulation during covert tracking was ∼25-30% of that measured when observers followed the target with their eyes. We used 4 electrodes in parieto-occipital areas, but similar results were achieved with a single electrode in Oz. In a second experiment we tested ramp and step motion. During overt tracking, SSVEPs were remarkably accurate, showing both saccadic-like and smooth pursuit-like modulations of cortical responsiveness, although during covert tracking the modulation deteriorated. Covert tracking was better with sinusoidal motion than ramp motion, and better with moving targets than stationary ones. The clear modulation of cortical responsiveness recorded during both overt and covert tracking, identical for motion observation and motion extrapolation, suggests to include covert attention movements in enactive theories of mental imagery.

A feasibility study of an improved procedure for using EEG to detect brain responses to imagery instruction in patients with disorders of consciousness

One of the major concerns of recent studies is the correct discrimination between vegetative and minimally conscious state as the distinction between these two conditions has major implications for subsequent patient rehabilitation. In particular, it would be advantageous to establish communication with these patients. This work describes a procedure using EEG to detect brain responses to imagery instruction in patients with disorders of consciousness. Five healthy subjects and five patients with different disorders of consciousness took part in the study. A support vector machine classifier applied to EEG data was used to distinguish two mental tasks (Imagery Trial) and to detect answers to simple yes or no questions (pre-Communication Trial). The proposed procedure uses feature selection based on a nested-leave-one-out algorithm to reduce the number of electrodes required. We obtained a mean classification accuracy of 82.0% (SD 5.1%) for healthy subjects and 84.6% (SD 9.1%) for patients in the Imagery Trial, and a mean classification accuracy of 80.7% (SD 11.5%) for healthy subjects and 91.7% (SD 7.4%) for patients in the pre-Communication Trial. The subset of electrodes selected was subject and session dependent.

Equal prefrontal cortex activation between males and females in a motor tasks and different visual imagery perspectives: a functional near-infrared spectroscopy (fNIRS) study

The purpose of this study was to compare the prefrontal cortex (PFC) blood flow variation and time on in males and females while performing a motor task and imagery perspectives. Eighteen right handed subjects (11 males and 7 females) were volunteers to this study. All subjects went through three randomly conditions, a motor task condition (MT) in which they had to do a simple finger tap. The other conditions included practicing imagery in first and third views. During all the conditions, the fNIRS device was attached to the subject forehead to obtain the blood flow; the total time in each task which was measured with a chronometer. No difference had been found in any condition for both sexes in the PFC and time, nor for all subjects integrated in the PFC. Therefore, we conclu-de that both imageries can be used to mentally train a motor task, and probably both sexes can be benefited.

Sex differences in components of imagined perspective transformation

Little research to date has examined whether sex differences in spatial ability extend to the mental self rotation involved in taking on a third party perspective. This question was addressed in the present study by assessing components of imagined perspective transformations in twenty men and twenty women. Participants made speeded left-right judgements about the hand in which an object was held by front- and back- facing schematic human figures in an "own body transformation task." Response times were longer when the figure did not share the same spatial orientation as the participant, and were substantially longer than those made for a control task requiring left-right judgements about the same stimuli from the participant's own point of view. A sex difference in imagined perspective transformation favouring males was found to be restricted to the speed of imagined self rotation, and was not observed for components indexing readiness to take a third party point of view, nor in left-right confusion. These findings indicate that the range of spatial abilities for which a sex difference has been established should be extended to include imagined perspective transformations. They also suggest that imagined perspective transformations may not draw upon those empathic social-emotional perspective taking processes for which females show an advantage.

Trial-to-trial variability differentiates motor imagery during observation between low versus high responders: a functional near-infrared spectroscopy study

Trial-to-trial variability is a well-known issue in brain signals measured using functional near-infrared spectroscopy (fNIRS). We aimed to investigate whether trial-to-trial variability does provide information about individual performance. Seventeen subjects observed a virtual reality grasping task in first-person view while either imagining (motor imagery during observation, MIO) or imitating (motor execution, ME) the movements. Each condition was performed with the display in one of two positions, a conventional vertical position and a mirrored horizontal position which placed the virtual arm in the correct position relative to the viewpoint. Averaged oxy-hemoglobin concentration Δ[O(2)Hb] showed that the responses could be differentiated into two distinct groups: low responders (LR) and high responders (HR). Within groups, two main sources of trial-to-trial variability were identified: (a) the Δ[O(2)Hb] amplitude, with largest amplitudes in ME conditions (group HR) and smallest amplitudes in MIO conditions (group LR), and (b) the sign of Δ[O(2)Hb], with positive responses occurring most frequently during ME (group HR) and negative responses most frequently during MIO (group LR). Furthermore, the trial-to-trial dynamics differed between groups and could be described in group LR as inverted polynomial U-shaped curve in the mirror conditions (ME-mirror, MIO-mirror). Last, trial-to-trial variability was significantly dependent on task modality, i.e. ME (group HR) versus MIO (group LR), and/or the mirrored display positions (group LR). Our results show a relationship of trial-to-trial variability to individual MI performance, which may be of significance for neurorehabilitation applications. Although the sources of trial-to-trial variability remain unknown, we suggest that they may contribute to future neurofeedback applications.

Men fear other men most: gender specific brain activations in perceiving threat from dynamic faces and bodies - an FMRI study

Gender differences are an important factor regulating our daily interactions. Using functional magnetic resonance imaging we show that brain areas involved in processing social signals are activated differently by threatening signals send from male and female facial and bodily expressions and that their activation patterns are different for male and female observers. Male participants pay more attention to the female face as shown by increased amygdala activity. But a host of other areas show selective sensitivity for male observers attending to male threatening bodily expressions (extrastriate body area, superior temporal sulcus, fusiform gyrus, pre-supplementary motor area, and premotor cortex). This is the first study investigating gender differences in processing dynamic female and male facial and bodily expressions and it illustrates the importance of gender differences in affective communication.