fMRI Validation of fNIRS Measurements During a Naturalistic Task

Optimizing spatial specificity and signal quality in fNIRS: an overview of potential challenges and possible options for improving the reliability of real-time applications

The optical brain imaging method functional near-infrared spectroscopy (fNIRS) is a promising tool for real-time applications such as neurofeedback and brain-computer interfaces. Its combination of spatial specificity and mobility makes it particularly attractive for clinical use, both at the bedside and in patients' homes. Despite these advantages, optimizing fNIRS for real-time use requires careful attention to two key aspects: ensuring good spatial specificity and maintaining high signal quality. While fNIRS detects superficial cortical brain regions, consistently and reliably targeting specific regions of interest can be challenging, particularly in studies that require repeated measurements. Variations in cap placement coupled with limited anatomical information may further reduce this accuracy. Furthermore, it is important to maintain good signal quality in real-time contexts to ensure that they reflect the true underlying brain activity. However, fNIRS signals are susceptible to contamination by cerebral and extracerebral systemic noise as well as motion artifacts. Insufficient real-time preprocessing can therefore cause the system to run on noise instead of brain activity. The aim of this review article is to help advance the progress of fNIRS-based real-time applications. It highlights the potential challenges in improving spatial specificity and signal quality, discusses possible options to overcome these challenges, and addresses further considerations relevant to real-time applications. By addressing these topics, the article aims to help improve the planning and execution of future real-time studies, thereby increasing their reliability and repeatability.

Mobile fNIRS for exploring inter-brain synchrony across generations and time

While still relatively rare, longitudinal hyperscanning studies are exceptionally valuable for documenting changes in inter-brain synchrony, which may in turn underpin how behaviors develop and evolve in social settings. The generalizability and ecological validity of this experimental approach hinges on the selected imaging technique being mobile-a requirement met by functional near-infrared spectroscopy (fNIRS). fNIRS has most frequently been used to examine the development of inter-brain synchrony and behavior in child-parent dyads. In this position paper, we contend that dedicating attention to longitudinal and intergenerational hyperscanning stands to benefit the fields of social and cognitive neuroscience more broadly. We argue that this approach is particularly relevant for understanding the neural mechanisms underpinning intergenerational social dynamics, and potentially for benchmarking progress in psychological and social interventions, many of which are situated in intergenerational contexts. In line with our position, we highlight areas of intergenerational research that stand to be enhanced by longitudinal hyperscanning with mobile devices, describe challenges that may arise from measuring across generations in the real world, and offer potential solutions.

Coherent, time-shifted patterns of microstructural plasticity during motor-skill learning

Motor skill learning relies on neural plasticity in the motor and limbic systems. However, the spatial and temporal characteristics of these changes-and their microstructural underpinnings-remain unclear. Eighteen healthy males received 1 hour of training in a computer-based motion game, 4 times a week, for 4 consecutive weeks, while 14 untrained participants underwent scanning only. Performance improvements were observed in all trained participants. Serial myelin- and iron-sensitive multiparametric mapping at 3T during this period of intensive motor skill acquisition revealed temporally and spatially distributed, performance-related microstructural changes in the grey and white matter across a corticospinal-cerebellar-hippocampal circuit. Analysis of the trajectory of these transient changes suggested time-shifted cascades of plasticity from the dominant sensorimotor system to the contralateral hippocampus. In the cranial corticospinal tracts, changes in myelin-sensitive metrics during training in the posterior limb of the internal capsule were of greater magnitude in those who trained their upper limbs vs. lower limb trainees. Motor skill learning is associated with waves of grey and white matter plasticity, across a broad sensorimotor network.

Multimodal assessment of the spatial correspondence between fNIRS and fMRI hemodynamic responses in motor tasks

Functional near-infrared spectroscopy (fNIRS) provides a cost-efficient and portable alternative to functional magnetic resonance imaging (fMRI) for assessing cortical activity changes based on hemodynamic signals. The spatial and temporal underpinnings of the fMRI blood-oxygen-level-dependent (BOLD) signal and corresponding fNIRS concentration of oxygenated (HbO), deoxygenated (HbR), and total hemoglobin (HbT) measurements are still not completely clear. We aim to analyze the spatial correspondence between these hemodynamic signals, in motor-network regions. To this end, we acquired asynchronous fMRI and fNIRS recordings from 9 healthy participants while performing motor imagery and execution. Using this multimodal approach, we investigated the ability to identify motor-related activation clusters in fMRI data using subject-specific fNIRS-based cortical signals as predictors of interest. Group-level activation was found in fMRI data modeled from corresponding fNIRS measurements, with significant peak activation found overlapping the individually-defined primary and premotor motor cortices, for all chromophores. No statistically significant differences were observed in multimodal spatial correspondence between HbO, HbR, and HbT, for both tasks. This suggests the possibility of translating neuronal information from fMRI into an fNIRS motor-coverage setup with high spatial correspondence using both oxy and deoxyhemoglobin data, with the inherent benefits of translating fMRI paradigms to fNIRS in cognitive and clinical neuroscience.

Neural and visual processing of social gaze cueing in typical and ASD adults

Atypical eye gaze in joint attention is a clinical characteristic of autism spectrum disorder (ASD). Despite this documented symptom, neural processing of joint attention tasks in real-life social interactions is not understood. To address this knowledge gap, functional-near infrared spectroscopy (fNIRS) and eye-tracking data were acquired simultaneously as ASD and typically developed (TD) individuals engaged in a gaze-directed joint attention task with a live human and robot partner. We test the hypothesis that face processing deficits in ASD are greater for interactive faces than for simulated (robot) faces. Consistent with prior findings, neural responses during human gaze cueing modulated by face visual dwell time resulted in increased activity of ventral frontal regions in ASD and dorsal parietal systems in TD participants. Hypoactivity of the right dorsal parietal area during live human gaze cueing was correlated with autism spectrum symptom severity: Brief Observations of Symptoms of Autism (BOSA) scores (r = âˆ'0.86). Contrarily, neural activity in response to robot gaze cueing modulated by visual acquisition factors activated dorsal parietal systems in ASD, and this neural activity was not related to autism symptom severity (r = 0.06). These results are consistent with the hypothesis that altered encoding of incoming facial information to the dorsal parietal cortex is specific to live human faces in ASD. These findings open new directions for understanding joint attention difficulties in ASD by providing a connection between superior parietal lobule activity and live interaction with human faces.

Lay Summary

Little is known about why it is so difficult for autistic individuals to make eye contact with other people. We find that in a live face-to-face viewing task with a robot, the brains of autistic participants were similar to typical participants but not when the partner was a live human. Findings suggest that difficulties in real-life social situations for autistic individuals may be specific to difficulties with live social interaction rather than general face gaze.

Shining a light on cultural neuroscience: Recommendations on the use of fNIRS to study how sociocultural contexts shape the brain

Functional near-infrared spectroscopy (fNIRS) is a portable neuroimaging technique that may serve as a methodological tool for studying how sociocultural contexts can shape the human brain and impact cognition and behavior. The use of fNIRS in community-based research may (a) advance theoretical knowledge in psychology and neuroscience, particularly regarding underrepresented ethnic-racial communities; (b) increase diversity in samples; and (c) provide neurobiological evidence of sociocultural factors supporting human development. The review aims to introduce the use of fNIRS, including its practicalities and limitations, to new adopters inquiring how sociocultural inputs affect the brain. The review begins with an introduction to cultural neuroscience, and a review on the use of fNIRS follows. Next, benefits and guidelines to the design of fNIRS research in naturalistic environments (in the community or in the field) using a cultural lens are discussed. Strengths-based and community-based approaches in cultural neuroscience are recommended throughout. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Emotional modulation of cortical activity during gum chewing: A functional near-infrared spectroscopy study

Distinct brain regions are known to be associated with various emotional states. Cortical activity may be modulated by emotional states that are triggered by flavors during food intake. We examined cortical activity during chewing with different flavors and assessed the emotional modulation of cortical activity using multichannel near-infrared spectroscopy. Thirty-six right-handed volunteers participated in this crossover trial. The participants experienced positive and negative emotions from chewing flavorful (palatable) or less flavorful (unpalatable) gums, respectively for 5 min. Participants rated the taste, odor, and deliciousness of each gum using a visual analog scale. Bilateral hemodynamic responses in the frontal and parietal lobes, bilateral masseter muscle activation, and heart rate were measured during gum chewing. Changes in all measured data during gum chewing were also evaluated. The ratings of the tastes and odors of each gum significantly differed among the participants (P < 0.001). Hemodynamic response changes were significantly elevated in the bilateral primary sensorimotor cortex during gum-chewing, in comparison to resting. The difference in hemodynamic responses between palatable and unpalatable gum conditions was detected in the left frontopolar/dorsolateral prefrontal cortex. Muscle activation and heart rate were not significantly different between different gum types. Our findings indicate that differential processing in the left prefrontal cortex might be responsible for the emotional states caused by palatable and unpalatable foods.

Neuroergonomic assessment of developmental coordination disorder

Until recently, neural assessments of gross motor coordination could not reliably handle active tasks, particularly in realistic environments, and offered a narrow understanding of motor-cognition. By applying a comprehensive neuroergonomic approach using optical mobile neuroimaging, we probed the neural correlates of motor functioning in young people with Developmental Coordination Disorder (DCD), a motor-learning deficit affecting 5-6% of children with lifelong complications. Neural recordings using fNIRS were collected during active ambulatory behavioral task execution from 37 Typically Developed and 48 DCD Children who performed cognitive and physical tasks in both single and dual conditions. This is the first of its kind study targeting regions of prefrontal cortical dysfunction for identification of neuropathophysiology for DCD during realistic motor tasks and is one of the largest neuroimaging study (across all modalities) involving DCD. We demonstrated that DCD is a motor-cognitive disability, as gross motor /complex tasks revealed neuro-hemodynamic deficits and dysfunction within the right middle and superior frontal gyri of the prefrontal cortex through functional near infrared spectroscopy. Furthermore, by incorporating behavioral performance, decreased neural efficiency in these regions were revealed in children with DCD, specifically during motor tasks. Lastly, we provide a framework, evaluating disorder impact in ecologically valid contexts to identify when and for whom interventional approaches are most needed and open the door for precision therapies.

Effects of degraded speech processing and binaural unmasking investigated using functional near-infrared spectroscopy (fNIRS)

The present study aimed to investigate the effects of degraded speech perception and binaural unmasking using functional near-infrared spectroscopy (fNIRS). Normal hearing listeners were tested when attending to unprocessed or vocoded speech, presented to the left ear at two speech-to-noise ratios (SNRs). Additionally, by comparing monaural versus diotic masker noise, we measured binaural unmasking. Our primary research question was whether the prefrontal cortex and temporal cortex responded differently to varying listening configurations. Our a priori regions of interest (ROIs) were located at the left dorsolateral prefrontal cortex (DLPFC) and auditory cortex (AC). The left DLPFC has been reported to be involved in attentional processes when listening to degraded speech and in spatial hearing processing, while the AC has been reported to be sensitive to speech intelligibility. Comparisons of cortical activity between these two ROIs revealed significantly different fNIRS response patterns. Further, we showed a significant and positive correlation between self-reported task difficulty levels and fNIRS responses in the DLPFC, with a negative but non-significant correlation for the left AC, suggesting that the two ROIs played different roles in effortful speech perception. Our secondary question was whether activity within three sub-regions of the lateral PFC (LPFC) including the DLPFC was differentially affected by varying speech-noise configurations. We found significant effects of spectral degradation and SNR, and significant differences in fNIRS response amplitudes between the three regions, but no significant interaction between ROI and speech type, or between ROI and SNR. When attending to speech with monaural and diotic noises, participants reported the latter conditions being easier; however, no significant main effect of masker condition on cortical activity was observed. For cortical responses in the LPFC, a significant interaction between SNR and masker condition was observed. These findings suggest that binaural unmasking affects cortical activity through improving speech reception threshold in noise, rather than by reducing effort exerted.

fMRI-based validation of continuous-wave fNIRS of supplementary motor area activation during motor execution and motor imagery

Compared to functional magnetic resonance imaging (fMRI), functional near infrared spectroscopy (fNIRS) has several advantages that make it particularly interesting for neurofeedback (NFB). A pre-requisite for NFB applications is that with fNIRS, signals from the brain region of interest can be measured. This study focused on the supplementary motor area (SMA). Healthy older participants (N = 16) completed separate continuous-wave (CW-) fNIRS and (f)MRI sessions. Data were collected for executed and imagined hand movements (motor imagery, MI), and for MI of whole body movements. Individual anatomical data were used to (i) define the regions of interest for fMRI analysis, to (ii) extract the fMRI BOLD response from the cortical regions corresponding to the fNIRS channels, and (iii) to select fNIRS channels. Concentration changes in oxygenated (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Delta [HbO]$$\end{document}Δ[HbO]) and deoxygenated (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Delta [HbR]$$\end{document}Δ[HbR]) hemoglobin were considered in the analyses. Results revealed subtle differences between the different MI tasks, indicating that for whole body MI movements as well as for MI of hand movements \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\Delta [HbR]$$\end{document}Δ[HbR] is the more specific signal. Selection of the fNIRS channel set based on individual anatomy did not improve the results. Overall, the study indicates that in terms of spatial specificity and task sensitivity SMA activation can be reliably measured with CW-fNIRS.

Characterisation of Phantom Limb Pain in Traumatic Lower-Limb Amputees

Introduction

There is no diagnosis for phantom limb pain (PLP), and its investigation is based on anamnesis, which is subject to several biases. Therefore, it is important to describe and standardize the diagnostic methodology for PLP.

Objective

To characterise PLP and, secondarily, to determine predictors for its diagnosis. Methodology. This is a cross-sectional study involving patients with unilateral traumatic lower-limb amputation aged over 18 years. Those with clinical decompensation or evidence of disease, trauma, or surgery in the central or peripheral nervous system were excluded. Sociodemographic and rehabilitative data were collected; PLP was characterised using the visual analogue scale (VAS), pain descriptors, and weekly frequency.

Results

A total of 55 eligible patients participated in the study; most were male, young, above-knee amputees in the preprosthetic phase of the rehabilitation. The median PLP VAS was 60 (50–79.3) mm characterised by 13 (6–20) different descriptors in the same patient, which coexist, alternate, and add up to a frequency of 3.94 (2.5–4.38) times per week. The most frequent descriptor was movement of the phantom limb (70.91%). Tingling, numbness, flushing, itchiness, spasm, tremor, and throbbing are statistically significant PLP descriptor numbers per patient predicted by above-knee amputation, prosthetic phase, higher education level, and greater PLP intensity by VAS (p < 0.05).

Conclusion

PLP is not a single symptom, but a set with different sensations and perceptions that need directed and guided anamnesis for proper diagnosis.

Learning to diagnose X-rays: a neuroscientific study of practice-related activation changes in the prefrontal cortex

OBJECTIVES

Medical expertise manifests itself by the ability of a physician to rapidly diagnose patients. How this expertise develops from a neural-activation perspective is not well understood. The objective of the present study was to investigate practice-related activation changes in the prefrontal cortex (PFC) as medical students learn to diagnose chest X-rays.

METHODS

The experimental paradigm consisted of a learning and a test phase. During the learning phase, 26 medical students were trained to diagnose four out of eight chest X-rays. These four cases were presented repeatedly and corrective feedback was provided. During the test phase, all eight cases were presented together with near- and far-transfer cases to examine whether participants' diagnostic learning went beyond simple rote recognition of the trained X-rays. During both phases, participants' PFC was scanned using functional near-infrared spectroscopy. Response time and diagnostic accuracy were recorded as behavioural indicators. One-way repeated measures ANOVA were conducted to analyse the data.

RESULTS

Results revealed that participants' diagnostic accuracy significantly increased during the learning phase (F=6.72, p<0.01), whereas their response time significantly decreased (F=16.69, p<0.001). Learning to diagnose chest X-rays was associated with a significant decrease in PFC activity (F=33.21, p<0.001) in the left dorsolateral prefrontal cortex, the orbitofrontal area, the frontopolar area and the frontal eye field. Further, the results of the test phase indicated that participants' diagnostic accuracy was significantly higher for the four trained cases, second highest for the near-transfer, third highest for the far-transfer cases and lowest for the untrained cases (F=167.20, p<0.001) and response time was lowest for the trained cases, second lowest for the near-transfer, third lowest for the far-transfer cases and highest for the untrained cases (F=9.72, p<0.001). In addition, PFC activity was lowest for the trained and near-transfer cases, followed by the far-transfer cases and highest for the untrained cases (F=282.38, p<0.001).

CONCLUSIONS

The results suggest that learning to diagnose X-rays is associated with a significant decrease in PFC activity. In terms of dual-process theory, these findings support the notion that students initially rely more on slow analytical system-2 reasoning. As expertise develops, system-2 reasoning transitions into faster and automatic system-1 reasoning.

Experiencing Happiness Together Facilitates Dyadic Coordination through the Enhanced Interpersonal Neural Synchronization

Experiencing positive emotions together facilitates interpersonal understanding and promotes subsequent social interaction among individuals. However, the neural underpinnings of such emotional-social effect remain to be discovered. Current study employed the fNIRS-based hyperscanning to investigate the above mentioned relationship. After participants in dyad watching movie clips with happily or neutral emotion, they were asked to perform the interpersonal cooperative task, with their neural activation of prefrontal cortex (PFC) being recorded simultaneously via functional near infrared spectroscopy. Results suggested that compared with the neutral movie watching together, a higher interpersonal neural synchronization (INS) in left inferior frontal gyrus during participant dyads watching happiness movie together. Subsequently, dyads in happiness showed more effective coordination interaction during performed the interpersonal cooperation task compared to those in the neutral condition, and such facilitated effect was associated with increased cooperation-related INS at left middle frontal cortex. A mediation analysis showed that the coordination interaction fully mediated the relationship between the emotion-induced INS during the happiness movie-viewing and the cooperation-related INS in interpersonal cooperation. Taken together, our findings suggest that the faciliatory effect experiencing happiness together has on interpersonal cooperation can be reliably reflected by the INS magnitude at the brain level.

Compromised Brain Activity With Age During a Game-Like Dynamic Balance Task: Single- vs. Dual-Task Performance

Background: Postural control and cognition are affected by aging. We investigated whether cognitive distraction influenced neural activity differently in young and older adults during a game-like mediolateral weight-shifting task with a personalized task load.

Methods: Seventeen healthy young and 17 older adults performed a balance game, involving hitting virtual wasps, serial subtractions and a combination of both (dual-task). A motion analysis system estimated each subject's center of mass position. Cortical activity in five regions was assessed by measuring oxygenated hemoglobin (HbO₂) with a functional Near-Infrared Spectroscopy system.

Results: When adding cognitive load to the game, weight-shifting speed decreased irrespective of age, but older adults reduced the wasp-hits more than young adults. Accompanying these changes, older adults decreased HbO₂ in the left pre-frontal cortex (PFC) and frontal eye fields (FEF) compared to single-tasking, a finding not seen in young adults. Additionally, lower HbO₂ levels were found during dual-tasking compared to the summed activation of the two single tasks in all regions except for the right PFC. These relative reductions were specific for the older age group in the left premotor cortex (PMC), the right supplementary motor area (SMA), and the left FEF.

Conclusion: Older adults showed more compromised neural activity than young adults when adding a distraction to a challenging balance game. We interpret these changes as competitive downgrading of neural activity underpinning the age-related deterioration of game performance during dual-tasking. Future work needs to ascertain if older adults can train their neural flexibility to withstand balance challenges during daily life activities.

Cerebral Hemodynamic Responses to the Difficulty Level of Ambulatory Tasks in Patients With Parkinson's Disease: A Systematic Review and Meta-Analysis

Background. Ambulatory tasks are the important components of balance training which effectively improve postural stability and functional activities in persons with Parkinson's disease (PD). The difficulty level of an ambulatory task is usually set in the form of attention, direction, speed, or amplitude requirement. Objectives. This study aimed to explore the neural mechanisms of cerebral hemodynamic responses to the difficulty level of ambulatory tasks in persons with PD. Methods. We included ten studies that examined cerebral hemodynamic responses during ambulatory tasks at different difficulty levels in persons with PD. The change in hemodynamic responses was synthesized and meta-analyzed. Results. Patients during "ON" medication had higher relative change in oxygenated hemoglobin (ΔHBO₂) in the prefrontal cortex in response to difficulty levels of ambulatory tasks, which is comparable to that in healthy elderly individuals. However, patients during "OFF" medication did not show cortical activation in response to difficulty levels. During the lower-difficulty tasks, patients during "ON" medication demonstrated higher ΔHBO₂ than healthy elderly participants and patients during "OFF" medication. Factors found to significantly contribute to the heterogeneity across studies included subjects' type and cognitive status, task duration, setting, and filter used for functional near-infrared spectroscopy (fNIRS) data pre-processing. Conclusions. The findings suggest that ambulatory task at a higher difficulty level could be necessary to train the cortical capacity of PD persons, which should be conducted during "ON" medication; meanwhile, the contributing factors to the heterogeneity of studies would be useful as a reference when designing comparable fNIRS studies.

Motor Training Using Mental Workload (MWL) With an Assistive Soft Exoskeleton System: A Functional Near-Infrared Spectroscopy (fNIRS) Study for Brain-Machine Interface (BMI)

Mental workload is a neuroergonomic human factor, which is widely used in planning a system's safety and areas like brain-machine interface (BMI), neurofeedback, and assistive technologies. Robotic prosthetics methodologies are employed for assisting hemiplegic patients in performing routine activities. Assistive technologies' design and operation are required to have an easy interface with the brain with fewer protocols, in an attempt to optimize mobility and autonomy. The possible answer to these design questions may lie in neuroergonomics coupled with BMI systems. In this study, two human factors are addressed: designing a lightweight wearable robotic exoskeleton hand that is used to assist the potential stroke patients with an integrated portable brain interface using mental workload (MWL) signals acquired with portable functional near-infrared spectroscopy (fNIRS) system. The system may generate command signals for operating a wearable robotic exoskeleton hand using two-state MWL signals. The fNIRS system is used to record optical signals in the form of change in concentration of oxy and deoxygenated hemoglobin (HbO and HbR) from the pre-frontal cortex (PFC) region of the brain. Fifteen participants participated in this study and were given hand-grasping tasks. Two-state MWL signals acquired from the PFC region of the participant's brain are segregated using machine learning classifier-support vector machines (SVM) to utilize in operating a robotic exoskeleton hand. The maximum classification accuracy is 91.31%, using a combination of mean-slope features with an average information transfer rate (ITR) of 1.43. These results show the feasibility of a two-state MWL (fNIRS-based) robotic exoskeleton hand (BMI system) for hemiplegic patients assisting in the physical grasping tasks.

Predicting Student Performance Using Machine Learning in fNIRS Data

Increasing student involvement in classes has always been a challenge for teachers and school managers. In online learning, some interactivity mechanisms like quizzes are increasingly used to engage students during classes and tasks. However, there is a high demand for tools that evaluate the efficiency of these mechanisms. In order to distinguish between high and low levels of engagement in tasks, it is possible to monitor brain activity through functional near-infrared spectroscopy (fNIRS). The main advantages of this technique are portability, low cost, and a comfortable way for students to concentrate and perform their tasks. This setup provides more natural conditions for the experiments if compared to the other acquisition tools. In this study, we investigated levels of task involvement through the identification of correct and wrong answers of typical quizzes used in virtual environments. We collected data from the prefrontal cortex region (PFC) of 18 students while watching a video lecture. This data was modeled with supervised learning algorithms. We used random forests and penalized logistic regression to classify correct answers as a function of oxyhemoglobin and deoxyhemoglobin concentration. These models identify which regions best predict student performance. The random forest and penalized logistic regression (GLMNET with LASSO) obtained, respectively, 0.67 and 0.65 area of the ROC curve. Both models indicate that channels F4-F6 and AF3-AFz are the most relevant for the prediction. The statistical significance of these models was confirmed through cross-validation (leave-one-subject-out) and a permutation test. This methodology can be useful to better understand the teaching and learning processes in a video lecture and also provide improvements in the methodologies used in order to better adapt the presentation content.

Comparison of Human Social Brain Activity During Eye-Contact With Another Human and a Humanoid Robot

Robot design to simulate interpersonal social interaction is an active area of research with applications in therapy and companionship. Neural responses to eye-to-eye contact in humans have recently been employed to determine the neural systems that are active during social interactions. Whether eye-contact with a social robot engages the same neural system remains to be seen. Here, we employ a similar approach to compare human-human and human-robot social interactions. We assume that if human-human and human-robot eye-contact elicit similar neural activity in the human, then the perceptual and cognitive processing is also the same for human and robot. That is, the robot is processed similar to the human. However, if neural effects are different, then perceptual and cognitive processing is assumed to be different. In this study neural activity was compared for human-to-human and human-to-robot conditions using near infrared spectroscopy for neural imaging, and a robot (Maki) with eyes that blink and move right and left. Eye-contact was confirmed by eye-tracking for both conditions. Increased neural activity was observed in human social systems including the right temporal parietal junction and the dorsolateral prefrontal cortex during human-human eye contact but not human-robot eye-contact. This suggests that the type of human-robot eye-contact used here is not sufficient to engage the right temporoparietal junction in the human. This study establishes a foundation for future research into human-robot eye-contact to determine how elements of robot design and behavior impact human social processing within this type of interaction and may offer a method for capturing difficult to quantify components of human-robot interaction, such as social engagement.

Comparison of short-channel separation and spatial domain filtering for removal of non-neural components in functional near-infrared spectroscopy signals

Significance: With the increasing popularity of functional near-infrared spectroscopy (fNIRS), the need to determine localization of the source and nature of the signals has grown. Aim: We compare strategies for removal of non-neural signals for a finger-thumb tapping task, which shows responses in contralateral motor cortex and a visual checkerboard viewing task that produces activity within the occipital lobe. Approach: We compare temporal regression strategies using short-channel separation to a spatial principal component (PC) filter that removes global signals present in all channels. For short-channel temporal regression, we compare non-neural signal removal using first and combined first and second PCs from a broad distribution of short channels to limited distribution on the forehead. Results: Temporal regression of non-neural information from broadly distributed short channels did not differ from forehead-only distribution. Spatial PC filtering provides results similar to short-channel separation using the temporal domain. Utilizing both first and second PCs from short channels removes additional non-neural information. Conclusions: We conclude that short-channel information in the temporal domain and spatial domain regression filtering methods remove similar non-neural components represented in scalp hemodynamics from fNIRS signals and that either technique is sufficient to remove non-neural components.

Tracking differential activation of primary and supplementary motor cortex across timing tasks: An fNIRS validation study

Functional near-infrared spectroscopy (fNIRS) provides an alternative to functional magnetic resonance imaging (fMRI) for assessing changes in cortical hemodynamics. To establish the utility of fNIRS for measuring differential recruitment of the motor network during the production of timing-based actions, we measured cortical hemodynamic responses in 10 healthy adults while they performed two versions of a finger-tapping task. The task, used in an earlier fMRI study (Jantzen et al., 2004), was designed to track the neural basis of different timing behaviors. Participants paced their tapping to a metronomic tone, then continued tapping at the established pace without the tone. Initial tapping was either synchronous or syncopated relative to the tone. This produced a 2 × 2 design: synchronous or syncopated tapping and pacing the tapping with or continuing without a tone. Accuracy of the timing of tapping was tracked while cortical hemodynamics were monitored using fNIRS. Hemodynamic responses were computed by canonical statistical analysis across trials in each of the four conditions. Task-induced brain activation resulted in significant increases in oxygenated hemoglobin concentration (oxy-Hb) in a broad region in and around the motor cortex. Overall, syncopated tapping was harder behaviorally and produced more cortical activation than synchronous tapping. Thus, we observed significant changes in oxy-Hb in direct relation to the complexity of the task.

New Directions in Exercise Prescription: Is There a Role for Brain-Derived Parameters Obtained by Functional Near-Infrared Spectroscopy?

In the literature, it is well established that regular physical exercise is a powerful strategy to promote brain health and to improve cognitive performance. However, exact knowledge about which exercise prescription would be optimal in the setting of exercise–cognition science is lacking. While there is a strong theoretical rationale for using indicators of internal load (e.g., heart rate) in exercise prescription, the most suitable parameters have yet to be determined. In this perspective article, we discuss the role of brain-derived parameters (e.g., brain activity) as valuable indicators of internal load which can be beneficial for individualizing the exercise prescription in exercise–cognition research. Therefore, we focus on the application of functional near-infrared spectroscopy (fNIRS), since this neuroimaging modality provides specific advantages, making it well suited for monitoring cortical hemodynamics as a proxy of brain activity during physical exercise.

Research progress of functional near-infrared spectroscopy in patients with psychiatric disorders

Functional near-infrared spectroscopy (fNIRS) is a technique of detecting cerebral cortical function by using near-infrared light, which is a multifunctional neuroimaging technique and provides a convenient and efficient detection method in neuroscience. In consideration of acceptability, safety, high spatial and temporal resolutions compared with electroencephalogram (EEG) and functional magnetic resonance imaging (fMRI), fNIRS is widely used to study different psychiatric disorders, most prominently affective disorders, schizophrenic illnesses, brain organic mental disorders and neurodevelopmental disorders, etc. The article focuses on the latest research progress and practical application of fNIRS in psychiatric disorders, especially traumatic brain, including studies on the characterization of phenomenology, treatment effects and descriptions of neuroimaging data.

The present and future use of functional near-infrared spectroscopy (fNIRS) for cognitive neuroscience

The past few decades have seen a rapid increase in the use of functional near-infrared spectroscopy (fNIRS) in cognitive neuroscience. This fast growth is due to the several advances that fNIRS offers over the other neuroimaging modalities such as functional magnetic resonance imaging and electroencephalography/magnetoencephalography. In particular, fNIRS is harmless, tolerant to bodily movements, and highly portable, being suitable for all possible participant populations, from newborns to the elderly and experimental settings, both inside and outside the laboratory. In this review we aim to provide a comprehensive and state-of-the-art review of fNIRS basics, technical developments, and applications. In particular, we discuss some of the open challenges and the potential of fNIRS for cognitive neuroscience research, with a particular focus on neuroimaging in naturalistic environments and social cognitive neuroscience.

The Hemodynamic Mass Action of a Central Pattern Generator

The hemodynamic response is a neurovascular and metabolic process in which there is rapid delivery of blood flow to a neuronal tissue in response to neuronal activation. The functional magnetic resonance imaging (fMRI) and the functional near-infrared spectroscopy (fNIRS), for instance, are based on the physiological principles of such hemodynamic responses. Both techniques allow the mapping of active neuronal regions in which the neurovascular and metabolic events are occurring. However, although both techniques have revolutionized the neurosciences, they are mostly employed for neuroimaging of the human brain but not for the spinal cord during functional tasks. Moreover, little is known about other techniques measuring the hemodynamic response in the spinal cord. The purpose of the present study was to show for the first time that a simple optical system termed direct current photoplethysmography (DC-PPG) can be employed to detect hemodynamic responses of the spinal cord and the brainstem during the functional activation of the spinal central pattern generator (CPG). In particular, we positioned two DC-PPG systems directly on the brainstem and spinal cord during fictive scratching in the cat. The optical DC-PPG systems allowed the trial-by-trial recording of massive hemodynamic signals. We found that the “strength” of the flexor-plus-extensor motoneuron activities during motor episodes of fictive scratching was significantly correlated to the “strengths” of the brainstem and spinal DC-PPG signals. Because the DC-PPG was robustly detected in real-time, we claim that such a functional signal reflects the hemodynamic mass action of the brainstem and spinal cord associated with the CPG motor action. Our findings shed light on an unexplored hemodynamic observable of the spinal CPGs, providing a proof of concept that the DC-PPG can be used for the assessment of the integrity of the human CPGs.

Real-Time Eye-to-Eye Contact Is Associated With Cross-Brain Neural Coupling in Angular Gyrus

Direct eye contact between two individuals is a salient social behavior known to initiate and promote interpersonal interaction. However, the neural processes that underlie these live interactive behaviors and eye-to-eye contact are not well understood. The Dynamic Neural Coupling Hypothesis presents a general theoretical framework proposing that shared interactive behaviors are represented by cross-brain signal coherence. Using functional near-infrared spectroscopy (fNIRS) adapted for hyper scanning, we tested this hypothesis specifically for neural mechanisms associated with eye-to-eye gaze between human participants compared to similar direct eye-gaze at a dynamic video of a face and predicted that the coherence of neural signals between the two participants during reciprocal eye-to-eye contact would be greater than coherence observed during direct eye-gaze at a dynamic video for those signals originating in social and face processing systems. Consistent with this prediction cross-brain coherence was increased for signals within the angular gyrus (AG) during eye-to-eye contact relative to direct eye-gaze at a dynamic face video (p < 0.01). Further, activity in the right temporal-parietal junction (TPJ) was increased in the real eye-to-eye condition (p < 0.05, FDR corrected). Together, these findings advance a functional and mechanistic understanding of the AG and cross-brain neural coupling associated with real-time eye-to-eye contact.

Prefrontal activation related to spontaneous creativity with rock music improvisation: A functional near-infrared spectroscopy study

Understanding how the brain modulates improvisation has been the focus of numerous studies in recent years. Models have suggested regulation of activity between default mode and executive control networks play a role in improvisational execution. Several studies comparing formulaic to improvised sequences support this framework and document increases in activity in medial frontal lobe with decreased activity in the dorsolateral prefrontal cortex (DLPFC). These patterns can be influenced through training and neural responses may differ between in beginner and expert musicians. Our goal was to test the generalizability of this framework and determine similarity in neural activity in the prefrontal cortex during improvisation. Twenty guitarists performed improvised and formulaic sequences in a blues rock format while brain activity was recorded using functional near-infrared spectroscopy. Results indicate similar modulation in DLPFC as seen previously. Specific decreases of activity from left DLPFC in the end compared to beginning or middle of improvised sequences were also found. Despite the range of skills of participants, we also found significant correlation between subjective feelings of improvisational performance and modulation in left DLPFC. Processing of subjective feelings regardless of skill may contribute to neural modulation and may be a factor in understanding neural activity during improvisation.

Modeling and classification of voluntary and imagery movements for brain-computer interface from fNIR and EEG signals through convolutional neural network

Practical brain-computer interface (BCI) demands the learning-based adaptive model that can handle diverse problems. To implement a BCI, usually functional near-infrared spectroscopy (fNIR) is used for measuring functional changes in brain oxygenation and electroencephalography (EEG) for evaluating the neuronal electric potential regarding the psychophysiological activity. Since the fNIR modality has an issue of temporal resolution, fNIR alone is not enough to achieve satisfactory classification accuracy as multiple neural stimuli are produced by voluntary and imagery movements. This leads us to make a combination of fNIR and EEG with a view to developing a BCI model for the classification of the brain signals of the voluntary and imagery movements. This work proposes a novel approach to prepare functional neuroimages from the fNIR and EEG using eight different movement-related stimuli. The neuroimages are used to train a convolutional neural network (CNN) to formulate a predictive model for classifying the combined fNIR-EEG data. The results reveal that the combined fNIR-EEG modality approach along with a CNN provides improved classification accuracy compared to a single modality and conventional classifiers. So, the outcomes of the proposed research work will be very helpful in the implementation of the finer BCI system.

Co-localization of theta-band activity and hemodynamic responses during face perception: simultaneous electroencephalography and functional near-infrared spectroscopy recordings

Face-specific neural processes in the human brain have been localized to multiple anatomical structures and associated with diverse and dynamic social functions. The question of how various face-related systems and functions may be bound together remains an active area of investigation. We hypothesize that face processing may be associated with specific frequency band oscillations that serve to integrate distributed face processing systems. Using a multimodal imaging approach, including electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS), simultaneous signals were acquired during face and object picture viewing. As expected for face processing, hemodynamic activity in the right occipital face area (OFA) increased during face viewing compared to object viewing, and in a subset of participants, the expected N170 EEG response was observed for faces. Based on recently reported associations between the theta band and visual processing, we hypothesized that increased hemodynamic activity in a face processing area would also be associated with greater theta-band activity originating in the same area. Consistent with our hypothesis, theta-band oscillations were also localized to the right OFA for faces, whereas alpha- and beta-band oscillations were not. Together, these findings suggest that theta-band oscillations originating in the OFA may be part of the distributed face-specific processing mechanism.

A Mini-Review on Functional Near-Infrared Spectroscopy (fNIRS): Where Do We Stand, and Where Should We Go?

This mini-review is aimed at briefly summarizing the present status of functional near-infrared spectroscopy (fNIRS) and predicting where the technique should go in the next decade. This mini-review quotes 33 articles on the different fNIRS basics and technical developments and 44 reviews on the fNIRS applications published in the last eight years. The huge number of review articles about a wide spectrum of topics in the field of cognitive and social sciences, functional neuroimaging research, and medicine testifies to the maturity achieved by this non-invasive optical vascular-based functional neuroimaging technique. Today, fNIRS has started to be utilized on healthy subjects while moving freely in different naturalistic settings. Further instrumental developments are expected to be done in the near future to fully satisfy this latter important aspect. In addition, fNIRS procedures, including correction methods for the strong extracranial interferences, need to be standardized before using fNIRS as a clinical tool in individual patients. New research avenues such as interactive neurosciences, cortical activation modulated by different type of sport performance, and cortical activation during neurofeedback training are highlighted.

Mapping brain function during naturalistic viewing using high-density diffuse optical tomography

Naturalistic stimuli, such as movies, more closely recapitulate "real life" sensory processing and behavioral demands relative to paradigms that rely on highly distilled and repetitive stimulus presentations. The rich complexity inherent in naturalistic stimuli demands an imaging system capable of measuring spatially distributed brain responses, and analysis tools optimized for unmixing responses to concurrently presented features. In this work, the combination of passive movie viewing with high-density diffuse optical tomography (HD-DOT) is developed as a platform for naturalistic brain mapping. We imaged healthy young adults during free viewing of a feature film using HD-DOT and observed reproducible, synchronized cortical responses across a majority of the field-of-view, most prominently in hierarchical cortical areas related to visual and auditory processing, both within and between individuals. In order to more precisely interpret broad patterns of cortical synchronization, we extracted visual and auditory features from the movie stimulus and mapped the cortical responses to the features. The results demonstrate the sensitivity of HD-DOT to evoked responses during naturalistic viewing, and that feature-based decomposition strategies enable functional mapping of naturalistic stimulus processing, including human-generated speech.

Pre-frontal Cortical Activity During Walking and Turning Is Reliable and Differentiates Across Young, Older Adults and People With Parkinson's Disease

Introduction: Mobility declines with age and further with neurodegenerative disorders, such as Parkinson's disease (PD). Walking and turning ability, in particular, are vital aspects of mobility that deteriorate with age and are further impaired in PD. Such deficits have been linked with reduction in automatic control of movement and the need for compensatory cognitive cortical control via the pre-frontal cortex (PFC), however the underlying neural mechanisms remain unclear. Establishing and using a robust methodology to examine PFC activity during continuous walking and turning via mobile functional near infra-red spectroscopy (fNIRS) may aid in the understanding of mobility deficits and help with development of appropriate therapeutics. This study aimed to: (1) examine test re-test reliability of PFC activity during continuous turning and walking via fNIRS measurement; and (2) compare PFC activity during continuous turning and walking in young, old and Parkinson's subjects. Methods: Twenty-five young (32.3 ± 7.5 years), nineteen older (65.4 ± 7.0 years), and twenty-four PD (69.3 ± 4.1 years) participants performed continuous walking and 360° turning-in-place tasks, each lasting 2 min. Young participants repeated the tasks a second time to allow fNIRS measurement reliability assessment. The primary outcome was PFC activity, assessed via measuring changes in oxygenated hemoglobin (HbO₂) concentrations. Results: PFC activity during continuous walking and turning was moderately reproducible (Intra-class correlation coefficient = 0.67). The PD group had higher PFC activation than young and older adults during walking and turning, with significant group differences for bilateral PFC activation (p = 0.025), left PFC activation (p = 0.012), and the early period (first 40 s) of walking (p = 0.007), with greater activation required in PD. Interestingly, older adults had similar PFC activation to young adults across conditions, however older adults required greater activation than young adults during continuous turning, specifically the early period of the turning task (Cohens d = 0.86). Conclusions: PFC activity can be measured during continuous walking and turning tasks with acceptable reliability, and can differentiate young, older and PD groups. PFC activation was significantly greater in PD compared to young and older adults during walking, particularly when beginning to walk.

Communication of emotion via drumming: dual-brain imaging with functional near-infrared spectroscopy

Nonverbal communication of emotion is essential to human interaction and relevant to many clinical applications, yet it is an understudied topic in social neuroscience. Drumming is an ancient nonverbal communication modality for expression of emotion that has not been previously investigated in this context. We investigate the neural response to live, natural communication of emotion via drumming using a novel dual-brain neuroimaging paradigm. Hemodynamic signals were acquired using whole-head functional near-infrared spectroscopy (fNIRS). Dyads of 36 subjects participated in two conditions, drumming and talking, alternating between 'sending' (drumming or talking to partner) and 'receiving' (listening to partner) in response to emotionally salient images from the International Affective Picture System. Increased frequency and amplitude of drum strikes was behaviorally correlated with higher arousal and lower valence measures and neurally correlated with temporoparietal junction (TPJ) activation in the listener. Contrast comparisons of drumming greater than talking also revealed neural activity in right TPJ. Together, findings suggest that emotional content communicated by drumming engages right TPJ mechanisms in an emotionally and behaviorally sensitive fashion. Drumming may provide novel, effective clinical approaches for treating social-emotional psychopathology.

WearLight: Toward a Wearable, Configurable Functional NIR Spectroscopy System for Noninvasive Neuroimaging

Functional near-infrared spectroscopy (fNIRS) has emerged as an effective brain monitoring technique to measure the hemodynamic response of the cortical surface. Its wide popularity and adoption in recent time attribute to its portability, ease of use, and flexibility in multimodal studies involving electroencephalography. While fNIRS is still emerging on various fronts including hardware, software, algorithm, and applications, it still requires overcoming several scientific challenges associated with brain monitoring in naturalistic environments where the human participants are allowed to move and required to perform various tasks stimulating brain behaviors. In response to these challenges and demands, we have developed a wearable fNIRS system, WearLight that was built upon an Internet-of-Things embedded architecture for onboard intelligence, configurability, and data transmission. In addition, we have pursued detailed research and comparative analysis on the design of the optodes encapsulating an near-infrared light source and a detector into 3-D printed material. We performed rigorous experimental studies on human participants to test reliability, signal-to-noise ratio, and configurability. Most importantly, we observed that WearLight has a capacity to measure hemodynamic responses in various setups including arterial occlusion on the forearm and frontal lobe brain activity during breathing exercises in a naturalistic environment. Our promising experimental results provide an evidence of preliminary clinical validation of WearLight. This encourages us to move toward intensive studies involving brain monitoring.

A Functional Near-Infrared Spectroscopy Study of State Anxiety and Auditory Working Memory Load

Cognitive studies have suggested that anxiety is correlated with cognitive performance. Previous research has focused on the relationship between anxiety level and the perceptual load within the frontal region, such as the dorsolateral prefrontal and anterior cingulate cortices. High-anxious individuals are predicted to have worse performance on cognitively-demanding tasks requiring efficient cognitive processing. A few functional magnetic resonance imaging studies have specifically discussed the performance and brain activity involving working memory for high-anxious individuals. This topic has been further explored with electroencephalography, although these studies have mostly provided results involving visual face-related stimuli. In this study, we used auditory stimulation to manipulate the working memory load and attempted to interpret the deficiency of cognitive function in high-anxious participants or patients using functional near infrared spectroscopy (fNIRS). The fNIRS signals of 30 participants were measured while they were performing an auditory working memory task. For the auditory n-back task, there were three experimental conditions, including two n-back task conditions of stimuli memorization with different memory load and a condition of passive listening to the stimuli. Hemodynamic responses from frontal brain regions were recorded using a wireless fNIRS device. Brain activation from the ventrolateral and orbital prefrontal cortex were measured with signals filtered and artifacts removed. The fNIRS signals were then standardized with statistical testing and group analysis was performed. The results revealed that there were significantly stronger hemodynamic responses in the right ventrolateral and orbital prefrontal cortex when subjects were attending to the auditory working memory task with higher load. Furthermore, the right lateralization of the prefrontal cortex was negatively correlated with the level of state anxiety. This study revealed the possibility of incorporating fNIRS signals as an index to evaluate cognitive performance and mood states given its flexibility regarding portable applications compared to other neuroimaging techniques.

fNIRS Optodes' Location Decider (fOLD): a toolbox for probe arrangement guided by brain regions-of-interest

The employment of functional near-infrared spectroscopy (fNIRS) as a method of brain imaging has increased over the last few years due to its portability, low-cost and robustness to subject movement. Experiments with fNIRS are designed in the face of a limited number of sources and detectors (optodes) to be positioned on selected portion(s) of the scalp. The optodes locations represent an expectation of assessing cortical regions relevant to the experiment’s hypothesis. However, this translation process remains a challenge for fNIRS experimental design. In the present study, we propose an approach that automatically decides the location of fNIRS optodes from a set of predefined positions with the aim of maximizing the anatomical specificity to brain regions-of-interest. The implemented method is based on photon transport simulations on two head atlases. The results are compiled into the publicly available “fNIRS Optodes’ Location Decider” (fOLD). This toolbox is a first-order approach to bring the achieved advancements of parcellation methods and meta-analyses from functional magnetic resonance imaging to more precisely guide the selection of optode positions for fNIRS experiments.

Comparison of oxyhemoglobin and deoxyhemoglobin signal reliability with and without global mean removal for digit manipulation motor tasks

Functional near-infrared spectroscopy (fNIRS) could be well suited for clinical use, such as measuring neural activity before and after treatment; however, reliability and specificity of fNIRS signals must be ensured so that differences can be attributed to the intervention. This study compared the test-retest and longitudinal reliability of oxyhemoglobin and deoxyhemoglobin signals before and after spatial filtering. In the test-retest experiment, 14 participants were scanned on 2 days while performing four right-handed digit-manipulation tasks. Group results revealed greater test-retest reliability for oxyhemoglobin than deoxyhemoglobin signals and greater spatial specificity for the deoxyhemoglobin signals. To further characterize reliability, a longitudinal experiment was conducted in which two participants repeated the same motor tasks for 10 days. Beta values from the two tasks with the lowest and highest test-retest reliability, respectively, in the spatially filtered deoxyhemoglobin signal are reported as representative findings. Both test-retest and longitudinal methods confirmed that task and signal type influence reliability. Oxyhemoglobin signals were more reliable overall than deoxyhemoglobin, and removal of the global mean reduced reliability of both signals. Findings are consistent with the suggestion that systemic components most prevalent in the oxyhemoglobin signal may inflate reliability relative to the deoxyhemoglobin signal, which is less influenced by systemic factors.

Distributed Neural Activity Patterns during Human-to-Human Competition

Interpersonal interaction is the essence of human social behavior. However, conventional neuroimaging techniques have tended to focus on social cognition in single individuals rather than on dyads or groups. As a result, relatively little is understood about the neural events that underlie face-to-face interaction. We resolved some of the technical obstacles inherent in studying interaction using a novel imaging modality and aimed to identify neural mechanisms engaged both within and across brains in an ecologically valid instance of interpersonal competition. Functional near-infrared spectroscopy was utilized to simultaneously measure hemodynamic signals representing neural activity in pairs of subjects playing poker against each other (human–human condition) or against computer opponents (human–computer condition). Previous fMRI findings concerning single subjects confirm that neural areas recruited during social cognition paradigms are individually sensitive to human–human and human–computer conditions. However, it is not known whether face-to-face interactions between opponents can extend these findings. We hypothesize distributed effects due to live processing and specific variations in across-brain coherence not observable in single-subject paradigms. Angular gyrus (AG), a component of the temporal-parietal junction (TPJ) previously found to be sensitive to socially relevant cues, was selected as a seed to measure within-brain functional connectivity. Increased connectivity was confirmed between AG and bilateral dorsolateral prefrontal cortex (dlPFC) as well as a complex including the left subcentral area (SCA) and somatosensory cortex (SS) during interaction with a human opponent. These distributed findings were supported by contrast measures that indicated increased activity at the left dlPFC and frontopolar area that partially overlapped with the region showing increased functional connectivity with AG. Across-brain analyses of neural coherence between the players revealed synchrony between dlPFC and supramarginal gyrus (SMG) and SS in addition to synchrony between AG and the fusiform gyrus (FG) and SMG. These findings present the first evidence of a frontal-parietal neural complex including the TPJ, dlPFC, SCA, SS, and FG that is more active during human-to-human social cognition both within brains (functional connectivity) and across brains (across-brain coherence), supporting a model of functional integration of socially and strategically relevant information during live face-to-face competitive behaviors.

Effects of trying 'not to move' instruction on cortical load and concurrent cognitive performance

Motor and cognitive tasks often interfere when performed concurrently. The amount of interference typically scales with difficulty of the tasks involved. Thus, supposedly 'easy' motor tasks with restricted movement amplitude, like sitting on a chair, should show little or no interference with cognitive tasks at all. We measured the processing load induced by different postural tasks and their effect on cognitive performance under cognitive-motor dual-task conditions. Sixteen subjects performed postural motor tasks in three different positions: 'Lying in a sun lounger', 'Sitting on a bike saddle', and 'Upright on feet'. In each position, three different movement instructions were given; 'Stay stock-still', 'Relax', 'Move easily'. Each combination of position and instruction was performed as single task but also in a dual-task condition with a concurrent calculation task. Brain activity in the right prefrontal cortex was monitored using functional near-infrared spectroscopy. The instruction to 'Stay stock-still' produced higher cortical loads in single-task conditions for all positions compared to all other instructions. The calculation task induced additional brain activity in the same prefrontal area as the motor task. Calculation performance tended to be reduced in the 'Lying'-'Stay stock-still' condition. We discuss the relevance of these findings for learning scenarios in school.

Functional Magnetic Resonance Imaging and Functional Near-Infrared Spectroscopy: Insights from Combined Recording Studies

Although blood oxygen level dependent (BOLD) functional magnetic resonance imaging (fMRI) is a widely available, non-invasive technique that offers excellent spatial resolution, it remains limited by practical constraints imposed by the scanner environment. More recently, functional near infrared spectroscopy (fNIRS) has emerged as an alternative hemodynamic-based approach that possesses a number of strengths where fMRI is limited, most notably in portability and higher tolerance for motion. To date, fNIRS has shown promise in its ability to shed light on the functioning of the human brain in populations and contexts previously inaccessible to fMRI. Notable contributions include infant neuroimaging studies and studies examining full-body behaviors, such as exercise. However, much like fMRI, fNIRS has technical constraints that have limited its application to clinical settings, including a lower spatial resolution and limited depth of recording. Thus, by combining fMRI and fNIRS in such a way that the two methods complement each other, a multimodal imaging approach may allow for more complex research paradigms than is feasible with either technique alone. In light of these issues, the purpose of the current review is to: (1) provide an overview of fMRI and fNIRS and their associated strengths and limitations; (2) review existing combined fMRI-fNIRS recording studies; and (3) discuss how their combined use in future research practices may aid in advancing modern investigations of human brain function.

Frontal temporal and parietal systems synchronize within and across brains during live eye-to-eye contact

Human eye-to-eye contact is a primary source of social cues and communication. In spite of the biological significance of this interpersonal interaction, the underlying neural processes are not well-understood. This knowledge gap, in part, reflects limitations of conventional neuroimaging methods, including solitary confinement in the bore of a scanner and minimal tolerance of head movement that constrain investigations of natural, two-person interactions. However, these limitations are substantially resolved by recent technical developments in functional near-infrared spectroscopy (fNIRS), a non-invasive spectral absorbance technique that detects changes in blood oxygen levels in the brain by using surface-mounted optical sensors. Functional NIRS is tolerant of limited head motion and enables simultaneous acquisitions of neural signals from two interacting partners in natural conditions. We employ fNIRS to advance a data-driven theoretical framework for two-person neuroscience motivated by the Interactive Brain Hypothesis which proposes that interpersonal interaction between individuals evokes neural mechanisms not engaged during solo, non-interactive, behaviors. Within this context, two specific hypotheses related to eye-to-eye contact, functional specificity and functional synchrony, were tested. The functional specificity hypothesis proposes that eye-to-eye contact engages specialized, within-brain, neural systems; and the functional synchrony hypothesis proposes that eye-to-eye contact engages specialized, across-brain, neural processors that are synchronized between dyads. Signals acquired during eye-to-eye contact between partners (interactive condition) were compared to signals acquired during mutual gaze at the eyes of a picture-face (non-interactive condition). In accordance with the specificity hypothesis, responses during eye-to-eye contact were greater than eye-to-picture gaze for a left frontal cluster that included pars opercularis (associated with canonical language production functions known as Broca's region), pre- and supplementary motor cortices (associated with articulatory systems), as well as the subcentral area. This frontal cluster was also functionally connected to a cluster located in the left superior temporal gyrus (associated with canonical language receptive functions known as Wernicke's region), primary somatosensory cortex, and the subcentral area. In accordance with the functional synchrony hypothesis, cross-brain coherence during eye-to-eye contact relative to eye-to-picture gaze increased for signals originating within left superior temporal, middle temporal, and supramarginal gyri as well as the pre- and supplementary motor cortices of both interacting brains. These synchronous cross-brain regions are also associated with known language functions, and were partner-specific (i.e., disappeared with randomly assigned partners). Together, both within and across-brain neural correlates of eye-to-eye contact included components of previously established productive and receptive language systems. These findings reveal a left frontal, temporal, and parietal long-range network that mediates neural responses during eye-to-eye contact between dyads, and advance insight into elemental mechanisms of social and interpersonal interactions.

Imaging Brain Function with Functional Near-Infrared Spectroscopy in Unconstrained Environments

Assessing the neural correlates of motor and cognitive processes under naturalistic experimentation is challenging due to the movement constraints of traditional brain imaging technologies. The recent advent of portable technologies that are less sensitive to motion artifacts such as Functional Near Infrared Spectroscopy (fNIRS) have been made possible the study of brain function in freely-moving participants. In this paper, we describe a series of proof-of-concept experiments examining the potential of fNIRS in assessing the neural correlates of cognitive and motor processes in unconstrained environments. We show illustrative applications for practicing a sport (i.e., table tennis), playing a musical instrument (i.e., piano and violin) alone or in duo and performing daily activities for many hours (i.e., continuous monitoring). Our results expand upon previous research on the feasibility and robustness of fNIRS to monitor brain hemodynamic changes in different real life settings. We believe that these preliminary results showing the flexibility and robustness of fNIRS measurements may contribute by inspiring future work in the field of applied neuroscience.

Comparison of Brain Activation during Motor Imagery and Motor Movement Using fNIRS

Motor-activity-related mental tasks are widely adopted for brain-computer interfaces (BCIs) as they are a natural extension of movement intention, requiring no training to evoke brain activity. The ideal BCI aims to eliminate neuromuscular movement, making motor imagery tasks, or imagined actions with no muscle movement, good candidates. This study explores cortical activation differences between motor imagery and motor execution for both upper and lower limbs using functional near-infrared spectroscopy (fNIRS). Four simple finger- or toe-tapping tasks (left hand, right hand, left foot, and right foot) were performed with both motor imagery and motor execution and compared to resting state. Significant activation was found during all four motor imagery tasks, indicating that they can be detected via fNIRS. Motor execution produced higher activation levels, a faster response, and a different spatial distribution compared to motor imagery, which should be taken into account when designing an imagery-based BCI. When comparing left versus right, upper limb tasks are the most clearly distinguishable, particularly during motor execution. Left and right lower limb activation patterns were found to be highly similar during both imagery and execution, indicating that higher resolution imaging, advanced signal processing, or improved subject training may be required to reliably distinguish them.

Assessment of mental stress effects on prefrontal cortical activities using canonical correlation analysis: an fNIRS-EEG study

This paper presents an investigation about the effects of mental stress on prefrontal cortex (PFC) subregions using simultaneous measurement of functional Near-Infrared Spectroscopy (fNIRS) and Electroencephalography (EEG) signals. The aim is to explore canonical correlation analysis (CCA) technique to study the relationship among the bi-modality signals in mental stress assessment, and how we could fuse the signals for better accuracy in stress detection. Twenty-five male healthy subjects participated in the study while performing mental arithmetic task under control and stress (under time pressure with negative feedback) conditions. The fusion of brain signals acquired by fNIRS-EEG was performed at feature-level using CCA by maximizing the inter-subject covariance across modalities. The CCA result discovered the associations across the modalities and estimated the components responsible for these associations. The experiment results showed that mental stress experienced by this cohort of subjects is subregion specific and localized to the right ventrolateral PFC subregion. These suggest the right ventrolateral PFC as a suitable candidate region to extract biomarkers as performance indicators of neurofeedback training in stress coping.

Assessing the Driver's Current Level of Working Memory Load with High Density Functional Near-infrared Spectroscopy: A Realistic Driving Simulator Study

Cognitive overload or underload results in a decrease in human performance which may result in fatal incidents while driving. We envision that driver assistive systems which adapt their functionality to the driver's cognitive state could be a promising approach to reduce road accidents due to human errors. This research attempts to predict variations of cognitive working memory load levels in a natural driving scenario with multiple parallel tasks and to reveal predictive brain areas. We used a modified version of the n-back task to induce five different working memory load levels (from 0-back up to 4-back) forcing the participants to continuously update, memorize, and recall the previous 'n' speed sequences and adjust their speed accordingly while they drove for approximately 60 min on a highway with concurrent traffic in a virtual reality driving simulator. We measured brain activation using multichannel whole head, high density functional near-infrared spectroscopy (fNIRS) and predicted working memory load level from the fNIRS data by combining multivariate lasso regression and cross-validation. This allowed us to predict variations in working memory load in a continuous time-resolved manner with mean Pearson correlations between induced and predicted working memory load over 15 participants of 0.61 [standard error (SE) 0.04] and a maximum of 0.8. Restricting the analysis to prefrontal sensors placed over the forehead reduced the mean correlation to 0.38 (SE 0.04), indicating additional information gained through whole head coverage. Moreover, working memory load predictions derived from peripheral heart rate parameters achieved much lower correlations (mean 0.21, SE 0.1). Importantly, whole head fNIRS sampling revealed increasing brain activation in bilateral inferior frontal and bilateral temporo-occipital brain areas with increasing working memory load levels suggesting that these areas are specifically involved in workload-related processing.

Neural correlates of conflict between gestures and words: A domain-specific role for a temporal-parietal complex

The interpretation of social cues is a fundamental function of human social behavior, and resolution of inconsistencies between spoken and gestural cues plays an important role in successful interactions. To gain insight into these underlying neural processes, we compared neural responses in a traditional color/word conflict task and to a gesture/word conflict task to test hypotheses of domain-general and domain-specific conflict resolution. In the gesture task, recorded spoken words ("yes" and "no") were presented simultaneously with video recordings of actors performing one of the following affirmative or negative gestures: thumbs up, thumbs down, head nodding (up and down), or head shaking (side-to-side), thereby generating congruent and incongruent communication stimuli between gesture and words. Participants identified the communicative intent of the gestures as either positive or negative. In the color task, participants were presented the words "red" and "green" in either red or green font and were asked to identify the color of the letters. We observed a classic "Stroop" behavioral interference effect, with participants showing increased response time for incongruent trials relative to congruent ones for both the gesture and color tasks. Hemodynamic signals acquired using functional near-infrared spectroscopy (fNIRS) were increased in the right dorsolateral prefrontal cortex (DLPFC) for incongruent trials relative to congruent trials for both tasks consistent with a common, domain-general mechanism for detecting conflict. However, activity in the left DLPFC and frontal eye fields and the right temporal-parietal junction (TPJ), superior temporal gyrus (STG), supramarginal gyrus (SMG), and primary and auditory association cortices was greater for the gesture task than the color task. Thus, in addition to domain-general conflict processing mechanisms, as suggested by common engagement of right DLPFC, socially specialized neural modules localized to the left DLPFC and right TPJ including adjacent homologous receptive language areas were engaged when processing conflicting communications. These findings contribute to an emerging view of specialization within the TPJ and adjacent areas for interpretation of social cues and indicate a role for the region in processing social conflict.

Measuring speaker-listener neural coupling with functional near infrared spectroscopy

The present study investigates brain-to-brain coupling, defined as inter-subject correlations in the hemodynamic response, during natural verbal communication. We used functional near-infrared spectroscopy (fNIRS) to record brain activity of 3 speakers telling stories and 15 listeners comprehending audio recordings of these stories. Listeners’ brain activity was significantly correlated with speakers’ with a delay. This between-brain correlation disappeared when verbal communication failed. We further compared the fNIRS and functional Magnetic Resonance Imaging (fMRI) recordings of listeners comprehending the same story and found a significant relationship between the fNIRS oxygenated-hemoglobin concentration changes and the fMRI BOLD in brain areas associated with speech comprehension. This correlation between fNIRS and fMRI was only present when data from the same story were compared between the two modalities and vanished when data from different stories were compared; this cross-modality consistency further highlights the reliability of the spatiotemporal brain activation pattern as a measure of story comprehension. Our findings suggest that fNIRS can be used for investigating brain-to-brain coupling during verbal communication in natural settings.

The role of parietal cortex in overimitation: a study with fNIRS

Previous studies have shown right parietal activation in response to observing irrational actions. Behavioral studies show that people sometimes imitate irrational actions, a phenomenon called overimitation. However, limitations on movement in functional magnetic resonance imaging (fMRI) mean that the neural basis of overimitation has not been studied. To address this, our study employed a less restrictive neuroimaging technique, functional near-infrared spectroscopy (fNIRS). Measurements were taken while participants observed either rational or irrational movements before performing movements on a computerized puzzle task. Observing irrational actions produced greater activation in right anterior inferior parietal lobule (aIPL), replicating results from the fMRI literature. This is a proof of principle that fNIRS can be used as an alternative to fMRI in social cognition experiments, and that parietal cortex has a core role in responding to irrational actions.

Prefrontal Cortex Activation and Young Driver Behaviour: A fNIRS Study

Road traffic accidents consistently show a significant over-representation for young, novice and particularly male drivers. This research examines the prefrontal cortex activation of young drivers and the changes in activation associated with manipulations of mental workload and inhibitory control. It also considers the explanation that a lack of prefrontal cortex maturation is a contributing factor to the higher accident risk in this young driver population. The prefrontal cortex is associated with a number of factors including mental workload and inhibitory control, both of which are also related to road traffic accidents. This experiment used functional near infrared spectroscopy to measure prefrontal cortex activity during five simulated driving tasks: one following task and four overtaking tasks at varying traffic densities which aimed to dissociate workload and inhibitory control. Age, experience and gender were controlled for throughout the experiment. The results showed that younger drivers had reduced prefrontal cortex activity compared to older drivers. When both mental workload and inhibitory control increased prefrontal cortex activity also increased, however when inhibitory control alone increased there were no changes in activity. Along with an increase in activity during overtaking manoeuvres, these results suggest that prefrontal cortex activation is more indicative of workload in the current task. There were no differences in the number of overtakes completed by younger and older drivers but males overtook significantly more than females. We conclude that prefrontal cortex activity is associated with the mental workload required for overtaking. We additionally suggest that the reduced activation in younger drivers may be related to a lack of prefrontal maturation which could contribute to the increased crash risk seen in this population.

Prefrontal Cortex Activation Upon a Demanding Virtual Hand-Controlled Task: A New Frontier for Neuroergonomics

Functional near-infrared spectroscopy (fNIRS) is a non-invasive vascular-based functional neuroimaging technology that can assess, simultaneously from multiple cortical areas, concentration changes in oxygenated-deoxygenated hemoglobin at the level of the cortical microcirculation blood vessels. fNIRS, with its high degree of ecological validity and its very limited requirement of physical constraints to subjects, could represent a valid tool for monitoring cortical responses in the research field of neuroergonomics. In virtual reality (VR) real situations can be replicated with greater control than those obtainable in the real world. Therefore, VR is the ideal setting where studies about neuroergonomics applications can be performed. The aim of the present study was to investigate, by a 20-channel fNIRS system, the dorsolateral/ventrolateral prefrontal cortex (DLPFC/VLPFC) in subjects while performing a demanding VR hand-controlled task (HCT). Considering the complexity of the HCT, its execution should require the attentional resources allocation and the integration of different executive functions. The HCT simulates the interaction with a real, remotely-driven, system operating in a critical environment. The hand movements were captured by a high spatial and temporal resolution 3-dimensional (3D) hand-sensing device, the LEAP motion controller, a gesture-based control interface that could be used in VR for tele-operated applications. Fifteen University students were asked to guide, with their right hand/forearm, a virtual ball (VB) over a virtual route (VROU) reproducing a 42 m narrow road including some critical points. The subjects tried to travel as long as possible without making VB fall. The distance traveled by the guided VB was 70.2 ± 37.2 m. The less skilled subjects failed several times in guiding the VB over the VROU. Nevertheless, a bilateral VLPFC activation, in response to the HCT execution, was observed in all the subjects. No correlation was found between the distance traveled by the guided VB and the corresponding cortical activation. These results confirm the suitability of fNIRS technology to objectively evaluate cortical hemodynamic changes occurring in VR environments. Future studies could give a contribution to a better understanding of the cognitive mechanisms underlying human performance either in expert or non-expert operators during the simulation of different demanding/fatiguing activities.

Cognitive mechanisms for responding to mimicry from others

Compared to our understanding of neurocognitive processes involved producing mimicry, the downstream consequences of being mimicked are less clear. A wide variety of positive consequences of mimicry, such as liking and helping, have been reported in behavioural research. However, an in-depth review suggests the link from mimicry to liking and other positive outcomes may be fragile. Positive responses to mimicry can break down due to individual factors and social situations where mimicry may be unexpected. It remains unclear how the complex behavioural effects of mimicry relate to neural systems which respond to being mimicked. Mimicry activates regions associated with mirror properties, self-other processing and reward. In this review, we outline three potential models linking these regions with cognitive consequences of being mimicked. The models suggest that positive downstream consequences of mimicry may depend upon self-other overlap, detection of contingency or low prediction error. Finally, we highlight limitations with traditional research designs and suggest alternative methods for achieving highly ecological validity and experimental control. We also highlight unanswered questions which may guide future research.