Simultaneous recording of event-related auditory oddball response using transcranial near infrared optical topography and surface EEG

Investigation of electro-vascular phase-amplitude coupling during an auditory task

Multimodal neuroimaging using electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) provides complementary views of cortical processes, including those related to auditory processing. However, current multimodal approaches often overlook potential insights that can be gained from nonlinear interactions between electrical and hemodynamic signals. Here, we explore electro-vascular phase-amplitude coupling (PAC) between low-frequency hemodynamic and high-frequency electrical oscillations during an auditory task. We further apply a temporally embedded canonical correlation analysis (tCCA)-general linear model (GLM)-based correction approach to reduce the possible effect of systemic physiology on fNIRS recordings. Before correction, we observed significant PAC between fNIRS and broadband EEG in the frontal region (p ≪ 0.05), β (p ≪ 0.05) and γ (p = 0.010) in the left temporal/temporoparietal (left auditory; LA) region, and γ (p = 0.032) in the right temporal/temporoparietal (right auditory; RA) region across the entire dataset. Significant differences in PAC across conditions (task versus silence) were observed in LA (p = 0.023) and RA (p = 0.049) γ sub-bands and in lower frequency (5-20 Hz) frontal activity (p = 0.005). After correction, significant fNIRS-γ-band PAC was observed in the frontal (p = 0.021) and LA (p = 0.025) regions, while fNIRS-α (p = 0.003) and fNIRS-β (p = 0.041) PAC were observed in RA. Decreased frontal γ-band (p = 0.008) and increased β-band (p ≪ 0.05) PAC were observed during the task. These outcomes represent the first characterization of electro-vascular PAC between fNIRS and EEG signals during an auditory task, providing insights into electro-vascular coupling in auditory processing.

Simulation study on high spatio-temporal resolution acousto-electrophysiological neuroimaging

Objective.Acousto-electrophysiological neuroimaging (AENI) is a technique hypothesized to record electrophysiological activity of the brain with millimeter spatial and sub-millisecond temporal resolution. This improvement is obtained by tagging areas with focused ultrasound (fUS). Due to mechanical vibration with respect to the measuring electrodes, the electrical activity of the marked region will be modulated onto the ultrasonic frequency. The region's electrical activity can subsequently be retrieved via demodulation of the measured signal. In this study, the feasibility of this hypothesized technique is tested.Approach.This is done by calculating the forward electroencephalography response under quasi-static assumptions. The head is simplified as a set of concentric spheres. Two sizes are evaluated representing human and mouse brains. Moreover, feasibility is assessed for wet and dry transcranial, and for cortically placed electrodes. The activity sources are modeled by dipoles, with their current intensity profile drawn from a power-law power spectral density.Results.It is shown that mechanical vibration modulates the endogenous activity onto the ultrasonic frequency. The signal strength depends non-linearly on the alignment between dipole orientation, vibration direction and recording point. The strongest signal is measured when these three dependencies are perfectly aligned. The signal strengths are in the pV-range for a dipole moment of 5 nAm and ultrasonic pressures within Food and Drug Administration (FDA)-limits. The endogenous activity can then be accurately reconstructed via demodulation. Two interference types are investigated: vibrational and static. Depending on the vibrational interference, it is shown that millimeter resolution signal detection is possible also for deep brain regions. Subsequently, successful demodulation depends on the static interference, that at MHz-range has to be sub-picovolt.Significance.Our results show that mechanical vibration is a possible underlying mechanism of acousto-electrophyisological neuroimaging. This paper is a first step towards improved understanding of the conditions under which AENI is feasible.

Sound Level Changes the Auditory Cortical Activation Detected with Functional Near-Infrared Spectroscopy

BACKGROUND

Functional near-infrared spectroscopy (fNIRS) is a viable non-invasive technique for functional neuroimaging in the cochlear implant (CI) population; however, the effects of acoustic stimulus features on the fNIRS signal have not been thoroughly examined. This study examined the effect of stimulus level on fNIRS responses in adults with normal hearing or bilateral CIs. We hypothesized that fNIRS responses would correlate with both stimulus level and subjective loudness ratings, but that the correlation would be weaker with CIs due to the compression of acoustic input to electric output.

METHODS

Thirteen adults with bilateral CIs and 16 with normal hearing (NH) completed the study. Signal-correlated noise, a speech-shaped noise modulated by the temporal envelope of speech stimuli, was used to determine the effect of stimulus level in an unintelligible speech-like stimulus between the range of soft to loud speech. Cortical activity in the left hemisphere was recorded.

RESULTS

Results indicated a positive correlation of cortical activation in the left superior temporal gyrus with stimulus level in both NH and CI listeners with an additional correlation between cortical activity and perceived loudness for the CI group. The results are consistent with the literature and our hypothesis.

CONCLUSIONS

These results support the potential of fNIRS to examine auditory stimulus level effects at a group level and the importance of controlling for stimulus level and loudness in speech recognition studies. Further research is needed to better understand cortical activation patterns for speech recognition as a function of both stimulus presentation level and perceived loudness.

Individual-Specific Characterization of Event-Related Hemodynamic Responses during an Auditory Task: An Exploratory Study

Functional near-infrared spectroscopy (fNIRS) has been established as an informative modality for understanding the hemodynamic-metabolic correlates of cortical auditory processing. To date, such knowledge has shown broad clinical applications in the diagnosis, treatment, and intervention procedures in disorders affecting auditory processing; however, exploration of the hemodynamic response to auditory tasks is yet incomplete. This holds particularly true in the context of auditory event-related fNIRS experiments, where preliminary work has shown the presence of valid responses while leaving the need for more comprehensive explorations of the hemodynamic correlates of event-related auditory processing. In this study, we apply an individual-specific approach to characterize fNIRS-based hemodynamic changes during an auditory task in healthy adults. Oxygenated hemoglobin (HbO₂) concentration change time courses were acquired from eight participants. Independent component analysis (ICA) was then applied to isolate individual-specific class discriminative spatial filters, which were then applied to HbO₂ time courses to extract auditory-related hemodynamic features. While six of eight participants produced significant class discriminative features before ICA-based spatial filtering, the proposed method identified significant auditory hemodynamic features in all participants. Furthermore, ICA-based filtering improved correlation between trial labels and extracted features in every participant. For the first time, this study demonstrates hemodynamic features important in experiments exploring auditory processing as well as the utility of individual-specific ICA-based spatial filtering in fNIRS-based feature extraction techniques in auditory experiments. These outcomes provide insights for future studies exploring auditory hemodynamic characteristics and may eventually provide a baseline framework for better understanding auditory response dysfunctions in clinical populations.

Memorisation and implicit perceptual learning are enhanced for preferred musical intervals and chords

Is it true that we learn better what we like? Current neuroaesthetic and neurocomputational models of aesthetic appreciation postulate the existence of a correlation between aesthetic appreciation and learning. However, even though aesthetic appreciation has been associated with attentional enhancements, systematic evidence demonstrating its influence on learning processes is still lacking. Here, in two experiments, we investigated the relationship between aesthetic preferences for consonance versus dissonance and the memorisation of musical intervals and chords. In Experiment 1, 60 participants were first asked to memorise and evaluate arpeggiated triad chords (memorisation phase), then, following a distraction task, chords’ memorisation accuracy was measured (recognition phase). Memorisation resulted to be significantly enhanced for subjectively preferred as compared with non-preferred chords. To explore the possible neural mechanisms underlying these results, we performed an EEG study, directed to investigate implicit perceptual learning dynamics (Experiment 2). Through an auditory mismatch detection paradigm, electrophysiological responses to standard/deviant intervals were recorded, while participants were asked to evaluate the beauty of the intervals. We found a significant trial-by-trial correlation between subjective aesthetic judgements and single trial amplitude fluctuations of the ERP attention-related N1 component. Moreover, implicit perceptual learning, expressed by larger mismatch detection responses, was enhanced for more appreciated intervals. Altogether, our results showed the existence of a relationship between aesthetic appreciation and implicit learning dynamics as well as higher-order learning processes, such as memorisation. This finding might suggest possible future applications in different research domains such as teaching and rehabilitation of memory and attentional deficits.

A comprehensive assessment of Brain Computer Interfaces: Recent trends and challenges

BACKGROUND

An uninterrupted channel of communication and control between the human brain and electronic processing units has led to an increased use of Brain Computer Interfaces (BCIs). This article attempts to present an all-encompassing review on BCI and the scientific advancements associated with it. The ultimate goal of this review is to provide a general overview of the BCI technology and to shed light on different aspects of BCIs. This review also underscores the applications, practical challenges and opportunities associated with BCI technology, which can be used to accelerate future developments in this field.

METHODS

This review is based on a systematic literature search for tracking down the relevant research annals and proceedings. Using a methodical search strategy, the search was carried out across major technical databases. The retrieved records were screened for their relevance and a total of 369 research chronicles were engulfed in this review based on the inclusion criteria.

RESULTS

This review describes the present scenario and recent advancements in BCI technology. It also identifies several application areas of BCI technology. This comprehensive review provides evidence that, while we are getting ever closer, significant challenges still exist for the development of BCIs that can seamlessly integrate with the user's biological system.

CONCLUSION

The findings of this review confirm the importance of BCI technology in various applications. It is concluded that BCI technology, still in its sprouting phase, requires significant explorations for further development.

Sensor Modalities for Brain-Computer Interface Technology: A Comprehensive Literature Review

Brain-computer interface (BCI) technology is rapidly developing and changing the paradigm of neurorestoration by linking cortical activity with control of an external effector to provide patients with tangible improvements in their ability to interact with the environment. The sensor component of a BCI circuit dictates the resolution of brain pattern recognition and therefore plays an integral role in the technology. Several sensor modalities are currently in use for BCI applications and are broadly either electrode-based or functional neuroimaging-based. Sensors vary in their inherent spatial and temporal resolutions, as well as in practical aspects such as invasiveness, portability, and maintenance. Hybrid BCI systems with multimodal sensory inputs represent a promising development in the field allowing for complimentary function. Artificial intelligence and deep learning algorithms have been applied to BCI systems to achieve faster and more accurate classifications of sensory input and improve user performance in various tasks. Neurofeedback is an important advancement in the field that has been implemented in several types of BCI systems by showing users a real-time display of their recorded brain activity during a task to facilitate their control over their own cortical activity. In this way, neurofeedback has improved BCI classification and enhanced user control over BCI output. Taken together, BCI systems have progressed significantly in recent years in terms of accuracy, speed, and communication. Understanding the sensory components of a BCI is essential for neurosurgeons and clinicians as they help advance this technology in the clinical setting.

A Newcomer's Guide to Functional Near Infrared Spectroscopy Experiments

This review presents a practical primer for functional near-infrared spectroscopy (fNIRS) with respect to technology, experimentation, and analysis software. Its purpose is to jump-start interested practitioners considering utilizing a non-invasive, versatile, nevertheless challenging window into the brain using optical methods. We briefly recapitulate relevant anatomical and optical foundations and give a short historical overview. We describe competing types of illumination (trans-illumination, reflectance, and differential reflectance) and data collection methods (continuous wave, time domain and frequency domain). Basic components (light sources, detection, and recording components) of fNIRS systems are presented. Advantages and limitations of fNIRS techniques are offered, followed by a list of very practical recommendations for its use. A variety of experimental and clinical studies with fNIRS are sampled, shedding light on many brain-related ailments. Finally, we describe and discuss a number of freely available analysis and presentation packages suited for data analysis. In conclusion, we recommend fNIRS due to its ever-growing body of clinical applications, state-of-the-art neuroimaging technique and manageable hardware requirements. It can be safely concluded that fNIRS adds a new arrow to the quiver of neuro-medical examinations due to both its great versatility and limited costs.

Measuring Cortical Activity During Auditory Processing with Functional Near-Infrared Spectroscopy

Functional near-infrared spectroscopy (fNIRS) is an optical, non-invasive neuroimaging technique that investigates human brain activity by calculating concentrations of oxy- and deoxyhemoglobin. The aim of this publication is to review the current state of the art as to how fNIRS has been used to study auditory function. We address temporal and spatial characteristics of the hemodynamic response to auditory stimulation as well as experimental factors that affect fNIRS data such as acoustic and stimulus-driven effects. The rising importance that fNIRS is generating in auditory neuroscience underlines the strong potential of the technology, and it seems likely that fNIRS will become a useful clinical tool.

Detecting Concealed Information with Fused Electroencephalography and Functional Near-infrared Spectroscopy

In this study, fused electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) techniques were utilized to examine the relationship between the ERP (event-related potential) component P300 and fNIRS hemodynamic signals for high-accuracy deception detection. During the performance of a modified concealed information test (CIT) task, a series of Chinese names were presented, which served as the target, irrelevant, or the probe stimuli for both the guilty and innocent groups. For participants in the guilty group, the probe stimulus was their individual name, whereas for the innocent group, the probe stimulus was one irrelevant name. In particular, data from concurrent fNIRS and ERP recordings were carefully inspected for participants from the two groups. Interestingly, we discovered that for the guilty group, the probe stimulus elicited significantly higher P300 amplitude at parietal site and also evoked significantly stronger oxyhemoglobin (HbO) concentration changes in the bilateral superior frontal gyrus and bilateral middle frontal gyrus than the irrelevant stimuli. However, this is not the case for the innocent group, in which participants exhibited no significant differences in both ERP and fNIRS measures between the probe and irrelevant stimuli. More importantly, our findings also demonstrated that the combined ERP and fNIRS feature was able to differentiate the guilty and innocent groups with enhanced sensitivity, in which AUC (the area under Receiver Operating Characteristic curve) is 0.94 for deception detection based on the combined indicator, much higher than that based on the ERP component P300 only (0.85) or HbO measure only (0.84).

Early onset cigarette smokers exhibit greater P300 reactivity to smoking-related stimuli and report greater craving

Adolescence is a period during which a number of critical neuromaturation processes occur and the vulnerability for developing nicotine dependence is extremely high. Thus, early-onset (EO; age < 16 years old), relative to late-onset (LO; age ≥ 16 years old), tobacco smoking may be uniquely deleterious for developmentally immature systems that regulate neural signaling reactivity. This study investigated how age of tobacco smoking onset affects neurophysiological measures of smoking cue reactivity and reported craving in adult smokers. EO smokers (EOS; n = 8; 4 females), LO smokers (LOS; n = 10; 5 females), and healthy non-smokers (HNS; n = 10; 5 females) participated in an event-related potential (ERP) cue reactivity study with tactile and image stimuli. Participants handled neutral objects during one interval and smoking-related objects during a second interval. After each interval, they viewed smoking-related, neutral, or arousing images using an oddball paradigm. P300 ERPs and craving for tobacco were recorded during each session. P300 amplitudes were significantly higher in central midline (Cz) channel to smoking, but not neutral or arousing, images after handling smoking objects. Specifically, Cz P300 smoking amplitudes were significantly greater in EOS, relative to LOS and HNS, and associated with greater craving at baseline. There were no other group differences in mood or craving. EOS exhibited greater P300 reactivity to smoking-related stimuli, relative to LOS, suggesting a more sensitized neural response. EO smoking during early neuromaturation may alter neurophysiological signaling involved in responding to smoking-related stimuli, which could impact the outcome of smoking cessation interventions.

The spatio-temporal dynamics of deviance and target detection in the passive and active auditory oddball paradigm: a sLORETA study

Background

Numerous studies have investigated the neural underpinnings of passive and active deviance and target detection in the well-known auditory oddball paradigm by means of event-related potentials (ERPs) or functional magnetic resonance imaging (fMRI). The present auditory oddball study investigates the spatio-temporal dynamics of passive versus active deviance and target detection by analyzing amplitude modulations of early and late ERPs while at the same time exploring the neural sources underling this modulation with standardized low-resolution brain electromagnetic tomography (sLORETA) .

Methods

A 64-channel EEG was recorded from twelve healthy right-handed participants while listening to ‘standards’ and ‘deviants’ (500 vs. 1000 Hz pure tones) during a passive (block 1) and an active (block 2) listening condition. During passive listening, participants had to simply listen to the tones. During active listening they had to attend and press a key in response to the deviant tones.

Results

Passive and active listening elicited an N1 component, a mismatch negativity (MMN) as difference potential (whose amplitudes were temporally overlapping with the N1) and a P3 component. N1/MMN and P3 amplitudes were significantly more pronounced for deviants as compared to standards during both listening conditions. Active listening augmented P3 modulation to deviants significantly compared to passive listening, whereas deviance detection as indexed by N1/MMN modulation was unaffected by the task. During passive listening, sLORETA contrasts (deviants > standards) revealed significant activations in the right superior temporal gyrus (STG) and the lingual gyri bilaterally (N1/MMN) as well as in the left and right insulae (P3). During active listening, significant activations were found for the N1/MMN in the right inferior parietal lobule (IPL) and for the P3 in multiple cortical regions (e.g., precuneus).

Discussion

The results provide evidence for the hypothesis that passive as well as active deviance and target detection elicit cortical activations in spatially distributed brain regions and neural networks including the ventral attention network (VAN), dorsal attention network (DAN) and salience network (SN). Based on the temporal activation of the neural sources underlying ERP modulations, a neurophysiological model of passive and active deviance and target detection is proposed which can be tested in future studies.

Effect of confounding variables on hemodynamic response function estimation using averaging and deconvolution analysis: An event-related NIRS study

Slow and rapid event-related designs are used in fMRI and functional near-infrared spectroscopy (fNIRS) experiments to temporally characterize the brain hemodynamic response to discrete events. Conventional averaging (CA) and the deconvolution method (DM) are the two techniques commonly used to estimate the Hemodynamic Response Function (HRF) profile in event-related designs. In this study, we conducted a series of simulations using synthetic and real NIRS data to examine the effect of the main confounding factors, including event sequence timing parameters, different types of noise, signal-to-noise ratio (SNR), temporal autocorrelation and temporal filtering on the performance of these techniques in slow and rapid event-related designs. We also compared systematic errors in the estimates of the fitted HRF amplitude, latency and duration for both techniques. We further compared the performance of deconvolution methods based on Finite Impulse Response (FIR) basis functions and gamma basis sets. Our results demonstrate that DM was much less sensitive to confounding factors than CA. Event timing was the main parameter largely affecting the accuracy of CA. In slow event-related designs, deconvolution methods provided similar results to those obtained by CA. In rapid event-related designs, our results showed that DM outperformed CA for all SNR, especially above -5 dB regardless of the event sequence timing and the dynamics of background NIRS activity. Our results also show that periodic low-frequency systemic hemodynamic fluctuations as well as phase-locked noise can markedly obscure hemodynamic evoked responses. Temporal autocorrelation also affected the performance of both techniques by inducing distortions in the time profile of the estimated hemodynamic response with inflated t-statistics, especially at low SNRs. We also found that high-pass temporal filtering could substantially affect the performance of both techniques by removing the low-frequency components of HRF profiles. Our results emphasize the importance of characterization of event timing, background noise and SNR when estimating HRF profiles using CA and DM in event-related designs.

Spread spectrum time-resolved diffuse optical measurement system for enhanced sensitivity in detecting human brain activity

Diffuse optical spectroscopy (DOS) and imaging methods have been widely applied to noninvasive detection of brain activity. We have designed and implemented a low cost, portable, real-time one-channel time-resolved DOS system for neuroscience studies. Phantom experiments were carried out to test the performance of the system. We further conducted preliminary human experiments and demonstrated that enhanced sensitivity in detecting neural activity in the cortex could be achieved by the use of late arriving photons.

Transient increase in systemic interferences in the superficial layer and its influence on event-related motor tasks: a functional near-infrared spectroscopy study

Functional near-infrared spectroscopy (fNIRS) is a widely utilized neuroimaging tool in fundamental neuroscience research and clinical investigation. Previous research has revealed that task-evoked systemic artifacts mainly originating from the superficial-tissue may preclude the identification of cerebral activation during a given task. We examined the influence of such artifacts on event-related brain activity during a brisk squeezing movement. We estimated task-evoked superficial-tissue hemodynamics from short source–detector distance channels (15 mm) by applying principal component analysis. The estimated superficial-tissue hemodynamics exhibited temporal profiles similar to the canonical cerebral hemodynamic model. Importantly, this task-evoked profile was also observed in data from a block design motor experiment, suggesting a transient increase in superficial-tissue hemodynamics occurs following motor behavior, irrespective of task design. We also confirmed that estimation of event-related cerebral hemodynamics was improved by a simple superficial-tissue hemodynamic artifact removal process using 15-mm short distance channels, compared to the results when no artifact removal was applied. Thus, our results elucidate task design-independent characteristics of superficial-tissue hemodynamics and highlight the need for the application of superficial-tissue hemodynamic artifact removal methods when analyzing fNIRS data obtained during event-related motor tasks.

Speech-specific categorical perception deficit in autism: An Event-Related Potential study of lexical tone processing in Mandarin-speaking children

Recent studies reveal that tonal language speakers with autism have enhanced neural sensitivity to pitch changes in nonspeech stimuli but not to lexical tone contrasts in their native language. The present ERP study investigated whether the distinct pitch processing pattern for speech and nonspeech stimuli in autism was due to a speech-specific deficit in categorical perception of lexical tones. A passive oddball paradigm was adopted to examine two groups (16 in the autism group and 15 in the control group) of Chinese children’s Mismatch Responses (MMRs) to equivalent pitch deviations representing within-category and between-category differences in speech and nonspeech contexts. To further examine group-level differences in the MMRs to categorical perception of speech/nonspeech stimuli or lack thereof, neural oscillatory activities at the single trial level were further calculated with the inter-trial phase coherence (ITPC) measure for the theta and beta frequency bands. The MMR and ITPC data from the children with autism showed evidence for lack of categorical perception in the lexical tone condition. In view of the important role of lexical tones in acquiring a tonal language, the results point to the necessity of early intervention for the individuals with autism who show such a speech-specific categorical perception deficit.

Temporal Cortex Activation to Audiovisual Speech in Normal-Hearing and Cochlear Implant Users Measured with Functional Near-Infrared Spectroscopy

BACKGROUND

Speech understanding may rely not only on auditory, but also on visual information. Non-invasive functional neuroimaging techniques can expose the neural processes underlying the integration of multisensory processes required for speech understanding in humans. Nevertheless, noise (from functional MRI, fMRI) limits the usefulness in auditory experiments, and electromagnetic artifacts caused by electronic implants worn by subjects can severely distort the scans (EEG, fMRI). Therefore, we assessed audio-visual activation of temporal cortex with a silent, optical neuroimaging technique: functional near-infrared spectroscopy (fNIRS).

METHODS

We studied temporal cortical activation as represented by concentration changes of oxy- and deoxy-hemoglobin in four, easy-to-apply fNIRS optical channels of 33 normal-hearing adult subjects and five post-lingually deaf cochlear implant (CI) users in response to supra-threshold unisensory auditory and visual, as well as to congruent auditory-visual speech stimuli.

RESULTS

Activation effects were not visible from single fNIRS channels. However, by discounting physiological noise through reference channel subtraction (RCS), auditory, visual and audiovisual (AV) speech stimuli evoked concentration changes for all sensory modalities in both cohorts (p < 0.001). Auditory stimulation evoked larger concentration changes than visual stimuli (p < 0.001). A saturation effect was observed for the AV condition.

CONCLUSIONS

Physiological, systemic noise can be removed from fNIRS signals by RCS. The observed multisensory enhancement of an auditory cortical channel can be plausibly described by a simple addition of the auditory and visual signals with saturation.

A brain of two halves: insights into interhemispheric organization provided by near-infrared spectroscopy

The discovery of functional lateralization and localization of the brain marked the beginning of a new era in neuroscience. While the past 150 years of research have provided a great deal of knowledge of hemispheric differences and functional relationships, the precise organization of functional laterality remains a topic of intense debate. Here I will shed light on the functional organization of the two hemispheres by reviewing some of the most recent functional near-infrared spectroscopy (NIRS) studies that have reported hemispheric differences in activation patterns. Most NIRS studies using visual stimuli, which revealed functional differentiation between the hemispheres, have reported unilateral activation, i.e., significant levels of activation in only one hemisphere. Auditory stimuli, including speech sounds, elicited bilateral activation, while the limited number of studies on young infants revealed primarily unilateral activation. The stimulus modality and the age of the participants therefore determine whether the resulting cortical activation is unilateral or bilateral. By combining a review of the existing literature with NIRS results regarding homologous connectivity across hemispheres, I hypothesized that the origin of functional lateralization changes from the independence of each hemispheric region, to mutual inhibition between homologous regions during development. Future studies applying multi-modal measurements along with NIRS and spatiotemporal analyses will further deepen our understanding of the interhemispheric organization of brain function.

Calibrating the BOLD signal during a motor task using an extended fusion model incorporating DOT, BOLD and ASL data

Multimodal imaging improves the accuracy of the localization and the quantification of brain activation when measuring different manifestations of the hemodynamic response associated with cerebral activity. In this study, we incorporated cerebral blood flow (CBF) changes measured with arterial spin labeling (ASL), Diffuse Optical Tomography (DOT) and blood oxygen level-dependent (BOLD) recordings to reconstruct changes in oxy- (ΔHbO(2)) and deoxyhemoglobin (ΔHbR). Using the Grubb relation between relative changes in CBF and cerebral blood volume (CBV), we incorporated the ASL measurement as a prior to the total hemoglobin concentration change (ΔHbT). We applied this ASL fusion model to both synthetic data and experimental multimodal recordings during a 2-s finger-tapping task. Our results show that the new approach is very powerful in estimating ΔHbO(2) and ΔHbR with high spatial and quantitative accuracy. Moreover, our approach allows the computation of baseline total hemoglobin concentration (HbT(0)) as well as of the BOLD calibration factor M on a single subject basis. We obtained an average HbT(0) of 71 μM, an average M value of 0.18 and an average increase of 13% in cerebral metabolic rate of oxygen (CMRO(2)), all of which are in agreement with values previously reported in the literature. Our method yields an independent measurement of M, which provides an alternative measurement to validate the hypercapnic calibration of the BOLD signal.

Quantitative assessment of diffuse optical tomography sensitivity to the cerebral cortex using a whole-head probe

We quantify the variability in diffuse optical tomography (DOT) sensitivity over the cortical surface in eight young adult subjects. We use the 10/5 electroencephalography system as a basis for our whole-head optical high-density probe design. The contrast-to-noise ratio (CNR) is calculated along with the percentage of the cortex that is above a CNR = 0 dB threshold. We also quantify the effect of including vasculature on the forward model and list our assumptions that allow us to estimate light penetration depth in the head. We show that using the 10/5 system for the optical probe design allows for the measurement of 37% of the cortical surface on average, with a mean CNR in the visible region of 5.5 dB. Certain anatomical regions, such as the lateral occipital cortex, had a very high percentage above the CNR threshold, while other regions such as the cingulate cortex were not measurable. Vasculature blocked optical sensitivity over 1% of the cortex. Cortical coverage was positively correlated with intracranial volume and relative cerebrospinal fluid volume, and negatively correlated with relative scalp volume and skull volume. These contributions allow experimenters to understand how anatomical variation in a subject population may impact DOT or functional near-infrared spectroscopy measurements.

Brain computer interfaces, a review

A brain-computer interface (BCI) is a hardware and software communications system that permits cerebral activity alone to control computers or external devices. The immediate goal of BCI research is to provide communications capabilities to severely disabled people who are totally paralyzed or 'locked in' by neurological neuromuscular disorders, such as amyotrophic lateral sclerosis, brain stem stroke, or spinal cord injury. Here, we review the state-of-the-art of BCIs, looking at the different steps that form a standard BCI: signal acquisition, preprocessing or signal enhancement, feature extraction, classification and the control interface. We discuss their advantages, drawbacks, and latest advances, and we survey the numerous technologies reported in the scientific literature to design each step of a BCI. First, the review examines the neuroimaging modalities used in the signal acquisition step, each of which monitors a different functional brain activity such as electrical, magnetic or metabolic activity. Second, the review discusses different electrophysiological control signals that determine user intentions, which can be detected in brain activity. Third, the review includes some techniques used in the signal enhancement step to deal with the artifacts in the control signals and improve the performance. Fourth, the review studies some mathematic algorithms used in the feature extraction and classification steps which translate the information in the control signals into commands that operate a computer or other device. Finally, the review provides an overview of various BCI applications that control a range of devices.

PHASE DIFFERENCE BETWEEN LOW-FREQUENCY OSCILLATIONS OF CEREBRAL DEOXY- AND OXY-HEMOGLOBIN CONCENTRATIONS DURING A MENTAL TASK

Hemodynamic low-frequency (~0.1 Hz) spontaneous oscillations as detected in the brain by near-infrared spectroscopy have potential applications in the study of brain activation, cerebral autoregulation, and functional connectivity. In this work, we have investigated the phase lag between oscillations of cerebral deoxy- and oxy-hemoglobin concentrations in the frequency range 0.05-0.10 Hz in a human subject during a mental workload task. We have obtained a measure of such phase lag using two different methods: (1) phase synchronization analysis as used in the theory of chaotic oscillators and (2) a novel cross-correlation phasor approach. The two methods yielded comparable initial results of a larger phase lag between low-frequency oscillations of deoxy- and oxy-hemoglobin concentrations during mental workload with respect to a control, rest condition.

Diminished prefrontal oxygenation with normal and above-average verbal fluency performance in adult ADHD

Attention-Deficit/Hyperactivity Disorder (ADHD) in adults is associated with deficits in executive functions such as verbal fluency. Functional near-infrared spectroscopy offers the possibility to measure brain activity during verbal fluency in psychiatric patients due to low susceptibility to movements artefacts. Fourteen patients with mainly combined ADHD subtype and 14 healthy controls matched for age, gender, handedness, education level, and intelligence showed equal performance in phonological verbal fluency and higher performance in semantical verbal fluency in comparison to the controls. On the level of brain function indicated by concentration changes of oxygenated and deoxygenated haemoglobin, both groups showed inferior frontal brain activity during both tasks. ADHD patients had a lower magnitude of oxygenation and a significant negative correlation of brain activity with performance, i.e. higher brain activity was associated with lower performance. These results might be interpreted as a lack of disease related deficits, as an economical recruitment of cognitive resources, or - more likely - as an expression of a benefit in the patient group. High verbal competence in our samples could contribute to these findings. One speculative and post hoc explanation aims at the clinically well-known phenomenon of hyperfocusing in patients with ADHD.

Nonlinear blood oxygen level-dependent responses for transient activations and deactivations in V1 - insights into the hemodynamic response function with the balloon model

We report studies of the nonlinear nature of blood oxygen level-dependent (BOLD) responses to short transient deactivations in human visual cortex. Both functional magnetic resonance imaging (fMRI) and near-infrared spectroscopy (NIRS) have been used to compare and contrast the hemodynamic response functions (HRFs) associated with transient activation and deactivation in primary visual cortex. We show that signal decreases for short duration deactivations are smaller than corresponding signal increases in activation studies. Moreover, the standard balloon model of BOLD effects may be modified to account for the observed nonlinear nature of deactivations by appropriate changes to simple hemodynamic parameters without recourse to new assumptions about the nature of the coupling between activity and oxygen use.

Altered frontal brain oxygenation in detoxified alcohol dependent patients with unaffected verbal fluency performance

Despite prominent prefrontal deficits and alterations in anatomy, neurophysiology, and neuropsychology after long-term alcohol consumption in alcohol dependent patients, only a few investigations of functional brain activity have been published. Using functional near-infrared spectroscopy (fNIRS), we examined the concentration changes in oxygenated (O(2)Hb) and deoxygenated (HHb) haemoglobin in 17 right-handed alcohol dependent patients after detoxification and 17 matched healthy controls during a verbal fluency task. Alcohol dependent patients were characterized by normal behavioural performance (number of words produced) and physiological activation patterns (increase of O(2)Hb and decrease of HHb) over frontotemporal regions during phonological and semantical verbal fluency. However, the degree of activation was diminished (lower magnitude of oxygenation) and the localization of the activation was more restricted to inferior frontal areas as compared with the healthy participants. fNIRS is a sensitive and valid method, to detect alterations in brain functioning in clinical groups like alcohol dependent patients. Altered prefrontal functional brain activation during verbal fluency in alcohol dependent patients in a detoxified state may precede behavioural or cognitive alterations with a later onset.

Event-related functional near-infrared spectroscopy (fNIRS) based on craniocerebral correlations: reproducibility of activation?

The purpose of the present study was to assess the retest reliability of cortical activation detected by event-related functional near-infrared spectroscopy (fNIRS) based on craniocerebral correlations. Isolated functional activation was evoked in the motor cortex by a periodically performed finger-tapping task. During 44-channel fNIRS recording, 12 subjects performed 30 trials of right and left index finger tapping in two sessions. The retest interval was set to 3 weeks. Simple correlations of the contrast t-values supplemented by scatterplots, channel-wise intraclass correlation coefficients (ICC), as well as reproducibility indices for the size and the location of the detected activation were calculated. The results at the group level showed sufficient single measure ICCs (up to 0.80) and excellent reproducibility of the size and the location (up to 89% were reproducible). Comparisons of the intersession group amplitudes demonstrate that the fNIRS signals were stable across time in a retest study design: the number of significant differences was less than randomly occurring false-positive activated channels if an alpha level of 5% is chosen. Effect size analyses indicated that the intersession amplitude differences are small (mean < 0.25). For deoxyhemoglobin and oxyhemoglobin distinct statistical power profiles were revealed regarding the activation vs. baseline contrast as well as the intersession amplitude differences, indicating a higher sensitivity of deoxyhemoglobin for local hemodynamic changes. The results suggest that sensorimotor activation assessed by event-related fNIRS based on craniocerebral correlations is sufficiently reproducible at the group level.

Applications of functional near-infrared spectroscopy (fNIRS) to Neurorehabilitation of cognitive disabilities

Functional Near-Infrared Spectroscopy (fNIRS) is a neuroimaging technique that utilizes light in the near-infrared spectrum (between 700 and 1000 nm) to detect hemodynamic changes within the cortex when sensory, motor, or cognitive activation occurs. FNIRS principles have been used to study brain oxygenation for several decades, but have more recently been applied to study cognitive processes. This paper provides a description of basic fNIRS techniques, and provides a review of the rehabilitation-related literature. The authors discuss strengths and weaknesses of this technique, assert that fNIRS may be particularly beneficial to neurorehabilitation of cognitive disabilities, and suggest future applications.

Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain–computer interface

There has been an increase in research interest for brain-computer interface (BCI) technology as an alternate mode of communication and environmental control for the disabled, such as patients suffering from amyotrophic lateral sclerosis (ALS), brainstem stroke and spinal cord injury. Disabled patients with appropriate physical care and cognitive ability to communicate with their social environment continue to live with a reasonable quality of life over extended periods of time. Near-infrared spectroscopy is a non-invasive technique which utilizes light in the near-infrared range (700 to 1000 nm) to determine cerebral oxygenation, blood flow and metabolic status of localized regions of the brain. In this paper, we describe a study conducted to test the feasibility of using multichannel NIRS in the development of a BCI. We used a continuous wave 20-channel NIRS system over the motor cortex of 5 healthy volunteers to measure oxygenated and deoxygenated hemoglobin changes during left-hand and right-hand motor imagery. We present results of signal analysis indicating that there exist distinct patterns of hemodynamic responses which could be utilized in a pattern classifier towards developing a BCI. We applied two different pattern recognition algorithms separately, Support Vector Machines (SVM) and Hidden Markov Model (HMM), to classify the data offline. SVM classified left-hand imagery from right-hand imagery with an average accuracy of 73% for all volunteers, while HMM performed better with an average accuracy of 89%. Our results indicate potential application of NIRS in the development of BCIs. We also discuss here future extension of our system to develop a word speller application based on a cursor control paradigm incorporating online pattern classification of single-trial NIRS data.

Model-based analysis of rapid event-related functional near-infrared spectroscopy (NIRS) data: a parametric validation study

To validate the usefulness of a model-based analysis approach according to the general linear model (GLM) for functional near-infrared spectroscopy (fNIRS) data, a rapid event-related paradigm with an unpredictable stimulus sequence was applied to 15 healthy subjects. A parametric design was chosen wherein four differently graded contrasts of a flickering checkerboard were presented, allowing directed hypotheses about the rank order of the evoked hemodynamic response amplitudes. The results indicate the validity of amplitude estimation by three main findings (a) the GLM approach for fNIRS data is capable to identify human brain activation in the visual cortex with inter-stimulus intervals of 4-9 s (6.5 s average) whereas in non-visual areas no systematic activation was detectable; (b) the different contrast level intensities lead to the hypothesized rank order of the GLM amplitude parameters: visual cortex activation evoked by highest contrast>moderate contrast>lowest contrast>no stimulation; (c) analysis of null-events (no stimulation) did not produce any significant activation in the visual cortex or in other brain areas. We conclude that a model-based GLM approach delivers valid fNIRS amplitude estimations and enables the analysis of rapid event-related fNIRS data series, which is highly relevant in particular for cognitive fNIRS studies.

Extraction of cognitive activity-related waveforms from functional near-infrared spectroscopy signals

We address the problem of prototypical waveform extraction in cognitive experiments using functional near-infrared spectroscopy (fNIRS) signals. These waveform responses are evoked with visual stimuli provided in an oddball type experimental protocol. As the statistical signal-processing tool, we consider the linear signal space representation paradigm and use independent component analysis (ICA). The assumptions underlying ICA is discussed in the light of the signal measurement and generation mechanisms in the brain. The ICA-based waveform extraction is validated based both on its conformance to the parametric brain hemodynamic response (BHR) model and to the coherent averaging technique. We assess the intra-subject and inter-subject waveform and parameter variability.

Spatially weighted BOLD signal for comparison of functional magnetic resonance imaging and near-infrared imaging of the brain

We introduce a weighted spatial average of the functional magnetic resonance imaging (fMRI) BOLD signal (blood oxygen level-dependent) that is appropriate for comparison with the changes in oxy- and deoxy-hemoglobin concentrations measured with near-infrared spectroscopy (NIRS) during brain activation. Because the BOLD signal shows a spatial dependence (both in shape and amplitude) within the region of activation, the location of the optical probe with respect to the region of BOLD activation should be taken into account for comparison of the BOLD and NIRS signals. Our new method is based on combining weighted contributions of the BOLD signal from each activated voxel, with a weight given by a hitting density function for photons migrating between a given pair of illumination and collection points. We present a case study where we have found that the new spatially weighted BOLD signal shows a high spatial and temporal correlation with the oxy- and deoxy-hemoglobin concentration changes measured with NIRS during a hand-tapping protocol. These findings reinforce the idea that fMRI and NIRS are sensitive to similar underlying hemodynamic changes, and indicate that the proposed weighted BOLD signal is needed for a quantitative comparison of BOLD and NIRS signals.

Effect of fMRI acoustic noise on sensorimotor activation examined using optical topography

Functional magnetic resonance imaging (fMRI) is an important tool for noninvasively imaging the hemodynamic responses accompanying brain activity, but fMRI measurements are accompanied by loud acoustic noises resulting from Lorentz forces that cannot be completely excluded when the present technology is used. We used recorded fMRI acoustic noise and examined its effect on sensorimotor activation in optical topography measurement when subjects were instructed to tap the fingers of the right hand under a 23-dB non-noise condition and 46-, 56-, and 65-dB noise conditions. The results showed that the amplitude of the activation signal (relative change in concentration) for oxygenated hemoglobin in the sensorimotor cortex decreased with increasing noise. The activation signal for deoxygenated hemoglobin did not depend significantly on the noise level but did tend to decrease with increasing noise. These results suggest that fMRI acoustic noise affects the hemodynamics of cortical areas associated with the processing of information other than auditory information.

Cerebrovascular reactivity to hypercapnia in migraine patients measured with near-infrared spectroscopy

Migraine pain is considered to manifest itself as a result of an impaired cerebrovascular reactivity. Hence, proper quantification and diagnosis of this problem without causing more disturbance has always been a challenge in investigating migraine pathogenesis. Functional near-infrared spectroscopy system (fNIRS) is being proposed as an inexpensive, rapid, safe and accurate technique to monitor cerebrovascular dynamics. We have developed NIROXCOPE 201, a novel multi source and detector device of fNIRS, and attempted to investigate the cerebrovascular reactivity of migraine patients to a breath hold task which produces a metabolic perturbation. Six normals and six migraine patients performed four consecutive breath holding task. A typical brain hemodynamic response (BHR) is observed both for controls and migraineurs with an initial phase, main response and a recovery phase. Hence, fitting to a sum of three sequentially arranged gaussian curves proved that amplitudes of [Hb] and [HbO2] signals acquired by fNIRS are approximately two to five times higher in controls than migraine patients (P<0.01) for all phases. Moreover, amplitude change between successive breath holds tends to converge to a steady value for controls whereas an uncontrolled percent change is observed for migraineurs. Our results confirm an impaired cerebrovascular reactivity in the frontal cortex of migraine patients interictally.

Event-related functional near-infrared spectroscopy (fNIRS): Are the measurements reliable?

The purpose of the present study was to investigate the retest reliability of event-related functional near-infrared spectroscopy (fNIRS). Therefore, isolated functional activation was evoked in the occipital cortex by a periodic checkerboard stimulation. During a 52-channel fNIRS recording, 12 subjects underwent 60 trials of visual stimulation in two sessions. The retest interval was set to 3 weeks. Linear correlations of the contrast t values supplemented by scatter plots, channel-wise intraclass correlation coefficients (ICC) as well as reproducibility indices for the quantity of activated channels (RQUANTITY) and the location (ROVERLAP) of the detected activation were calculated. The results at the group level showed good reliability in terms of the single measure ICCs (up to 0.84) and excellent reproducibility quantified by RQUANTITY and ROVERLAP (up to 96% of the quantity and the location were reproducible), whereas the results at the single subjects' level were mediocre. Furthermore, the reliability assessed by single measurement ICCs improved if regarded at a cluster level.

Integration of fMRI, NIROT and ERP for studies of human brain function

Different methods of assessing human brain function possess specific advantages and disadvantages compared to others, but it is believed that combining different approaches will provide greater information than can be obtained from each alone. For example, functional magnetic resonance imaging (fMRI) has good spatial resolution but poor temporal resolution, whereas the converse is true for electrophysiological recordings (event-related potentials or ERPs). In this review of recent work, we highlight a novel approach to combining these modalities in a manner designed to increase information on the origins and locations of the generators of specific ERPs and the relationship between fMRI and ERP signals. Near infrared imaging techniques have also been studied as alternatives to fMRI and can be readily integrated with simultaneous electrophysiological recordings. Each of these modalities may in principle be also used in so-called steady-state acquisitions in which the correlational structure of signals from the brain may be analyzed to provide new insights into brain function.

Intersubject variability of near-infrared spectroscopy signals during sensorimotor cortex activation

We investigate the intersubject signal variability of near-infrared spectroscopy (NIRS), which is commonly used for noninvasive measurement of the product of the optical path length and the concentration change in oxygenated hemoglobin (DeltaC'oxy) and deoxygenated hemoglobin (DeltaC'deoxy) and their sum (DeltaC'total) related to human cortical activation. We do this by measuring sensorimotor cortex activation in 31 healthy adults using 24-measurement-position near-infrared (NIR) topography. A finger-tapping task is used to activate the sensorimotor cortex, and significant changes in the hemisphere contralateral to the tapping hand are assessed as being due to the activation. Of the possible patterns of signal changes, 90% include a positive DeltaC'oxy, 76% included a negative DeltaC'deoxy, and 73% included a positive DeltaC'total. The DeltaC'deoxy and DeltaC'total are less consistent because of a large intersubject variability in DeltaC'deoxy; in some cases there is a positive DeltaC'deoxy. In the cases with no positive DeltaC'oxy in the contralateral hemisphere, there are cases of other possible changes for either or both hemispheres and no cases of no change in any hemoglobin species in either hemisphere. These results suggest that NIR topography is useful for observing brain activity in most cases, although intersubject signal variability still needs to be resolved.

Multi-channel near-infrared spectroscopy detects specific inferior-frontal activation during incongruent Stroop trials

Near-infrared spectroscopy (NIRS) is an optical method, which allows non-invasive in vivo measurements of changes in the concentration of oxygenated (O2Hb) and deoxygenated (HHb) hemoglobin in brain tissue. In the present study we investigated 10 healthy subjects by means of multi-channel NIRS (Optical Topography; ETG-100, Hitachi Medical Co., Japan) during performance of congruent and incongruent trials of the Stroop color word task. With a similar pattern of activation for both congruent and incongruent Stroop trials in the NIRS channels located left superior-frontally, the results for O2Hb and the total amount of hemoglobin (Hb-tot) indicate specific activation for interference trials in inferior-frontal areas of the left hemisphere. This result is in line with several neuroimaging studies (fMRI, PET) that have already investigated the frontal activation related to Stroop interference, which further supports the assumption that multi-channel NIRS is sensitive enough to detect spatially specific activation during the performance of cognitive tasks.

Principles, techniques, and limitations of near infrared spectroscopy

In the last decade the study of the human brain and muscle energetics underwent a radical change, thanks to the progressive introduction of noninvasive techniques, including near-infrared (NIR) spectroscopy (NIRS). This review summarizes the most recent literature about the principles, techniques, advantages, limitations, and applications of NIRS in exercise physiology and neuroscience. The main NIRS instrumentations and measurable parameters will be reported. NIR light (700-1000 m) penetrates superficial layers (skin, subcutaneous fat, skull, etc.) and is either absorbed by chromophores (oxy- and deoxyhemoglobin and myoglobin) or scattered within the tissue. NIRS is a noninvasive and relatively low-cost optical technique that is becoming a widely used instrument for measuring tissue O2 saturation, changes in hemoglobin volume and, indirectly, brain/muscle blood flow and muscle O2 consumption. Tissue O2 saturation represents a dynamic balance between O2 supply and O2 consumption in the small vessels such as the capillary, arteriolar, and venular bed. The possibility of measuring the cortical activation in response to different stimuli, and the changes in the cortical cytochrome oxidase redox state upon O2 delivery changes, will also be mentioned.

Changes in serial optical topography and TMS during task performance after constraint-induced movement therapy in stroke: a case study

The authors examined serial changes in optical topography in a stroke patient performing a functional task, as well as clinical and physiologic measures while undergoing constraint-induced therapy (CIT). A 73-year-old right hemiparetic patient, who had a subcortical stroke 4 months previously, received 2 weeks of CIT. During the therapy, daily optical topography imaging using near-infrared light was measured serially while the participant performed a functional key-turning task. Clinical outcome measures included the Wolf Motor Function Test (WMFT), Motor Activity Log (MAL), and functional key grip test. Transcranial magnetic stimulation (TMS) and functional magnetic resonance imaging (fMRI) were also used to map cortical areas and hemodynamic brain responses, respectively. Optical topography measurement showed an overall decrease in oxy-hemoglobin concentration in both hemispheres as therapy progressed and the laterality index increased toward the contralateral hemisphere. An increased TMS motor map area was observed in the contralateral cortex following treatment. Posttreatment fMRI showed bilateral primary motor cortex activation, although slightly greater in the contralateral hemisphere, during affected hand movement. Clinical scores revealed marked improvement in functional activities. In one patient who suffered a stroke, 2 weeks of CIT led to improved function and cortical reorganization in the hemisphere contralateral to the affected hand.

Removal of time-varying gradient artifacts from EEG data acquired during continuous fMRI

OBJECTIVE

Recording low amplitude electroencephalography (EEG) signals in the face of large gradient artifacts generated by changing functional magnetic resonance imaging (fMRI) magnetic fields continues to be a challenge. We present a new method of removing gradient artifacts with time-varying waveforms, and evaluate it in continuous (non-interleaved) simultaneous EEG-fMRI experiments.

METHODS

The current method consists of an analog filter, an EEG-fMRI timing error correction algorithm, and a temporal principal component analysis based gradient noise removal algorithm. We conducted a phantom experiment and a visual oddball experiment to evaluate the method.

RESULTS

The results from the phantom experiment showed that the current method reduced the number of averaged samples required to obtain high correlation between injected and recovered signals, compared to a conventional average waveform subtraction method with adaptive noise cancelling. For the oddball experiment, the results obtained from the two methods were very similar, except that the current method resulted in a higher P300 amplitude when the number of averaged trials was small.

CONCLUSIONS

The current method enabled us to obtain high quality EEGs in continuous simultaneous EEG-fMRI experiments.

SIGNIFICANCE

Continuous simultaneous EEG-fMRI acquisition enables efficient use of data acquisition time and better monitoring of rare EEG events.

The concept of 'developing the brain': a new natural science for learning and education

From the viewpoint of biology, learning and education can be defined as the processes of forming neuronal connections in response to external environmental stimuli, and of controlling or adding appropriate stimuli, respectively. Learning and education can thus be studied as a new field of natural sciences with the entire human life span as its subject, thus including various problems such as fetal environment, childcare, language acquisition, general/special education, and rehabilitation. Non-invasive imaging of higher-order brain functions in humans will clarify the brain's developmental processes, and will provide various evidence for learning sciences. This new approach is called 'developing the brain' or 'brain science and education'. The origin of the concept and its present state are described and its future prospects are briefly analyzed.