Shedding light on words and sentences: near-infrared spectroscopy in language research

Flexible-circuit-based 3-D aware modular optical brain imaging system for high-density measurements in natural settings

Significance

Functional near-infrared spectroscopy (fNIRS) presents an opportunity to study human brains in everyday activities and environments. However, achieving robust measurements under such dynamic condition remains a significant challenge.

Aim

The modular optical brain imaging (MOBI) system is designed to enhance optode-to-scalp coupling and provide real-time probe 3-D shape estimation to improve the use of fNIRS in everyday conditions.

Approach

The MOBI system utilizes a bendable and lightweight modular circuit-board design to enhance probe conformity to head surfaces and comfort for long-term wearability. Combined with automatic module connection recognition, the built-in orientation sensors on each module can be used to estimate optode 3-D positions in real-time to enable advanced tomographic data analysis and motion tracking.

Results

Optical characterization of the MOBI detector reports a noise equivalence power (NEP) of 8.9 and 7.3 pW / H z at 735 nm and 850 nm, respectively, with a dynamic range of 88 dB. The 3-D optode shape acquisition yields an average error of 4.2 mm across 25 optodes in a phantom test compared to positions acquired from a digitizer. Results for initial in vivo validations, including a cuff occlusion and a finger-tapping test, are also provided.

Conclusions

To the best of our knowledge, the MOBI system is the first modular fNIRS system featuring fully flexible circuit boards. The self-organizing module sensor network and automatic 3-D optode position acquisition, combined with lightweight modules (18 g/module) and ergonomic designs, would greatly aid emerging explorations of brain function in naturalistic settings.

Language reorganization patterns in global aphasia-evidence from fNIRS

Background

Exploring the brain reorganization patterns associated with language recovery would promote the treatment of global aphasia. While functional near-infrared spectroscopy (fNIRS) has been widely used in the study of speech and language impairment, its application in the field of global aphasia is still limited.

Aims

We aimed to identify cortical activation patterns of patients with global aphasia during naming and repetition tasks.

Methods and procedures

We recruited patients with post-stroke aphasia from the Department of Rehabilitation Medicine at Huashan Hospital. These individuals were diagnosed with global aphasia without cognitive impairments, as assessed by speech-language pathology evaluations. Age- and sex-matched healthy controls were recruited from the greater Shanghai area. During fNIRS measurement, patients and healthy controls completed the picture-naming and phrase repetition task. Cortical activation patterns on each of these language tasks were then compared between groups.

Outcomes and results

A total of nine patients with global aphasia and 14 healthy controls were included in this study. Compared with the healthy subjects, patients with global aphasia showed increased activation in the left Broca's area, middle temporal gyrus (MTG), superior temporal gyrus (STG), and pre-motor and supplementary motor cortex (SMA) (p < 0.05) in the picture-naming task. Furthermore, the latency of the oxyhemoglobin (HbO) concentration in the left supramarginal gyrus (SMG) region had a strong negative correlation with their score of the naming task (p < 0.01). In the phrase repetition task, decreased activation was detected in the left SMA and SMG (p < 0.05) of patients relative to controls.

Conclusion

The left SMG plays a critical role in the language function of patients with global aphasia, especially in their abilities to name and repeat. fNIRS is a promising approach to revealing the changes in brain activities in patients with aphasia, and we believe it will contribute to a deeper understanding of the neurological mechanisms and the establishment of a novel treatment approach for global aphasia.

MOCA: a systematic toolbox for designing and assessing modular functional near-infrared brain imaging probes

Significance

The expansion of functional near-infrared spectroscopy (fNIRS) systems toward broader utilities has led to the emergence of modular fNIRS systems composed of repeating optical source/detector modules. Compared to conventional fNIRS systems, modular fNIRS systems are more compact and flexible, making wearable and long-term monitoring possible. However, the large number of design parameters makes understanding their impact on a probe's performance a daunting task.

Aim

We aim to create a systematic software platform to facilitate the design, characterization, and comparison of modular fNIRS probes.

Approach

Our software-modular optode configuration analyzer (MOCA)-implements semi-automatic algorithms that assist in tessellating user-specified regions-of-interest, in interconnecting modules of various shapes, and in quantitatively comparing probe performance using metrics, such as spatial channel distributions and average brain sensitivity of the resulting probes. There is also support for limited parameter sweeping capabilities.

Results

Through several examples, we show that users can use MOCA to design and optimize modular fNIRS probes, study trade-offs between several module shapes, improve brain sensitivity in probes via module re-orientation, and enhance probe performance via adjusting module spatial layouts.

Conclusion

Despite its simplicity, our modular probe design platform offers a framework to describe and quantitatively assess probes made by modules, opening a new door for the growing fNIRS user community to approach the challenging problem of module- and probe-parameter selection and fine-tuning.

Investigating Language and Domain-General Processing in Neurotypicals and Individuals With Aphasia - A Functional Near-Infrared Spectroscopy Pilot Study

Brain reorganization patterns associated with language recovery after stroke have long been debated. Studying mechanisms of spontaneous and treatment-induced language recovery in post-stroke aphasia requires a network-based approach given the potential for recruitment of perilesional left hemisphere language regions, homologous right hemisphere language regions, and/or spared bilateral domain-general regions. Recent hardware, software, and methodological advances in functional near-infrared spectroscopy (fNIRS) make it well-suited to examine this question. fNIRS is cost-effective with minimal contraindications, making it a robust option to monitor treatment-related brain activation changes over time. Establishing clear activation patterns in neurotypical adults during language and domain-general cognitive processes via fNIRS is an important first step. Some fNIRS studies have investigated key language processes in healthy adults, yet findings are challenging to interpret in the context of methodological limitations. This pilot study used fNIRS to capture brain activation during language and domain-general processing in neurotypicals and individuals with aphasia. These findings will serve as a reference when interpreting treatment-related changes in brain activation patterns in post-stroke aphasia in the future. Twenty-four young healthy controls, seventeen older healthy controls, and six individuals with left hemisphere stroke-induced aphasia completed two language tasks (i.e., semantic feature, picture naming) and one domain-general cognitive task (i.e., arithmetic) twice during fNIRS. The probe covered bilateral frontal, parietal, and temporal lobes and included short-separation detectors for scalp signal nuisance regression. Younger and older healthy controls activated core language regions during semantic feature processing (e.g., left inferior frontal gyrus pars opercularis) and lexical retrieval (e.g., left inferior frontal gyrus pars triangularis) and domain-general regions (e.g., bilateral middle frontal gyri) during hard versus easy arithmetic as expected. Consistent with theories of post-stroke language recovery, individuals with aphasia activated areas outside the traditional networks: left superior frontal gyrus and left supramarginal gyrus during semantic feature judgment; left superior frontal gyrus and right precentral gyrus during picture naming; and left inferior frontal gyrus pars opercularis during arithmetic processing. The preliminary findings in the stroke group highlight the utility of using fNIRS to study language and domain-general processing in aphasia.

The cortical organization of listening effort: New insight from functional near-infrared spectroscopy

Everyday challenges impact our ability to hear and comprehend spoken language with ease, such as accented speech (source factors), spectral degradation (transmission factors), complex or unfamiliar language use (message factors), and predictability (context factors). Auditory degradation and linguistic complexity in the brain and behavior have been well investigated, and several computational models have emerged. The work here provides a novel test of the hypotheses that listening effort is partially reliant on higher cognitive auditory attention and working memory mechanisms in the frontal lobe, and partially reliant on hierarchical linguistic computation in the brain's left hemisphere. We specifically hypothesize that these models are robust and can be applied in ecologically relevant and coarse-grain contexts that rigorously control for acoustic and linguistic listening challenges. Using functional near-infrared spectroscopy during an auditory plausibility judgment task, we show the hierarchical cortical organization for listening effort in the frontal and left temporal-parietal brain regions. In response to increasing levels of cognitive demand, we found (i) poorer comprehension, (ii) slower reaction times, (iii) increasing levels of perceived mental effort, (iv) increasing levels of brain activity in the prefrontal cortex, (v) hierarchical modulation of core language processing regions that reflect increasingly higher-order auditory-linguistic processing, and (vi) a correlation between participants' mental effort ratings and their performance on the task. Our results demonstrate that listening effort is partly reliant on higher cognitive auditory attention and working memory mechanisms in the frontal lobe and partly reliant on hierarchical linguistic computation in the brain's left hemisphere. Further, listening effort is driven by a voluntary, motivation-based attention system for which our results validate the use of a single-item post-task questionnaire for measuring perceived levels of mental effort and predicting listening performance. We anticipate our study to be a starting point for more sophisticated models of listening effort and even cognitive neuroplasticity in hearing aid and cochlear implant users.

Similarities and Differences Between Native and Non-native Speakers' Processing of Formulaic Sequences: A Functional Near-Infrared Spectroscopy (fNIRS) Study

The present study reported an experiment examining whether both native speakers (NSs) and non-native speakers (NNSs) give formulaic sequences (FSs) priority over novel phrases in processing, as the dual route model has postulated. In this experiment, NSs and NNSs were asked to read Japanese versions of semi-transparent restricted collocations (e.g., kenka-o uru 'pick a fight (acc)'), novel phrases (e.g., tomato-o uru 'sell tomatoes (acc)'), and violated phrases (e.g., kenka-o sagasu 'find out a fight (acc)'); and they judged the naturalness of these sequences. Participants' reaction times were measured, as well as their cortical activation. The results revealed that, for the NSs, collocations required shorter reaction times and elicited less cortical activation than the novel stimuli. For NNSs, collocations similarly required shorter reaction times, but they elicited greater cortical activation than novel phrases. These results support the dual route model, both for NSs and NNSs.

The challenge of learning a new language in adulthood: Evidence from a multi-methodological neuroscientific approach

Being proficient in several foreign languages is an essential part of every-day life. In contrast to childhood, learning a new language can be highly challenging for adults. The present study aims at investigating neural mechanisms supporting very initial foreign language learning in adulthood. For this reason, subjects underwent an implicit semantic associative training in which they had to learn new pseudoword-picture pairings. Learning success was measured via a recognition experiment presenting learned versus new pseudoword-picture pairings. Neural correlates were assessed by an innovative multi-methodological approach simultaneously applying electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS). Results indicate memory-related processes based on familiarity and mechanisms of cognitive control to be present during initial vocabulary learning. Findings underline the fascinating plasticity of the adult brain during foreign language learning, even after a short semantic training of only 18 minutes as well as the importance of comparing evidence from different neuroscientific methods and behavioral data.

Inner versus Overt Speech Production: Does This Make a Difference in the Developing Brain?

Studies in adults showed differential neural processing between overt and inner speech. So far, it is unclear whether inner and overt speech are processed differentially in children. The present study examines the pre-activation of the speech network in order to disentangle domain-general executive control from linguistic control of inner and overt speech production in 6- to 7-year-olds by simultaneously applying electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS). Children underwent a picture-naming task in which the pure preparation of a subsequent speech production and the actual execution of speech can be differentiated. The preparation phase does not represent speech per se but it resembles the setting up of the language production network. Only the fNIRS revealed a larger activation for overt, compared to inner, speech over bilateral prefrontal to parietal regions during the preparation phase. Findings suggest that the children's brain can prepare the subsequent speech production. The preparation for overt and inner speech requires different domain-general executive control. In contrast to adults, the children´s brain did not show differences between inner and overt speech when a concrete linguistic content occurs and a concrete execution is required. This might indicate that domain-specific executive control processes are still under development.

The interaction between language and working memory: a systematic review of fMRI studies in the past two decades

Language processing involves other cognitive domains, including Working Memory (WM). Much detail about the neural correlates of language and WM interaction remains unclear. This review summarizes the evidence for the interaction between WM and language obtained via functional Magnetic Resonance Imaging (fMRI) in the past two decades. The search was limited to PubMed, Google Scholar, Science direct and Neurosynth for working memory, language, fMRI, neuroimaging, cognition, attention, network, connectome keywords. The exclusion criteria consisted of studies including children, older adults, bilingual or multilingual population, clinical cases, music, sign language, speech, motor processing, review papers, meta-analyses, electroencephalography/event-related potential, and positron emission tomography. A total of 20 articles were included and discussed in four categories: language comprehension, language production, syntax, and networks. Studies on neural correlates of WM and language interaction are rare. Language tasks that involve WM activate common neural systems. Activated areas can be associated with cognitive concepts proposed by Baddeley and Hitch (1974), including the phonological loop of WM (mainly Broca and Wernicke's areas), other prefrontal cortex and right hemispheric regions linked to the visuospatial sketchpad. There is a clear, dynamic interaction between language and WM, reflected in the involvement of subcortical structures, particularly the basal ganglia (caudate), and of widespread right hemispheric regions. WM involvement is levered by cognitive demand in response to task complexity. High WM capacity readers draw upon buffer memory systems in midline cortical areas to decrease the WM demands for efficiency. Different dynamic networks are involved in WM and language interaction in response to the task in hand for an ultimate brain function efficiency, modulated by language modality and attention.

So young, yet so mature? Electrophysiological and vascular correlates of phonotactic processing in 18-month-olds

The present study investigated neural correlates of implicit phonotactic processing in 18-month-old children that just reached an important step in language development: the vocabulary spurt. Pseudowords, either phonotactically legal or illegal with respect to their native language, were acoustically presented to monolingually German raised infants. Neural activity was simultaneously assessed by means of electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS). The former method excellently tracks fast processing mechanisms, whereas the latter reveals brain areas recruited. Results of the present study indicate that 18-month-olds recognize the linguistic properties of their native language based on phonotactics. This manifested in an increased N400 for legal compared to illegal pseudowords in the EEG conforming to adult-like mechanisms. Unfortunately, fNIRS findings did not support this discrimination ability. Possible methodological and brain maturational reasons might explain this null finding. This study provides evidence for the advantage of a multi-methodological approach in order to get a clear picture on neural language development.

Uncovering electrophysiological and vascular signatures of implicit emotional prosody

The capability of differentiating between various emotional states in speech displays a crucial prerequisite for successful social interactions. The aim of the present study was to investigate neural processes underlying this differentiating ability by applying a simultaneous neuroscientific approach in order to gain both electrophysiological (via electroencephalography, EEG) and vascular (via functional near-infrared-spectroscopy, fNIRS) responses. Pseudowords conforming to angry, happy, and neutral prosody were presented acoustically to participants using a passive listening paradigm in order to capture implicit mechanisms of emotional prosody processing. Event-related brain potentials (ERPs) revealed a larger P200 and an increased late positive potential (LPP) for happy prosody as well as larger negativities for angry and neutral prosody compared to happy prosody around 500 ms. FNIRS results showed increased activations for angry prosody at right fronto-temporal areas. Correlation between negativity in the EEG and activation in fNIRS for angry prosody suggests analogous underlying processes resembling a negativity bias. Overall, results indicate that mechanisms of emotional and phonological encoding (P200), emotional evaluation (increased negativities) as well as emotional arousal and relevance (LPP) are present during implicit processing of emotional prosody.

The Brain Differentially Prepares Inner and Overt Speech Production: Electrophysiological and Vascular Evidence

Speech production not only relies on spoken (overt speech) but also on silent output (inner speech). Little is known about whether inner and overt speech are processed differently and which neural mechanisms are involved. By simultaneously applying electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS), we tried to disentangle executive control from motor and linguistic processes. A preparation phase was introduced additionally to the examination of overt and inner speech directly during naming (i.e., speech execution). Participants completed a picture-naming paradigm in which the pure preparation phase of a subsequent speech production and the actual speech execution phase could be differentiated. fNIRS results revealed a larger activation for overt rather than inner speech at bilateral prefrontal to parietal regions during the preparation and at bilateral temporal regions during the execution phase. EEG results showed a larger negativity for inner compared to overt speech between 200 and 500 ms during the preparation phase and between 300 and 500 ms during the execution phase. Findings of the preparation phase indicated that differences between inner and overt speech are not exclusively driven by specific linguistic and motor processes but also impacted by inhibitory mechanisms. Results of the execution phase suggest that inhibitory processes operate during phonological code retrieval and encoding.

Multi-time-point analysis: A time course analysis with functional near-infrared spectroscopy

In the data analysis of functional near-infrared spectroscopy (fNIRS), linear model frameworks, in particular mass univariate analysis, are often used when researchers consider examining the difference between conditions at each sampled time point. However, some statistical issues, such as assumptions of linearity, autocorrelation and multiple comparison problems, influence statistical inferences when mass univariate analysis is used on fNIRS time course data. In order to address these issues, the present study proposes a novel perspective, multi-time-point analysis (MTPA), to discriminate signal differences between conditions by combining temporal information from multiple time points in fNIRS. In addition, MTPA adopts the random forest algorithm from the statistical learning domain, followed by a series of cross-validation procedures, providing reasonable power for detecting significant time points and ensuring generalizability. Using a real fNIRS data set, the proposed MTPA outperformed mass univariate analysis in detecting more time points, showing significant differences between experimental conditions. Finally, MTPA was also able to make comparisons between different areas, leading to a novel viewpoint of fNIRS time course analysis and providing additional theoretical implications for future fNIRS studies. The data set and all source code are available for researchers to replicate the analyses and to adapt the program for their own needs in future fNIRS studies.

How the Brain Understands Spoken and Sung Sentences

The present study investigates whether meaning is similarly extracted from spoken and sung sentences. For this purpose, subjects listened to semantically correct and incorrect sentences while performing a correctness judgement task. In order to examine underlying neural mechanisms, a multi-methodological approach was chosen combining two neuroscientific methods with behavioral data. In particular, fast dynamic changes reflected in the semantically associated N400 component of the electroencephalography (EEG) were simultaneously assessed with the topographically more fine-grained vascular signals acquired by the functional near-infrared spectroscopy (fNIRS). EEG results revealed a larger N400 for incorrect compared to correct sentences in both spoken and sung sentences. However, the N400 was delayed for sung sentences, potentially due to the longer sentence duration. fNIRS results revealed larger activations for spoken compared to sung sentences irrespective of semantic correctness at predominantly left-hemispheric areas, potentially suggesting a greater familiarity with spoken material. Furthermore, the fNIRS revealed a widespread activation for correct compared to incorrect sentences irrespective of modality, potentially indicating a successful processing of sentence meaning. The combined results indicate similar semantic processing in speech and song.

A Newcomer's Guide to Functional Near Infrared Spectroscopy Experiments

This review presents a practical primer for functional near-infrared spectroscopy (fNIRS) with respect to technology, experimentation, and analysis software. Its purpose is to jump-start interested practitioners considering utilizing a non-invasive, versatile, nevertheless challenging window into the brain using optical methods. We briefly recapitulate relevant anatomical and optical foundations and give a short historical overview. We describe competing types of illumination (trans-illumination, reflectance, and differential reflectance) and data collection methods (continuous wave, time domain and frequency domain). Basic components (light sources, detection, and recording components) of fNIRS systems are presented. Advantages and limitations of fNIRS techniques are offered, followed by a list of very practical recommendations for its use. A variety of experimental and clinical studies with fNIRS are sampled, shedding light on many brain-related ailments. Finally, we describe and discuss a number of freely available analysis and presentation packages suited for data analysis. In conclusion, we recommend fNIRS due to its ever-growing body of clinical applications, state-of-the-art neuroimaging technique and manageable hardware requirements. It can be safely concluded that fNIRS adds a new arrow to the quiver of neuro-medical examinations due to both its great versatility and limited costs.

A Mini-Review on Functional Near-Infrared Spectroscopy (fNIRS): Where Do We Stand, and Where Should We Go?

This mini-review is aimed at briefly summarizing the present status of functional near-infrared spectroscopy (fNIRS) and predicting where the technique should go in the next decade. This mini-review quotes 33 articles on the different fNIRS basics and technical developments and 44 reviews on the fNIRS applications published in the last eight years. The huge number of review articles about a wide spectrum of topics in the field of cognitive and social sciences, functional neuroimaging research, and medicine testifies to the maturity achieved by this non-invasive optical vascular-based functional neuroimaging technique. Today, fNIRS has started to be utilized on healthy subjects while moving freely in different naturalistic settings. Further instrumental developments are expected to be done in the near future to fully satisfy this latter important aspect. In addition, fNIRS procedures, including correction methods for the strong extracranial interferences, need to be standardized before using fNIRS as a clinical tool in individual patients. New research avenues such as interactive neurosciences, cortical activation modulated by different type of sport performance, and cortical activation during neurofeedback training are highlighted.

Sonority's Effect as a Surface Cue on Lexical Speech Perception of Children With Cochlear Implants

OBJECTIVES

Sonority is the relative perceptual prominence/loudness of speech sounds of the same length, stress, and pitch. Children with cochlear implants (CIs), with restored audibility and relatively intact temporal processing, are expected to benefit from the perceptual prominence cues of highly sonorous sounds. Sonority also influences lexical access through the sonority-sequencing principle (SSP), a grammatical phonotactic rule, which facilitates the recognition and segmentation of syllables within speech. The more nonsonorous the onset of a syllable is, the larger is the degree of sonority rise to the nucleus, and the more optimal the SSP. Children with CIs may experience hindered or delayed development of the language-learning rule SSP, as a result of their deprived/degraded auditory experience. The purpose of the study was to explore sonority's role in speech perception and lexical access of prelingually deafened children with CIs.

DESIGN

A case-control study with 15 children with CIs, 25 normal-hearing children (NHC), and 50 normal-hearing adults was conducted, using a lexical identification task of novel, nonreal CV-CV words taught via fast mapping. The CV-CV words were constructed according to four sonority conditions, entailing syllables with sonorous onsets/less optimal SSP (SS) and nonsonorous onsets/optimal SSP (NS) in all combinations, that is, SS-SS, SS-NS, NS-SS, and NS-NS. Outcome measures were accuracy and reaction times (RTs). A subgroup analysis of 12 children with CIs pair matched to 12 NHC on hearing age aimed to study the effect of oral-language exposure period on the sonority-related performance.

RESULTS

The children groups showed similar accuracy performance, overall and across all the sonority conditions. However, within-group comparisons showed that the children with CIs scored more accurately on the SS-SS condition relative to the NS-NS and NS-SS conditions, while the NHC performed equally well across all conditions. Additionally, adult-comparable accuracy performance was achieved by the children with CIs only on the SS-SS condition, as opposed to NS-SS, SS-NS, and SS-SS conditions for NHC. Accuracy analysis of the subgroups of children matched in hearing age showed similar results. Overall longer RTs were recorded by the children with CIs on the sonority-treated lexical task, specifically on the SS-SS condition compared with age-matched controls. However, the subgroup analysis showed that both groups of children did not differ on RTs.

CONCLUSIONS

Children with CIs performed better in lexical tasks relying on the sonority perceptual prominence cues, as in SS-SS condition, than on SSP initial relying conditions as NS-NS and NS-SS. Template-driven word learning, an early word-learning strategy, appears to play a role in the lexical access of children with CIs whether matched in hearing age or not. The SS-SS condition acts as a preferred word template. The longer RTs brought about by the highly accurate SS-SS condition in children with CIs is possibly because listening becomes more effortful. The lack of RTs difference between the children groups when matched on hearing age points out the importance of oral-language exposure period as a key factor in developing the auditory processing skills.

Exploring early human brain development with structural and physiological neuroimaging

Early brain development, from the embryonic period to infancy, is characterized by rapid structural and functional changes. These changes can be studied using structural and physiological neuroimaging methods. In order to optimally acquire and accurately interpret this data, concepts from adult neuroimaging cannot be directly transferred. Instead, one must have a basic understanding of fetal and neonatal structural and physiological brain development, and the important modulators of this process. Here, we first review the major developmental milestones of transient cerebral structures and structural connectivity (axonal connectivity) followed by a summary of the contributions from ex vivo and in vivo MRI. Next, we discuss the basic biology of neuronal circuitry development (synaptic connectivity, i.e. ensemble of direct chemical and electrical connections between neurons), physiology of neurovascular coupling, baseline metabolic needs of the fetus and the infant, and functional connectivity (defined as statistical dependence of low-frequency spontaneous fluctuations seen with functional magnetic resonance imaging (fMRI)). The complementary roles of magnetic resonance imaging (MRI), electroencephalography (EEG), magnetoencephalography (MEG), and near-infrared spectroscopy (NIRS) are discussed. We include a section on modulators of brain development where we focus on the placenta and emerging placental MRI approaches. In each section we discuss key technical limitations of the imaging modalities and some of the limitations arising due to the biology of the system. Although neuroimaging approaches have contributed significantly to our understanding of early brain development, there is much yet to be done and a dire need for technical innovations and scientific discoveries to realize the future potential of early fetal and infant interventions to avert long term disease.

Modality-independent recruitment of inferior frontal cortex during speech processing in human infants

Despite increasing interest in the development of audiovisual speech perception in infancy, the underlying mechanisms and neural processes are still only poorly understood. In addition to regions in temporal cortex associated with speech processing and multimodal integration, such as superior temporal sulcus, left inferior frontal cortex (IFC) has been suggested to be critically involved in mapping information from different modalities during speech perception. To further illuminate the role of IFC during infant language learning and speech perception, the current study examined the processing of auditory, visual and audiovisual speech in 6-month-old infants using functional near-infrared spectroscopy (fNIRS). Our results revealed that infants recruit speech-sensitive regions in frontal cortex including IFC regardless of whether they processed unimodal or multimodal speech. We argue that IFC may play an important role in associating multimodal speech information during the early steps of language learning.

Optical Mapping of Brain Activation and Connectivity in Occipitotemporal Cortex During Chinese Character Recognition

In this study, functional near-infrared spectroscopy (fNIRS) was used to examine the brain activation and connectivity in occipitotemporal cortex during Chinese character recognition (CCR). Eighteen healthy participants were recruited to perform a well-designed task with three categories of stimuli (real characters, pseudo characters, and checkerboards). By inspecting the brain activation difference and its relationship with behavioral data, the left laterality during CCR was clearly identified in the Brodmann area (BA) 18 and 19. In addition, our novel findings also demonstrated that the bilateral superior temporal gyrus (STG), bilateral BA 19, and left fusiform gyrus were also involved in high-level lexical information processing such as semantic and phonological ones. Meanwhile, by examining functional brain networks, we discovered that the right BA 19 exhibited enhanced brain connectivity. In particular, the connectivity in the right fusiform gyrus, right BA 19, and left STG showed significant correlation with the performance of CCR. Consequently, the combination of fNIRS technique with functional network analysis paves a new avenue for improved understanding of the cognitive mechanism underlying CCR.

Variability of the hemodynamic response in infants: Influence of experimental design and stimulus complexity

Measuring brain activity in developmental populations remains a major challenge despite great technological advances. Among the numerous available methods, functional near-infrared spectroscopy (fNIRS), an imaging modality that probes the hemodynamic response, is a powerful tool for recording brain activity in a great variety of situations and populations. Neurocognitive studies with infants have often reported inverted hemodynamic responses, i.e. a decrease instead of an increase in regional blood oxygenation, but the exact physiological explanation and cognitive interpretation of this response remain unclear. Here, we first provide an overview of the basic principles of NIRS and its use in cognitive developmental neuroscience. We then review the infant fNIRS literature to show that the hemodynamic response is modulated by experimental design and stimulus complexity, sometimes leading to hemodynamic responses with non-canonical shapes. We also argue that this effect is further modulated by the age of participants, the cortical regions involved, and the developmental stage of the tested cognitive process. We argue that this variability needs to be taken into account when designing and interpreting developmental studies measuring the hemodynamic response.

Age-Dependent Effects of Catechol-O-Methyltransferase (COMT) Gene Val158Met Polymorphism on Language Function in Developing Children

The genetic basis controlling language development remains elusive. Previous studies of the catechol-O-methyltransferase (COMT) Val¹⁵⁸Met genotype and cognition have focused on prefrontally guided executive functions involving dopamine. However, COMT may further influence posterior cortical regions implicated in language perception. We investigated whether COMT influences language ability and cortical language processing involving the posterior language regions in 246 children aged 6–10 years. We assessed language ability using a language test and cortical responses recorded during language processing using a word repetition task and functional near-infrared spectroscopy. The COMT genotype had significant effects on language performance and processing. Importantly, Met carriers outperformed Val homozygotes in language ability during the early elementary school years (6–8 years), whereas Val homozygotes exhibited significant language development during the later elementary school years. Both genotype groups exhibited equal language performance at approximately 10 years of age. Val homozygotes exhibited significantly less cortical activation compared with Met carriers during word processing, particularly at older ages. These findings regarding dopamine transmission efficacy may be explained by a hypothetical inverted U-shaped curve. Our findings indicate that the effects of the COMT genotype on language ability and cortical language processing may change in a narrow age window of 6–10 years.

Optical neuroimaging of spoken language

In this review I introduce the historical context and methods of optical neuroimaging, leading to the modern use of functional near-infrared spectroscopy (fNIRS) and high-density diffuse optical tomography (HD-DOT) to study human brain function. In its most frequent application, optical neuroimaging measures a hemodynamically-mediated signal indirectly related to neural processing, similar to that captured by fMRI. Compared to other approaches to measuring human brain function, optical imaging has many advantages: it is noninvasive, frequently portable, acoustically silent, robust to motion and muscle movement, and appropriate in many situations in which fMRI is not possible (for example, due to implanted medical devices). Challenges include producing a full-brain field of view, homogenous spatial resolution, and accurate source localization. Experimentally, optical neuroimaging has been used to study phoneme, word, and sentence processing in a variety of paradigms. With continuing technical and methodological improvements the future of optical neuroimaging is increasingly bright.

Somatic stimulation causes frontoparietal cortical changes in neonates: a functional near-infrared spectroscopy study

Palmar and plantar grasp are the foremost primitive neonatal reflexes and functions. Persistence of these reflexes in infancy is a sign of evolving cerebral palsy. Our aims were to establish measurement feasibility in a clinical setting and to characterize changes in oxyhemoglobin (HbO) and deoxyhemoglobin (HbD) concentration in the bilateral frontoparietal cortex in unsedated neonates at the crib-side using functional near-infrared spectroscopy (fNIRS). We hypothesized that bilateral concentration changes will occur upon somatic central and peripheral somatic stimulation. Thirteen preterm neonates (five males) underwent time 1, and six (two males) returned for time 2 (mean [Formula: see text] and 47.0 weeks, respectively). Signals from a total of 162 somatic stimuli responses were measured. Response amplitude, duration, and latency were log-transformed and compared between palmar, plantar, and oromotor stimuli using linear mixed models, adjusted for cap, electroencephalogram abnormality, time (1 versus 2), and Sarnat score, if necessary. The oromotor stimulus resulted in a 50% greater response than the palmar or plantar stimuli for HbO left and right hemisphere duration ([Formula: see text]). There were no other statistically significant differences between stimuli for any other outcome ([Formula: see text]). Utilizing fNIRS in conjunction with occupational and physical therapy maneuvers is efficacious to study modifiable and restorative neurophysiological mechanisms.

Adult-like processing of time-compressed speech by newborns: A NIRS study

•

Newborns’ perception of time-compressed speech is similar to that of adults.

•

Newborns adapt to moderately compressed speech, but not to highly compressed speech.

•

Adaptation to time-compressed speech happens at an auditory level.

•

Adaptation to time-compressed speech involves the left temporoparietal regions.

Humans can adapt to a wide range of variations in the speech signal, maintaining an invariant representation of the linguistic information it contains. Among them, adaptation to rapid or time-compressed speech has been well studied in adults, but the developmental origin of this capacity remains unknown. Does this ability depend on experience with speech (if yes, as heard in utero or as heard postnatally), with sounds in general or is it experience-independent? Using near-infrared spectroscopy, we show that the newborn brain can discriminate between three different compression rates: normal, i.e. 100% of the original duration, moderately compressed, i.e. 60% of original duration and highly compressed, i.e. 30% of original duration. Even more interestingly, responses to normal and moderately compressed speech are similar, showing a canonical hemodynamic response in the left temporoparietal, right frontal and right temporal cortex, while responses to highly compressed speech are inverted, showing a decrease in oxyhemoglobin concentration. These results mirror those found in adults, who readily adapt to moderately compressed, but not to highly compressed speech, showing that adaptation to time-compressed speech requires little or no experience with speech, and happens at an auditory, and not at a more abstract linguistic level.

Functional Near-Infrared Spectroscopy (fNIRS) for Assessing Cerebral Cortex Function During Human Behavior in Natural/Social Situations: A Concise Review

Upon adequate stimulation, real-time maps of cortical hemodynamic responses can be obtained by functional near-infrared spectroscopy (fNIRS), which noninvasively measures changes in oxygenated and deoxygenated hemoglobin after positioning multiple sources and detectors over the human scalp. This review is aimed at giving a concise and simple overview of the basic principles of fNIRS including features, strengths, advantages, limitations, and utility for evaluating human behavior. The transportable/wireless commercially available fNIRS systems have a time resolution of 1 to 10 Hz, a depth sensitivity of about 1.5 cm, and a spatial resolution up to 1 cm. fNIRS has been found suitable for many applications on human beings, either adults or infants/children, in the field of social sciences, neuroimaging basic research, and medicine. Some examples of present and future prospects of fNIRS for assessing cerebral cortex function during human behavior in different situations (in natural and social situations) will be provided. Moreover, the most recent fNIRS studies for investigating interpersonal interactions by adopting the hyperscanning approach, which consists of the measurement of brain activity simultaneously on two or more people, will be reported.

A Proof of Concept Study of Function-Based Statistical Analysis of fNIRS Data: Syntax Comprehension in Children with Specific Language Impairment Compared to Typically-Developing Controls

Functional near infrared spectroscopy (fNIRS) is a neuroimaging technology that enables investigators to indirectly monitor brain activity in vivo through relative changes in the concentration of oxygenated and deoxygenated hemoglobin. One of the key features of fNIRS is its superior temporal resolution, with dense measurements over very short periods of time (100 ms increments). Unfortunately, most statistical analysis approaches in the existing literature have not fully utilized the high temporal resolution of fNIRS. For example, many analysis procedures are based on linearity assumptions that only extract partial information, thereby neglecting the overall dynamic trends in fNIRS trajectories. The main goal of this article is to assess the ability of a functional data analysis (FDA) approach for detecting significant differences in hemodynamic responses recorded by fNIRS. Children with and without SLI wore two, 3 × 5 fNIRS caps situated over the bilateral parasylvian areas as they completed a language comprehension task. FDA was used to decompose the high dimensional hemodynamic curves into the mean function and a few eigenfunctions to represent the overall trend and variation structures over time. Compared to the most popular GLM, we did not assume any parametric structure and let the data speak for itself. This analysis identified significant differences between the case and control groups in the oxygenated hemodynamic mean trends in the bilateral inferior frontal and left inferior posterior parietal brain regions. We also detected significant group differences in the deoxygenated hemodynamic mean trends in the right inferior posterior parietal cortex and left temporal parietal junction. These findings, using dramatically different approaches, experimental designs, data sets, and foci, were consistent with several other reports, confirming group differences in the importance of these two areas for syntax comprehension. The proposed FDA was consistent with the temporal characteristics of fNIRS, thus providing an alternative methodology for fNIRS analyses.

Object processing in the infant: lessons from neuroscience

Object identification is a fundamental cognitive capacity that forms the basis for complex thought and behavior. The adult cortex is organized into functionally distinct visual object-processing pathways that mediate this ability. Insights into the origin of these pathways have begun to emerge through the use of neuroimaging techniques with infant populations. The outcome of this work supports the view that, from the early days of life, object-processing pathways are organized in a way that resembles that of the adult. At the same time, theoretically important changes in patterns of cortical activation are observed during the first year. These findings lead to a new understanding of the cognitive and neural architecture in infants that supports their emerging object-processing capacities.

fNIRS in the developmental sciences

With the introduction of functional near-infrared spectroscopy (fNIRS) into the experimental setting, developmental scientists have, for the first time, the capacity to investigate the functional activation of the infant brain in awake, engaged participants. The advantages of fNIRS clearly outweigh the limitations, and a description of how this technology is implemented in infant populations is provided. Most fNIRS research falls into one of three content domains: object processing, processing of biologically and socially relevant information, and language development. Within these domains, there are ongoing debates about the origins and development of human knowledge, making early neuroimaging particularly advantageous. The use of fNIRS has allowed investigators to begin to identify the localization of early object, social, and linguistic knowledge in the immature brain and the ways in which this changes with time and experience. In addition, there is a small but growing body of research that provides insight into the neural mechanisms that support and facilitate learning during the first year of life. At the same time, as with any emerging field, there are limitations to the conclusions that can be drawn on the basis of current findings. We offer suggestions as to how to optimize the use of this technology to answer questions of theoretical and practical importance to developmental scientists.

Separating heart and brain: on the reduction of physiological noise from multichannel functional near-infrared spectroscopy (fNIRS) signals

OBJECTIVE

Functional near-infrared spectroscopy (fNIRS) is an emerging technique for the in vivo assessment of functional activity of the cerebral cortex as well as in the field of brain-computer interface (BCI) research. A common challenge for the utilization of fNIRS in these areas is a stable and reliable investigation of the spatio-temporal hemodynamic patterns. However, the recorded patterns may be influenced and superimposed by signals generated from physiological processes, resulting in an inaccurate estimation of the cortical activity. Up to now only a few studies have investigated these influences, and still less has been attempted to remove/reduce these influences. The present study aims to gain insights into the reduction of physiological rhythms in hemodynamic signals (oxygenated hemoglobin (oxy-Hb), deoxygenated hemoglobin (deoxy-Hb)).

APPROACH

We introduce the use of three different signal processing approaches (spatial filtering, a common average reference (CAR) method; independent component analysis (ICA); and transfer function (TF) models) to reduce the influence of respiratory and blood pressure (BP) rhythms on the hemodynamic responses.

MAIN RESULTS

All approaches produce large reductions in BP and respiration influences on the oxy-Hb signals and, therefore, improve the contrast-to-noise ratio (CNR). In contrast, for deoxy-Hb signals CAR and ICA did not improve the CNR. However, for the TF approach, a CNR-improvement in deoxy-Hb can also be found.

SIGNIFICANCE

The present study investigates the application of different signal processing approaches to reduce the influences of physiological rhythms on the hemodynamic responses. In addition to the identification of the best signal processing method, we also show the importance of noise reduction in fNIRS data.

Language universals at birth

The evolution of human languages is driven both by primitive biases present in the human sensorimotor systems and by cultural transmission among speakers. However, whether the design of the language faculty is further shaped by linguistic biological biases remains controversial. To address this question, we used near-infrared spectroscopy to examine whether the brain activity of neonates is sensitive to a putatively universal phonological constraint. Across languages, syllables like blif are preferred to both lbif and bdif. Newborn infants (2-5 d old) listening to these three types of syllables displayed distinct hemodynamic responses in temporal-perisylvian areas of their left hemisphere. Moreover, the oxyhemoglobin concentration changes elicited by a syllable type mirrored both the degree of its preference across languages and behavioral linguistic preferences documented experimentally in adulthood. These findings suggest that humans possess early, experience-independent, linguistic biases concerning syllable structure that shape language perception and acquisition.

Auditory cortex activation to natural speech and simulated cochlear implant speech measured with functional near-infrared spectroscopy

The primary goal of most cochlear implant procedures is to improve a patient's ability to discriminate speech. To accomplish this, cochlear implants are programmed so as to maximize speech understanding. However, programming a cochlear implant can be an iterative, labor-intensive process that takes place over months. In this study, we sought to determine whether functional near-infrared spectroscopy (fNIRS), a non-invasive neuroimaging method which is safe to use repeatedly and for extended periods of time, can provide an objective measure of whether a subject is hearing normal speech or distorted speech. We used a 140 channel fNIRS system to measure activation within the auditory cortex in 19 normal hearing subjects while they listed to speech with different levels of intelligibility. Custom software was developed to analyze the data and compute topographic maps from the measured changes in oxyhemoglobin and deoxyhemoglobin concentration. Normal speech reliably evoked the strongest responses within the auditory cortex. Distorted speech produced less region-specific cortical activation. Environmental sounds were used as a control, and they produced the least cortical activation. These data collected using fNIRS are consistent with the fMRI literature and thus demonstrate the feasibility of using this technique to objectively detect differences in cortical responses to speech of different intelligibility.

The use of near-infrared spectroscopy in the study of typical and atypical development

The use of functional near infrared spectroscopy (fNIRS) has grown exponentially over the past decade, particularly among investigators interested in early brain development. The use of this neuroimaging technique has begun to shed light on the development of a variety of sensory, perceptual, linguistic, and social-cognitive functions. Rather than cast a wide net, in this paper we first discuss typical development, focusing on joint attention, face processing, language, and sensorimotor development. We then turn our attention to infants and children whose development has been compromised or who are at risk for atypical development. We conclude our review by critiquing some of the methodological issues that have plagued the extant literature as well as offer suggestions for future research.

A brain of two halves: insights into interhemispheric organization provided by near-infrared spectroscopy

The discovery of functional lateralization and localization of the brain marked the beginning of a new era in neuroscience. While the past 150 years of research have provided a great deal of knowledge of hemispheric differences and functional relationships, the precise organization of functional laterality remains a topic of intense debate. Here I will shed light on the functional organization of the two hemispheres by reviewing some of the most recent functional near-infrared spectroscopy (NIRS) studies that have reported hemispheric differences in activation patterns. Most NIRS studies using visual stimuli, which revealed functional differentiation between the hemispheres, have reported unilateral activation, i.e., significant levels of activation in only one hemisphere. Auditory stimuli, including speech sounds, elicited bilateral activation, while the limited number of studies on young infants revealed primarily unilateral activation. The stimulus modality and the age of the participants therefore determine whether the resulting cortical activation is unilateral or bilateral. By combining a review of the existing literature with NIRS results regarding homologous connectivity across hemispheres, I hypothesized that the origin of functional lateralization changes from the independence of each hemispheric region, to mutual inhibition between homologous regions during development. Future studies applying multi-modal measurements along with NIRS and spatiotemporal analyses will further deepen our understanding of the interhemispheric organization of brain function.

Cortical effects of user training in a motor imagery based brain-computer interface measured by fNIRS and EEG

The present study aims to gain insights into the effects of training with a motor imagery (MI)-based brain-computer interface (BCI) on activation patterns of the sensorimotor cortex. We used functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG) to investigate long-term training effects across 10 sessions using a 2-class (right hand and feet) MI-based BCI in fifteen subjects. In the course of the training a significant enhancement of activation pattern emerges, represented by an [oxy-Hb] increase in fNIRS and a stronger event-related desynchronization in the upper β-frequency band in the EEG. These effects were only visible in participants with relatively low BCI performance (mean accuracy ≤ 70%). We found that training with an MI-based BCI affects cortical activation patterns especially in users with low BCI performance. Our results may serve as a valuable contribution to the field of BCI research and provide information about the effects that training with an MI-based BCI has on cortical activation patterns. This might be useful for clinical applications of BCI which aim at promoting and guiding neuroplasticity.

Newborn's brain activity signals the origin of word memories

Recent research has shown that specific areas of the human brain are activated by speech from the time of birth. However, it is currently unknown whether newborns' brains also encode and remember the sounds of words when processing speech. The present study investigates the type of information that newborns retain when they hear words and the brain structures that support word-sound recognition. Forty-four healthy newborns were tested with the functional near-infrared spectroscopy method to establish their ability to memorize the sound of a word and distinguish it from a phonetically similar one, 2 min after encoding. Right frontal regions--comparable to those activated in adults during retrieval of verbal material--showed a characteristic neural signature of recognition when newborns listened to a test word that had the same vowel of a previously heard word. In contrast, a characteristic novelty response was found when a test word had different vowels than the familiar word, despite having the same consonants. These results indicate that the information carried by vowels is better recognized by newborns than the information carried by consonants. Moreover, these data suggest that right frontal areas may support the recognition of speech sequences from the very first stages of language acquisition.

A brief review on the history of human functional near-infrared spectroscopy (fNIRS) development and fields of application

This review is aimed at celebrating the upcoming 20th anniversary of the birth of human functional near-infrared spectroscopy (fNIRS). After the discovery in 1992 that the functional activation of the human cerebral cortex (due to oxygenation and hemodynamic changes) can be explored by NIRS, human functional brain mapping research has gained a new dimension. fNIRS or optical topography, or near-infrared imaging or diffuse optical imaging is used mainly to detect simultaneous changes in optical properties of the human cortex from multiple measurement sites and displays the results in the form of a map or image over a specific area. In order to place current fNIRS research in its proper context, this paper presents a brief historical overview of the events that have shaped the present status of fNIRS. In particular, technological progresses of fNIRS are highlighted (i.e., from single-site to multi-site functional cortical measurements (images)), introduction of the commercial multi-channel systems, recent commercial wireless instrumentation and more advanced prototypes.

A failure of left temporal cortex to specialize for language is an early emerging and fundamental property of autism

Failure to develop normal language comprehension is an early warning sign of autism, but the neural mechanisms underlying this signature deficit are unknown. This is because of an almost complete absence of functional studies of the autistic brain during early development. Using functional magnetic resonance imaging, we previously observed a trend for abnormally lateralized temporal responses to language (i.e. greater activation on the right, rather than the expected left) in a small sample (n = 12) of sleeping 2-3 year olds with autism in contrast to typically developing children, a finding also reported in autistic adults and adolescents. It was unclear, however, if findings of atypical laterality would be observed in a larger sample, and at even earlier ages in autism, such as around the first birthday. Answers to these questions would provide the foundation for understanding how neurofunctional defects of autism unfold, and provide a foundation for studies using patterns of brain activation as a functional early biomarker of autism. To begin to examine these issues, a prospective, cross-sectional design was used in which brain activity was measured in a large sample of toddlers (n = 80) during the presentation of a bedtime story during natural sleep. Forty toddlers with autism spectrum disorder and 40 typically developing toddlers ranging in age between 12-48 months participated. Any toddler with autism who participated in the imaging experiment prior to final diagnosis was tracked and diagnoses confirmed at a later age. Results indicated that at-risk toddlers later diagnosed as autistic display deficient left hemisphere response to speech sounds and have abnormally right-lateralized temporal cortex response to language; this defect worsens with age, becoming most severe in autistic 3- and 4-year-olds. Typically developing children show opposite developmental trends with a tendency towards greater temporal cortex response with increasing age and maintenance of left-lateralized activation with age. We have now demonstrated lateralized abnormalities of temporal cortex processing of language in autism across two separate samples, including a large sample of young infants who later are diagnosed with autism, suggesting that this pattern may reflect a fundamental early neural developmental pathology in autism.