Using near-infrared spectroscopy to assess neural activation during object processing in infants

Expecting the Unexpected: Infants Use Others' Surprise to Revise Their Own Expectations

Human infants show systematic responses to events that violate their expectations. Can they also revise these expectations based on others' expressions of surprise? Here we ask whether infants (N = 156, mean = 15.2 months, range: 12.0-18.0 months) can use an experimenter's expression of surprise to revise their own expectations about statistically probable vs. improbable events. An experimenter sampled a ball from a box of red and white balls and briefly displayed either a surprised or an unsurprised expression at the outcome before revealing it to the infant. Following an unsurprised expression, the results were consistent with prior work; infants looked longer at a statistically improbable outcome than a probable outcome. Following a surprised expression, however, this standard pattern disappeared or was even reversed. These results suggest that even before infants can observe the unexpected events themselves, they can use others' surprise to expect the unexpected. Starting early in life, human learners can leverage social information that signals others' prediction error to update their own predictions.

Two Independent Response Mechanisms to Auditory Stimuli Measured with Functional Near-Infrared Spectroscopy in Sleeping Infants

This study investigated the morphology of the functional near-infrared spectroscopy (fNIRS) response to speech sounds measured from 16 sleeping infants and how it changes with repeated stimulus presentation. We observed a positive peak followed by a wide negative trough, with the latter being most evident in early epochs. We argue that the overall response morphology captures the effects of two simultaneous, but independent, response mechanisms that are both activated at the stimulus onset: one being the obligatory response to a sound stimulus by the auditory system, and the other being a neural suppression effect induced by the arousal system. Because the two effects behave differently with repeated epochs, it is possible to mathematically separate them and use fNIRS to study factors that affect the development and activation of the arousal system in infants. The results also imply that standard fNIRS analysis techniques need to be adjusted to take into account the possibilities of multiple simultaneous brain systems being activated and that the response to a stimulus is not necessarily stationary.

Laterality Index Calculations in a Control Study of Functional Near Infrared Spectroscopy

Hemispheric dominance has been used to understand the influence of central and peripheral neural damage on the motor function of individuals with stroke, cerebral palsy, and limb loss. It has been well established that greater activation occurs in the contralateral hemisphere to the side of the body used to perform the task. However, there is currently a large variability in calculation procedures for brain laterality when using functional near-infrared spectroscopy (fNIRS) as a non-invasive neuroimaging tool. In this study, we used fNIRS to measure brain activity over the left and right sensorimotor cortices while participants (n = 20, healthy and uninjured) performed left and right-hand movement tasks. Then, we analyzed the fNIRS data using two different processing pipelines (block averaging or general linear model [GLM]), two different criteria of processing for negative values (include all beta values or include only positive beta values), and three different laterality index (LI) formulas. The LI values produced using the block averaging analysis indicated an expected contralateral dominance with some instances of bilateral dominance, which agreed with the expected contralateral activation. However, the inclusion criteria nor the LI formulas altered the outcome. The LI values produced using the GLM analysis displayed a robust left hemisphere dominance regardless of the hand performing the task, which disagreed with the expected contralateral activation but did provide instances of correctly identifying brain laterality. In conclusion, both analysis pipelines were able to correctly determine brain laterality, but processes to account for negative beta values were recommended especially when utilizing the GLM analysis to determine brain laterality.

Motion artifacts removal and evaluation techniques for functional near-infrared spectroscopy signals: A review

With the emergence of an increasing number of functional near-infrared spectroscopy (fNIRS) devices, the significant deterioration in measurement caused by motion artifacts has become an essential research topic for fNIRS applications. However, a high requirement for mathematics and programming limits the number of related researches. Therefore, here we provide the first comprehensive review for motion artifact removal in fNIRS aiming to (i) summarize the latest achievements, (ii) present the significant solutions and evaluation metrics from the perspective of application and reproduction, and (iii) predict future topics in the field. The present review synthesizes information from fifty-one journal articles (screened according to three criteria). Three hardware-based solutions and nine algorithmic solutions are summarized, and their application requirements (compatible signal types, the availability for online applications, and limitations) and extensions are discussed. Five metrics for noise suppression and two metrics for signal distortion were synthesized to evaluate the motion artifact removal methods. Moreover, we highlight three deficiencies in the existing research: (i) The balance between the use of auxiliary hardware and that of an algorithmic solution is not clarified; (ii) few studies mention the filtering delay of the solutions, and (iii) the robustness and stability of the solution under extreme application conditions are not discussed.

Deep learning-based motion artifact removal in functional near-infrared spectroscopy

Significance: Functional near-infrared spectroscopy (fNIRS), a well-established neuroimaging technique, enables monitoring cortical activation while subjects are unconstrained. However, motion artifact is a common type of noise that can hamper the interpretation of fNIRS data. Current methods that have been proposed to mitigate motion artifacts in fNIRS data are still dependent on expert-based knowledge and the post hoc tuning of parameters. Aim: Here, we report a deep learning method that aims at motion artifact removal from fNIRS data while being assumption free. To the best of our knowledge, this is the first investigation to report on the use of a denoising autoencoder (DAE) architecture for motion artifact removal. Approach: To facilitate the training of this deep learning architecture, we (i) designed a specific loss function and (ii) generated data to mimic the properties of recorded fNIRS sequences. Results: The DAE model outperformed conventional methods in lowering residual motion artifacts, decreasing mean squared error, and increasing computational efficiency. Conclusion: Overall, this work demonstrates the potential of deep learning models for accurate and fast motion artifact removal in fNIRS data.

Infants’ brain activity to cartoon face using functional near-infrared spectroscopy

In this study, to investigate whether infants showed face-specific brain activity to a cartoon human face, we conducted a functional near-infrared spectroscopy (fNIRS) experiment and a behavioral experiment. In the fNIRS experiment, we measured the hemodynamic responses of 5- and 6-month-old infants to cartoon female and cartoon character faces using fNIRS. The results showed that the concentration of oxy-Hb increased for cartoon female faces but not for cartoon character faces. This indicates that face-specific brain activity occurred for cartoon female faces but not cartoon character faces, despite the fact that both are faces. In the behavioral experiment, we examined whether the 5- and 6-month-old infants preferred cartoon female faces to cartoon character faces in the upright and inverted conditions. The results showed a preference for cartoon female faces in the upright but not in the inverted condition. This indicates that 5- and 6-month-old infants can perceive cartoon female faces, but not cartoon character faces, as faces. The results of the two experiments indicated that face-specific brain activity occurred for cartoon female faces. This indicates that infants can perceive cartoon female faces as faces.

Regional Haemodynamic and Metabolic Coupling in Infants

Metabolic pathways underlying brain function remain largely unexplored during neurodevelopment, predominantly due to the lack of feasible techniques for use with awake infants. Broadband near-infrared spectroscopy (bNIRS) provides the opportunity to explore the relationship between cerebral energy metabolism and blood oxygenation/haemodynamics through the measurement of changes in the oxidation state of mitochondrial respiratory chain enzyme cytochrome-c-oxidase (ΔoxCCO) alongside haemodynamic changes. We used a bNIRS system to measure ΔoxCCO and haemodynamics during functional activation in a group of 42 typically developing infants aged between 4 and 7 months. bNIRS measurements were made over the right hemisphere over temporal, parietal and central cortical regions, in response to social and non-social visual and auditory stimuli. Both ΔoxCCO and Δ[HbO2] displayed larger activation for the social condition in comparison to the non-social condition. Integration of haemodynamic and metabolic signals revealed networks of stimulus-selective cortical regions that were not apparent from analysis of the individual bNIRS signals. These results provide the first spatially resolved measures of cerebral metabolic activity alongside haemodynamics during functional activation in infants. Measuring synchronised changes in metabolism and haemodynamics have the potential for uncovering the development of cortical specialisation in early infancy.

Comparison of functional activation responses from the auditory cortex derived using multi-distance frequency domain and continuous wave near-infrared spectroscopy

Significance: Quantitative measurements of cerebral hemodynamic changes due to functional activation are widely accomplished with commercial continuous wave (CW-NIRS) instruments despite the availability of the more rigorous multi-distance frequency domain (FD-NIRS) approach. A direct comparison of the two approaches to functional near-infrared spectroscopy can help in the interpretation of optical data and guide implementations of diffuse optical instruments for measuring functional activation. Aim: We explore the differences between CW-NIRS and multi-distance FD-NIRS by comparing measurements of functional activation in the human auditory cortex. Approach: Functional activation of the human auditory cortex was measured using a commercial frequency domain near-infrared spectroscopy instrument for 70 dB sound pressure level broadband noise and pure tone (1000 Hz) stimuli. Changes in tissue oxygenation were calculated using the modified Beer-Lambert law (CW-NIRS approach) and the photon diffusion equation (FD-NIRS approach). Results: Changes in oxygenated hemoglobin measured with the multi-distance FD-NIRS approach were about twice as large as those measured with the CW-NIRS approach. A finite-element simulation of the functional activation problem was performed to demonstrate that tissue oxygenation changes measured with the CW-NIRS approach is more accurate than that with multi-distance FD-NIRS. Conclusions: Multi-distance FD-NIRS approaches tend to overestimate functional activation effects, in part due to partial volume effects.

Explainable artificial intelligence based analysis for interpreting infant fNIRS data in developmental cognitive neuroscience

In the last decades, non-invasive and portable neuroimaging techniques, such as functional near infrared spectroscopy (fNIRS), have allowed researchers to study the mechanisms underlying the functional cognitive development of the human brain, thus furthering the potential of Developmental Cognitive Neuroscience (DCN). However, the traditional paradigms used for the analysis of infant fNIRS data are still quite limited. Here, we introduce a multivariate pattern analysis for fNIRS data, xMVPA, that is powered by eXplainable Artificial Intelligence (XAI). The proposed approach is exemplified in a study that investigates visual and auditory processing in six-month-old infants. xMVPA not only identified patterns of cortical interactions, which confirmed the existent literature; in the form of conceptual linguistic representations, it also provided evidence for brain networks engaged in the processing of visual and auditory stimuli that were previously overlooked by other methods, while demonstrating similar statistical performance.

Cortical Activation to Social and Mechanical Stimuli in the Infant Brain

From the early days of life infants distinguish between social and non-social physical entities and have different expectations for the way these two entities should move and interact. At the same time, we know very little about the cortical systems that support this early emerging ability. The goal of the current research was to assess the extent to which infant's processing of social and non-social physical entities is mediated by distinct information processing systems in the temporal cortex. Using a cross-sectional design, infants aged 6-9 months (Experiment 1) and 11-18 months (Experiment 2) were presented with two types of events: social interaction and mechanical interaction. In the social interaction event (patterned after Hamlin et al., 2007), an entity with googly eyes, hair tufts, and an implied goal of moving up the hill was either helped up, or pushed down, a hill through the actions of another social entity. In the mechanical interaction event, the googly eyes and hair tufts were replaced with vertical black dots and a hook and clasp, and the objects moved up or down the hill via mechanical interactions. FNIRS was used to measure activation from temporal cortex while infants viewed the test events. In both age groups, viewing social and mechanical interaction events elicited different patterns of activation in the right temporal cortex, although responses were more specialized in the older age group. Activation was not obtained in these areas when the objects moved in synchrony without interacting, suggesting that the causal nature of the interaction events may be responsible, in part, to the results obtained. This is one of the few fNIRS studies that has investigated age-related patterns of cortical activation and the first to provide insight into the functional development of networks specialized for processing of social and non-social physical entities engaged in interaction events.

Comparing different pre-processing routines for infant fNIRS data

Functional Near Infrared Spectroscopy (fNIRS) is an important neuroimaging technique in cognitive developmental neuroscience. Nevertheless, there is no general consensus yet about best pre-processing practices. This issue is highly relevant, especially since the development and variability of the infant hemodynamic response (HRF) is not fully known. Systematic comparisons between analysis methods are thus necessary. We investigated the performance of five different pipelines, selected on the basis of a systematic search of the infant NIRS literature, in two experiments. In Experiment 1, we used synthetic data to compare the recovered HRFs with the true HRF and to assess the robustness of each method against increasing levels of noise. In Experiment 2, we analyzed experimental data from a published study, which assessed the neural correlates of artificial grammar processing in newborns. We found that with motion artifact correction (as opposed to rejection) a larger number of trials were retained, but HRF amplitude was often strongly reduced. By contrast, artifact rejection resulted in a high exclusion rate but preserved adequately the characteristics of the HRF. We also found that the performance of all pipelines declined as the noise increased, but significantly less so than if no pre-processing was applied. Finally, we found no difference between running the pre-processing on optical density or concentration change data. These results suggest that pre-processing should thus be optimized as a function of the specific quality issues a give dataset exhibits.

Measuring the Cognitive Workload During Dual-Task Walking in Young Adults: A Combination of Neurophysiological and Subjective Measures

Background: Walking while performing a secondary task (dual-task (DT) walking) increases cognitive workload in young adults. To date, few studies have used neurophysiological measures in combination to subjective measures to assess cognitive workload during a walking task. This combined approach can provide more insights into the amount of cognitive resources in relation with the perceived mental effort involving in a walking task.

Research Question: The objective was to examine cognitive workload in young adults during walking conditions varying in complexity.

Methods: Twenty-five young adults (mean = 24.4 ± 5.4) performed four conditions: (1) usual walking, (2) simple DT walking, (3) complex DT walking and (4) standing while subtracting. During the walking task, mean speed, cadence, stride time, stride length, and their respective coefficient of variation (CV) were recorded. Cognitive workload will be measured through changes in oxy- and deoxy-hemoglobin (ΔHbO₂ and ΔHbR) during walking in the dorsolateral prefrontal cortex (DLPFC) and perceived mental demand score from NASA-TLX questionnaire.

Results: In young adults, ΔHbO₂ in the DLPFC increased from usual walking to both DT walking conditions and standing while subtracting condition. ΔHbO₂ did not differ between the simple and complex DT and between the complex DT and standing while subtracting condition. Perceived mental demand gradually increased with walking task complexity. As expected, all mean values of gait parameters were altered according to task complexity. CV of speed, cadence and stride time were significantly higher during DT walking conditions than during usual walking whereas CV of stride length was only higher during complex DT walking than during usual walking.

Significance: Young adults had greater cognitive workload in the two DT walking conditions compared to usual walking. However, only the mental demand score from NASA-TLX questionnaire discriminated simple from complex DT walking. Subjective measure provides complementary information to objective one on changes in cognitive workload during challenging walking tasks in young adults. These results may be useful to improve our understanding of cognitive workload during walking.

Brief Report: Classification of Autistic Traits According to Brain Activity Recoded by fNIRS Using ε-Complexity Coefficients

Individuals with ASD have been shown to have different pattern of functional connectivity. In this study, brain activity of participants with many and few autistic traits, was recorded using an fNIRS device, as participants preformed an interpersonal synchronization task. This type of task involves synchronization and functional connectivity of different brain regions. A novel method for assessing signal complexity, using ε-complexity coefficients, applied for the first i.e. on fNIRS recording, was used to classify brain recording of participants with many/few autistic traits. Successful classification was achieved implying that this method may be useful for classification of fNIRS recordings and that there is a difference in brain activity between participants with low and high autistic traits as they perform an interpersonal synchronization task.

Local syntactic violations evoke fast mismatch-related neural activity detected by optical neuroimaging

It remains to be investigated whether syntax-related mismatch activity would be evoked in event-related optical signals by syntactic violations that deviate from our language knowledge and expectations. In the current study, we have employed fast optical neuroimaging with a frequency-domain oximeter to examine whether syntactic violations of English bare infinitives in the non-finite complement clause would trigger syntax-related mismatch effects. Recorded sentences of bare or full infinitive structures (without or with the 'to' infinitival marker) with syntactically correct or incorrect versions and non-syntactic lexical items (verbs) were presented to native speakers of English (n = 8) during silent movie viewing as a passive oddball task. The analysis of source strength (i.e., minimum norm current amplitudes) revealed that the syntactic category violations of bare object infinitives led to significantly more robust optical mismatch effects than the other syntactic violation and non-structural, lexical elements. This mismatch response had a peak latency of 186 ms in the left anterior superior temporal gyrus. In combination with our prior MEG report (Kubota et al. in Neurosci Lett 662:195-204, 2018), the present optical neuroimaging findings show that syntactic marking (unmarked-to-marked) violations of the bare object infinitive against the rule of the mental grammar enhance the signal strength exactly in the same manner seen with MEG scanning, including the peak latency of mismatch activity and the activated area of the brain.

The functional brain networks that underlie visual working memory in the first two years of life

Visual working memory (VWM) is a central cognitive system used to compare views of the world and detect changes in the local environment. This system undergoes dramatic development in the first two years; however, we know relatively little about the functional organization of VWM at the level of the brain. Here, we used image-based functional near-infrared spectroscopy (fNIRS) to test four hypotheses about the spatial organization of the VWM network in early development. Four-month-olds, 1-year-olds, and 2-year-olds completed a VWM task while we recorded neural activity from 19 cortical regions-of-interest identified from a meta-analysis of the adult fMRI literature on VWM. Results showed significant task-specific functional activation near 6 of 19 ROIs, revealing spatial consistency in the brain regions activated in our study and brain regions identified to be part of the VWM network in adult fMRI studies. Working memory related activation was centered on bilateral anterior intraparietal sulcus (aIPS), left temporoparietal junction (TPJ), and left ventral occipital complex (VOC), while visual exploratory measures were associated with activation in right dorsolateral prefrontal cortex, left TPJ, and bilateral IPS. Results show that a distributed brain network underlies functional changes in VWM in infancy, revealing new insights into the neural mechanisms that support infants’ improved ability to remember visual information and to detect changes in an on-going visual stream.

•

A distributed brain network underlies functional changes in VWM in infancy and toddlerhood.

•

This network shows robust engagement of similar brain regions identified in fMRI studies with adults as early as four months.

•

Working memory related activation was centered on bilateral anterior intraparietal sulcus, left temporoparietal junction, and left ventral occipital complex

•

Visual exploratory measures were associated with activation in right dorsolateral prefrontal cortex, bilateral anterior intraparietal sulcus, and left temporoparietal junction.

Neural and psychophysiological correlates of social communication development: Evidence from sensory processing, motor, cognitive, language and emotional behavioral milestones across infancy

This article presents a literature review focusing on the neural and psychophysiological correlates associated with social communication development in infancy. Studies presenting evidence on infants' brain activity and developments in infant sensory processing, motor, cognitive, language, and emotional abilities are described in regard to the neuropsychophysiological processes underlying the emergence of these specific behavioral milestones and their associations with social communication development. Studies that consider specific age-related characteristics across the infancy period are presented. Evidence suggests that specific neural and physiological signatures accompany age-related social communication development during the first 18 months of life.

Performance Monitoring via Functional Near Infrared Spectroscopy for Virtual Reality Based Basic Life Support Training

The use of serious game tools in training of medical professions is steadily growing. However, there is a lack of reliable performance assessment methods to evaluate learner’s outcome. The aim of this study is to determine whether functional near infrared spectroscopy (fNIRS) can be used as an additional tool for assessing the learning outcome of virtual reality (VR) based learning modules. The hypothesis is that together with an improvement in learning outcome there would be a decrease in the participants’ cerebral oxygenation levels measured from the prefrontal cortex (PFC) region and an increase of participants’ serious gaming results. To test this hypothesis, the subjects were recruited and divided into four groups with different combinations of prior virtual reality experience and prior Basic Life Support (BLS) knowledge levels. A VR based serious gaming module for teaching BLS and 16-Channel fNIRS system were used to collect data from the participants. Results of the participants’ scores acquired from the serious gaming module were compared with fNIRS measures on the initial and final training sessions. Kruskal Wallis test was run to determine any significant statistical difference between the groups and Mann–Whitney U test was utilized to obtain pairwise comparisons. BLS training scores of the participants acquired from VR based serious game’s the learning management system and fNIRS measurements revealed decrease in use of resources from the PFC, but increase in behavioral performance. Importantly, brain-based measures can provide an additional quantitative metric for trainee’s expertise development and can assist the medical simulation instructors.

Functional near-infrared spectroscopy for intraoperative brain mapping

Functional near-infrared spectroscopy (fNIRS) is a relatively new seizure-free technique and its value for intraoperative brain mapping is unknown. We examine the feasibility of fNIRS for intraoperative functional brain mapping. A 1 × 1    cm 2 density fNIRS probe specially designed for intraoperative use was used to map brain function in adult patients undergoing awake brain surgery and performing motor and/or language tasks. The ability of fNIRS for functional mapping was compared with direct cortical stimulation (DCS) and regression was used to determine if mean blood pressure (MBP) and blood hemoglobin influenced fNIRS measurements. Eighteen patients underwent awake craniotomy and performed 19 language- and 17 motor-related tasks. fNIRS mapping was highly correlated with DCS for 10 language- and 7 motor-related tasks. fNIRS was able to detect functional language ( p < 0.001 ) and motor areas ( p = 0.002 ). Compared to DCS, fNIRS was less accurate in determining both functional language (at least 22.64%, p < 0.001 ) and motor areas (at least 32.74%, p < 0.001 ). Higher MBP and blood hemoglobin were associated with better fNIRS results ( p = 0.045 and 0.007, respectively). No seizures or other complications occurred during fNIRS measurement. fNIRS is a promising seizure-free technique for intraoperative brain mapping. The accuracy of current technology needs further development for clinical use.

Hemodynamic responses to emotional speech in two-month-old infants imaged using diffuse optical tomography

Emotional speech is one of the principal forms of social communication in humans. In this study, we investigated neural processing of emotional speech (happy, angry, sad and neutral) in the left hemisphere of 21 two-month-old infants using diffuse optical tomography. Reconstructed total hemoglobin (HbT) images were analysed using adaptive voxel-based clustering and region-of-interest (ROI) analysis. We found a distributed happy > neutral response within the temporo-parietal cortex, peaking in the anterior temporal cortex; a negative HbT response to emotional speech (the average of the emotional speech conditions < baseline) in the temporo-parietal cortex, neutral > angry in the anterior superior temporal sulcus (STS), happy > angry in the superior temporal gyrus and posterior superior temporal sulcus, angry < baseline in the insula, superior temporal sulcus and superior temporal gyrus and happy < baseline in the anterior insula. These results suggest that left STS is more sensitive to happy speech as compared to angry speech, indicating that it might play an important role in processing positive emotions in two-month-old infants. Furthermore, happy speech (relative to neutral) seems to elicit more activation in the temporo-parietal cortex, thereby suggesting enhanced sensitivity of temporo-parietal cortex to positive emotional stimuli at this stage of infant development.

Violations of Core Knowledge Shape Early Learning

Research on cognitive development has revealed that even the youngest minds detect and respond to events that adults find surprising. These surprise responses suggest that infants have a basic set of "core" expectations about the world that are shared with adults and other species. However, little work has asked what purpose these surprise responses serve. Here we discuss recent evidence that violations of core knowledge offer special opportunities for learning. Infants and young children make predictions about the world on the basis of their core knowledge of objects, quantities, and social entities. We argue that when these predictions fail to match the observed data, infants and children experience an enhanced drive to seek and retain new information. This impact of surprise on learning is not equipotent. Instead, it is directed to entities that are relevant to the surprise itself; this drive propels children-even infants-to form and test new hypotheses about surprising aspects of the world. We briefly consider similarities and differences between these recent findings with infants and children, on the one hand, and findings on prediction errors in humans and non-human animals, on the other. These comparisons raise open questions that require continued inquiry, but suggest that considering phenomena across species, ages, kinds of surprise, and types of learning will ultimately help to clarify how surprise shapes thought.

Functional near-infrared spectroscopy as a tool for assessing speech and spoken language processing in pediatric and adult cochlear implant users

Much of what is known about the course of auditory learning in following cochlear implantation is based on behavioral indicators that users are able to perceive sound. Both prelingually deafened children and postlingually deafened adults who receive cochlear implants display highly variable speech and language processing outcomes, although the basis for this is poorly understood. To date, measuring neural activity within the auditory cortex of implant recipients of all ages has been challenging, primarily because the use of traditional neuroimaging techniques is limited by the implant itself. Functional near-infrared spectroscopy (fNIRS) is an imaging technology that works with implant users of all ages because it is non-invasive, compatible with implant devices, and not subject to electrical artifacts. Thus, fNIRS can provide insight into processing factors that contribute to variations in spoken language outcomes in implant users, both children and adults. There are important considerations to be made when using fNIRS, particularly with children, to maximize the signal-to-noise ratio and to best identify and interpret cortical responses. This review considers these issues, recent data, and future directions for using fNIRS as a tool to understand spoken language processing in children and adults who hear through a cochlear implant.

The origins of cortical multisensory dynamics: Evidence from human infants

Classic views of multisensory processing suggest that cortical sensory regions are specialized. More recent views argue that cortical sensory regions are inherently multisensory. To date, there are no published neuroimaging data that directly test these claims in infancy. Here we used fNIRS to show that temporal and occipital cortex are functionally coupled in 3.5-5-month-old infants (N = 65), and that the extent of this coupling during a synchronous, but not an asynchronous, audiovisual event predicted whether occipital cortex would subsequently respond to sound-only information. These data suggest that multisensory experience may shape cortical dynamics to adapt to the ubiquity of synchronous multisensory information in the environment, and invoke the possibility that adaptation to the environment can also reflect broadening of the computational range of sensory systems.

Using individual functional channels of interest to study cortical development with fNIRS

Functional near-infrared spectroscopy (fNIRS) is a noninvasive neuroimaging technique that could be uniquely effective for investigating cortical function in human infants. However, prior efforts have been hampered by the difficulty of aligning arrays of fNIRS optodes placed on the scalp to anatomical or functional regions of underlying cortex. This challenge can be addressed by identifying channels of interest in individual participants, and then testing the reliability of those channels' response profiles in independent data. Using this approach, cortical regions with preferential responses to faces versus scenes, and to scenes versus faces, were observed reliably in both adults and infants. By contrast, standard analysis techniques did not reliably identify significant responses to both categories in either age group. These results reveal scene-responsive regions, and confirm face-responsive regions, in preverbal infants. More generally, the analysis approach will be a robust and sensitive tool for future characterization of the early functional development of the human brain.

Object Recognition in Mental Representations: Directions for Exploring Diagnostic Features through Visual Mental Imagery

One of the fundamental goals of object recognition research is to understand how a cognitive representation produced from the output of filtered and transformed sensory information facilitates efficient viewer behavior. Given that mental imagery strongly resembles perceptual processes in both cortical regions and subjective visual qualities, it is reasonable to question whether mental imagery facilitates cognition in a manner similar to that of perceptual viewing: via the detection and recognition of distinguishing features. Categorizing the feature content of mental imagery holds potential as a reverse pathway by which to identify the components of a visual stimulus which are most critical for the creation and retrieval of a visual representation. This review will examine the likelihood that the information represented in visual mental imagery reflects distinctive object features thought to facilitate efficient object categorization and recognition during perceptual viewing. If it is the case that these representational features resemble their sensory counterparts in both spatial and semantic qualities, they may well be accessible through mental imagery as evaluated through current investigative techniques. In this review, methods applied to mental imagery research and their findings are reviewed and evaluated for their efficiency in accessing internal representations, and implications for identifying diagnostic features are discussed. An argument is made for the benefits of combining mental imagery assessment methods with diagnostic feature research to advance the understanding of visual perceptive processes, with suggestions for avenues of future investigation.

Expectancy violations promote learning in young children

Children, including infants, have expectations about the world around them, and produce reliable responses when these expectations are violated. However, little is known about how such expectancy violations affect subsequent cognition. Here we tested the hypothesis that violations of expectation enhance children's learning. In four experiments we compared 3- to 6-year-old children's ability to learn novel words in situations that defied versus accorded with their core knowledge of object behavior. In Experiments 1 and 2 we taught children novel words following one of two types of events. One event violated expectations about the spatiotemporal or featural properties of objects (e.g., an object appeared to magically change locations). The other event was almost identical, but did not violate expectations (e.g., an object was visibly moved from one location to another). In both experiments we found that children robustly learned when taught after the surprising event, but not following the expected event. In Experiment 3 we ruled out two alternative explanations for our results. Finally, in Experiment 4, we asked whether surprise affects children's learning in a targeted or a diffuse way. We found that surprise only enhanced children's learning about the entity that had behaved surprisingly, and not about unrelated objects. Together, these experiments show that core knowledge - and violations of expectations generated by core knowledge - shapes new learning.

Off to a Good Start: The Early Development of the Neural Substrates Underlying Visual Working Memory

Current neuroscientific models describe the functional neural architecture of visual working memory (VWM) as an interaction of the frontal-parietal control network and more posterior areas in the ventral visual stream (Jonides et al., 2008; D'Esposito and Postle, 2015; Eriksson et al., 2015). These models are primarily based on adult neuroimaging studies. However, VWM undergoes significant development in infancy and early childhood, and the goal of this mini-review is to examine how recent findings from neuroscientific studies of early VWM development can be reconciled with this model. We surveyed 29 recent empirical reports that present neuroimaging findings in infants, toddlers, and preschoolers (using EEG, fNIRS, rs-fMRI) and neonatal lesion studies in non-human primates. We conclude that (1) both the frontal-parietal control network and the posterior cortical storage areas are active from early infancy; (2) this system undergoes focalization and some reorganization during early development; (3) and the MTL plays a significant role in this process as well. Motivated by both theoretical and methodological considerations, we offer some recommendations for future directions for the field.

Oscillatory Activity in the Infant Brain and the Representation of Small Numbers

Gamma-band oscillatory activity (GBA) is an established neural signature of sustained occluded object representation in infants and adults. However, it is not yet known whether the magnitude of GBA in the infant brain reflects the quantity of occluded items held in memory. To examine this, we compared GBA of 6–8 month-old infants during occlusion periods after the representation of two objects vs. that of one object. We found that maintaining a representation of two objects during occlusion resulted in significantly greater GBA relative to maintaining a single object. Further, this enhancement was located in the right occipital region, which is consistent with previous object representation research in adults and infants. We conclude that enhanced GBA reflects neural processes underlying infants’ representation of small numbers.

Functional near-infrared spectroscopy for neuroimaging in cochlear implant recipients

Functional neuroimaging can provide insight into the neurobiological factors that contribute to the variations in individual hearing outcomes following cochlear implantation. To date, measuring neural activity within the auditory cortex of cochlear implant (CI) recipients has been challenging, primarily because the use of traditional neuroimaging techniques is limited in people with CIs. Functional near-infrared spectroscopy (fNIRS) is an emerging technology that offers benefits in this population because it is non-invasive, compatible with CI devices, and not subject to electrical artifacts. However, there are important considerations to be made when using fNIRS to maximize the signal to noise ratio and to best identify meaningful cortical responses. This review considers these issues, the current data, and future directions for using fNIRS as a clinical application in individuals with CIs. This article is part of a Special Issue entitled <Annual Reviews 2016>.

Functional Activation in the Ventral Object Processing Pathway during the First Year

Infants' capacity to represent objects in visual working memory changes substantially during the first year of life. There is a growing body of research focused on identifying neural mechanisms that support this emerging capacity, and the extent to which visual object processing elicits different patterns of cortical activation in the infant as compared to the adult. Recent studies have identified areas in temporal and occipital cortex that mediate infants' developing capacity to track objects on the basis of their featural properties. The current research (Experiments 1 and 2) assessed patterns of activation in posterior temporal cortex and occipital cortex using fNIRS in infants 3–13 months of age as they viewed occlusion events. In the occlusion events, either the same object or featurally distinct objects emerged to each side of a screen. The outcome of these studies, combined, revealed that in infants 3–6 months, posterior temporal cortex was activated to all events, regardless of the featural properties of the objects and whether the event involved one object or two (featurally distinct) objects. Infants 7–8 infants months showed a waning posterior temporal response and by 10–13 months this response was negligible. Additional analysis showed that the age groups did not differ in their visual attention to the events and that changes in HbO were better explained by age in days than head circumference. In contrast to posterior temporal cortex, robust activation was obtained in occipital cortex across all ages tested. One interpretation of these results is that they reflect pruning of the visual object-processing network during the first year. The functional contribution of occipital and posterior temporal cortex, along with higher-level temporal areas, to infants' capacity to keep track of distinct entities in visual working memory is discussed.

Functional brain organization for number processing in pre-verbal infants

Humans are born with the ability to mentally represent the approximate numerosity of a set of objects, but little is known about the brain systems that sub-serve this ability early in life and their relation to the brain systems underlying symbolic number and mathematics later in development. Here we investigate processing of numerical magnitudes before the acquisition of a symbolic numerical system or even spoken language, by measuring the brain response to numerosity changes in pre-verbal infants using functional near-infrared spectroscopy (fNIRS). To do this, we presented infants with two types of numerical stimulus blocks: number change blocks that presented dot arrays alternating in numerosity and no change blocks that presented dot arrays all with the same number. Images were carefully constructed to rule out the possibility that responses to number changes could be due to non-numerical stimulus properties that tend to co-vary with number. Interleaved with the two types of numerical blocks were audio-visual animations designed to increase attention. We observed that number change blocks evoked an increase in oxygenated hemoglobin over a focal right parietal region that was greater than that observed during no change blocks and during audio-visual attention blocks. The location of this effect was consistent with intra-parietal activity seen in older children and adults for both symbolic and non-symbolic numerical tasks. A distinct set of bilateral occipital and middle parietal channels responded more to the attention-grabbing animations than to either of the types of numerical stimuli, further dissociating the specific right parietal response to number from a more general bilateral visual or attentional response. These results provide the strongest evidence to date that the right parietal cortex is specialized for numerical processing in infancy, as the response to number is dissociated from visual change processing and general attentional processing.

Object processing in the infant: lessons from neuroscience

Object identification is a fundamental cognitive capacity that forms the basis for complex thought and behavior. The adult cortex is organized into functionally distinct visual object-processing pathways that mediate this ability. Insights into the origin of these pathways have begun to emerge through the use of neuroimaging techniques with infant populations. The outcome of this work supports the view that, from the early days of life, object-processing pathways are organized in a way that resembles that of the adult. At the same time, theoretically important changes in patterns of cortical activation are observed during the first year. These findings lead to a new understanding of the cognitive and neural architecture in infants that supports their emerging object-processing capacities.

Maintaining Gait Performance by Cortical Activation during Dual-Task Interference: A Functional Near-Infrared Spectroscopy Study

In daily life, mobility requires walking while performing a cognitive or upper-extremity motor task. Although previous studies have evaluated the effects of dual tasks on gait performance, few studies have evaluated cortical activation and its association with gait disturbance during dual tasks. In this study, we simultaneously assessed gait performance and cerebral oxygenation in the bilateral prefrontal cortices (PFC), premotor cortices (PMC), and supplemental motor areas (SMA), using functional near-infrared spectroscopy, in 17 young adults performing dual tasks. Each participant was evaluated while performing normal-pace walking (NW), walking while performing a cognitive task (WCT), and walking while performing a motor task (WMT). Our results indicated that the left PFC exhibited the strongest and most sustained activation during WCT, and that NW and WMT were associated with minor increases in oxygenation levels during their initial phases. We observed increased activation in channels in the SMA and PMC during WCT and WMT. Gait data indicated that WCT and WMT both caused reductions in walking speed, but these reductions resulted from differing alterations in gait properties. WCT was associated with significant changes in cadence, stride time, and stride length, whereas WMT was associated with reductions in stride length only. During dual-task activities, increased activation of the PMC and SMA correlated with declines in gait performance, indicating a control mechanism for maintaining gait performance during dual tasks. Thus, the regulatory effects of cortical activation on gait behavior enable a second task to be performed while walking.

Effect of motion artifacts and their correction on near-infrared spectroscopy oscillation data: a study in healthy subjects and stroke patients

Functional near-infrared spectroscopy is prone to contamination by motion artifacts (MAs). Motion correction algorithms have previously been proposed and their respective performance compared for evoked rain activation studies. We study instead the effect of MAs on "oscillation" data which is at the basis of functional connectivity and autoregulation studies. We use as our metric of interest the interhemispheric correlation (IHC), the correlation coefficient between symmetrical time series of oxyhemoglobin oscillations. We show that increased motion content results in a decreased IHC. Using a set of motion-free data on which we add real MAs, we find that the best motion correction approach consists of discarding the segments of MAs following a careful approach to minimize the contamination due to band-pass filtering of data from "bad" segments spreading into adjacent "good" segments. Finally, we compare the IHC in a stroke group and in a healthy group that we artificially contaminated with the MA content of the stroke group, in order to avoid the confounding effect of increased motion incidence in the stroke patients. After motion correction, the IHC remains lower in the stroke group in the frequency band around 0.1 and 0.04 Hz, suggesting a physiological origin for the difference. We emphasize the importance of considering MAs as a confounding factor in oscillation-based functional near-infrared spectroscopy studies.

Cognitive development. Observing the unexpected enhances infants' learning and exploration

Given the overwhelming quantity of information available from the environment, how do young learners know what to learn about and what to ignore? We found that 11-month-old infants (N = 110) used violations of prior expectations as special opportunities for learning. The infants were shown events that violated expectations about object behavior or events that were nearly identical but did not violate expectations. The sight of an object that violated expectations enhanced learning and promoted information-seeking behaviors; specifically, infants learned more effectively about objects that committed violations, explored those objects more, and engaged in hypothesis-testing behaviors that reflected the particular kind of violation seen. Thus, early in life, expectancy violations offer a wedge into the problem of what to learn.

Are you talking to me? Neural activations in 6-month-old infants in response to being addressed during natural interactions

Human interactions are guided by continuous communication among the parties involved, in which verbal communication plays a primary role. However, speech does not necessarily reveal to whom it is addressed, especially for young infants who are unable to decode its semantic content. To overcome such difficulty, adults often explicitly mark their communication as infant-directed. In the present study we investigated whether ostensive signals, which would disambiguate the infant as the addressee of a communicative act, would modulate the brain responses of 6-month-old infants to speech and gestures in an ecologically valid setting. In Experiment 1, we tested whether the gaze direction of the speaker modulates cortical responses to infant-direct speech. To provide a naturalistic environment, two infants and their parents participated at the same time. In Experiment 2, we tested whether a similar modulation of the cortical response would be obtained by varying the intonation (infant versus adult directed speech) of the speech during face-to-face communication, one on one. The results of both experiments indicated that only the combination of ostensive signals (infant directed speech and direct gaze) led to enhanced brain activation. This effect was indicated by responses localized in regions known to be involved in processing auditory and visual aspects of social communication. This study also demonstrated the potential of fNIRS as a tool for studying neural responses in naturalistic scenarios, and for simultaneous measurement of brain function in multiple participants.

fNIRS in the developmental sciences

With the introduction of functional near-infrared spectroscopy (fNIRS) into the experimental setting, developmental scientists have, for the first time, the capacity to investigate the functional activation of the infant brain in awake, engaged participants. The advantages of fNIRS clearly outweigh the limitations, and a description of how this technology is implemented in infant populations is provided. Most fNIRS research falls into one of three content domains: object processing, processing of biologically and socially relevant information, and language development. Within these domains, there are ongoing debates about the origins and development of human knowledge, making early neuroimaging particularly advantageous. The use of fNIRS has allowed investigators to begin to identify the localization of early object, social, and linguistic knowledge in the immature brain and the ways in which this changes with time and experience. In addition, there is a small but growing body of research that provides insight into the neural mechanisms that support and facilitate learning during the first year of life. At the same time, as with any emerging field, there are limitations to the conclusions that can be drawn on the basis of current findings. We offer suggestions as to how to optimize the use of this technology to answer questions of theoretical and practical importance to developmental scientists.

Cortical activation to object shape and speed of motion during the first year

A great deal is known about the functional organization of cortical networks that mediate visual object processing in the adult. The current research is part of a growing effort to identify the functional maturation of these pathways in the developing brain. The current research used near-infrared spectroscopy to investigate functional activation of the infant cortex during the processing of featural information (shape) and spatiotemporal information (speed of motion) during the first year of life. Our investigation focused on two areas that were implicated in previous studies: anterior temporal cortex and posterior parietal cortex. Neuroimaging data were collected with 207 infants across three age groups: 3-6 months (Experiment 1), 7-8 months (Experiment 2), and 10-12 months (Experiments 3 and 4). The neuroimaging data revealed age-related changes in patterns of activation to shape and speed information, mostly involving posterior parietal areas, some of which were predicted and others that were not. We suggest that these changes reflect age-related differences in the perceptual and/or cognitive processes engaged during the task.

Test-retest reliability of functional near infrared spectroscopy in infants

There has been a rapid rise in the number of publications using functional near infrared spectroscopy (fNIRS) for human developmental research over the past decade. However test-retest reliability of this measure of brain activation in infants remains unknown. To assess this, we utilized data from a longitudinal cohort who participated in an fNIRS study on social perception at two age points. Thirteen infants had valid data from two sessions held 8.5 months apart (4 to 8 months and 12 to 16 months). Inter- and intrasession fNIRS test-retest reliability was assessed at the individual and group levels using the oxyhemoglobin ([Formula: see text]) signal. Infant compliance with the study was similar in both sessions (assessed by the proportion of time infants looked to the stimuli), and there was minimal discrepancy in sensor placement over the targeted area between sessions. At the group level, good spatial overlap of significant responses and signal reliability was seen (spatial overlap was 0.941 and average signal change within an region of interest was [Formula: see text]). At participant level, spatial overlap was acceptable ([Formula: see text] on average across infants) although signal reliability varied between participants. This first study of test-retest reliability of fNIRS in infants shows encouraging results, particularly for group-based analysis.

Dissociating Cortical Activity during Processing of Native and Non-Native Audiovisual Speech from Early to Late Infancy

Initially, infants are capable of discriminating phonetic contrasts across the world's languages. Starting between seven and ten months of age, they gradually lose this ability through a process of perceptual narrowing. Although traditionally investigated with isolated speech sounds, such narrowing occurs in a variety of perceptual domains (e.g., faces, visual speech). Thus far, tracking the developmental trajectory of this tuning process has been focused primarily on auditory speech alone, and generally using isolated sounds. But infants learn from speech produced by people talking to them, meaning they learn from a complex audiovisual signal. Here, we use near-infrared spectroscopy to measure blood concentration changes in the bilateral temporal cortices of infants in three different age groups: 3-to-6 months, 7-to-10 months, and 11-to-14-months. Critically, all three groups of infants were tested with continuous audiovisual speech in both their native and another, unfamiliar language. We found that at each age range, infants showed different patterns of cortical activity in response to the native and non-native stimuli. Infants in the youngest group showed bilateral cortical activity that was greater overall in response to non-native relative to native speech; the oldest group showed left lateralized activity in response to native relative to non-native speech. These results highlight perceptual tuning as a dynamic process that happens across modalities and at different levels of stimulus complexity.

Extraction of heart rate from functional near-infrared spectroscopy in infants

Changes in heart rate are a useful physiological measure in infant studies. We present an algorithm for calculating the heart rate (HR) from oxyhemoglobin pulsation in functional near-infrared spectroscopy (fNIRS) signals. The algorithm is applied to data collected from 10 infants, and the HR derived from the fNIRS signals is compared against the HR as calculated by electrocardiography. We show high agreement between the two HR signals for all infants (r > 0.90), and also compare stimulus-related HR responses as measured by the two methods and find good agreement despite high levels of movement in the infants. This algorithm can be used to measure changes in HR in infants participating in fNIRS studies without the need for additional HR sensors.

Functional near infrared spectroscopy (fNIRS) to assess cognitive function in infants in rural Africa

Cortical mapping of cognitive function during infancy is poorly understood in low-income countries due to the lack of transportable neuroimaging methods. We have successfully piloted functional near infrared spectroscopy (fNIRS) as a neuroimaging tool in rural Gambia. Four-to-eight month old infants watched videos of Gambian adults perform social movements, while haemodynamic responses were recorded using fNIRS. We found distinct regions of the posterior superior temporal and inferior frontal cortex that evidenced either visual-social activation or vocally selective activation (vocal > non-vocal). The patterns of selective cortical activation in Gambian infants replicated those observed within similar aged infants in the UK. These are the first reported data on the measurement of localized functional brain activity in young infants in Africa and demonstrate the potential that fNIRS offers for field-based neuroimaging research of cognitive function in resource-poor rural communities.

fNIRS evidence of prefrontal regulation of frustration in early childhood

The experience of frustration is common in early childhood, yet some children seem to possess a lower tolerance for frustration than others. Characterizing the biological mechanisms underlying a wide range of frustration tolerance observed in early childhood may inform maladaptive behavior and psychopathology that is associated with this construct. The goal of this study was to measure prefrontal correlates of frustration in 3-5-year-old children, who are not readily adaptable for typical neuroimaging approaches, using functional near infrared spectroscopy (fNIRS). fNIRS of frontal regions were measured as frustration was induced in children through a computer game where a desired and expected prize was "stolen" by an animated dog. A fNIRS general linear model (GLM) was used to quantify the correlation of brain regions with the task and identify areas that were statistically different between the winning and frustrating test conditions. A second-level voxel-based ANOVA analysis was then used to correlate the amplitude of each individual's brain activation with measure of parent-reported frustration. Experimental results indicated increased activity in the middle prefrontal cortex during winning of a desired prize, while lateral prefrontal cortex activity increased during frustration. Further, activity increase in lateral prefrontal cortex during frustration correlated positively with parent-reported frustration tolerance. These findings point to the role of the lateral prefrontal cortex as a potential region supporting the regulation of emotion during frustration.

The effect of color priming on infant brain and behavior

Behavioral studies have identified select experiences that can prime infants to attend to color information as the basis for individuating objects prior to the time they do so spontaneously. For example, viewing pretest events in which the color of an object predicts the function in which it will engage leads 9-month-olds (who typically do not attend to color differences) to demonstrate increased sensitivity to color information in a subsequent individuation task (Wilcox and Chapa, 2004). In contrast, viewing pretest events in which the color of an object predicts distinct object motions, but the motions are not functionally relevant, does not produce color priming. The purpose of the present research was to identify the cortical underpinnings of these behavioral effects. Infants aged 8 and 9 months viewed function or motion pretest events and then their capacity to individuate-by-color was assessed in an object individuation task. Behavioral and neuroimaging data were collected. Two main findings emerged. First, as predicted, the infants who viewed the function but not the motion pretest events showed prolonged looking to the test event, a behavioral indicator of object individuation. In addition, they evidenced increased activation in anterior temporal cortex, thought to be a cortical signature of object individuation. A second and unexpected finding was that viewing either type of pretest events led to increased activation in the posterior temporal cortex, as compared to infants who did not see pretest events, revealing that prior exposure to the motion pretest events does influence infants' processing of the test event, even though it is not evident in the behavioral results. The cognitive processes involved, and the cortical structures that mediate these processes, are discussed.

Small-world network properties in prefrontal cortex correlate with predictors of psychopathology risk in young children: a NIRS study

Near infrared spectroscopy (NIRS) is an emerging imaging technique that is relatively inexpensive, portable, and particularly well suited for collecting data in ecological settings. Therefore, it holds promise as a potential neurodiagnostic for young children. We set out to explore whether NIRS could be utilized in assessing the risk of developmental psychopathology in young children. A growing body of work indicates that temperament at young age is associated with vulnerability to psychopathology later on in life. In particular, it has been shown that low effortful control (EC), which includes the focusing and shifting of attention, inhibitory control, perceptual sensitivity, and a low threshold for pleasure, is linked to conditions such as anxiety, depression and attention deficit hyperactivity disorder (ADHD). Physiologically, EC has been linked to a control network spanning among other sites the prefrontal cortex. Several psychopathologies, such as depression and ADHD, have been shown to result in compromised small-world network properties. Therefore we set out to explore the relationship between EC and the small-world properties of PFC using NIRS. NIRS data were collected from 44 toddlers, ages 3-5, while watching naturalistic stimuli (movie clips). Derived complex network measures were then correlated to EC as derived from the Children's Behavior Questionnaire (CBQ). We found that reduced levels of EC were associated with compromised small-world properties of the prefrontal network. Our results suggest that the longitudinal NIRS studies of complex network properties in young children hold promise in furthering our understanding of developmental psychopathology.

Can Infants Tell the Difference between Gold and Yellow?

There is a large literature focused on the color perception of matte surface. However, recent research showed that the component of surface specular reflection, such as glossiness, also affects categorical color perception. For instance, the color term "gold" was used to name high specular stimuli within a specific range of chromaticity, which overlaps with those of yellow and orange for low specular stimuli. In the present study, we investigated whether the component of surface specular reflectance affects the color perception of 5- to 8-month-old infants by using the preferential looking technique. In the first experiment, we conducted a simple test to determine whether infants perceive yellow and gold as the same color by comparing their preference for these colors over green. If the infants perceive yellow and gold as the same color, they would show similar preference scores over green. On the other hand, if infants show different preference scores over green, it indicates that infants do not perceive yellow and gold as the same color. Only the 7-8 month-old infants showed different preference scores for gold and yellow over green. This result indicates that the 7-8 month-old infants perceive gold and yellow as different colors. In Experiment 2, we eliminated the component of specular reflectance on the gold surface and presented it against green to infants. A similar preference score of yellow over green was obtained. This result suggests that the difference between the preference scores for gold and yellow over green in Experiment 1 was based on representations of glossiness.