The functional organization of the left STS: a large scale meta-analysis of PET and fMRI studies of healthy adults

Mapping the mentalizing brain: An ALE meta-analysis to differentiate the representation of social scenes and ages on theory of mind

Theory of mind (ToM) involves understanding others' mental states and relies on brain regions like the temporoparietal junction (TPJ) and medial prefrontal cortex (mPFC). This meta-analytic review categorizes ToM studies into six sub-components across three pairs: (1) Theory of collective mind (ToCM) and individualized theory of mind (iToM), (2) Social intention ToM and private intention ToM, and (3) ToM in adults and ToM in children. We conducted coordinate-based activation likelihood estimation (ALE) analyses and meta-analytic connectivity modeling (MACM) for each sub-component. We found that the ToM components utilized in social or group situations were associated with both the dorsomedial PFC (dmPFC) and right superior temporal sulcus (STS), whereas the ToM components focused on personal concentration were associated with both the lateral PFC and the left STS. The coactivation patterns for the group and age sub-component pairs showed significant spatial overlap with the language networks. These findings indicate that ToM is a multidimensional construct that is related to distinct functional networks for processing each of the ToM sub-components.

Neural representations of phonological information in bilingual language production

Previous research has explored the neural mechanisms of bilinguals' language production, but most studies focused on neural mechanisms of cognitive control during language production. Therefore, it is unclear which brain regions represent lexical information (especially phonological information) during production and how they are affected by language context. To address those questions, we used representational similarity analysis to explore neural representations of phonological information in native (L1) and second languages (L2) in the single- and mixed-language contexts, respectively. Results showed that Chinese-English bilinguals behaviorally performed worse and exhibited more activations in brain regions associated with language processing and cognitive control in the mixed-language context relative to the single-language context. Further representational similarity analysis revealed that phonological representations of L1 were detected in the left pars opercularis, middle frontal gyrus, and anterior supramarginal gyrus, while phonological representations of L2 were detected in the bilateral occipitotemporal cortex regardless of the target language. More interestingly, robust phonological representations of L1 were observed in brain areas related to phonological processing during L2 production regardless of language context. These results provide direct neuroimaging evidence for the nonselective processing hypothesis and highlight the superiority of phonological representations in the dominant language during bilingual language production.

A quantitative comparison of atlas parcellations on the human superior temporal sulcus

The superior temporal sulcus (STS) has a functional topography that has been difficult to characterize through traditional approaches. Automated atlas parcellations may be one solution while also being beneficial for both dimensional reduction and standardizing regions of interest, but they yield very different boundary definitions along the STS. Here we evaluate how well machine learning classifiers can correctly identify six social cognitive tasks from STS activation patterns dimensionally reduced using four popular atlases (Glasser et al., 2016; Gordon et al., 2016; Power et al., 2011 as projected onto the surface by Arslan et al., 2018; Schaefer et al., 2018). Functional data was summarized within each STS parcel in one of four ways, then subjected to leave-one-subject-out cross-validation SVM classification. We found that the classifiers could readily label conditions when data was parcellated using any of the four atlases, evidence that dimensional reduction to parcels did not compromise functional fingerprints. Mean activation for the social conditions was the most effective metric for classification in the right STS, whereas all the metrics classified equally well in the left STS. Interestingly, even atlases constructed from random parcellation schemes (null atlases) classified the conditions with high accuracy. We therefore conclude that the complex activation maps on the STS are readily differentiated at a coarse granular level, despite a strict topography having not yet been identified. Further work is required to identify what features have greatest potential to improve the utility of atlases in replacing functional localizers.

The Role of Occipitotemporal Network for Speed-Reading: An fMRI Study

The activity of occipitotemporal regions involved in linguistic reading processes, such as the ventral occipitotemporal cortex (vOT), is believed to exhibit strong interactions during higher-order language processing, specifically in the connectivity between the occipital gyrus and the temporal gyrus. In this study, we utilized functional magnetic resonance imaging (fMRI) with psychophysiological interaction (PPI) and dynamic causal modeling (DCM) to investigate the functional and effective connectivity in the occipitotemporal network during speed reading. We conducted the experiment with native Japanese speakers who underwent and without speed-reading training and subsequently performed established reading tasks at different speeds (slow, medium, and fast) while undergoing 3-Tesla Siemens fMRI. Our activation analyses revealed significant changes in occipital and temporal regions as reading speed increased, indicating functional connectivity within the occipitotemporal network. DCM results further demonstrated more intricate effective connections and high involvement within the occipitotemporal pathway: (1) reading signals originated from the inferior occipital gyrus (iO), distributed to the vOT and the posterior superior temporal sulcus (pSTS), and then gathered in the anterior superior temporal sulcus (aSTS); (2) reading speed loads had modulation effects on the pathways from the aSTS to vOT and from the iO to vOT. These findings highlight the complex connectivity and dynamic interactions within the occipitotemporal network during speed-reading processes.

Intracranial electrophysiology of spectrally degraded speech in the human cortex

Introduction

Cochlear implants (CIs) are the treatment of choice for severe to profound hearing loss. Variability in CI outcomes remains despite advances in technology and is attributed in part to differences in cortical processing. Studying these differences in CI users is technically challenging. Spectrally degraded stimuli presented to normal-hearing individuals approximate input to the central auditory system in CI users. This study used intracranial electroencephalography (iEEG) to investigate cortical processing of spectrally degraded speech.

Methods

Participants were adult neurosurgical epilepsy patients. Stimuli were utterances /aba/ and /ada/, spectrally degraded using a noise vocoder (1-4 bands) or presented without vocoding. The stimuli were presented in a two-alternative forced choice task. Cortical activity was recorded using depth and subdural iEEG electrodes. Electrode coverage included auditory core in posteromedial Heschl's gyrus (HGPM), superior temporal gyrus (STG), ventral and dorsal auditory-related areas, and prefrontal and sensorimotor cortex. Analysis focused on high gamma (70-150 Hz) power augmentation and alpha (8-14 Hz) suppression.

Results

Chance task performance occurred with 1-2 spectral bands and was near-ceiling for clear stimuli. Performance was variable with 3-4 bands, permitting identification of good and poor performers. There was no relationship between task performance and participants demographic, audiometric, neuropsychological, or clinical profiles. Several response patterns were identified based on magnitude and differences between stimulus conditions. HGPM responded strongly to all stimuli. A preference for clear speech emerged within non-core auditory cortex. Good performers typically had strong responses to all stimuli along the dorsal stream, including posterior STG, supramarginal, and precentral gyrus; a minority of sites in STG and supramarginal gyrus had a preference for vocoded stimuli. In poor performers, responses were typically restricted to clear speech. Alpha suppression was more pronounced in good performers. In contrast, poor performers exhibited a greater involvement of posterior middle temporal gyrus when listening to clear speech.

Discussion

Responses to noise-vocoded speech provide insights into potential factors underlying CI outcome variability. The results emphasize differences in the balance of neural processing along the dorsal and ventral stream between good and poor performers, identify specific cortical regions that may have diagnostic and prognostic utility, and suggest potential targets for neuromodulation-based CI rehabilitation strategies.

Intensity of repetitive negative thinking in depression is associated with greater functional connectivity between semantic processing and emotion regulation areas

BACKGROUND

Repetitive negative thinking (RNT), a cognitive process that encompasses past (rumination) and future (worry) directed thoughts focusing on negative experiences and the self, is a transdiagnostic construct that is especially relevant for major depressive disorder (MDD). Severe RNT often occurs in individuals with severe levels of MDD, which makes it challenging to disambiguate the neural circuitry underlying RNT from depression severity.

METHODS

We used a propensity score, i.e., a conditional probability of having high RNT given observed covariates to match high and low RNT individuals who are similar in the severity of depression, anxiety, and demographic characteristics. Of 148 MDD individuals, we matched high and low RNT groups (n = 50/group) and used a data-driven whole-brain voxel-to-voxel connectivity pattern analysis to investigate the resting-state functional connectivity differences between the groups.

RESULTS

There was an association between RNT and connectivity in the bilateral superior temporal sulcus (STS), an important region for speech processing including inner speech. High relative to low RNT individuals showed greater connectivity between right STS and bilateral anterior insular cortex (AI), and between bilateral STS and left dorsolateral prefrontal cortex (DLPFC). Greater connectivity in those regions was specifically related to RNT but not to depression severity.

CONCLUSIONS

RNT intensity is directly related to connectivity between STS and AI/DLPFC. This might be a mechanism underlying the role of RNT in perceptive, cognitive, speech, and emotional processing. Future investigations will need to determine whether modifying these connectivities could be a treatment target to reduce RNT.

Association of childhood trauma with cognitive impairment and structural brain alterations in remitted patients with bipolar disorder

BACKGROUND

Cognitive impairment affects many patients with bipolar disorder (BD). No pro-cognitive treatment with robust efficacy exists partly due to limited insight into underlying neurobiological abnormalities.

METHODS

This magnetic resonance imaging (MRI) study investigates structural neuronal correlates of cognitive impairment in BD by comparing brain measures in a large sample of cognitively impaired versus cognitively intact patients with BD or cognitively impaired patients with major depressive disorder (MDD) and healthy controls (HC). Participants underwent neuropsychological assessments and MRI scans. The cognitively impaired and - intact BD and MDD patient groups were compared with each other and HC regarding prefrontal cortex measures, hippocampus shape/volume, and total cerebral white (WM) and grey matter (GM).

RESULTS

Cognitively impaired BD patients showed lower total cerebral WM volume than HC, which scaled with poorer global cognitive performance and more childhood trauma. Cognitively impaired BD patients also showed lower adjusted GM volume and thickness in the frontopolar cortex than HC but greater adjusted GM volume in the temporal cortex than cognitively normal BD patients. Cognitively impaired BD patients showed decreased cingulate volume than cognitively impaired MDD patients. Hippocampal measures were similar across all groups.

LIMITATIONS

The cross-sectional study design prevented insights into causal relationships.

CONCLUSIONS

Lower total cerebral WM and regional frontopolar and temporal GM abnormalities may constitute structural neuronal correlates of cognitive impairment in BD, of which the WM deficits scale with the degree of childhood trauma. The results deepen the understanding of cognitive impairment in BD and provide a neuronal target for pro-cognitive treatment development.

Fetal temporal sulcus depth asymmetry has prognostic value for language development

In most humans, the superior temporal sulcus (STS) shows a rightward depth asymmetry. This asymmetry can not only be observed in adults, but is already recognizable in the fetal brain. As the STS lies adjacent to brain areas important for language, STS depth asymmetry may represent an anatomical marker for language abilities. This study investigated the prognostic value of STS depth asymmetry in healthy fetuses for later language abilities, language localization, and language-related white matter tracts. Less right lateralization of the fetal STS depth was significantly associated with better verbal abilities, with fetal STS depth asymmetry explaining more than 40% of variance in verbal skills 6-13 years later. Furthermore, less right fetal STS depth asymmetry correlated with increased left language localization during childhood. We hypothesize that earlier and/or more localized fetal development of the left temporal cortex is accompanied by an earlier development of the left STS and is favorable for early language learning. If the findings of this pilot study hold true in larger samples of healthy children and in different clinical populations, fetal STS asymmetry has the potential to become a diagnostic biomarker of the maturity and integrity of neural correlates of language.

Neural decoding of emotional prosody in voice-sensitive auditory cortex predicts social communication abilities in children

During social interactions, speakers signal information about their emotional state through their voice, which is known as emotional prosody. Little is known regarding the precise brain systems underlying emotional prosody decoding in children and whether accurate neural decoding of these vocal cues is linked to social skills. Here, we address critical gaps in the developmental literature by investigating neural representations of prosody and their links to behavior in children. Multivariate pattern analysis revealed that representations in the bilateral middle and posterior superior temporal sulcus (STS) divisions of voice-sensitive auditory cortex decode emotional prosody information in children. Crucially, emotional prosody decoding in middle STS was correlated with standardized measures of social communication abilities; more accurate decoding of prosody stimuli in the STS was predictive of greater social communication abilities in children. Moreover, social communication abilities were specifically related to decoding sadness, highlighting the importance of tuning in to negative emotional vocal cues for strengthening social responsiveness and functioning. Findings bridge an important theoretical gap by showing that the ability of the voice-sensitive cortex to detect emotional cues in speech is predictive of a child's social skills, including the ability to relate and interact with others.

Genome-wide analyses of individual differences in quantitatively assessed reading- and language-related skills in up to 34,000 people

The use of spoken and written language is a fundamental human capacity. Individual differences in reading- and language-related skills are influenced by genetic variation, with twin-based heritability estimates of 30 to 80% depending on the trait. The genetic architecture is complex, heterogeneous, and multifactorial, but investigations of contributions of single-nucleotide polymorphisms (SNPs) were thus far underpowered. We present a multicohort genome-wide association study (GWAS) of five traits assessed individually using psychometric measures (word reading, nonword reading, spelling, phoneme awareness, and nonword repetition) in samples of 13,633 to 33,959 participants aged 5 to 26 y. We identified genome-wide significant association with word reading (rs11208009, P = 1.098 × 10-8) at a locus that has not been associated with intelligence or educational attainment. All five reading-/language-related traits showed robust SNP heritability, accounting for 13 to 26% of trait variability. Genomic structural equation modeling revealed a shared genetic factor explaining most of the variation in word/nonword reading, spelling, and phoneme awareness, which only partially overlapped with genetic variation contributing to nonword repetition, intelligence, and educational attainment. A multivariate GWAS of word/nonword reading, spelling, and phoneme awareness maximized power for follow-up investigation. Genetic correlation analysis with neuroimaging traits identified an association with the surface area of the banks of the left superior temporal sulcus, a brain region linked to the processing of spoken and written language. Heritability was enriched for genomic elements regulating gene expression in the fetal brain and in chromosomal regions that are depleted of Neanderthal variants. Together, these results provide avenues for deciphering the biological underpinnings of uniquely human traits.

Functional Plasticity Coupled With Structural Predispositions in Auditory Cortex Shape Successful Music Category Learning

Categorizing sounds into meaningful groups helps listeners more efficiently process the auditory scene and is a foundational skill for speech perception and language development. Yet, how auditory categories develop in the brain through learning, particularly for non-speech sounds (e.g., music), is not well understood. Here, we asked musically naïve listeners to complete a brief (∼20 min) training session where they learned to identify sounds from a musical interval continuum (minor-major 3rds). We used multichannel EEG to track behaviorally relevant neuroplastic changes in the auditory event-related potentials (ERPs) pre- to post-training. To rule out mere exposure-induced changes, neural effects were evaluated against a control group of 14 non-musicians who did not undergo training. We also compared individual categorization performance with structural volumetrics of bilateral Heschl's gyrus (HG) from MRI to evaluate neuroanatomical substrates of learning. Behavioral performance revealed steeper (i.e., more categorical) identification functions in the posttest that correlated with better training accuracy. At the neural level, improvement in learners' behavioral identification was characterized by smaller P2 amplitudes at posttest, particularly over right hemisphere. Critically, learning-related changes in the ERPs were not observed in control listeners, ruling out mere exposure effects. Learners also showed smaller and thinner HG bilaterally, indicating superior categorization was associated with structural differences in primary auditory brain regions. Collectively, our data suggest successful auditory categorical learning of music sounds is characterized by short-term functional changes (i.e., greater post-training efficiency) in sensory coding processes superimposed on preexisting structural differences in bilateral auditory cortex.

Learning From Mistakes: Cognitive and Metabolic Correlates of Errors on Picture Naming in the Alzheimer’s Disease Spectrum

Background: Analysis of subtypes of picture naming errors produced by patients with Alzheimer’s disease (AD) have seldom been investigated yet may clarify the cognitive and neural underpinnings of naming in the AD spectrum. Objective: To elucidate the neurocognitive bases of picture naming in AD through a qualitative analysis of errors. Methods: Over 1000 naming errors produced by 70 patients with amnestic, visuospatial, linguistic, or frontal AD were correlated with general cognitive tests and with distribution of hypometabolism on FDG-PET. Results: Principal component analysis identified 1) a Visual processing factor clustering visuospatial tests and unrecognized stimuli, pure visual errors and visual-semantic errors, associated with right parieto-occipital hypometabolism; 2) a Concept-Lemma factor grouping language tests and anomias, circumlocutions, superordinates, and coordinates, correlated with left basal temporal hypometabolism; 3) a Lemma-Phonology factor including the digit span and phonological errors, linked with left temporo-parietal hypometabolism. Regression of brain metabolism on individual errors showed that errors due to impairment of basic and higher-order processing of object visual attributes or of their interaction with semantics, were related with bilateral occipital and left occipito-temporal dysfunction. Omissions and superordinates were linked to degradation of broad and basic concepts in the left basal temporal cortex. Semantic-lexical errors derived from faulty semantically- and phonologically-driven lexical retrieval in the left superior and middle temporal gyri. Generation of nonwords was underpinned by of phonological impairment within the left inferior parietal cortex. Conclusion: Analysis of individual naming errors allowed to outline a comprehensive anatomo-functional model of picture naming in classical and atypical AD.

Multisensory mental imagery of fatigue: Evidence from an fMRI study

Functional imaging experimental designs measuring fatigue, defined as a subjective lack of physical and/or mental energy characterizing a wide range of neurologic conditions, are still under development. Nineteen right‐handed healthy subjects (9 M and 10 F, mean age 43.15 ± 8.34 years) were evaluated by means of functional magnetic resonance imaging (fMRI), asking them to perform explicit, first‐person, mental imagery of fatigue‐related multisensory sensations. Short sentences designed to assess the principal manifestations of fatigue from the Multidimensional Fatigue Symptom Inventory were presented. Participants were asked to imagine the corresponding sensations (Sensory Imagery, SI). As a control, they had to imagine the visual scenes (Visual Imagery, VI) described in short phrases. The SI task (vs. VI task) differentially activated three areas: (i) the precuneus, which is involved in first‐person perspective taking; (ii) the left superior temporal sulcus, which is a multisensory integration area; and (iii) the left inferior frontal gyrus, known to be involved in mental imagery network. The SI fMRI task can be used to measure processing involved in mental imagery of fatigue‐related multisensory sensations.

Dissociating the functions of three left posterior superior temporal regions that contribute to speech perception and production

Prior studies have shown that the left posterior superior temporal sulcus (pSTS) and left temporo-parietal junction (TPJ) both contribute to phonological short-term memory, speech perception and speech production. Here, by conducting a within-subjects multi-factorial fMRI study, we dissociate the response profiles of these regions and a third region – the anterior ascending terminal branch of the left superior temporal sulcus (atSTS), which lies dorsal to pSTS and ventral to TPJ. First, we show that each region was more activated by (i) 1-back matching on visually presented verbal stimuli (words or pseudowords) compared to 1-back matching on visually presented non-verbal stimuli (pictures of objects or non-objects), and (ii) overt speech production than 1-back matching, across 8 types of stimuli (visually presented words, pseudowords, objects and non-objects and aurally presented words, pseudowords, object sounds and meaningless hums). The response properties of the three regions dissociated within the auditory modality. In left TPJ, activation was higher for auditory stimuli that were non-verbal (sounds of objects or meaningless hums) compared to verbal (words and pseudowords), irrespective of task (speech production or 1-back matching). In left pSTS, activation was higher for non-semantic stimuli (pseudowords and hums) than semantic stimuli (words and object sounds) on the dorsal pSTS surface (dpSTS), irrespective of task. In left atSTS, activation was not sensitive to either semantic or verbal content. The contrasting response properties of left TPJ, dpSTS and atSTS was cross-validated in an independent sample of 59 participants, using region-by-condition interactions. We also show that each region participates in non-overlapping networks of frontal, parietal and cerebellar regions. Our results challenge previous claims about functional specialisation in the left posterior superior temporal lobe and motivate future studies to determine the timing and directionality of information flow in the brain networks involved in speech perception and production.

Electrophysiology of the Human Superior Temporal Sulcus during Speech Processing

The superior temporal sulcus (STS) is a crucial hub for speech perception and can be studied with high spatiotemporal resolution using electrodes targeting mesial temporal structures in epilepsy patients. Goals of the current study were to clarify functional distinctions between the upper (STSU) and the lower (STSL) bank, hemispheric asymmetries, and activity during self-initiated speech. Electrophysiologic properties were characterized using semantic categorization and dialog-based tasks. Gamma-band activity and alpha-band suppression were used as complementary measures of STS activation. Gamma responses to auditory stimuli were weaker in STSL compared with STSU and had longer onset latencies. Activity in anterior STS was larger during speaking than listening; the opposite pattern was observed more posteriorly. Opposite hemispheric asymmetries were found for alpha suppression in STSU and STSL. Alpha suppression in the STS emerged earlier than in core auditory cortex, suggesting feedback signaling within the auditory cortical hierarchy. STSL was the only region where gamma responses to words presented in the semantic categorization tasks were larger in subjects with superior task performance. More pronounced alpha suppression was associated with better task performance in Heschl's gyrus, superior temporal gyrus, and STS. Functional differences between STSU and STSL warrant their separate assessment in future studies.

Modulation of Brain Activity by Selective Attention to Audiovisual Dialogues

In real-life noisy situations, we can selectively attend to conversations in the presence of irrelevant voices, but neurocognitive mechanisms in such natural listening situations remain largely unexplored. Previous research has shown distributed activity in the mid superior temporal gyrus (STG) and sulcus (STS) while listening to speech and human voices, in the posterior STS and fusiform gyrus when combining auditory, visual and linguistic information, as well as in left-hemisphere temporal and frontal cortical areas during comprehension. In the present functional magnetic resonance imaging (fMRI) study, we investigated how selective attention modulates neural responses to naturalistic audiovisual dialogues. Our healthy adult participants (N = 15) selectively attended to video-taped dialogues between a man and woman in the presence of irrelevant continuous speech in the background. We modulated the auditory quality of dialogues with noise vocoding and their visual quality by masking speech-related facial movements. Both increased auditory quality and increased visual quality were associated with bilateral activity enhancements in the STG/STS. In addition, decreased audiovisual stimulus quality elicited enhanced fronto-parietal activity, presumably reflecting increased attentional demands. Finally, attention to the dialogues, in relation to a control task where a fixation cross was attended and the dialogue ignored, yielded enhanced activity in the left planum polare, angular gyrus, the right temporal pole, as well as in the orbitofrontal/ventromedial prefrontal cortex and posterior cingulate gyrus. Our findings suggest that naturalistic conversations effectively engage participants and reveal brain networks related to social perception in addition to speech and semantic processing networks.

Olfactory and Neuropsychological Functioning in Olfactory Reference Syndrome

BACKGROUND

Olfactory reference syndrome (ORS) is an underrecognized, understudied, and often severe psychiatric disorder characterized by a prominent and distressing or impairing preoccupation with a false belief of emitting an offensive body odor. As this condition has only recently been recognized in the International Classification of Diseases (the 11th Edition), no empirical evidence exists about the underlying features and etiology of the disorder.

OBJECTIVE

To examine the neuropsychological and olfactory functioning of individuals with ORS and address whether there is central nervous system or sensory dysfunction associated with the condition.

METHODS

In this preliminary investigation, 9 consecutive participants with ORS completed a structured clinical interview and neuropsychological and olfaction evaluations.

RESULTS

A proportion of individuals with ORS displayed deficits in aspects of cognitive functioning (i.e., processing speed, executive functioning, recognition memory bias for ORS-related words), olfaction functioning (i.e., odor detection and discrimination), and emotional processing.

CONCLUSIONS

Based on these preliminary findings of cognitive, olfaction, and emotional processing deficits in individuals with ORS, further neuropsychological and olfaction studies are needed that better characterize this understudied patient group and address this study's limitations.

Degradation of Praxis Brain Networks and Impaired Comprehension of Manipulable Nouns in Stroke

Distributed brain systems contribute to representation of semantic knowledge. Whether sensory and motor systems of the brain are causally involved in representing conceptual knowledge is an especially controversial question. Here, we tested 57 chronic left-hemisphere stroke patients using a semantic similarity judgment task consisting of manipulable and nonmanipulable nouns. Three complementary methods were used to assess the neuroanatomical correlates of semantic processing: voxel-based lesion-symptom mapping, resting-state functional connectivity, and gray matter fractional anisotropy. The three measures provided converging evidence that injury to the brain networks required for action observation, execution, planning, and visuomotor coordination are associated with specific deficits in manipulable noun comprehension relative to nonmanipulable items. Damage or disrupted connectivity of areas such as the middle posterior temporal gyrus, anterior inferior parietal lobe, and premotor cortex was related specifically to the impairment of manipulable noun comprehension. These results suggest that praxis brain networks contribute especially to the comprehension of manipulable object nouns.

Sex Effect on Presurgical Language Mapping in Patients With a Brain Tumor

Differences between males and females in brain development and in the organization and hemispheric lateralization of brain functions have been described, including in language. Sex differences in language organization may have important implications for language mapping performed to assess, and minimize neurosurgical risk to, language function. This study examined the effect of sex on the activation and functional connectivity of the brain, measured with presurgical functional magnetic resonance imaging (fMRI) language mapping in patients with a brain tumor. We carried out a retrospective analysis of data from neurosurgical patients treated at our institution who met the criteria of pathological diagnosis (malignant brain tumor), tumor location (left hemisphere), and fMRI paradigms [sentence completion (SC); antonym generation (AG); and resting-state fMRI (rs-fMRI)]. Forty-seven patients (22 females, mean age = 56.0 years) were included in the study. Across the SC and AG tasks, females relative to males showed greater activation in limited areas, including the left inferior frontal gyrus classically associated with language. In contrast, males relative to females showed greater activation in extended areas beyond the classic language network, including the supplementary motor area (SMA) and precentral gyrus. The rs-fMRI functional connectivity of the left SMA in the females was stronger with inferior temporal pole (TP) areas, and in the males with several midline areas. The findings are overall consistent with theories of greater reliance on specialized language areas in females relative to males, and generalized brain areas in males relative to females, for language function. Importantly, the findings suggest that sex could affect fMRI language mapping. Thus, considering sex as a variable in presurgical language mapping merits further investigation.

Whole-Brain Functional Networks for Phonological and Orthographic Processing in Chinese Good and Poor Readers

The neural basis of dyslexia in different languages remains unresolved, and it is unclear whether the phonological deficit as the core deficit of dyslexia is language-specific or universal. The current functional magnetic resonance imaging (fMRI) study using whole-brain data-driven network analyses investigated the neural mechanisms for phonological and orthographic processing in Chinese children with good and poor reading ability. Sixteen good readers and 16 poor readers were requested to make homophone judgments (phonological processing) and component judgments (visual-orthographic processing) of presented Chinese characters. Poor readers displayed worse performance than the good readers in phonological processing, but not in orthographic processing. Whole-brain activation analyses showed compensatory activations in the poor readers during phonological processing and automatic phonological production activation in the good readers during orthographic processing. Significant group differences in the topological properties of their brain networks were found only in orthographic processing. Analyses of nodal degree centrality and betweenness centrality revealed significant group differences in both phonological and orthographic processing. The present study supports the phonological core deficit hypothesis of reading difficulty in Chinese. It also suggests that Chinese good and poor readers might recruit different strategies and neural mechanisms for orthographic processing.

The functional database of the ARCHI project: Potential and perspectives

More than two decades of functional magnetic resonance imaging (fMRI) of the human brain have succeeded to identify, with a growing level of precision, the neural basis of multiple cognitive skills within various domains (perception, sensorimotor processes, language, emotion and social cognition …). Progress has been made in the comprehension of the functional organization of localized brain areas. However, the long time required for fMRI acquisition limits the number of experimental conditions performed in a single individual. As a consequence, distinct brain localizations have mostly been studied in separate groups of participants, and their functional relationships at the individual level remain poorly understood. To address this issue, we report here preliminary results on a database of fMRI data acquired on 78 individuals who each performed a total of 29 experimental conditions, grouped in 4 cross-domains functional localizers. This protocol has been designed to efficiently isolate, in a single session, the brain activity associated with language, numerical representation, social perception and reasoning, premotor and visuomotor representations. Analyses are reported at the group and at the individual level, to establish the ability of our protocol to selectively capture distinct regions of interest in a very short time. Test-retest reliability was assessed in a subset of participants. The activity evoked by the different contrasts of the protocol is located in distinct brain networks that, individually, largely replicate previous findings and, taken together, cover a large proportion of the cortical surface. We provide detailed analyses of a subset of regions of relevance: the left frontal, left temporal and middle frontal cortices. These preliminary analyses highlight how combining such a large set of functional contrasts may contribute to establish a finer-grained brain atlas of cognitive functions, especially in regions of high functional overlap. Detailed structural images (structural connectivity, micro-structures, axonal diameter) acquired in the same individuals in the context of the ARCHI database provide a promising situation to explore functional/structural interdependence. Additionally, this protocol might also be used as a way to establish individual neurofunctional signatures in large cohorts.

Cortical Tracking of Speech-in-Noise Develops from Childhood to Adulthood

In multitalker backgrounds, the auditory cortex of adult humans tracks the attended speech stream rather than the global auditory scene. Still, it is unknown whether such preferential tracking also occurs in children whose speech-in-noise (SiN) abilities are typically lower compared with adults. We used magnetoencephalography (MEG) to investigate the frequency-specific cortical tracking of different elements of a cocktail party auditory scene in 20 children (age range, 6-9 years; 8 females) and 20 adults (age range, 21-40 years; 10 females). During MEG recordings, subjects attended to four different 5 min stories, mixed with different levels of multitalker background at four signal-to-noise ratios (SNRs; noiseless, +5, 0, and -5 dB). Coherence analysis quantified the coupling between the time courses of the MEG activity and attended speech stream, multitalker background, or global auditory scene, respectively. In adults, statistically significant coherence was observed between MEG signals originating from the auditory system and the attended stream at <1, 1-4, and 4-8 Hz in all SNR conditions. Children displayed similar coupling at <1 and 1-4 Hz, but increasing noise impaired the coupling more strongly than in adults. Also, children displayed drastically lower coherence at 4-8 Hz in all SNR conditions. These results suggest that children's difficulties to understand speech in noisy conditions are related to an immature selective cortical tracking of the attended speech streams. Our results also provide unprecedented evidence for an acquired cortical tracking of speech at syllable rate and argue for a progressive development of SiN abilities in humans.SIGNIFICANCE STATEMENT Behaviorally, children are less proficient than adults at understanding speech-in-noise. Here, neuromagnetic signals were recorded while healthy adults and typically developing 6- to 9-year-old children attended to a speech stream embedded in a multitalker background noise with varying intensity. Results demonstrate that auditory cortices of both children and adults selectively track the attended speaker's voice rather than the global acoustic input at phrasal and word rates. However, increments of noise compromised the tracking significantly more in children than in adults. Unexpectedly, children displayed limited tracking of both the attended voice and the global acoustic input at the 4-8 Hz syllable rhythm. Thus, both speech-in-noise abilities and cortical tracking of speech syllable repetition rate seem to mature later in adolescence.

An interactive model of auditory-motor speech perception

Mounting evidence indicates a role in perceptual decoding of speech for the dorsal auditory stream connecting between temporal auditory and frontal-parietal articulatory areas. The activation time course in auditory, somatosensory and motor regions during speech processing is seldom taken into account in models of speech perception. We critically review the literature with a focus on temporal information, and contrast between three alternative models of auditory-motor speech processing: parallel, hierarchical, and interactive. We argue that electrophysiological and transcranial magnetic stimulation studies support the interactive model. The findings reveal that auditory and somatomotor areas are engaged almost simultaneously, before 100 ms. There is also evidence of early interactions between auditory and motor areas. We propose a new interactive model of auditory-motor speech perception in which auditory and articulatory somatomotor areas are connected from early stages of speech processing. We also discuss how attention and other factors can affect the timing and strength of auditory-motor interactions and propose directions for future research.

Cognitive and Brain Activity Changes After Mnemonic Strategy Training in Amnestic Mild Cognitive Impairment: Evidence From a Randomized Controlled Trial

Background: Mnemonic strategy training (MST) has been shown to improve cognitive performance in amnestic mild cognitive impairment (a-MCI), however, several questions remain unresolved. The goal of the present study was to replicate earlier pilot study findings using a randomized controlled design and to evaluate transfer effects and changes in brain activation. Methods: Thirty patients with a-MCI were randomized into MST or education program. At baseline, participants completed clinical and neuropsychological assessments as well as structural and functional magnetic resonance imaging (fMRI). Interventions were administered individually and comprised four sessions, over 2 weeks. MST taught patients to use a three-step process to learn and recall face-name associations. Post-treatment assessment included fMRI, a separate face-name association task, neuropsychological tests, and measures of metamemory. Behavioral (i.e., non-fMRI) measures were repeated after one and 3-months. Results: Participants in the MST condition showed greater improvement on measures of face-name memory, and increased associative strategy use; effects that were accompanied by increased fMRI activation in the left anterior temporal lobe. While all participants reported greater contentment with their everyday memory following intervention, only the MST group reported significant improvements in their memory abilities. There was no clear indication of far-transfer effects to other neuropsychological tests. Conclusion: Results demonstrate that patients with a-MCI not only show stimulus specific benefits of MST, but that they appear capable of transferring training to at least some other cognitive tasks. MST also facilitated the use of brain regions that are involved in face processing, episodic and semantic memory, and social cognition, which are consonant with the cognitive processes engaged by training.

Electrophysiological Indexes of Incongruent Audiovisual Phonemic Processing: Unraveling the McGurk Effect

In this study the timing of electromagnetic signals recorded during incongruent and congruent audiovisual (AV) stimulation in 14 Italian healthy volunteers was examined. In a previous study (Proverbio et al., 2016) we investigated the McGurk effect in the Italian language and found out which visual and auditory inputs provided the most compelling illusory effects (e.g., bilabial phonemes presented acoustically and paired with non-labials, especially alveolar-nasal and velar-occlusive phonemes). In this study EEG was recorded from 128 scalp sites while participants observed a female and a male actor uttering 288 syllables selected on the basis of the previous investigation (lasting approximately 600 ms) and responded to rare targets (/re/, /ri/, /ro/, /ru/). In half of the cases the AV information was incongruent, except for targets that were always congruent. A pMMN (phonological Mismatch Negativity) to incongruent AV stimuli was identified 500 ms after voice onset time. This automatic response indexed the detection of an incongruity between the labial and phonetic information. SwLORETA (Low-Resolution Electromagnetic Tomography) analysis applied to the difference voltage incongruent-congruent in the same time window revealed that the strongest sources of this activity were the right superior temporal (STG) and superior frontal gyri, which supports their involvement in AV integration.

Predicting Neural Activity Patterns Associated with Sentences Using a Neurobiologically Motivated Model of Semantic Representation

We introduce an approach that predicts neural representations of word meanings contained in sentences then superposes these to predict neural representations of new sentences. A neurobiological semantic model based on sensory, motor, social, emotional, and cognitive attributes was used as a foundation to define semantic content. Previous studies have predominantly predicted neural patterns for isolated words, using models that lack neurobiological interpretation. Fourteen participants read 240 sentences describing everyday situations while undergoing fMRI. To connect sentence-level fMRI activation patterns to the word-level semantic model, we devised methods to decompose the fMRI data into individual words. Activation patterns associated with each attribute in the model were then estimated using multiple-regression. This enabled synthesis of activation patterns for trained and new words, which were subsequently averaged to predict new sentences. Region-of-interest analyses revealed that prediction accuracy was highest using voxels in the left temporal and inferior parietal cortex, although a broad range of regions returned statistically significant results, showing that semantic information is widely distributed across the brain. The results show how a neurobiologically motivated semantic model can decompose sentence-level fMRI data into activation features for component words, which can be recombined to predict activation patterns for new sentences.

Convergence of spoken and written language processing in the superior temporal sulcus

Spoken and written language processing streams converge in the superior temporal sulcus (STS), but the functional and anatomical nature of this convergence is not clear. We used functional MRI to quantify neural responses to spoken and written language, along with unintelligible stimuli in each modality, and employed several strategies to segregate activations on the dorsal and ventral banks of the STS. We found that intelligible and unintelligible inputs in both modalities activated the dorsal bank of the STS. The posterior dorsal bank was able to discriminate between modalities based on distributed patterns of activity, pointing to a role in encoding of phonological and orthographic word forms. The anterior dorsal bank was agnostic to input modality, suggesting that this region represents abstract lexical nodes. In the ventral bank of the STS, responses to unintelligible inputs in both modalities were attenuated, while intelligible inputs continued to drive activation, indicative of higher level semantic and syntactic processing. Our results suggest that the processing of spoken and written language converges on the posterior dorsal bank of the STS, which is the first of a heterogeneous set of language regions within the STS, with distinct functions spanning a broad range of linguistic processes.

Obligatory and facultative brain regions for voice-identity recognition

Recognizing the identity of others by their voice is an important skill for social interactions. To date, it remains controversial which parts of the brain are critical structures for this skill. Based on neuroimaging findings, standard models of person-identity recognition suggest that the right temporal lobe is the hub for voice-identity recognition. Neuropsychological case studies, however, reported selective deficits of voice-identity recognition in patients predominantly with right inferior parietal lobe lesions. Here, our aim was to work towards resolving the discrepancy between neuroimaging studies and neuropsychological case studies to find out which brain structures are critical for voice-identity recognition in humans. We performed a voxel-based lesion-behaviour mapping study in a cohort of patients (n = 58) with unilateral focal brain lesions. The study included a comprehensive behavioural test battery on voice-identity recognition of newly learned (voice-name, voice-face association learning) and familiar voices (famous voice recognition) as well as visual (face-identity recognition) and acoustic control tests (vocal-pitch and vocal-timbre discrimination). The study also comprised clinically established tests (neuropsychological assessment, audiometry) and high-resolution structural brain images. The three key findings were: (i) a strong association between voice-identity recognition performance and right posterior/mid temporal and right inferior parietal lobe lesions; (ii) a selective association between right posterior/mid temporal lobe lesions and voice-identity recognition performance when face-identity recognition performance was factored out; and (iii) an association of right inferior parietal lobe lesions with tasks requiring the association between voices and faces but not voices and names. The results imply that the right posterior/mid temporal lobe is an obligatory structure for voice-identity recognition, while the inferior parietal lobe is only a facultative component of voice-identity recognition in situations where additional face-identity processing is required.

Language related differences of the sustained response evoked by natural speech sounds

In tonal languages, such as Mandarin Chinese, the pitch contour of vowels discriminates lexical meaning, which is not the case in non-tonal languages such as German. Recent data provide evidence that pitch processing is influenced by language experience. However, there are still many open questions concerning the representation of such phonological and language-related differences at the level of the auditory cortex (AC). Using magnetoencephalography (MEG), we recorded transient and sustained auditory evoked fields (AEF) in native Chinese and German speakers to investigate language related phonological and semantic aspects in the processing of acoustic stimuli. AEF were elicited by spoken meaningful and meaningless syllables, by vowels, and by a French horn tone. Speech sounds were recorded from a native speaker and showed frequency-modulations according to the pitch-contours of Mandarin. The sustained field (SF) evoked by natural speech signals was significantly larger for Chinese than for German listeners. In contrast, the SF elicited by a horn tone was not significantly different between groups. Furthermore, the SF of Chinese subjects was larger when evoked by meaningful syllables compared to meaningless ones, but there was no significant difference regarding whether vowels were part of the Chinese phonological system or not. Moreover, the N100m gave subtle but clear evidence that for Chinese listeners other factors than purely physical properties play a role in processing meaningful signals. These findings show that the N100 and the SF generated in Heschl’s gyrus are influenced by language experience, which suggests that AC activity related to specific pitch contours of vowels is influenced in a top-down fashion by higher, language related areas. Such interactions are in line with anatomical findings and neuroimaging data, as well as with the dual-stream model of language of Hickok and Poeppel that highlights the close and reciprocal interaction between superior temporal gyrus and sulcus.

Specifying the brain anatomy underlying temporo-parietal junction activations for theory of mind: A review using probabilistic atlases from different imaging modalities

In this quantitative review, we specified the anatomical basis of brain activity reported in the Temporo-Parietal Junction (TPJ) in Theory of Mind (ToM) research. Using probabilistic brain atlases, we labeled TPJ peak coordinates reported in the literature. This was carried out for four different atlas modalities: (i) gyral-parcellation, (ii) sulco-gyral parcellation, (iii) cytoarchitectonic parcellation and (iv) connectivity-based parcellation. In addition, our review distinguished between two ToM task types (false belief and social animations) and a nonsocial task (attention reorienting). We estimated the mean probabilities of activation for each atlas label, and found that for all three task types part of TPJ activations fell into the same areas: (i) Angular Gyrus (AG) and Lateral Occpital Cortex (LOC) in terms of a gyral atlas, (ii) AG and Superior Temporal Sulcus (STS) in terms of a sulco-gyral atlas, (iii) areas PGa and PGp in terms of cytoarchitecture and (iv) area TPJp in terms of a connectivity-based parcellation atlas. Beside these commonalities, we also found that individual task types showed preferential activation for particular labels. Main findings for the right hemisphere were preferential activation for false belief tasks in AG/PGa, and in Supramarginal Gyrus (SMG)/PFm for attention reorienting. Social animations showed strongest selective activation in the left hemisphere, specifically in left Middle Temporal Gyrus (MTG). We discuss how our results (i.e., identified atlas structures) can provide a new reference for describing future findings, with the aim to integrate different labels and terminologies used for studying brain activity around the TPJ. Hum Brain Mapp 38:4788-4805, 2017. © 2017 Wiley Periodicals, Inc.

Auditory, Visual and Audiovisual Speech Processing Streams in Superior Temporal Sulcus

The human superior temporal sulcus (STS) is responsive to visual and auditory information, including sounds and facial cues during speech recognition. We investigated the functional organization of STS with respect to modality-specific and multimodal speech representations. Twenty younger adult participants were instructed to perform an oddball detection task and were presented with auditory, visual, and audiovisual speech stimuli, as well as auditory and visual nonspeech control stimuli in a block fMRI design. Consistent with a hypothesized anterior-posterior processing gradient in STS, auditory, visual and audiovisual stimuli produced the largest BOLD effects in anterior, posterior and middle STS (mSTS), respectively, based on whole-brain, linear mixed effects and principal component analyses. Notably, the mSTS exhibited preferential responses to multisensory stimulation, as well as speech compared to nonspeech. Within the mid-posterior and mSTS regions, response preferences changed gradually from visual, to multisensory, to auditory moving posterior to anterior. Post hoc analysis of visual regions in the posterior STS revealed that a single subregion bordering the mSTS was insensitive to differences in low-level motion kinematics yet distinguished between visual speech and nonspeech based on multi-voxel activation patterns. These results suggest that auditory and visual speech representations are elaborated gradually within anterior and posterior processing streams, respectively, and may be integrated within the mSTS, which is sensitive to more abstract speech information within and across presentation modalities. The spatial organization of STS is consistent with processing streams that are hypothesized to synthesize perceptual speech representations from sensory signals that provide convergent information from visual and auditory modalities.

The Language, Tone and Prosody of Emotions: Neural Substrates and Dynamics of Spoken-Word Emotion Perception

Rapid assessment of emotions is important for detecting and prioritizing salient input. Emotions are conveyed in spoken words via verbal and non-verbal channels that are mutually informative and unveil in parallel over time, but the neural dynamics and interactions of these processes are not well understood. In this paper, we review the literature on emotion perception in faces, written words, and voices, as a basis for understanding the functional organization of emotion perception in spoken words. The characteristics of visual and auditory routes to the amygdala—a subcortical center for emotion perception—are compared across these stimulus classes in terms of neural dynamics, hemispheric lateralization, and functionality. Converging results from neuroimaging, electrophysiological, and lesion studies suggest the existence of an afferent route to the amygdala and primary visual cortex for fast and subliminal processing of coarse emotional face cues. We suggest that a fast route to the amygdala may also function for brief non-verbal vocalizations (e.g., laugh, cry), in which emotional category is conveyed effectively by voice tone and intensity. However, emotional prosody which evolves on longer time scales and is conveyed by fine-grained spectral cues appears to be processed via a slower, indirect cortical route. For verbal emotional content, the bulk of current evidence, indicating predominant left lateralization of the amygdala response and timing of emotional effects attributable to speeded lexical access, is more consistent with an indirect cortical route to the amygdala. Top-down linguistic modulation may play an important role for prioritized perception of emotions in words. Understanding the neural dynamics and interactions of emotion and language perception is important for selecting potent stimuli and devising effective training and/or treatment approaches for the alleviation of emotional dysfunction across a range of neuropsychiatric states.

Integration demands modulate effective connectivity in a fronto-temporal network for contextual sentence integration

Previous neuroimaging studies demonstrated that a network of left-hemispheric frontal and temporal brain regions contributes to the integration of contextual information into a sentence. However, it remains unclear how these cortical areas influence and drive each other during contextual integration. The present study used dynamic causal modeling (DCM) to investigate task-related changes in the effective connectivity within this network. We found increased neural activity in left anterior inferior frontal gyrus (aIFG), posterior superior temporal sulcus/middle temporal gyrus (pSTS/MTG) and anterior superior temporal sulcus/MTG (aSTS/MTG) that probably reflected increased integration demands and restructuring attempts during the processing of unexpected or semantically anomalous relative to expected endings. DCM analyses of this network revealed that unexpected endings increased the inhibitory influence of left aSTS/MTG on pSTS/MTG during contextual integration. In contrast, during the processing of semantically anomalous endings, left aIFG increased its inhibitory drive on pSTS/MTG. Probabilistic fiber tracking showed that effective connectivity between these areas is mediated by distinct ventral and dorsal white matter association tracts. Together, these results suggest that increasing integration demands require an inhibition of the left pSTS/MTG, which presumably reflects the inhibition of the dominant expected sentence ending. These results are important for a better understanding of the neural implementation of sentence comprehension on a large-scale network level and might influence future studies of language in post-stroke aphasia after focal lesions.

Meta-analytic connectivity modeling of the human superior temporal sulcus

The superior temporal sulcus (STS) is a critical region for multiple neural processes in the human brain Hein and Knight (J Cogn Neurosci 20(12): 2125-2136, 2008). To better understand the multiple functions of the STS it would be useful to know more about its consistent functional coactivations with other brain regions. We used the meta-analytic connectivity modeling technique to determine consistent functional coactivation patterns across experiments and behaviors associated with bilateral anterior, middle, and posterior anatomical STS subregions. Based on prevailing models for the cortical organization of audition and language, we broadly hypothesized that across various behaviors the posterior STS (pSTS) would coactivate with dorsal-stream regions, whereas the anterior STS (aSTS) would coactivate with ventral-stream regions. The results revealed distinct coactivation patterns for each STS subregion, with some overlap in the frontal and temporal areas, and generally similar coactivation patterns for the left and right STS. Quantitative comparison of STS subregion coactivation maps demonstrated that the pSTS coactivated more strongly than other STS subregions in the same hemisphere with dorsal-stream regions, such as the inferior parietal lobule (only left pSTS), homotopic pSTS, precentral gyrus and supplementary motor area. In contrast, the aSTS showed more coactivation with some ventral-stream regions, such as the homotopic anterior temporal cortex and left inferior frontal gyrus, pars orbitalis (only right aSTS). These findings demonstrate consistent coactivation maps across experiments and behaviors for different anatomical STS subregions, which may help future studies consider various STS functions in the broader context of generalized coactivations for individuals with and without neurological disorders.

The grounding of temporal metaphors

Grounded cognition suggests that the processing of conceptual knowledge cued by language relies on the sensory-motor regions. Does temporal language similarly engage brain areas involved in time perception? Participants read sentences that describe the temporal extent of events with motion verbs (The hours crawled until the release of the news) and their static controls. Comparison conditions were fictive motion (The trail crawled until the end of the hills) and literal motion (The caterpillar crawled towards the top of the tree), along with their static controls. Several time sensitive locations, identified using a meta-analysis, showed activation specific to temporal metaphors, including in the left insula, right claustrum, and bilateral posterior superior temporal sulci. Fictive and literal motion contrasts did not show this difference. Fictive motion contrast showed activation in a conceptual motion sensitive area of the left posterior inferior temporal sulcus (ITS). These data suggest that language of time is at least partially grounded in experiential time. In addition, motion semantics has different consequences for events and objects: temporal events become animate, while static entities become motional.

The cortical analysis of speech-specific temporal structure revealed by responses to sound quilts

Speech contains temporal structure that the brain must analyze to enable linguistic processing. To investigate the neural basis of this analysis, we used sound quilts, stimuli constructed by shuffling segments of a natural sound, approximately preserving its properties on short timescales while disrupting them on longer scales. We generated quilts from foreign speech to eliminate language cues and manipulated the extent of natural acoustic structure by varying the segment length. Using functional magnetic resonance imaging, we identified bilateral regions of the superior temporal sulcus (STS) whose responses varied with segment length. This effect was absent in primary auditory cortex and did not occur for quilts made from other natural sounds or acoustically matched synthetic sounds, suggesting tuning to speech-specific spectrotemporal structure. When examined parametrically, the STS response increased with segment length up to ∼500 ms. Our results identify a locus of speech analysis in human auditory cortex that is distinct from lexical, semantic or syntactic processes.

The neural substrates of natural reading: a comparison of normal and nonword text using eyetracking and fMRI

Most previous studies investigating the neural correlates of reading have presented text using serial visual presentation (SVP), which may not fully reflect the underlying processes of natural reading. In the present study, eye movements and BOLD data were collected while subjects either read normal paragraphs naturally or moved their eyes through "paragraphs" of pseudo-text (pronounceable pseudowords or consonant letter strings) in two pseudo-reading conditions. Eye movement data established that subjects were reading and scanning the stimuli normally. A conjunction fMRI analysis across natural- and pseudo-reading showed that a common eye-movement network including frontal eye fields (FEF), supplementary eye fields (SEF), and intraparietal sulci was activated, consistent with previous studies using simpler eye movement tasks. In addition, natural reading versus pseudo-reading showed different patterns of brain activation: normal reading produced activation in a well-established language network that included superior temporal gyrus/sulcus, middle temporal gyrus (MTG), angular gyrus (AG), inferior frontal gyrus, and middle frontal gyrus, whereas pseudo-reading produced activation in an attentional network that included anterior/posterior cingulate and parietal cortex. These results are consistent with results found in previous single-saccade eye movement tasks and SVP reading studies, suggesting that component processes of eye-movement control and language processing observed in past fMRI research generalize to natural reading. The results also suggest that combining eyetracking and fMRI is a suitable method for investigating the component processes of natural reading in fMRI research.

Neural pathways for visual speech perception

This paper examines the questions, what levels of speech can be perceived visually, and how is visual speech represented by the brain? Review of the literature leads to the conclusions that every level of psycholinguistic speech structure (i.e., phonetic features, phonemes, syllables, words, and prosody) can be perceived visually, although individuals differ in their abilities to do so; and that there are visual modality-specific representations of speech qua speech in higher-level vision brain areas. That is, the visual system represents the modal patterns of visual speech. The suggestion that the auditory speech pathway receives and represents visual speech is examined in light of neuroimaging evidence on the auditory speech pathways. We outline the generally agreed-upon organization of the visual ventral and dorsal pathways and examine several types of visual processing that might be related to speech through those pathways, specifically, face and body, orthography, and sign language processing. In this context, we examine the visual speech processing literature, which reveals widespread diverse patterns of activity in posterior temporal cortices in response to visual speech stimuli. We outline a model of the visual and auditory speech pathways and make several suggestions: (1) The visual perception of speech relies on visual pathway representations of speech qua speech. (2) A proposed site of these representations, the temporal visual speech area (TVSA) has been demonstrated in posterior temporal cortex, ventral and posterior to multisensory posterior superior temporal sulcus (pSTS). (3) Given that visual speech has dynamic and configural features, its representations in feedforward visual pathways are expected to integrate these features, possibly in TVSA.