Spatiotemporal dynamics of modality-specific and supramodal word processing

Binding of cortical functional modules by synchronous high-frequency oscillations

Whether high-frequency phase-locked oscillations facilitate integration ('binding') of information across widespread cortical areas is controversial. Here we show with intracranial electroencephalography that cortico-cortical co-ripples (~100-ms-long ~90 Hz oscillations) increase during reading and semantic decisions, at the times and co-locations when and where binding should occur. Fusiform wordform areas co-ripple with virtually all language areas, maximally from 200 to 400 ms post-word-onset. Semantically specified target words evoke strong co-rippling between wordform, semantic, executive and response areas from 400 to 800 ms, with increased co-rippling between semantic, executive and response areas prior to correct responses. Co-ripples were phase-locked at zero lag over long distances (>12 cm), especially when many areas were co-rippling. General co-activation, indexed by non-oscillatory high gamma, was mainly confined to early latencies in fusiform and earlier visual areas, preceding co-ripples. These findings suggest that widespread synchronous co-ripples may assist the integration of multiple cortical areas for sustained periods during cognition.

Overlapping neural correlates underpin theory of mind and semantic cognition: Evidence from a meta-analysis of 344 functional neuroimaging studies

Key unanswered questions for cognitive neuroscience include whether social cognition is underpinned by specialised brain regions and to what extent it simultaneously depends on more domain-general systems. Until we glean a better understanding of the full set of contributions made by various systems, theories of social cognition will remain fundamentally limited. In the present study, we evaluate a recent proposal that semantic cognition plays a crucial role in supporting social cognition. While previous brain-based investigations have focused on dissociating these two systems, our primary aim was to assess the degree to which the neural correlates are overlapping, particularly within two key regions, the anterior temporal lobe (ATL) and the temporoparietal junction (TPJ). We focus on activation associated with theory of mind (ToM) and adopt a meta-analytic activation likelihood approach to synthesise a large set of functional neuroimaging studies and compare their results with studies of semantic cognition. As a key consideration, we sought to account for methodological differences across the two sets of studies, including the fact that ToM studies tend to use nonverbal stimuli while the semantics literature is dominated by language-based tasks. Overall, we observed consistent overlap between the two sets of brain regions, especially in the ATL and TPJ. This supports the claim that tasks involving ToM draw upon more general semantic retrieval processes. We also identified activation specific to ToM in the right TPJ, bilateral anterior mPFC, and right precuneus. This is consistent with the view that, nested amongst more domain-general systems, there is specialised circuitry that is tuned to social processes.

Reading instruction causes changes in category-selective visual cortex

Education sculpts specialized neural circuits for skills like reading that are critical to success in modern society but were not anticipated by the selective pressures of evolution. Does the emergence of brain regions that selectively process novel visual stimuli like words occur at the expense of cortical representations of other stimuli like faces and objects? "Neuronal Recycling" predicts that learning to read should enhance the response to words in ventral occipitotemporal cortex (VOTC) and decrease the response to other visual categories such as faces and objects. To test this hypothesis, and more broadly to understand the changes that are induced by the early stages of literacy instruction, we conducted a randomized controlled trial with pre-school children (five years of age). Children were randomly assigned to intervention programs focused on either reading skills or oral language skills and magnetoencephalography (MEG) data collected before and after the intervention was used to measure visual responses to images of text, faces, and objects. We found that being taught reading versus oral language skills induced different patterns of change in category-selective regions of visual cortex, but that there was not a clear tradeoff between the response to words versus other categories. Within a predefined region of VOTC corresponding to the visual word form area (VWFA) we found that the relative amplitude of responses to text, faces, and objects changed, but increases in the response to words were not linked to decreases in the response to faces or objects. How these changes play out over a longer timescale is still unknown but, based on these data, we can surmise that high-level visual cortex undergoes rapid changes as children enter school and begin establishing new skills like literacy.

Sentence superiority in the reading brain

When a sequence of written words is briefly presented and participants are asked to identify just one word at a post-cued location, then word identification accuracy is higher when the word is presented in a grammatically correct sequence compared with an ungrammatical sequence. This sentence superiority effect has been reported in several behavioral studies and two EEG investigations. Taken together, the results of these studies support the hypothesis that the sentence superiority effect is primarily driven by rapid access to a sentence-level representation via partial word identification processes that operate in parallel over several words. Here we used MEG to examine the neural structures involved in this early stage of written sentence processing, and to further specify the timing of the different processes involved. Source activities over time showed grammatical vs. ungrammatical differences first in the left inferior frontal gyrus (IFG: 321-406 ms), then the left anterior temporal lobe (ATL: 466-531 ms), and finally in both left IFG (549-602 ms) and left posterior superior temporal gyrus (pSTG: 553-622 ms). We interpret the early IFG activity as reflecting the rapid bottom-up activation of sentence-level representations, including syntax, enabled by partly parallel word processing. Subsequent activity in ATL and pSTG is thought to reflect the constraints imposed by such sentence-level representations on on-going word-based semantic activation (ATL), and the subsequent development of a more detailed sentence-level representation (pSTG). These results provide further support for a cascaded interactive-activation account of sentence reading.

Verbal semantic expertise is associated with reduced functional connectivity between left and right anterior temporal lobes

The left and right anterior temporal lobes (ATLs) encode semantic representations. They show graded hemispheric specialization in function, with the left ATL contributing preferentially to verbal semantic processing. We investigated the cognitive correlates of this organization, using resting-state functional connectivity as a measure of functional segregation between ATLs. We analyzed two independent resting-state fMRI datasets (n = 86 and n = 642) in which participants' verbal semantic expertise was measured using vocabulary tests. In both datasets, people with more advanced verbal semantic knowledge showed weaker functional connectivity between left and right ventral ATLs. This effect was highly specific. It was not observed for within-hemisphere connections between semantic regions (ventral ATL and inferior frontal gyrus (IFG), though it was found for left-right IFG connectivity in one dataset). Effects were not found for tasks probing semantic control, nonsemantic cognition, or face recognition. Our results suggest that hemispheric specialization in the ATLs is not an innate property but rather emerges as people develop highly detailed verbal semantic representations. We speculate that this effect is a consequence of the left ATL's greater connectivity with left-lateralized written word recognition regions, which causes it to preferentially represent meaning for advanced vocabulary acquired primarily through reading.

A scoping review of utilization of the verbal fluency task in Chinese and Japanese clinical settings with near-infrared spectroscopy

This review targets the application of the Verbal Fluency Task (VFT) in conjunction with functional near-infrared spectroscopy (fNIRS) for diagnosing psychiatric disorders, specifically in the contexts of China and Japan. These two countries are at the forefront of integrating fNIRS with VFT in clinical psychiatry, often employing this combination as a complementary tool alongside traditional psychiatric examinations. Our study aims to synthesize research findings on the hemodynamic responses elicited by VFT task in clinical settings of the two countries, analyzing variations in task design (phonological versus semantic), stimulus modality (auditory versus visual), and the impact of language typology. The focus on China and Japan is crucial, as it provides insights into the unique applications and adaptations of VFT in these linguistically and culturally distinct environments. By exploring these specific cases, our review underscores the importance of tailoring VFT to fit the linguistic and cultural context, thereby enhancing its validity and utility in cross-cultural psychiatric assessments.

Decoding Semantics from Dynamic Brain Activation Patterns: From Trials to Task in EEG/MEG Source Space

The temporal dynamics within the semantic brain network and its dependence on stimulus and task parameters are still not well understood. Here, we addressed this by decoding task as well as stimulus information from source-estimated EEG/MEG human data. We presented the same visual word stimuli in a lexical decision (LD) and three semantic decision (SD) tasks. The meanings of the presented words varied across five semantic categories. Source space decoding was applied over time in five ROIs in the left hemisphere (anterior and posterior temporal lobe, inferior frontal gyrus, primary visual areas, and angular gyrus) and one in the right hemisphere (anterior temporal lobe). Task decoding produced sustained significant effects in all ROIs from 50 to 100 ms, both when categorizing tasks with different semantic demands (LD-SD) as well as for similar semantic tasks (SD-SD). In contrast, a semantic word category could only be decoded in lATL, rATL, PTC, and IFG, between 250 and 500 ms. Furthermore, we compared two approaches to source space decoding: conventional ROI-by-ROI decoding and combined-ROI decoding with back-projected activation patterns. The former produced more reliable results for word category decoding while the latter was more informative for task decoding. This indicates that task effects are distributed across the whole semantic network while stimulus effects are more focal. Our results demonstrate that the semantic network is widely distributed but that bilateral anterior temporal lobes together with control regions are particularly relevant for the processing of semantic information.

Characterizing directional dynamics of semantic prediction based on inter-regional temporal generalization

The event-related potential/field component N400(m) has been widely used as a neural index for semantic prediction. It has long been hypothesized that feedback information from inferior frontal areas plays a critical role in generating the N400. However, due to limitations in causal connectivity estimation, direct testing of this hypothesis has remained difficult. Here, magnetoencephalography (MEG) data was obtained during a classic N400 paradigm where the semantic predictability of a fixed target noun was manipulated in simple German sentences. To estimate causality, we implemented a novel approach based on machine learning and temporal generalization to estimate the effect of inferior frontal gyrus (IFG) on temporal areas. In this method, a support vector machine (SVM) classifier is trained on each time point of the neural activity in IFG to classify less predicted (LP) and highly predicted (HP) nouns and then tested on all time points of superior/middle temporal sub-regions activity (and vice versa, to establish spatio-temporal evidence for or against causality). The decoding accuracy was significantly above chance level when the classifier was trained on IFG activity and tested on future activity in superior and middle temporal gyrus (STG/MTG). The results present new evidence for a model predictive speech comprehension where predictive IFG activity is fed back to shape subsequent activity in STG/MTG, implying a feedback mechanism in N400 generation. In combination with the also observed strong feedforward effect from left STG/MTG to IFG, our findings provide evidence of dynamic feedback and feedforward influences between IFG and temporal areas during N400 generation.

Reliability and generalizability of neural speech tracking in younger and older adults

Neural tracking of spoken speech is considered a potential clinical biomarker for speech-processing difficulties, but the reliability of neural speech tracking is unclear. Here, younger and older adults listened to stories in two sessions while electroencephalography was recorded to investigate the reliability and generalizability of neural speech tracking. Speech tracking amplitude was larger for older than younger adults, consistent with an age-related loss of inhibition. The reliability of neural speech tracking was moderate (ICC ∼0.5-0.75) and tended to be higher for older adults. However, reliability was lower for speech tracking than for neural responses to noise bursts (ICC >0.8), which we used as a benchmark for maximum reliability. Neural speech tracking generalized moderately across different stories (ICC ∼0.5-0.6), which appeared greatest for audiobook-like stories spoken by the same person. Hence, a variety of stories could possibly be used for clinical assessments. Overall, the current data are important for developing a biomarker of speech processing but suggest that further work is needed to increase the reliability to meet clinical standards.

Magnetoencephalography Language Mapping Using Auditory Memory Retrieval and Silent Repeating Task

PURPOSE

The study aims to (1) examine the spatiotemporal map of magnetoencephalography-evoked responses during an Auditory Memory Retrieval and Silent Repeating (AMRSR) task, and determine the hemispheric dominance for language, and (2) evaluate the accuracy of the AMRSR task in Wernicke and Broca area localization.

METHODS

In 30 patients with brain tumors and/or epilepsies, the AMRSR task was used to evoke magnetoencephalography responses. We applied Fast VEctor-based Spatial-Temporal Analyses with minimum L1-norm source imaging method to the magnetoencephalography responses for localizing the brain areas evoked by the AMRSR task.

RESULTS

The Fast-VEctor-based Spatial-Temporal Analysis found consistent activation in the posterior superior temporal gyrus around 300 to 500 ms, and another activation in the frontal cortex (pars opercularis and/or pars triangularis) around 600 to 900 ms, which were localized to the Wernicke area (BA 22) and Broca area (BA 44 and BA 45), respectively. The language-dominant hemispheric laterization elicited by the AMRSR task was comparable with the result from an Auditory Dichotic task result given to the same patient, with the exception that AMRSR is more sensitive on bilateral language laterization cases on finding the Wernicke and Broca areas.

CONCLUSIONS

For all patients who successfully finished the AMRSR task, Fast-VEctor-based Spatial-Temporal Analysis could establish accurate and robust localizations of Broca and Wernicke area and determine hemispheric dominance. For subjects with normal auditory functionality, the AMRSR paradigm evaluation showed significant promise in providing reliable assessments of cerebral language dominance and language network localization.

Representation of event and object concepts in ventral anterior temporal lobe and angular gyrus

Semantic knowledge includes understanding of objects and their features and also understanding of the characteristics of events. The hub-and-spoke theory holds that these conceptual representations rely on multiple information sources that are integrated in a central hub in the ventral anterior temporal lobes. The dual-hub theory expands this framework with the claim that the ventral anterior temporal lobe hub is specialized for object representation, while a second hub in angular gyrus is specialized for event representation. To test these ideas, we used representational similarity analysis, univariate and psychophysiological interaction analyses of fMRI data collected while participants processed object and event concepts (e.g. "an apple," "a wedding") presented as images and written words. Representational similarity analysis showed that angular gyrus encoded event concept similarity more than object similarity, although the left angular gyrus also encoded object similarity. Bilateral ventral anterior temporal lobes encoded both object and event concept structure, and left ventral anterior temporal lobe exhibited stronger coding for events. Psychophysiological interaction analysis revealed greater connectivity between left ventral anterior temporal lobe and right pMTG, and between right angular gyrus and bilateral ITG and middle occipital gyrus, for event concepts compared to object concepts. These findings support the specialization of angular gyrus for event semantics, though with some involvement in object coding, but do not support ventral anterior temporal lobe specialization for object concepts.

Beta- and gamma-band cortico-cortical interactions support naturalistic reading of continuous text

Large-scale integration of information across cortical structures, building on neural connectivity, has been proposed to be a key element in supporting human cognitive processing. In electrophysiological neuroimaging studies of reading, quantification of neural interactions has been limited to the level of isolated words or sentences due to artefacts induced by eye movements. Here, we combined magnetoencephalography recording with advanced artefact rejection tools to investigate both cortico-cortical coherence and directed neural interactions during naturalistic reading of full-page texts. Our results show that reading versus visual scanning of text was associated with wide-spread increases of cortico-cortical coherence in the beta and gamma bands. We further show that the reading task was linked to increased directed neural interactions compared to the scanning task across a sparse set of connections within a wide range of frequencies. Together, the results demonstrate that neural connectivity flexibly builds on different frequency bands to support continuous natural reading.

Frequency-specific directed interactions between whole-brain regions during sentence processing using multimodal stimulus

Neural oscillations subserve a broad range of speech processing and language comprehension functions. Using an electroencephalogram (EEG), we investigated the frequency-specific directed interactions between whole-brain regions while the participants processed Chinese sentences using different modality stimuli (i.e., auditory, visual, and audio-visual). The results indicate that low-frequency responses correspond to the process of information flow aggregation in primary sensory cortices in different modalities. Information flow dominated by high-frequency responses exhibited characteristics of bottom-up flow from left posterior temporal to left frontal regions. The network pattern of top-down information flowing out of the left frontal lobe was presented by the joint dominance of low- and high-frequency rhythms. Overall, our results suggest that the brain may be modality-independent when processing higher-order language information.

Spatiotemporal dynamics of abstract and concrete semantic representations

Dual Coding Theories (DCT) suggest that meaning is represented in the brain by a double code: a language-derived code in the Anterior Temporal Lobe (ATL) and a sensory-derived code in perceptual and motor regions. Concrete concepts should activate both codes, while abstract ones rely solely on the linguistic code. To test these hypotheses, the present magnetoencephalography (MEG) experiment had participants judge whether visually presented words relate to the senses while we recorded brain responses to abstract and concrete semantic components obtained from 65 independently rated semantic features. Results evidenced early involvement of anterior-temporal and inferior-frontal brain areas in both abstract and concrete semantic information encoding. At later stages, occipital and occipito-temporal regions showed greater responses to concrete compared to abstract features. The present findings suggest that the concreteness of words is processed first with a transmodal/linguistic code, housed in frontotemporal brain systems, and only after with an imagistic/sensorimotor code in perceptual regions.

Mapping access to meaning in adolescents with autism: Atypical lateralization and spatiotemporal patterns as a function of language ability

Individuals with autism spectrum disorders (ASD) vary in their language abilities, associated with atypical patterns of brain activity. However, few studies have examined the spatiotemporal profiles of lexico-semantic processing in ASD, particularly as a function of language heterogeneity. Thirty-nine high-functioning adolescents with ASD and 21 typically developing (TD) peers took part in a lexical decision task that combined semantic access with demands on cognitive control. Spatiotemporal characteristics of the processing stages were examined with a multimodal anatomically-constrained magnetoencephalography (aMEG) approach, which integrates MEG with structural MRI. Additional EEG data were acquired from a limited montage simultaneously with MEG. TD adolescents showed the canonical left-dominant activity in frontotemporal regions during both early (N250m) and late (N400m) stages of lexical access and semantic integration. In contrast, the ASD participants showed bilateral engagement of the frontotemporal language network, indicative of compensatory recruitment of the right hemisphere. The left temporal N400m was prominent in both groups, confirming preserved attempts to access meaning. In contrast, the left prefrontal N400m was reduced in ASD participants, consistent with impaired semantic/contextual integration and inhibitory control. To further investigate the impact of language proficiency, the ASD sample was stratified into high- and low-performing (H-ASD and L-ASD) subgroups based on their task accuracy. The H-ASD subgroup performed on par with the TD group and showed greater activity in the right prefrontal and bilateral temporal cortices relative to the L-ASD subgroup, suggesting compensatory engagement. The L-ASD subgroup additionally showed reduced and delayed left prefrontal N400m, consistent with more profound semantic and executive impairments in this subgroup. These distinct spatiotemporal activity profiles reveal the neural underpinnings of the ASD-specific access to meaning and provide insight into the phenotypic heterogeneity of language in ASD, which may be a result of different neurodevelopmental trajectories and adoption of compensatory strategies.

Uncovering the fast, directional signal flow through the human temporal pole during semantic processing

The temporal pole (TP) plays a central role in semantic memory, yet its neural machinery is unknown. Intracerebral recordings in patients discriminating visually the gender or actions of an actor, yielded gender discrimination responses in the ventrolateral (VL) and tip (T) regions of right TP. Granger causality revealed task-specific signals travelling first forward from VL to T, under control of orbitofrontal cortex (OFC) and neighboring prefrontal cortex, and then, strongly, backwards from T to VL. Many other cortical regions provided inputs to or received outputs from both TP regions, often with longer delays, with ventral temporal afferents to VL signaling the actor's physical appearance. The TP response timing reflected more that of the connections to VL, controlled by OFC, than that of the input leads themselves. Thus, visual evidence for gender categories, collected by VL, activates category labels in T, and consequently, category features in VL, indicating a two-stage representation of semantic categories in TP.

Time-Lagged Multidimensional Pattern Connectivity (TL-MDPC): An EEG/MEG pattern transformation based functional connectivity metric

Functional and effective connectivity methods are essential to study the complex information flow in brain networks underlying human cognition. Only recently have connectivity methods begun to emerge that make use of the full multidimensional information contained in patterns of brain activation, rather than unidimensional summary measures of these patterns. To date, these methods have mostly been applied to fMRI data, and no method allows vertex-to-vertex transformations with the temporal specificity of EEG/MEG data. Here, we introduce time-lagged multidimensional pattern connectivity (TL-MDPC) as a novel bivariate functional connectivity metric for EEG/MEG research. TL-MDPC estimates the vertex-to-vertex transformations among multiple brain regions and across different latency ranges. It determines how well patterns in ROI X at time point tx can linearly predict patterns of ROI Y at time point ty. In the present study, we use simulations to demonstrate TL-MDPC's increased sensitivity to multidimensional effects compared to a unidimensional approach across realistic choices of number of trials and signal-to-noise ratios. We applied TL-MDPC, as well as its unidimensional counterpart, to an existing dataset varying the depth of semantic processing of visually presented words by contrasting a semantic decision and a lexical decision task. TL-MDPC detected significant effects beginning very early on, and showed stronger task modulations than the unidimensional approach, suggesting that it is capable of capturing more information. With TL-MDPC only, we observed rich connectivity between core semantic representation (left and right anterior temporal lobes) and semantic control (inferior frontal gyrus and posterior temporal cortex) areas with greater semantic demands. TL-MDPC is a promising approach to identify multidimensional connectivity patterns, typically missed by unidimensional approaches.

Predictive coding across the left fronto-temporal hierarchy during language comprehension

We used magnetoencephalography (MEG) and event-related potentials (ERPs) to track the time-course and localization of evoked activity produced by expected, unexpected plausible, and implausible words during incremental language comprehension. We suggest that the full pattern of results can be explained within a hierarchical predictive coding framework in which increased evoked activity reflects the activation of residual information that was not already represented at a given level of the fronto-temporal hierarchy ("error" activity). Between 300 and 500 ms, the three conditions produced progressively larger responses within left temporal cortex (lexico-semantic prediction error), whereas implausible inputs produced a selectively enhanced response within inferior frontal cortex (prediction error at the level of the event model). Between 600 and 1,000 ms, unexpected plausible words activated left inferior frontal and middle temporal cortices (feedback activity that produced top-down error), whereas highly implausible inputs activated left inferior frontal cortex, posterior fusiform (unsuppressed orthographic prediction error/reprocessing), and medial temporal cortex (possibly supporting new learning). Therefore, predictive coding may provide a unifying theory that links language comprehension to other domains of cognition.

Modulations of right hemisphere connectivity in young children relates to the perception of spoken words

The early school years shape a young brain's capability to comprehend and contextualize words within milliseconds of exposure. Parsing word sounds (phonological interpretation) and word recognition (enabling semantic interpretation) are integral to this process. Yet little is known about the causal mechanisms of cortical activity during these early developmental stages. In this study, we aimed to explore these causal mechanisms via dynamic causal modelling of event-related potentials (ERPs) acquired from 30 typically developing children (ages 6-8 years) as they completed a spoken word-picture matching task. Source reconstruction of high-density electroencephalography (128 channels) was used to ascertain differences in whole-brain cortical activity during semantically "congruent" and "incongruent" conditions. Source activations analyzed during the N400 ERP window identified significant regions-of-interest (p_FWE<.05) localized primarily in the right hemisphere when contrasting congruent and incongruent word-picture stimuli. Dynamic causal models (DCMs) were tested on source activations in the fusiform gyrus (rFusi), inferior parietal lobule (rIPL), inferior temporal gyrus (rITG) and superior frontal gyrus (rSFG). DCM results indicated that a fully connected bidirectional model with self-(inhibiting) connections over rFusi, rIPL and rSFG provided the highest model evidence, based on exceedance probabilities derived from Bayesian statistical inferences. Connectivity parameters of rITG and rSFG regions from the winning DCM were negatively correlated with behavioural measures of receptive vocabulary and phonological memory (p_FDR<.05), such that lower scores on these assessments corresponded with increased connectivity between temporal pole and anterior frontal regions. The findings suggest that children with lower language processing skills required increased recruitment of right hemisphere frontal/temporal areas during task performance.

Social semantics: the organization and grounding of abstract concepts

concepts, like justice and friendship, are central features of our daily lives. Traditionally, abstract concepts are distinguished from other concepts in that they cannot be directly experienced through the senses. As such, they pose a challenge for strongly embodied models of semantic representation that assume a central role for sensorimotor information. There is growing recognition, however, that it is possible for meaning to be 'grounded' via cognitive systems, including those involved in processing language and emotion. In this article, we focus on the specific proposal that social significance is a key feature in the representation of some concepts. We begin by reviewing recent evidence in favour of this proposal from the fields of psycholinguistics and neuroimaging. We then discuss the limited extent to which there is consensus about the definition of 'socialness' and propose essential next steps for research in this domain. Taking one such step, we describe preliminary data from an unprecedented large-scale rating study that can help determine how socialness is distinct from other facets of word meaning. We provide a backdrop of contemporary theories regarding semantic representation and social cognition and highlight important predictions for both brain and behaviour. This article is part of the theme issue 'Concepts in interaction: social engagement and inner experiences'.

Neural circuits underlying language control and modality control in bilinguals: An fMRI study

Human communication not only involves the need to switch between the modalities of speaking and listening, but for bilinguals, it can also involve switching between languages. It is unknown as to whether modality and language switching share underlying control mechanisms or whether one type of switching affects control processes involved in the other. The present study uses behavioral and fMRI measures to examine neural circuits of control during communicative situations that required Chinese-English bilinguals to switch between modalities and their two languages according to associated color cues. The results showed that for both language and modality control, similar brain regions were recruited during speech production and comprehension. For modality control, the specific control processes partly depended on the corresponding modality. Finally, switching between modalities appears to exert more influence on language control in production compared to comprehension. These findings offer a first detailed characterization of the neural bases involved in control mechanisms in bilingual communication.

fMRI BOLD and MEG theta power reflect complementary aspects of activity during lexicosemantic decision in adolescents with ASD

Neuroimaging studies of autism spectrum disorder (ASD) have been predominantly unimodal. While many fMRI studies have reported atypical activity patterns for diverse tasks, the MEG literature in ASD remains comparatively small. Our group recently reported atypically increased event-related theta power in individuals with ASD during lexicosemantic processing. The current multimodal study examined the relationship between fMRI BOLD signal and anatomically-constrained MEG (aMEG) theta power. Thirty-three adolescents with ASD and 23 typically developing (TD) peers took part in both fMRI and MEG scans, during which they distinguished between standard words (SW), animal words (AW), and pseudowords (PW). Regions-of-interest (ROIs) were derived based on task effects detected in BOLD signal and aMEG theta power. BOLD signal and theta power were extracted for each ROI and word condition. Compared to TD participants, increased theta power in the ASD group was found across several time windows and regions including left fusiform and inferior frontal, as well as right angular and anterior cingulate gyri, whereas BOLD signal was significantly increased in the ASD group only in right anterior cingulate gyrus. No significant correlations were observed between BOLD signal and theta power. Findings suggest that the common interpretation of increases in BOLD signal and theta power as 'activation' require careful differentiation, as these reflect largely distinct aspects of regional brain activity. Some group differences in dynamic neural processing detected with aMEG that are likely relevant for lexical processing may be obscured by the hemodynamic signal source and low temporal resolution of fMRI.

The role of the ventrolateral anterior temporal lobes in social cognition

A key challenge for neurobiological models of social cognition is to elucidate whether brain regions are specialised for that domain. In recent years, discussion surrounding the role of anterior temporal regions epitomises such debates; some argue the anterior temporal lobe (ATL) is part of a domain‐specific network for social processing, while others claim it comprises a domain‐general hub for semantic representation. In the present study, we used ATL‐optimised fMRI to map the contribution of different ATL structures to a variety of paradigms frequently used to probe a crucial social ability, namely ‘theory of mind’ (ToM). Using multiple tasks enables a clearer attribution of activation to ToM as opposed to idiosyncratic features of stimuli. Further, we directly explored whether these same structures are also activated by a non‐social task probing semantic representations. We revealed that common to all of the tasks was activation of a key ventrolateral ATL region that is often invisible to standard fMRI. This constitutes novel evidence in support of the view that the ventrolateral ATL contributes to social cognition via a domain‐general role in semantic processing and against claims of a specialised social function.

Time Is of the Essence: Neural Codes, Synchronies, Oscillations, Architectures

Time is of the essence in how neural codes, synchronies, and oscillations might function in encoding, representation, transmission, integration, storage, and retrieval of information in brains. This Hypothesis and Theory article examines observed and possible relations between codes, synchronies, oscillations, and types of neural networks they require. Toward reverse-engineering informational functions in brains, prospective, alternative neural architectures incorporating principles from radio modulation and demodulation, active reverberant circuits, distributed content-addressable memory, signal-signal time-domain correlation and convolution operations, spike-correlation-based holography, and self-organizing, autoencoding anticipatory systems are outlined. Synchronies and oscillations are thought to subserve many possible functions: sensation, perception, action, cognition, motivation, affect, memory, attention, anticipation, and imagination. These include direct involvement in coding attributes of events and objects through phase-locking as well as characteristic patterns of spike latency and oscillatory response. They are thought to be involved in segmentation and binding, working memory, attention, gating and routing of signals, temporal reset mechanisms, inter-regional coordination, time discretization, time-warping transformations, and support for temporal wave-interference based operations. A high level, partial taxonomy of neural codes consists of channel, temporal pattern, and spike latency codes. The functional roles of synchronies and oscillations in candidate neural codes, including oscillatory phase-offset codes, are outlined. Various forms of multiplexing neural signals are considered: time-division, frequency-division, code-division, oscillatory-phase, synchronized channels, oscillatory hierarchies, polychronous ensembles. An expandable, annotative neural spike train framework for encoding low- and high-level attributes of events and objects is proposed. Coding schemes require appropriate neural architectures for their interpretation. Time-delay, oscillatory, wave-interference, synfire chain, polychronous, and neural timing networks are discussed. Some novel concepts for formulating an alternative, more time-centric theory of brain function are discussed. As in radio communication systems, brains can be regarded as networks of dynamic, adaptive transceivers that broadcast and selectively receive multiplexed temporally-patterned pulse signals. These signals enable complex signal interactions that select, reinforce, and bind common subpatterns and create emergent lower dimensional signals that propagate through spreading activation interference networks. If memory traces share the same kind of temporal pattern forms as do active neuronal representations, then distributed, holograph-like content-addressable memories are made possible via temporal pattern resonances.

Individual differences in behavioral and electrophysiological signatures of familiarity- and recollection-based recognition memory

Our everyday memories can vary in terms of accuracy and phenomenology. According to one theoretical account, these differences hinge on whether the memories contain information about both an item itself as well as associated details (remember) versus those that are devoid of these associated contextual details (familiar). This distinction has been supported by computational modeling of behavior, studies in patients, and neuroimaging work including differences both in electrophysiological and functional magnetic resonance imaging. At present, however, little evidence has emerged to suggest that neurophysiological measures track individual differences in estimates of recollection and familiarity. Here, we conducted electrophysiological recordings of brain activity during a recognition memory task designed to differentiate between behavioral indices of recollection and familiarity. Non-parametric cluster-based permutation analyses revealed associations between electrophysiological signatures of familiarity and recollection with their respective behavioral estimates. These results support the idea that recollection and familiarity are distinct phenomena and is the first, to our knowledge, to identify distinct electrophysiological signatures that track individual differences in these processes.

The importance of basal-temporal white matter to pre- and post-surgical naming ability in temporal lobe epilepsy

OBJECTIVE

Emerging research highlights the importance of basal-temporal cortex, centered on the fusiform gyrus, to both pre-surgical naming ability and post-surgical naming outcomes in temporal lobe epilepsy (TLE). In this study, we investigate whether integrity of the white matter network that interconnects this basal region to the distributed language network affects naming ability and risk for post-surgical naming decline.

METHODS

Patients with drug-resistant TLE were recruited from two epilepsy centers in a prospective longitudinal study. The pre-surgical dataset included 50 healthy controls, 47 left TLE (L-TLE), and 41 right TLE (R-TLE) patients. All participants completed pre-surgical T1- and diffusion-weighted MRI (dMRI), as well as neuropsychological tests of auditory and visual naming. Nineteen L-TLE and 18 R-TLE patients underwent anterior temporal lobectomy (ATL) and also completed post-surgical neuropsychological testing. Pre-surgical fractional anisotropy (FA) of the white matter directly beneath the fusiform neocortex (i.e., superficial white matter; SWM) and of deep white matter tracts with connections to the basal-temporal cortex [inferior longitudinal fasciculus (ILF) and inferior frontal occipital fasciculus (IFOF)] was calculated. Clinical variables, hippocampal volume, and FA of each white matter tract or region were examined in linear regressions with naming scores, or change in naming scores, as the primary outcomes.

RESULTS

Pre-surgically, higher FA in the bilateral ILF, bilateral IFOF, and left fusiform SWM was associated with better visual and auditory naming scores (all ps < 0.05 with FDR correction). In L-TLE, higher pre-surgical FA was also associated with less naming decline post-surgically, but results varied across tracts. When including only patients with typical language dominance, only integrity of the right fusiform SWM was associated with less visual naming decline (p = .0018).

DISCUSSION

Although a broad network of white matter network matter may contribute to naming ability pre-surgically, the reserve capacity of the contralateral (right) fusiform SWM may be important for mitigating visual naming decline following ATL in L-TLE. This shows that the study of the structural network interconnecting the basal-temporal region to the wider language network has implications for understanding both pre- and post-surgical naming in TLE.

Task modulation of spatiotemporal dynamics in semantic brain networks: An EEG/MEG study

How does brain activity in distributed semantic brain networks evolve over time, and how do these regions interact to retrieve the meaning of words? We compared spatiotemporal brain dynamics between visual lexical and semantic decision tasks (LD and SD), analysing whole-cortex evoked responses and spectral functional connectivity (coherence) in source-estimated electroencephalography and magnetoencephalography (EEG and MEG) recordings. Our evoked analysis revealed generally larger activation for SD compared to LD, starting in primary visual area (PVA) and angular gyrus (AG), followed by left posterior temporal cortex (PTC) and left anterior temporal lobe (ATL). The earliest activation effects in ATL were significantly left-lateralised. Our functional connectivity results showed significant connectivity between left and right ATL, PTC and right ATL in an early time window, as well as between left ATL and IFG in a later time window. The connectivity of AG was comparatively sparse. We quantified the limited spatial resolution of our source estimates via a leakage index for careful interpretation of our results. Our findings suggest that the different demands on semantic information retrieval in lexical and semantic decision tasks first modulate visual and attentional processes, then multimodal semantic information retrieval in the ATLs and finally control regions (PTC and IFG) in order to extract task-relevant semantic features for response selection. Whilst our evoked analysis suggests a dominance of left ATL for semantic processing, our functional connectivity analysis also revealed significant involvement of right ATL in the more demanding semantic task. Our findings demonstrate the complementarity of evoked and functional connectivity analysis, as well as the importance of dynamic information for both types of analyses.

The Cortical Organization of Syntactic Processing Is Supramodal: Evidence from American Sign Language

Areas within the left-lateralized neural network for language have been found to be sensitive to syntactic complexity in spoken and written language. Previous research has revealed that these areas are active for sign language as well, but whether these areas are specifically responsive to syntactic complexity in sign language independent of lexical processing has yet to be found. To investigate the question, we used fMRI to neuroimage deaf native signers' comprehension of 180 sign strings in American Sign Language (ASL) with a picture-probe recognition task. The ASL strings were all six signs in length but varied at three levels of syntactic complexity: sign lists, two-word sentences, and complex sentences. Syntactic complexity significantly affected comprehension and memory, both behaviorally and neurally, by facilitating accuracy and response time on the picture-probe recognition task and eliciting a left lateralized activation response pattern in anterior and posterior superior temporal sulcus (aSTS and pSTS). Minimal or absent syntactic structure reduced picture-probe recognition and elicited activation in bilateral pSTS and occipital-temporal cortex. These results provide evidence from a sign language, ASL, that the combinatorial processing of anterior STS and pSTS is supramodal in nature. The results further suggest that the neurolinguistic processing of ASL is characterized by overlapping and separable neural systems for syntactic and lexical processing.

Associations of Neurocognition and Social Cognition With Brain Structure and Function in Early-Onset Schizophrenia

BACKGROUND

Cognitive impairment is a core feature of schizophrenia that is more serious in patients with early-onset schizophrenia (EOS). However, the neuroimaging basis of cognitive functions, including neurocognition and social cognition, remains unclear in patients with EOS.

METHODS

Forty-three patients with EOS underwent structural and resting state functional magnetic resonance imaging scans. Brain structure and function were evaluated through the analysis of brain gray matter volume (GMV) and amplitude of low-frequency fluctuations (ALFF). They underwent comprehensive assessments for neurocognition (verbal memory, verbal expression, attention, and executive function) and social cognition (theory of mind and attributional bias). Correlation analyses were conducted to detect the potential link between cognitive function indices and brain imaging parameters.

RESULTS

First, neurocognition was linked to brain structure characterized by higher immediate recall scores associated with increased GMV in the left temporal pole, higher verbal fluency scores associated with increased GMV in the left temporal pole: middle temporal gyrus, and higher Stroop-word scores associated with increased GMV in the right middle frontal gyrus. Second, social cognition was related to brain function characterized by lower sense of reality scores associated with increased ALFF in the left precentral gyrus, higher scores of accidental hostility bias associated with increased ALFF in the right middle temporal gyrus, and higher scores of accidental aggression bias associated with increased ALFF in the left precentral gyrus.

CONCLUSION

These findings may add to the existing knowledge about the cognitive function-brain relationship. They may have clinical significance for studying the mechanism of neurocognitive and social cognitive impairment in patients with EOS and providing potential neural targets for their treatment and intervention.

Frontotemporal dementia: A unique window on the functional role of the temporal lobes

Frontotemporal dementia (FTD) is an umbrella term covering a plethora of progressive changes in executive functions, motor abilities, behavior, and/or language. Different clinical syndromes have been described in relation to localized atrophy, informing on the functional networks that underlie these specific cognitive, emotional, and behavioral processes. These functional declines are linked with the underlying neurodegeneration of frontal and/or temporal lobes due to diverse molecular pathologies. Initially, the accumulation of misfolded proteins targets specifically susceptible cell assemblies, leading to relatively focal neurodegeneration that later spreads throughout large-scale cortical networks. Here, we discuss the most recent clinical, neuropathological, imaging, and genetics findings in FTD-spectrum syndromes affecting the temporal lobe. We focus on the semantic variant of primary progressive aphasia and its mirror image, the right temporal variant of FTD. Incipient focal atrophy of the left anterior temporal lobe (ATL) manifests with predominant naming, word comprehension, reading, and object semantic deficits, while cases of predominantly right ATL atrophy present with impairments of socioemotional, nonverbal semantic, and person-specific knowledge. Overall, the observations in FTD allow for crucial clinical-anatomic inferences, shedding light on the role of the temporal lobes in both cognition and complex behaviors. The concerted activity of both ATLs is critical to ensure that percepts are translated into concepts, yet important hemispheric differences should be acknowledged. On one hand, the left ATL attributes meaning to linguistic, external stimuli, thus supporting goal-oriented, action-related behaviors (e.g., integrating sounds and letters into words). On the other hand, the right ATL assigns meaning to emotional, visceral stimuli, thus guiding socially relevant behaviors (e.g., integrating body sensations into feelings of familiarity).

The representational structure of mental states generalizes across target people and stimulus modalities

Each individual experiences mental states in their own idiosyncratic way, yet perceivers can accurately understand a huge variety of states across unique individuals. How do they accomplish this feat? Do people think about their own anger in the same ways as another person's anger? Is reading about someone's anxiety the same as seeing it? Here, we test the hypothesis that a common conceptual core unites mental state representations across contexts. Across three studies, participants judged the mental states of multiple targets, including a generic other, the self, a socially close other, and a socially distant other. Participants viewed mental state stimuli in multiple modalities, including written scenarios and images. Using representational similarity analysis, we found that brain regions associated with social cognition expressed stable neural representations of mental states across both targets and modalities. Together, these results suggest that people use stable models of mental states across different people and contexts.

The resilience of the developing reading system: multi-modal evidence of incident and recovery after a pediatric stroke

Decades of neuroscientific findings have elucidated the highly specialized brain areas involved in reading, especially along the ventral occipitotemporal stream where the critical step of recognizing words occurs. We report on a 14-year-old female with temporary dyslexia after a left ventral occipitotemporal ischemic stroke. Our longitudinal multimodal findings show that the resolution of the reading impairment was associated with heightened activity in the left posterior superior and inferior temporal gyri. Our findings highlight the role of the left inferior temporal gyrus in reading and the importance of perilesional and ipsilateral cortical areas for functional recovery after childhood stroke.

Reading: The Confluence of Vision and Language

The scientific study of reading has a rich history that spans disciplines from vision science to linguistics, psychology, cognitive neuroscience, neurology, and education. The study of reading can elucidate important general mechanisms in spatial vision, attentional control, object recognition, and perceptual learning, as well as the principles of plasticity and cortical topography. However, literacy also prompts the development of specific neural circuits to process a unique and artificial stimulus. In this review, we describe the sequence of operations that transforms visual features into language, how the key neural circuits are sculpted by experience during development, and what goes awry in children for whom learning to read is a struggle. Expected final online publication date for the Annual Review of Vision Science, Volume 7 is September 2021. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Reverse-engineering the cortical architecture for controlled semantic cognition

We employ a reverse-engineering approach to illuminate the neurocomputational building blocks that combine to support controlled semantic cognition: the storage and context-appropriate use of conceptual knowledge. By systematically varying the structure of a computational model and assessing the functional consequences, we identified the architectural properties that best promote some core functions of the semantic system. Semantic cognition presents a challenging test case, as the brain must achieve two seemingly contradictory functions: abstracting context-invariant conceptual representations across time and modalities, while producing specific context-sensitive behaviours appropriate for the immediate task. These functions were best achieved in models possessing a single, deep multimodal hub with sparse connections from modality-specific regions, and control systems acting on peripheral rather than deep network layers. The reverse-engineered model provides a unifying account of core findings in the cognitive neuroscience of controlled semantic cognition, including evidence from anatomy, neuropsychology and functional brain imaging.

Implicit, automatic semantic word categorisation in the left occipito-temporal cortex as revealed by fast periodic visual stimulation

Conceptual knowledge allows the categorisation of items according to their meaning beyond their physical similarities. This ability to respond to different stimuli (e.g., a leek, a cabbage, etc.) based on similar semantic representations (e.g., belonging to the vegetable category) is particularly important for language processing, because word meaning and the stimulus form are unrelated. The neural basis of this core human ability is debated and is complicated by the strong reliance of most neural measures on explicit tasks, involving many non-semantic processes. Here we establish an implicit method, i.e., fast periodic visual stimulation (FPVS) coupled with electroencephalography (EEG), to study neural conceptual categorisation processes with written word stimuli. Fourteen neurotypical participants were presented with different written words belonging to the same semantic category (e.g., different animals) alternating at 4 Hz rate. Words from a different semantic category (e.g., different cities) appeared every 4 stimuli (i.e., at 1 Hz). Following a few minutes of recording, objective electrophysiological responses at 1 Hz, highlighting the human brain’s ability to implicitly categorize stimuli belonging to distinct conceptual categories, were found over the left occipito-temporal region. Topographic differences were observed depending on whether the periodic change involved living items, associated with relatively more ventro-temporal activity as compared to non-living items associated with relatively more dorsal posterior activity. Overall, this study demonstrates the validity and high sensitivity of an implicit frequency-tagged marker of word-based semantic memory abilities.

Convergence of Modality Invariance and Attention Selectivity in the Cortical Semantic Circuit

The human linguistic system is characterized by modality invariance and attention selectivity. Previous studies have examined these properties independently and reported perisylvian region involvement for both; however, their relationship and the linguistic information they harbor remain unknown. Participants were assessed by functional magnetic resonance imaging, while spoken narratives (auditory) and written texts (visual) were presented, either separately or simultaneously. Participants were asked to attend to one stimulus when both were presented. We extracted phonemic and semantic features from these auditory and visual modalities, to train multiple, voxel-wise encoding models. Cross-modal examinations of the trained models revealed that perisylvian regions were associated with modality-invariant semantic representations. Attentional selectivity was quantified by examining the modeling performance for attended and unattended conditions. We have determined that perisylvian regions exhibited attention selectivity. Both modality invariance and attention selectivity are both prominent in models that use semantic but not phonemic features. Modality invariance was significantly correlated with attention selectivity in some brain regions; however, we also identified cortical regions associated with only modality invariance or only attention selectivity. Thus, paying selective attention to a specific sensory input modality may regulate the semantic information that is partly processed in brain networks that are shared across modalities.

Compensatory neuroadaptation to binge drinking: Human evidence for allostasis

Animal studies have established that acute alcohol increases neural inhibition and that frequent intoxication episodes elicit neuroadaptive changes in the excitatory/inhibitory neurotransmission balance. To compensate for the depressant effects of alcohol, neural hyperexcitability develops in alcohol use disorder and is manifested through withdrawal symptoms. It is unclear, however, whether neuroadaptive changes can be observed in young, emerging adults at lower levels of consumption in the absence of withdrawal symptoms. Here, we used an anatomically constrained magnetoencephalography method to assess cortical excitability in two independent sets of experiments. We measured early visual activity (1) in social drinkers during alcohol intoxication versus placebo conditions and (2) in parallel cohorts of sober binge drinkers (BDs) and light drinkers (LDs). Acute alcohol intoxication attenuated early sensory activity in the visual cortex in social drinkers, confirming its inhibitory effects on neurotransmission. In contrast, sober BDs showed greater neural responsivity compared with a matched group of LDs. A positive correlation between alcohol consumption and neural activity in BDs is indicative of cortical hyperexcitability associated with hazardous drinking. Furthermore, neural responsivity was positively correlated with alcohol intake in social drinkers whose drinking did not reach binge levels. This study provides novel evidence of compensatory imbalance reflected in the downregulation of inhibitory and upregulation of excitatory signaling associated with binge drinking in young, emerging adults. By contrasting acute effects and a history of BD, these results support the mechanistic model of allostasis. Direct neural measures are sensitive to synaptic currents and could serve as biomarkers of neuroadaptation.

The Graded Change in Connectivity across the Ventromedial Prefrontal Cortex Reveals Distinct Subregions

The functional heterogeneity of the ventromedial prefrontal cortex (vmPFC) suggests it may include distinct functional subregions. To date these have not been well elucidated. Regions with differentiable connectivity (and as a result likely dissociable functions) may be identified using emergent data-driven approaches. However, prior parcellations of the vmPFC have only considered hard splits between distinct regions, although both hard and graded connectivity changes may exist. Here we determine the full pattern of change in structural and functional connectivity across the vmPFC for the first time and extract core distinct regions. Both structural and functional connectivity varied along a dorsomedial to ventrolateral axis from relatively dorsal medial wall regions to relatively lateral basal orbitofrontal cortex. The pattern of connectivity shifted from default mode network to sensorimotor and multimodal semantic connections. This finding extends the classical distinction between primate medial and orbital regions by demonstrating a similar gradient in humans for the first time. Additionally, core distinct regions in the medial wall and orbitofrontal cortex were identified that may show greater correspondence to functional differences than prior hard parcellations. The possible functional roles of the orbitofrontal cortex and medial wall are discussed.

The temporal pole: From anatomy to function-A literature appraisal

Historically, the anterior part of the temporal lobe was labelled as a unique structure named Brain Area 38 by Brodmann or Temporopolar Area TG by Von Economo, but its functions were unknown at that time. Later on, a few studies proposed to divide the temporal pole in several different subparts, based on distinct cytoarchitectural structure or connectivity patterns, while a still growing number of studies have associated the temporal pole with many cognitive functions. In this review, we provide an overview of the temporal pole anatomical and histological structure and its various functions. We performed a literature review of articles published prior to September 30, 2020 that included 112 articles. The temporal pole has thereby been associated with several high-level cognitive processes: visual processing for complex objects and face recognition, autobiographic memory, naming and word-object labelling, semantic processing in all modalities, and socio-emotional processing, as demonstrated in healthy subjects and in patients with neurological or psychiatric diseases, especially in the field of neurodegenerative disorders. A good knowledge of those functions and the symptoms associated with temporal pole lesions or dysfunctions is helpful to identify these diseases, whose diagnosis may otherwise be difficult.

MEG Theta during Lexico-Semantic and Executive Processing Is Altered in High-Functioning Adolescents with Autism

Neuroimaging studies have revealed atypical activation during language and executive tasks in individuals with autism spectrum disorders (ASD). However, the spatiotemporal stages of processing associated with these dysfunctions remain poorly understood. Using an anatomically constrained magnetoencephalography approach, we examined event-related theta oscillations during a double-duty lexical decision task that combined demands on lexico-semantic processing and executive functions. Relative to typically developing peers, high-functioning adolescents with ASD had lower performance accuracy on trials engaging selective semantic retrieval and cognitive control. They showed an early overall theta increase in the left fusiform cortex followed by greater activity in the left-lateralized temporal (starting at ~250 ms) and frontal cortical areas (after ~450 ms) known to contribute to language processing. During response preparation and execution, the ASD group exhibited elevated theta in the anterior cingulate cortex, indicative of greater engagement of cognitive control. Simultaneously increased activity in the ipsilateral motor cortex may reflect a less lateralized and suboptimally organized motor circuitry. Spanning early sensory-specific and late response selection stages, the higher event-related theta responsivity in ASD may indicate compensatory recruitment to offset inefficient lexico-semantic retrieval under cognitively demanding conditions. Together, these findings provide further support for atypical language and executive functions in high-functioning ASD.

Rapid acquisition of novel written word-forms: ERP evidence

Background

Novel word acquisition is generally believed to be a rapid process, essential for ensuring a flexible and efficient communication system; at least in spoken language, learners are able to construct memory traces for new linguistic stimuli after just a few exposures. However, such rapid word learning has not been systematically found in visual domain, with different confounding factors obscuring the orthographic learning of novel words. This study explored the changes in human brain activity occurring online, during a brief training with novel written word-forms using a silent reading task

Results

Single-trial, cluster-based random permutation analysis revealed that training caused an extremely fast (after just one repetition) and stable facilitation in novel word processing, reflected in the modulation of P200 and N400 components, possibly indicating rapid dynamics at early and late stages of the lexical processing. Furthermore, neural source estimation of these effects revealed the recruitment of brain areas involved in orthographic and lexico-semantic processing, respectively.

Conclusions

These results suggest the formation of neural memory traces for novel written word-forms after a minimal exposure to them even in the absence of a semantic reference, resembling the rapid learning processes known to occur in spoken language.

Multimodal comprehension in left hemisphere stroke patients

Hand gestures, imagistically related to the content of speech, are ubiquitous in face-to-face communication. Here we investigated people with aphasia's (PWA) processing of speech accompanied by gestures using lesion-symptom mapping. Twenty-nine PWA and 15 matched controls were shown a picture of an object/action and then a video-clip of a speaker producing speech and/or gestures in one of the following combinations: speech-only, gesture-only, congruent speech-gesture, and incongruent speech-gesture. Participants' task was to indicate, in different blocks, whether the picture and the word matched (speech task), or whether the picture and the gesture matched (gesture task). Multivariate lesion analysis with Support Vector Regression Lesion-Symptom Mapping (SVR-LSM) showed that benefit for congruent speech-gesture was associated with 1) lesioned voxels in anterior fronto-temporal regions including inferior frontal gyrus (IFG), and sparing of posterior temporal cortex and lateral temporal-occipital regions (pTC/LTO) for the speech task, and 2) conversely, lesions to pTC/LTO and sparing of anterior regions for the gesture task. The two tasks did not share overlapping voxels. Costs from incongruent speech-gesture pairings were associated with lesioned voxels in these same anterior (for the speech task) and posterior (for the gesture task) regions, but crucially, also shared voxels in superior temporal gyrus (STG) and middle temporal gyrus (MTG), including the anterior temporal lobe. These results suggest that IFG and pTC/LTO contribute to extracting semantic information from speech and gesture, respectively; however, they are not causally involved in integrating information from the two modalities. In contrast, regions in anterior STG/MTG are associated with performance in both tasks and may thus be critical to speech-gesture integration. These conclusions are further supported by associations between performance in the experimental tasks and performance in tests assessing lexical-semantic processing and gesture recognition.

Meaning before grammar: A review of ERP experiments on the neurodevelopmental origins of semantic processing

According to traditional linguistic theories, the construction of complex meanings relies firmly on syntactic structure-building operations. Recently, however, new models have been proposed in which semantics is viewed as being partly autonomous from syntax. In this paper, we discuss some of the developmental implications of syntax-based and autonomous models of semantics. We review event-related brain potential (ERP) studies on semantic processing in infants and toddlers, focusing on experiments reporting modulations of N400 amplitudes using visual or auditory stimuli and different temporal structures of trials. Our review suggests that infants can relate or integrate semantic information from temporally overlapping stimuli across modalities by 6 months of age. The ability to relate or integrate semantic information over time, within and across modalities, emerges by 9 months. The capacity to relate or integrate information from spoken words in sequences and sentences appears by 18 months. We also review behavioral and ERP studies showing that grammatical and syntactic processing skills develop only later, between 18 and 32 months. These results provide preliminary evidence for the availability of some semantic processes prior to the full developmental emergence of syntax: non-syntactic meaning-building operations are available to infants, albeit in restricted ways, months before the abstract machinery of grammar is in place. We discuss this hypothesis in light of research on early language acquisition and human brain development.

Progress in Brain-Compatible Interfaces with Soft Nanomaterials

Neural interfaces facilitating communication between the brain and machines must be compatible with the soft, curvilinear, and elastic tissues of the brain and yet yield enough power to read and write information across a wide range of brain areas through high-throughput recordings or optogenetics. Biocompatible-material engineering has facilitated the development of brain-compatible neural interfaces to support built-in modulation of neural circuits and neurological disorders. Recent developments in brain-compatible neural interfaces that use soft nanomaterials more suitable for complex neural circuit analysis and modulation are reviewed. Preclinical tests of the compatibility and specificity of these interfaces in animal models are also discussed.

Taking the sublexical route: brain dynamics of reading in the semantic variant of primary progressive aphasia

Reading aloud requires mapping an orthographic form to a phonological one. The mapping process relies on sublexical statistical regularities (e.g. 'oo' to |uː|) or on learned lexical associations between a specific visual form and a series of sounds (e.g. yacht to/jɑt/). Computational, neuroimaging, and neuropsychological evidence suggest that sublexical, phonological and lexico-semantic processes rely on partially distinct neural substrates: a dorsal (occipito-parietal) and a ventral (occipito-temporal) route, respectively. Here, we investigated the spatiotemporal features of orthography-to-phonology mapping, capitalizing on the time resolution of magnetoencephalography and the unique clinical model offered by patients with semantic variant of primary progressive aphasia (svPPA). Behaviourally, patients with svPPA manifest marked lexico-semantic impairments including difficulties in reading words with exceptional orthographic to phonological correspondence (irregular words). Moreover, they present with focal neurodegeneration in the anterior temporal lobe, affecting primarily the ventral, occipito-temporal, lexical route. Therefore, this clinical population allows for testing of specific hypotheses on the neural implementation of the dual-route model for reading, such as whether damage to one route can be compensated by over-reliance on the other. To this end, we reconstructed and analysed time-resolved whole-brain activity in 12 svPPA patients and 12 healthy age-matched control subjects while reading irregular words (e.g. yacht) and pseudowords (e.g. pook). Consistent with previous findings that the dorsal route is involved in sublexical, phonological processes, in control participants we observed enhanced neural activity over dorsal occipito-parietal cortices for pseudowords, when compared to irregular words. This activation was manifested in the beta-band (12-30 Hz), ramping up slowly over 500 ms after stimulus onset and peaking at ∼800 ms, around response selection and production. Consistent with our prediction, svPPA patients did not exhibit this temporal pattern of neural activity observed in controls this contrast. Furthermore, a direct comparison of neural activity between patients and controls revealed a dorsal spatiotemporal cluster during irregular word reading. These findings suggest that the sublexical/phonological route is involved in processing both irregular and pseudowords in svPPA. Together these results provide further evidence supporting a dual-route model for reading aloud mediated by the interplay between lexico-semantic and sublexical/phonological neurocognitive systems. When the ventral route is damaged, as in the case of neurodegeneration affecting the anterior temporal lobe, partial compensation appears to be possible by over-recruitment of the slower, serial attention-dependent, dorsal one.