Neural network bases of thematic semantic processing in language production

Language and sensory characteristics are reflected in voice-evoked responses in low birth weight children

BACKGROUND

Children born with very low birth weight (VLBW) are at higher risk for cognitive impairment, including language deficits and sensorimotor difficulties. Voice-evoked response (P1m), which has been suggested as a language development biomarker in young children, remains unexplored for its efficacy in VLBW children. Furthermore, the relation between P1m and sensory difficulties in VLBW children remains unclear.

METHODS

40 children with VLBW were recruited at 5-to-6 years old (26 male, 14 female, mean age of months ± SD, 80.0 ± 4.9). We measured their voice-evoked brain response using child-customized magnetoencephalography (MEG) and examined the relation between P1m and language conceptual inference ability and sensory characteristics.

RESULTS

The final sample comprised 36 children (23 boys, 13 girls; ages 61-86 months; gestational ages 24-36 weeks). As a result of multiple regression analysis, voice-evoked P1m in the left hemisphere was correlated significantly with language ability (β = 0.414 P = 0.015) and sensory hypersensitivity (β = 0.471 P = 0.005).

CONCLUSION

Our findings indicate that the relation between P1m and language conceptual inference ability observed in term children in earlier studies is replicated in VLBW children, and suggests P1m intensity as a biomarker of sensory sensitivity characteristics.

IMPACT

We investigated brain functions related to language development and sensory problems in very low birth-weight children. In very low birth weight children at early school age, brain responses to human voices are associated with language conceptual inference ability and sensory hypersensitivity. These findings promote a physiological understanding of both language development and sensory characteristics in very low birth weight children.

Discourse- and lesion-based aphasia quotient estimation using machine learning

Discourse is a fundamentally important aspect of communication, and discourse production provides a wealth of information about linguistic ability. Aphasia commonly affects, in multiple ways, the ability to produce discourse. Comprehensive aphasia assessments such as the Western Aphasia Battery-Revised (WAB-R) are time- and resource-intensive. We examined whether discourse measures can be used to estimate WAB-R Aphasia Quotient (AQ), and whether this can serve as an ecologically valid, less resource-intensive measure. We used features extracted from discourse tasks using three AphasiaBank prompts involving expositional (picture description), story narrative, and procedural discourse. These features were used to train a machine learning model to predict the WAB-R AQ. We also compared and supplemented the model with lesion location information from structural neuroimaging. We found that discourse-based models could estimate AQ well, and that they outperformed models based on lesion features. Addition of lesion features to the discourse features did not improve the performance of the discourse model substantially. Inspection of the most informative discourse features revealed that different prompt types taxed different aspects of language. These findings suggest that discourse can be used to estimate aphasia severity, and provide insight into the linguistic content elicited by different types of discourse prompts.

Phase synchronization during the processing of taxonomic and thematic relations

Semantic relations include "taxonomic" relations based on shared features and "thematic" relations based on co-occurrence in events. The "dual-hub" account proposes that the anterior temporal lobe (ATL) is functionally specialized for taxonomic relations and the inferior parietal lobule (IPL) for thematic relations. This study examined this claim by analyzing the intra- and inter-region phase synchronization of intracranial EEG data from electrodes in the ATL, IPL, and two subregions of the semantic control network: left inferior frontal gyrus (IFG) and posterior middle temporal gyrus (pMTG). Ten participants with epilepsy completed a semantic relatedness judgment task during intracranial EEG recording and had electrodes in at least one hub and at least one semantic control region. Theta band phase synchronization was partially consistent with the dual-hub account: synchronization between the ATL and IFG/pMTG increased when processing taxonomic relations, and synchronization within the IPL and between IPL and pMTG increased when processing thematic relations.

Network-based statistics distinguish anomic and Broca's aphasia

INTRODUCTION

Aphasia is a speech-language impairment commonly caused by damage to the left hemisphere. The neural mechanisms that underpin different types of aphasia and their symptoms are still not fully understood. This study aims to identify differences in resting-state functional connectivity between anomic and Broca's aphasia measured through resting-state functional magnetic resonance imaging (rs-fMRI).

METHODS

We used the network-based statistic (NBS) method, as well as voxel- and connectome-based lesion symptom mapping (V-, CLSM), to identify distinct neural correlates of the anomic and Broca's groups. To control for lesion effect, we included lesion volume as a covariate in both the NBS method and LSM.

RESULTS

NBS identified a subnetwork located in the dorsal language stream bilaterally, including supramarginal gyrus, primary sensory, motor, and auditory cortices, and insula. The connections in the subnetwork were weaker in the Broca's group than the anomic group. The properties of the subnetwork were examined through complex network measures, which indicated that regions in right inferior frontal sulcus, right paracentral lobule, and bilateral superior temporal gyrus exhibit intensive interaction. Left superior temporal gyrus, right postcentral gyrus, and left supramarginal gyrus play an important role in information flow and overall communication efficiency. Disruption of this network underlies the constellation of symptoms associated with Broca's aphasia. Whole-brain CLSM did not detect any significant connections, suggesting an advantage of NBS when thousands of connections are considered. However, CLSM identified connections that differentiated Broca's from anomic aphasia when analysis was restricted to a hypothesized network of interest.

DISCUSSION

We identified novel signatures of resting-state brain network differences between groups of individuals with anomic and Broca's aphasia. We identified a subnetwork of connections that statistically differentiated the resting-state brain networks of the two groups, in comparison with standard CLSM results that yielded isolated connections. Network-level analyses are useful tools for the investigation of the neural correlates of language deficits post-stroke.

The right superior temporal gyrus plays a role in semantic-rule learning: Evidence supporting a reinforcement learning model

In real-life communication, individuals use language that carries evident rewarding and punishing elements, such as praise and criticism. A common trend is to seek more praise while avoiding criticism. Furthermore, semantics is crucial for conveying information, but such semantic access to native and foreign languages is subtly distinct. To investigate how rule learning occurs in different languages and to highlight the importance of semantics in this process, we investigated both verbal and non-verbal rule learning in first (L1) and second (L2) languages using a reinforcement learning framework, including a semantic rule and a color rule. Our computational modeling on behavioral and brain imaging data revealed that individuals may be more motivated to learn and adhere to rules in an L1 compared to L2, with greater striatum activation during the outcome phase in the L1. Additionally, results on the learning rates and inverse temperature in the two rule learning tasks showed that individuals tend to be conservative and are reluctant to change their judgments regarding rule learning of semantic information. Moreover, the greater the prediction errors, the greater activation of the right superior temporal gyrus in the semantic-rule learning condition, demonstrating that such learning has differential neural correlates than symbolic rule learning. Overall, the findings provide insight into the neural mechanisms underlying rule learning in different languages, and indicate that rule learning involving verbal semantics is not a general symbolic learning that resembles a conditioned stimulus-response, but rather has its own specific characteristics.

The spatiotemporal dynamics of semantic integration in the human brain

Language depends critically on the integration of lexical information across multiple words to derive semantic concepts. Limitations of spatiotemporal resolution have previously rendered it difficult to isolate processes involved in semantic integration. We utilized intracranial recordings in epilepsy patients (n = 58) who read written word definitions. Descriptions were either referential or non-referential to a common object. Semantically referential sentences enabled high frequency broadband gamma activation (70-150 Hz) of the inferior frontal sulcus (IFS), medial parietal cortex, orbitofrontal cortex (OFC) and medial temporal lobe in the left, language-dominant hemisphere. IFS, OFC and posterior middle temporal gyrus activity was modulated by the semantic coherence of non-referential sentences, exposing semantic effects that were independent of task-based referential status. Components of this network, alongside posterior superior temporal sulcus, were engaged for referential sentences that did not clearly reduce the lexical search space by the final word. These results indicate the existence of complementary cortical mosaics for semantic integration in posterior temporal and inferior frontal cortex.

Speech decoding from a small set of spatially segregated minimally invasive intracranial EEG electrodes with a compact and interpretable neural network

Objective. Speech decoding, one of the most intriguing brain-computer interface applications, opens up plentiful opportunities from rehabilitation of patients to direct and seamless communication between human species. Typical solutions rely on invasive recordings with a large number of distributed electrodes implanted through craniotomy. Here we explored the possibility of creating speech prosthesis in a minimally invasive setting with a small number of spatially segregated intracranial electrodes.Approach. We collected one hour of data (from two sessions) in two patients implanted with invasive electrodes. We then used only the contacts that pertained to a single stereotactic electroencephalographic (sEEG) shaft or an electrocorticographic (ECoG) stripe to decode neural activity into 26 words and one silence class. We employed a compact convolutional network-based architecture whose spatial and temporal filter weights allow for a physiologically plausible interpretation.Mainresults. We achieved on average 55% accuracy using only six channels of data recorded with a single minimally invasive sEEG electrode in the first patient and 70% accuracy using only eight channels of data recorded for a single ECoG strip in the second patient in classifying 26+1 overtly pronounced words. Our compact architecture did not require the use of pre-engineered features, learned fast and resulted in a stable, interpretable and physiologically meaningful decision rule successfully operating over a contiguous dataset collected during a different time interval than that used for training. Spatial characteristics of the pivotal neuronal populations corroborate with active and passive speech mapping results and exhibit the inverse space-frequency relationship characteristic of neural activity. Compared to other architectures our compact solution performed on par or better than those recently featured in neural speech decoding literature.Significance. We showcase the possibility of building a speech prosthesis with a small number of electrodes and based on a compact feature engineering free decoder derived from a small amount of training data.