Active perception: sensorimotor circuits as a cortical basis for language

The sound of thought: Form matters-The prosody of inner speech

This paper offers a new perspective on inner speech based on the theoretical framework of embodiment, focusing on the embodiment of structure rather than content. We argue that inner speech is used to simulate the acoustic aspects of overt speech including prosody. Prosody refers to the rhythm, intonation, and stress of spoken language, which is closely related to structural aspects of phrases, sentences, and larger language contexts such as discourse and narrative. We propose that inner speech gives form and structure to thought, and that this form is a necessary component of mental life. Thus, our paper opens with a review of the varieties of inner speech, followed by evidence concerning the form of inner speech, and finally, we discuss the functionality of inner speech. We consider cognitive and socio-emotional functions in which inner speech is involved and posit that inner speech serves as a simulation that maintains form and that this form serves different aspects of thought - attention, memory, emotion and self- regulation, social conceptualization, and narrative of self. In concluding, we address future research asking how inner speech contributes to making mental processes accessible to conscious thought, and whether accessibility to consciousness is related to form and structure.

Transcranial direct-current stimulation of core language areas facilitates novel word acquisition

Transcranial direct current stimulation (tDCS) is a non-invasive neuromodulation technique that can alter the state of the stimulated brain area and thereby affect neurocognitive processes and resulting behavioural performance. Previous studies have shown disparate results with respect to tDCS effects on language function, particularly with respect to language learning and word acquisition. To fill this gap, this study aimed at systematically addressing the effects of tDCS of core left-hemispheric language cortices on the brain mechanisms underpinning two main neurocognitive strategies of word learning: implicit inference-based Fast Mapping (FM) and direct instruction-based Explicit Encoding (EE). Prior to a word-learning session, 160 healthy participants were given 15 min of either anodal or cathodal tDCS of Wernicke's or Broca's areas, or a control sham (placebo) stimulation, using a between-group design. Each participant then learned 16 novel words (8 through FM and 8 through EE) in a contextual word-picture association session. Moreover, these words were learnt either perceptually via auditory exposure combined with a graphical image of the novel object, or in an articulatory mode, where the participants additionally had to overtly articulate the novel items. These learning conditions were fully counterbalanced across participants, stimuli and tDCS groups. Learning outcomes were tested at both lexical and semantic levels using two tasks: recognition and word-picture matching. EE and FM conditions produced similar outcomes, indicating comparable efficiency of the respective learning strategies. At the same time, articulatory learning produced generally better results than non-articulatory exposure, yielding higher recognition accuracies and shorter latencies in both tasks. Crucially, real tDCS led to global outcome improvements, demonstrated by faster (compared to sham) reactions, as well as some accuracy changes. There was also evidence of more specific tDCS effects: better word-recognition accuracy for EE vs. FM following cathodal stimulation as well as more expressed improvements in recognition accuracy and reaction times for anodal Broca's and cathodal Wernicke's stimulation, particularly for unarticulated FM items. These learning mode-specific effects support the notion of partially distinct brain mechanisms underpinning these two learning strategies. Overall, numerically largest improvements were observed for anodal Broca's tDCS, whereas the least expressed benefits of tDCS for learning were measured after anodal Wernicke stimulation. Finally, we did not find any inhibitory effects of either tDCS polarity in any of the comparisons. We conclude that tDCS of core language areas exerts a general facilitatory effect on new word acquisition with some limited specificity to learning protocols - the result that may be of potential applied value for future research aimed at ameliorating learning deficits and language disorders.

Context, transparency and culture in motor resonance phenomena: Causal evidence of the motor cortex

A connection between language and movement information in metaphorical and literal expressions activates the motor system. Despite numerous studies exploring distinctions between idioms and metaphors, a notable research gap remains in the specific effect of idioms with different transparency levels concerning motor resonance. Our primary focus was analysing the functional role of the primary motor cortex (M1) in processing hand motor verbs both in literal expressions and in two idiomatic contexts, i.e., opaque and transparent idioms. Additionally, we explored a potential language and cultural effect by comparing Turkish and Spanish speakers. An overt priming task with self-paced reading was used to judge the relatedness of a primer and a target sentence. We implemented a repetitive transcranial magnetic stimulation (TMS) protocol using continuous theta-burst stimulation (cTBS) compared to sham stimulation over the M1 in both Turkish and Spanish native speakers prior to the experimental task. Our findings reveal that the performance of Turkish and Spanish participants in processing hand motor actions was facilitated after the application of cTBS over the left M1. Moreover, brain stimulation specifically facilitated the processing of only transparent-but not opaque-idioms in both Spanish and Turkish participants. Our study reports distinct motor resonance results between different types of idioms with a parallel cross-cultural effect.

The value of action observation in speech and language rehabilitation: A systematic review and meta-analysis

In this systematic review and meta-analysis, our aim was to identify and quantify evidence of action observation therapy (AOT) efficacy in managing language deficits in patients with aphasia. This study conducts two quantitative investigations: firstly, comparing the effects of AOT and conventional control therapy in different groups, and secondly, analyzing within AOT group to explore potential moderators of AOT effectiveness. Four databases were searched up until August 2023 to find studies utilizing AOT for aphasia management. Seven eligible studies were included. The main analyses revealed moderate evidence of improvement in naming tasks, with a large effect size (Hedge's g = 1.27, 95 %CI [0.44; 2.09], p = 0.003, I2 < 25) following AOT compared to control interventions. Furthermore, to be efficient, AOT should focus on human actions (e.g., running, jumping) rather than non-human actions (e.g., meowing or barking). These findings indicate that AOT is a promising alternative complementary approach for patients with aphasia. Future research should confirm the potential benefits of AOT with more randomized controlled studies and aim to clarify the minimal dose necessary and the possibility of transfer to various language tasks.

Early Boost of Linguistic Skills? Individualized Non-Invasive Brain Stimulation in Early Postacute Aphasia

Non-invasive brain stimulation, such as transcranial direct current stimulation (tDCS), has been shown to increase the outcome of speech and language therapy (SLT) in chronic aphasia. Only a few studies have investigated the effect of add-on tDCS on SLT in the early stage of aphasia; this may be due to methodological reasons, in particular the influence of spontaneous remission and the difficulty of establishing stimulation protocols in clinical routines. Thirty-seven participants with subacute aphasia (PwA) after stroke (23 men, 14 women; mean age 62 ± 12 years; mean duration 49 ± 28 days) were included in two consecutive periods of treatment lasting two weeks each. During the first period (P1) the participants received 10 sessions of SLT, during the second period (P2) the aphasia therapy was supplemented by anodal left hemispheric 2 mA tDCS over the left hemisphere. Severity-specific language tests (Aachen Aphasia Test (AAT), n = 27 and Bielefeld Aphasia Screening-Reha (BIAS-R), n = 10) were administered before P1, between P1 and P2, and after P2. Where information was available, the results were corrected for spontaneous remission (AAT sample), and the therapy outcomes of P1 and P2 were compared. Participants' overall language abilities improved significantly during P1 and P2. However, improvement-as measured by the AAT profile level or the BIAS-R mean percentage value-during P2 (with tDCS) was significantly higher than during P1 (p < 0.001; AAT sample and p = 0.005; BIAS-R sample). Thus, tDCS protocols can be implemented in early aphasia rehabilitation. Despite the limitations of the research design, which are also discussed from an implementation science perspective, this is preliminary evidence that an individually tailored anodal tDCS can have a significant add-on effect on the outcome of behavioral aphasia therapy in subacute aphasia.

The prediction potential indexes the meaning and communicative function of upcoming utterances

Prediction has a fundamental role in language processing. However, predictions can be made at different levels, and it is not always clear whether speech sounds, morphemes, words, meanings, or communicative functions are anticipated during dialogues. Previous studies reported specific brain signatures of communicative pragmatic function, in particular enhanced brain responses immediately after encountering an utterance used to request an object from a partner, but relatively smaller ones when the same utterance was used for naming the object. The present experiment now investigates whether similar neuropragmatic signatures emerge in recipients before the onset of upcoming utterances carrying different predictable communicative functions. Trials started with a context question and object pictures displayed on the screen, raising the participant's expectation that words from a specific semantic category (food or tool) would subsequently be used to either name or request one of the objects. Already 600 msec before utterance onset, a larger prediction potential was observed when a request was anticipated relative to naming expectation. As this result is congruent with the neurophysiological difference previously observed right after the critical utterance, the anticipatory brain activity may index predictions about the social-communicative function of upcoming utterances. In addition, we also found that the predictable semantic category of the upcoming word was likewise reflected in the anticipatory brain potential. Thus, the neurophysiological characteristics of the prediction potential can capture different types of upcoming linguistic information, including semantic and pragmatic aspects of an upcoming utterance and communicative action.

Using Biosensors to Detect and Map Language Areas in the Brain for Individuals with Traumatic Brain Injury

The application of biosensors in neurolinguistics has significantly advanced the detection and mapping of language areas in the brain, particularly for individuals with brain trauma. This study explores the role of biosensors in this domain and proposes a conceptual model to guide their use in research and clinical practice. The researchers explored the integration of biosensors in language and brain function studies, identified trends in research, and developed a conceptual model based on cluster and thematic analyses. Using a mixed-methods approach, we conducted cluster and thematic analyses on data curated from Web of Science, Scopus, and SciSpace, encompassing 392 articles. This dual analysis facilitated the identification of research trends and thematic insights within the field. The cluster analysis highlighted Functional Magnetic Resonance Imaging (fMRI) dominance and the importance of neuroplasticity in language recovery. Biosensors such as the Magnes 2500 watt-hour (WH) neuromagnetometer and microwire-based sensors are reliable for real-time monitoring, despite methodological challenges. The proposed model synthesizes these findings, emphasizing biosensors' potential in preoperative assessments and therapeutic customization. Biosensors are vital for non-invasive, precise mapping of language areas, with fMRI and repetitive Transcranial Magnetic Stimulation (rTMS) playing pivotal roles. The conceptual model serves as a strategic framework for employing biosensors and improving neurolinguistic interventions. This research may enhance surgical planning, optimize recovery therapies, and encourage technological advancements in biosensor precision and application protocols.

Mendelian randomization analyses support causal relationships between tinnitus of different stages and severity and structural characteristics of specific brain regions

This study aims to delineate the causal relationships between idiopathic tinnitus in different stages and severity and the morphological properties in specific brain regions. We utilized a two-sample bidirectional Mendelian randomization (MR) analysis to ascertain the causal effects of brain structural attributes on varying severities and stages of tinnitus. Our approach involved harnessing genetic variables derived from extensive genome-wide association studies as instrumental variables, centered mainly on pertinent single-nucleotide polymorphisms associated with tinnitus. Subsequently, we integrated this data with brain structural imaging inputs to facilitate the MR analysis. We also applied reverse MR analysis to pinpoint the critical brain regions implicated in the onset of tinnitus. Our analysis revealed a demonstrable causal relationship between tinnitus and brain structural alterations, including changes primarily within the auditory cortex and hub regions of the limbic system, as well as portions of the frontal-temporal-occipital circuit. We found that individuals exhibiting cortical thickness alterations in the bilateral peri-calcarine and right superior occipital gyrus might have previously experienced tinnitus. Changes in the cortical areas of the right rectus, left inferior frontal gyrus, and right pars-orbitalis appeared unrelated to tinnitus. Furthermore, moderate tinnitus patients showed more pronounced structural alterations. This study substantiates that tinnitus could instigate substantial structural alterations mainly within the auditory-limbic-frontal-visual system, while the reciprocal causality was not supported. Moreover, the data underscores that moderate, rather than severe, tinnitus precipitates the most significant structural changes. Morphological alterations in several specific brain areas either indicate a history of tinnitus or bear no relation to it.

Enhancing speech perception in noise through articulation

Considerable debate exists about the interplay between auditory and motor speech systems. Some argue for common neural mechanisms, whereas others assert that there are few shared resources. In four experiments, we tested the hypothesis that priming the speech motor system by repeating syllable pairs aloud improves subsequent syllable discrimination in noise compared with a priming discrimination task involving same-different judgments via button presses. Our results consistently showed that participants who engaged in syllable repetition performed better in syllable discrimination in noise than those who engaged in the priming discrimination task. This gain in accuracy was observed for primed and new syllable pairs, highlighting increased sensitivity to phonological details. The benefits were comparable whether the priming tasks involved auditory or visual presentation. Inserting a 1-h delay between the priming tasks and the syllable-in-noise task, the benefits persisted but were confined to primed syllable pairs. Finally, we demonstrated the effectiveness of this approach in older adults. Our findings substantiate the existence of a speech production-perception relationship. They also have clinical relevance as they raise the possibility of production-based interventions to improve speech perception ability. This would be particularly relevant for older adults who often encounter difficulties in perceiving speech in noise.

Continuous Theta-Burst Stimulation on the Left Posterior Inferior Frontal Gyrus Perturbs Complex Syntactic Processing Stability in Mandarin Chinese

The structure of human language is inherently hierarchical. The left posterior inferior frontal gyrus (LpIFG) is proposed to be a core region for constructing syntactic hierarchies. However, it remains unclear whether LpIFG plays a causal role in syntactic processing in Mandarin Chinese and whether its contribution depends on syntactic complexity, working memory, or both. We addressed these questions by applying inhibitory continuous theta-burst stimulation (cTBS) over LpIFG. Thirty-two participants processed sentences containing embedded relative clauses (i.e., complex syntactic processing), syntactically simpler coordinated sentences (i.e., simple syntactic processing), and non-hierarchical word lists (i.e., word list processing) after receiving real or sham cTBS. We found that cTBS significantly increased the coefficient of variation, a representative index of processing stability, in complex syntactic processing (esp., when subject relative clause was embedded) but not in the other two conditions. No significant changes in d' and reaction time were detected in these conditions. The findings suggest that (a) inhibitory effect of cTBS on the LpIFG might be prominent in perturbing the complex syntactic processing stability but subtle in altering the processing quality; and (b) the causal role of the LpIFG seems to be specific for syntactic processing rather than working memory capacity, further evidencing their separability in LpIFG. Collectively, these results support the notion of the LpIFG as a core region for complex syntactic processing across languages.

The role of embodied cognition in action language comprehension in L1 and L2

In this study we carried out a behavioral experiment comparing action language comprehension in L1 (Italian) and L2 (English). Participants were Italian native speakers who had acquired the second language late (after the age of 10). They performed semantic judgments on L1 and L2 literal, idiomatic and metaphorical action sentences after viewing a video of a hand performing an action that was related or unrelated to the verb used in the sentence. Results showed that responses to literal and metaphorical L1 sentences were faster when the action depicted was related to the verb used rather than when the action depicted was unrelated to the verb used. No differences were found for the idiomatic condition. In L2 we found that all responses to the three conditions were facilitated when the action depicted was related to the verb used. Moreover, we found that the difference between the unrelated and the related modalities was greater in L2 than in L1 for the literal and the idiomatic condition but not for the metaphorical condition. These findings are consistent with the embodied cognition hypothesis of language comprehension.

Infants' brain responses to social interaction predict future language growth

In face-to-face interactions with infants, human adults exhibit a species-specific communicative signal. Adults present a distinctive "social ensemble": they use infant-directed speech (parentese), respond contingently to infants' actions and vocalizations, and react positively through mutual eye-gaze and smiling. Studies suggest that this social ensemble is essential for initial language learning. Our hypothesis is that the social ensemble attracts attentional systems to speech and that sensorimotor systems prepare infants to respond vocally, both of which advance language learning. Using infant magnetoencephalography (MEG), we measure 5-month-old infants' neural responses during live verbal face-to-face (F2F) interaction with an adult (social condition) and during a control (nonsocial condition) in which the adult turns away from the infant to speak to another person. Using a longitudinal design, we tested whether infants' brain responses to these conditions at 5 months of age predicted their language growth at five future time points. Brain areas involved in attention (right hemisphere inferior frontal, right hemisphere superior temporal, and right hemisphere inferior parietal) show significantly higher theta activity in the social versus nonsocial condition. Critical to theory, we found that infants' neural activity in response to F2F interaction in attentional and sensorimotor regions significantly predicted future language development into the third year of life, more than 2 years after the initial measurements. We develop a view of early language acquisition that underscores the centrality of the social ensemble, and we offer new insight into the neurobiological components that link infants' language learning to their early brain functioning during social interaction.

The impact of early and late blindness on language and verbal working memory: A brain-constrained neural model

Neural circuits related to language exhibit a remarkable ability to reorganize and adapt in response to visual deprivation. Particularly, early and late blindness induce distinct neuroplastic changes in the visual cortex, repurposing it for language and semantic processing. Interestingly, these functional changes provoke a unique cognitive advantage - enhanced verbal working memory, particularly in early blindness. Yet, the underlying neuromechanisms and the impact on language and memory-related circuits remain not fully understood. Here, we applied a brain-constrained neural network mimicking the structural and functional features of the frontotemporal-occipital cortices, to model conceptual acquisition in early and late blindness. The results revealed differential expansion of conceptual-related neural circuits into deprived visual areas depending on the timing of visual loss, which is most prominent in early blindness. This neural recruitment is fundamentally governed by the biological principles of neural circuit expansion and the absence of uncorrelated sensory input. Critically, the degree of these changes is constrained by the availability of neural matter previously allocated to visual experiences, as in the case of late blindness. Moreover, we shed light on the implication of visual deprivation on the neural underpinnings of verbal working memory, revealing longer reverberatory neural activity in 'blind models' as compared to the sighted ones. These findings provide a better understanding of the interplay between visual deprivations, neuroplasticity, language processing and verbal working memory.

How does the human brain process noisy speech in real life? Insights from the second-person neuroscience perspective

Comprehending speech with the existence of background noise is of great importance for human life. In the past decades, a large number of psychological, cognitive and neuroscientific research has explored the neurocognitive mechanisms of speech-in-noise comprehension. However, as limited by the low ecological validity of the speech stimuli and the experimental paradigm, as well as the inadequate attention on the high-order linguistic and extralinguistic processes, there remains much unknown about how the brain processes noisy speech in real-life scenarios. A recently emerging approach, i.e., the second-person neuroscience approach, provides a novel conceptual framework. It measures both of the speaker's and the listener's neural activities, and estimates the speaker-listener neural coupling with regarding of the speaker's production-related neural activity as a standardized reference. The second-person approach not only promotes the use of naturalistic speech but also allows for free communication between speaker and listener as in a close-to-life context. In this review, we first briefly review the previous discoveries about how the brain processes speech in noise; then, we introduce the principles and advantages of the second-person neuroscience approach and discuss its implications to unravel the linguistic and extralinguistic processes during speech-in-noise comprehension; finally, we conclude by proposing some critical issues and calls for more research interests in the second-person approach, which would further extend the present knowledge about how people comprehend speech in noise.

The Role of the Motor System in L1 and L2 Action Verb Processing for Chinese Learners of English: Evidence from Mu Rhythm Desynchronization

The nature of semantic representation has long been a key question in linguistic research. The Embodied Cognition theory challenges the traditional view of language representation, stating that semantic information stems from the sensory-motor cortex, which is activated automatically during semantic processing. However, most of the evidence comes from monolingual studies; it remains unclear whether second-language (L2) comprehension involves different semantic representations or mirrors the pattern seen in first-language (L1) processing. Therefore, the present study investigated the role of the sensory-motor system in language processing via making Electroencephalography (EEG) recordings during the processing of L1 and L2 action verbs. The results showed that L1 (Chinese) action verbs generated higher mu-event-related desynchronization (ERD) than L1 abstract verbs in the early processing stage (250 ms after verb presentation), and the same phenomenon was also observed for L2 (English). The results also indicated that language modulated the processing of action verbs, with L1 action verbs eliciting stronger ERD than L2 action verbs. These results demonstrate that the sensory-motor cortex plays a crucial role in comprehending both L1 and L2 action verbs.

Predicting and coding sound into action translation in spinal cord injured people

Motor activation in response to perception of action-related stimuli may depend on a resonance mechanism subserving action understanding. The extent to which this mechanism is innate or learned from sensorimotor experience is still unclear. Here, we recorded EEG while people with paraplegia or tetraplegia consequent to spinal cord injury (SCI) and healthy control participants were presented with action sounds produced by body parts (mouth, hands or feet) that were or were not affected by SCI. Non-action sounds were used as further control. We observed reduced brain activation in subjects affected by SCI at both pre- and post-stimulus latencies specifically for those actions whose effector was disconnected by the spinal lesion (i.e., hand sound for tetraplegia and leg sound for both paraplegia and tetraplegia). Correlation analyses showed that these modulations were functionally linked with the chronicity of the lesion, indicating that the longer the time the lesion- EEG data acquisition interval and/or the more the lesion occurred at a young age, the weaker was the cortical activity in response to these action sounds. Tellingly, source estimations confirmed that these modulations originated from a deficit in the motor resonance mechanism, by showing diminished activity in premotor (during prediction and perception) and near the primary motor (during perception) areas. Such dissociation along the cortical hierarchy is consistent with both previous reports in healthy subjects and with hierarchical predictive coding accounts. Overall, these data expand on the notion that sensorimotor experience maintains the cortical representations relevant to anticipate and perceive action-related stimuli.

Neural specialization for 'visual' concepts emerges in the absence of vision

Vision provides a key source of information about many concepts, including 'living things' (e.g., tiger) and visual events (e.g., sparkle). According to a prominent theoretical framework, neural specialization for different conceptual categories is shaped by sensory features, e.g., living things are neurally dissociable from navigable places because living things concepts depend more on visual features. We tested this framework by comparing the neural basis of 'visual' concepts across sighted (n=22) and congenitally blind (n=21) adults. Participants judged the similarity of words varying in their reliance on vision while undergoing fMRI. We compared neural responses to living things nouns (birds, mammals) and place nouns (natural, manmade). In addition, we compared visual event verbs (e.g., 'sparkle') to non-visual events (sound emission, hand motion, mouth motion). People born blind exhibited distinctive univariate and multivariate responses to living things in a temporo-parietal semantic network activated by nouns, including the precuneus (PC). To our knowledge, this is the first demonstration that neural selectivity for living things does not require vision. We additionally observed preserved neural signatures of 'visual' light events in the left middle temporal gyrus (LMTG+). Across a wide range of semantic types, neural representations of sensory concepts develop independent of sensory experience.

Music Rhythmic Cueing for the Production of Non-native Speech Rhythm: Evidence from Chinese Learners of French

The present study examined the cross-modal cueing effect of musical rhythmic beats on non-native speech rhythm production. Two groups of Chinese learners of French were cued respectively with rhythmic beats that either matched (matching group) or mismatched (mismatching group) the rhythm patterns of the target French sentences. The participants were asked to produce the target sentences after cueing and their speech production was compared with their baseline condition in which no cueing was used. The results showed that the matching group produced the target French rhythm significantly better after cueing with musical rhythmic beats that matched the French rhythm, in contrast to the mismatching group where no significant improvement was found. Individual differences in auditory short-term memory and rhythmic skills were not related to improvement in producing French rhythm after cueing. The results suggest that musical rhythmic cueing can be used to improve non-native speech rhythm production, further indicating a close link between speech and music in the temporal domain.

Receptive language and receptive-expressive discrepancy in minimally verbal autistic children and adolescents

Among the approximately one-third of autistic individuals who experience considerable challenges in acquiring spoken language and are minimally verbal (MV), relatively little is known about the range of their receptive language abilities. This study included 1579 MV autistic children and adolescents between 5 and 18 years of age drawn from the National Database for Autism Research and the SFARI Base data repository. MV autistic children and adolescents demonstrated significantly lower receptive language compared to the norms on standardized language assessment and parent report measures. Moreover, their receptive language gap widened with age. Overall, our sample demonstrated significantly better receptive than expressive language. However, at the individual level, only about 25% of MV autistic children and adolescents demonstrated significantly better receptive language relative to their minimal expressive levels. Social skills explained a significant proportion of the variance in parent-reported receptive language skills, while motor skills were the most significant predictor of greater receptive-expressive discrepancy. Findings from this study revealed the heterogeneous language profiles in MV autistic children and adolescents, underscoring the importance of individualizing interventions to match their different communication strengths and needs and integrating multiple interconnected areas to optimize their overall development of language comprehension, socialization, and general motor skills.

Motor experience modulates neural processing of lexical action language: Evidence from rugby players

The perceptual symbol theory proposes a sensorimotor simulation in language processing, emphasizing the role of motor experience. However, the neural basis of motor experience on lexical-level language processing remains little known. In the current fMRI study, we compared brain activation and task-based functional connectivity in 28 rugby players and 28 novices during rugby- specialized and daily verb processing. Distinct differences were observed between the two groups in the bilateral superior temporal gyrus and left angular gyrus regions during specialized verb processing. Notably, intergroup functional connectivity was evident between the left superior temporal gyrus and the right precentral gyrus during specialized verb processing. This study contributes insights into the neural responses and connectivity patterns associated with motor experience at the lexical level, highlighting its potential impact on language processing.

Syntax matters in shaping sensorimotor activation driven by nouns

Existing evidence has shown that adjectives modulate the grasp-compatibility effect elicited by object nouns. The aim of the present study was to investigate the role of syntax on the sensorimotor activation elicited by nouns in a grasp-compatibility task. We assessed two languages with different syntactic rules, Italian in Experiment 1 and English in Experiment 2. In both experiments, an adjective-noun pair was shown on the screen. The adjective was always in a pre-nominal position and denoted either a disadvantageous quality of the object graspability (e.g., sharp) or the object colour (e.g., reddish). Participants had to categorize the object nouns as natural or artifact, performing a precision or a power reach-to-grasp movement. On different trials, the grasp response was compatible or incompatible with the grip typically used to manipulate the object indicated by the noun. In Experiment 1 (Italian language) the adjective-noun order violated the syntactic order and no difference emerged between reaction times on compatible and incompatible trials (no grasp compatibility effect). In Experiment 2 (English language), the adjective-noun order followed the syntactic rule. Results showed a grasp-compatibility effect when a colour adjective was presented before a natural object noun. When a disadvantageous adjective preceded an artifact or a natural object noun, an inverted grasp-compatibility effect emerged with slower responses on compatible than incompatible trials. Taken together, these findings suggest that adjectives can shape the sensorimotor activation elicited by nouns of graspable objects only when the syntax is correct. Results are discussed with respect to embodied cognition theories.

Characteristics of different Mandarin pronunciation element perception: evidence based on a multifeature paradigm for recording MMN and P3a components of phonemic changes in speech sounds

Background

As a tonal language, Mandarin Chinese has the following pronunciation elements for each syllable: the vowel, consonant, tone, duration, and intensity. Revealing the characteristics of auditory-related cortical processing of these different pronunciation elements is interesting.

Methods

A Mandarin pronunciation multifeature paradigm was designed, during which a standard stimulus and five different phonemic deviant stimuli were presented. The electroencephalogram (EEG) data were recorded with 256-electrode high-density EEG equipment. Time-domain and source localization analyses were conducted to demonstrate waveform characteristics and locate the sources of the cortical processing of mismatch negativity (MMN) and P3a components following different stimuli.

Results

Vowel and consonant differences elicited distinct MMN and P3a components, but tone and duration differences did not. Intensity differences elicited distinct MMN components but not P3a components. For MMN and P3a components, the activated cortical areas were mainly in the frontal-temporal lobe. However, the regions and intensities of the cortical activation were significantly different among the components for the various deviant stimuli. The activated cortical areas of the MMN and P3a components elicited by vowels and consonants seemed to be larger and show more intense activation.

Conclusion

The auditory processing centers use different auditory-related cognitive resources when processing different Mandarin pronunciation elements. Vowels and consonants carry more information for speech comprehension; moreover, more neurons in the cortex may be involved in the recognition and cognitive processing of these elements.

A Chinese verb semantic feature dataset (CVFD)

Language is an advanced cognitive function of humans, and verbs play a crucial role in language. To understand how the human brain represents verbs, it is critical to analyze what knowledge humans have about verbs. Thus, several verb feature datasets have been developed in different languages such as English, Spanish, and German. However, there is still a lack of a dataset of Chinese verbs. In this study, we developed a semantic feature dataset of 1140 Chinese Mandarin verbs (CVFD) with 11 dimensions including verb familiarity, agentive subject, patient, action effector, perceptual modality, instrumentality, emotional valence, action imageability, action complexity, action intensity, and the usage scenario of action. We calculated the semantic features of each verb and the correlation between dimensions. We also compared the difference between action, mental, and other verbs and gave some examples about how to use CVFD to classify verbs according to different dimensions. Finally, we discussed the potential applications of CVFD in the fields of neuroscience, psycholinguistics, cultural differences, and artificial intelligence. All the data can be found at https://osf.io/pv29z/ .

Role of articulatory motor networks in perceptual categorization of speech signals: a 7T fMRI study

Speech and language processing involve complex interactions between cortical areas necessary for articulatory movements and auditory perception and a range of areas through which these are connected and interact. Despite their fundamental importance, the precise mechanisms underlying these processes are not fully elucidated. We measured BOLD signals from normal hearing participants using high-field 7 Tesla fMRI with 1-mm isotropic voxel resolution. The subjects performed 2 speech perception tasks (discrimination and classification) and a speech production task during the scan. By employing univariate and multivariate pattern analyses, we identified the neural signatures associated with speech production and perception. The left precentral, premotor, and inferior frontal cortex regions showed significant activations that correlated with phoneme category variability during perceptual discrimination tasks. In addition, the perceived sound categories could be decoded from signals in a region of interest defined based on activation related to production task. The results support the hypothesis that articulatory motor networks in the left hemisphere, typically associated with speech production, may also play a critical role in the perceptual categorization of syllables. The study provides valuable insights into the intricate neural mechanisms that underlie speech processing.

The Italian Sensorimotor Norms: Perception and action strength measures for 959 words

Neuroscience research has provided evidence that semantic information is stored in a distributed brain network involved in sensorimotor and linguistic processing. More specifically, according to the embodied cognition accounts, the representation of concepts is deemed as grounded in our bodily states. For these reasons, normative measures of words should provide relevant information about the extent to which each word embeds perceptual and action properties. In the present study, we collected ratings for 959 Italian nouns and verbs from 398 volunteers, recruited via an online platform. The words were mostly taken from the Italian adaptation of the Affective Norms for English Words (ANEW). A pool of 145 verbs was added to the original set. All the words were rated on 11 sensorimotor dimensions: six perceptual modalities (vision, audition, taste, smell, touch, and interoception) and five effectors (hand-arm, foot-leg, torso, mouth, head). The new verbs were also rated on the ANEW dimensions. Results showed good reliability and consistency with previous studies. Relations between perceptual and motor dimensions are described and interpreted, along with relations between the sensorimotor and the affective dimensions. The currently developed dataset represents an important novelty, as it includes different word classes, i.e., both nouns and verbs, and integrates ratings of both sensorimotor and affective dimensions, along with other psycholinguistic parameters; all features only partially accomplished in previous studies.

Linguistic Illusions Guide Eye Movement: Evidence From Doubling

Across languages, certain phonological patterns are preferred to others (e.g., blog > lbog). But whether such preferences arise from abstract linguistic constraints or sensorimotor pressures is controversial. We address this debate by examining the constraints on doubling (e.g., slaflaf, generally, XX). Doubling demonstrably elicits conflicting responses (aversion or preference), depending on the linguistic level of analysis (phonology vs. morphology). Since the stimulus remains unchanged, the shifting responses imply abstract constraints. Here, we ask whether these constraints apply online, in eye movements. Experiment 1 shows that, in bare phonological forms, doubling is dispreferred, and correspondingly it elicits shorter fixations. Remarkably, when doubling signals morphological plurality, the aversion shifts into preference, in Experiment 2. Our results demonstrate for the first time that the constraints on doubling apply online. These findings are consistent with the hypothesis that phonological knowledge arises, in part, from an abstract linguistic source.

Breakdown of category-specific word representations in a brain-constrained neurocomputational model of semantic dementia

The neurobiological nature of semantic knowledge, i.e., the encoding and storage of conceptual information in the human brain, remains a poorly understood and hotly debated subject. Clinical data on semantic deficits and neuroimaging evidence from healthy individuals have suggested multiple cortical regions to be involved in the processing of meaning. These include semantic hubs (most notably, anterior temporal lobe, ATL) that take part in semantic processing in general as well as sensorimotor areas that process specific aspects/categories according to their modality. Biologically inspired neurocomputational models can help elucidate the exact roles of these regions in the functioning of the semantic system and, importantly, in its breakdown in neurological deficits. We used a neuroanatomically constrained computational model of frontotemporal cortices implicated in word acquisition and processing, and adapted it to simulate and explain the effects of semantic dementia (SD) on word processing abilities. SD is a devastating, yet insufficiently understood progressive neurodegenerative disease, characterised by semantic knowledge deterioration that is hypothesised to be specifically related to neural damage in the ATL. The behaviour of our brain-based model is in full accordance with clinical data-namely, word comprehension performance decreases as SD lesions in ATL progress, whereas word repetition abilities remain less affected. Furthermore, our model makes predictions about lesion- and category-specific effects of SD: our simulation results indicate that word processing should be more impaired for object- than for action-related words, and that degradation of white matter should produce more severe consequences than the same proportion of grey matter decay. In sum, the present results provide a neuromechanistic explanatory account of cortical-level language impairments observed during the onset and progress of semantic dementia.

A perceptual control theory of emotional action

A theory is proposed that views emotional feelings as pivotal for action control. Feelings of emotions are valued interoceptive signals from the body that become multimodally integrated with perceptual contents from registered and mentally simulated events. During the simulation of a perceptual change from one event to the next, a conative feeling signal is created that codes for the wanting of a specific perceptual change. A wanted perceptual change is weighted more strongly than alternatives, increasing its activation level on the cognitive level and that of associated motor structures that produced this perceptual change in the past. As a consequence, a tendency for action is generated that is directed at the production of the wanted perception.

Neurobiological mechanisms for language, symbols and concepts: Clues from brain-constrained deep neural networks

Neural networks are successfully used to imitate and model cognitive processes. However, to provide clues about the neurobiological mechanisms enabling human cognition, these models need to mimic the structure and function of real brains. Brain-constrained networks differ from classic neural networks by implementing brain similarities at different scales, ranging from the micro- and mesoscopic levels of neuronal function, local neuronal links and circuit interaction to large-scale anatomical structure and between-area connectivity. This review shows how brain-constrained neural networks can be applied to study in silico the formation of mechanisms for symbol and concept processing and to work towards neurobiological explanations of specifically human cognitive abilities. These include verbal working memory and learning of large vocabularies of symbols, semantic binding carried by specific areas of cortex, attention focusing and modulation driven by symbol type, and the acquisition of concrete and abstract concepts partly influenced by symbols. Neuronal assembly activity in the networks is analyzed to deliver putative mechanistic correlates of higher cognitive processes and to develop candidate explanations founded in established neurobiological principles.

Grammatical Parallelism in Aphasia: A Lesion-Symptom Mapping Study

Sentence structure, or syntax, is potentially a uniquely creative aspect of the human mind. Neuropsychological experiments in the 1970s suggested parallel syntactic production and comprehension deficits in agrammatic Broca's aphasia, thought to result from damage to syntactic mechanisms in Broca's area in the left frontal lobe. This hypothesis was sometimes termed overarching agrammatism, converging with developments in linguistic theory concerning central syntactic mechanisms supporting language production and comprehension. However, the evidence supporting an association among receptive syntactic deficits, expressive agrammatism, and damage to frontal cortex is equivocal. In addition, the relationship among a distinct grammatical production deficit in aphasia, paragrammatism, and receptive syntax has not been assessed. We used lesion-symptom mapping in three partially overlapping groups of left-hemisphere stroke patients to investigate these issues: grammatical production deficits in a primary group of 53 subjects and syntactic comprehension in larger sample sizes (N = 130, 218) that overlapped with the primary group. Paragrammatic production deficits were significantly associated with multiple analyses of syntactic comprehension, particularly when incorporating lesion volume as a covariate, but agrammatic production deficits were not. The lesion correlates of impaired performance of syntactic comprehension were significantly associated with damage to temporal lobe regions, which were also implicated in paragrammatism, but not with the inferior and middle frontal regions implicated in expressive agrammatism. Our results provide strong evidence against the overarching agrammatism hypothesis. By contrast, our results suggest the possibility of an alternative grammatical parallelism hypothesis rooted in paragrammatism and a central syntactic system in the posterior temporal lobe.

Non-Invasive Mapping of the Neuronal Networks of Language

This review consists of three main sections. In the first, the Introduction, the main theories of the neuronal mediation of linguistic operations, derived mostly from studies of the effects of focal lesions on linguistic performance, are summarized. These models furnish the conceptual framework on which the design of subsequent functional neuroimaging investigations is based. In the second section, the methods of functional neuroimaging, especially those of functional Magnetic Resonance Imaging (fMRI) and of Magnetoencephalography (MEG), are detailed along with the specific activation tasks employed in presurgical functional mapping. The reliability of these non-invasive methods and their validity, judged against the results of the invasive methods, namely, the "Wada" procedure and Cortical Stimulation Mapping (CSM), is assessed and their use in presurgical mapping is justified. In the third and final section, the applications of fMRI and MEG in basic research are surveyed in the following six sub-sections, each dealing with the assessment of the neuronal networks for (1) the acoustic and phonological, (2) for semantic, (3) for syntactic, (4) for prosodic operations, (5) for sign language and (6) for the operations of reading and the mechanisms of dyslexia.

Ecological Meanings: A Consensus Paper on Individual Differences and Contextual Influences in Embodied Language

Embodied theories of cognition consider many aspects of language and other cognitive domains as the result of sensory and motor processes. In this view, the appraisal and the use of concepts are based on mechanisms of simulation grounded on prior sensorimotor experiences. Even though these theories continue receiving attention and support, increasing evidence indicates the need to consider the flexible nature of the simulation process, and to accordingly refine embodied accounts. In this consensus paper, we discuss two potential sources of variability in experimental studies on embodiment of language: individual differences and context. Specifically, we show how factors contributing to individual differences may explain inconsistent findings in embodied language phenomena. These factors include sensorimotor or cultural experiences, imagery, context-related factors, and cognitive strategies. We also analyze the different contextual modulations, from single words to sentences and narratives, as well as the top-down and bottom-up influences. Similarly, we review recent efforts to include cultural and language diversity, aging, neurodegenerative diseases, and brain disorders, as well as bilingual evidence into the embodiment framework. We address the importance of considering individual differences and context in clinical studies to drive translational research more efficiently, and we indicate recommendations on how to correctly address these issues in future research. Systematically investigating individual differences and context may contribute to understanding the dynamic nature of simulation in language processes, refining embodied theories of cognition, and ultimately filling the gap between cognition in artificial experimental settings and cognition in the wild (i.e., in everyday life).

Evolutionary neuroanatomical expansion of Broca's region serving a human-specific function

The question concerning the evolution of language is directly linked to the debate on whether language and action are dependent or not and to what extent Broca's region serves as a common neural basis. The debate resulted in two opposing views, one arguing for and one against the dependence of language and action mainly based on neuroscientific data. This article presents an evolutionary neuroanatomical framework which may offer a solution to this dispute. It is proposed that in humans, Broca's region houses language and action independently in spatially separated subregions. This became possible due to an evolutionary expansion of Broca's region in the human brain, which was not paralleled by a similar expansion in the chimpanzee's brain, providing additional space needed for the neural representation of language in humans.

Cortical networks for recognition of speech with simultaneous talkers

The relative contributions of superior temporal vs. inferior frontal and parietal networks to recognition of speech in a background of competing speech remain unclear, although the contributions themselves are well established. Here, we use fMRI with spectrotemporal modulation transfer function (ST-MTF) modeling to examine the speech information represented in temporal vs. frontoparietal networks for two speech recognition tasks with and without a competing talker. Specifically, 31 listeners completed two versions of a three-alternative forced choice competing speech task: "Unison" and "Competing", in which a female (target) and a male (competing) talker uttered identical or different phrases, respectively. Spectrotemporal modulation filtering (i.e., acoustic distortion) was applied to the two-talker mixtures and ST-MTF models were generated to predict brain activation from differences in spectrotemporal-modulation distortion on each trial. Three cortical networks were identified based on differential patterns of ST-MTF predictions and the resultant ST-MTF weights across conditions (Unison, Competing): a bilateral superior temporal (S-T) network, a frontoparietal (F-P) network, and a network distributed across cortical midline regions and the angular gyrus (M-AG). The S-T network and the M-AG network responded primarily to spectrotemporal cues associated with speech intelligibility, regardless of condition, but the S-T network responded to a greater range of temporal modulations suggesting a more acoustically driven response. The F-P network responded to the absence of intelligibility-related cues in both conditions, but also to the absence (presence) of target-talker (competing-talker) vocal pitch in the Competing condition, suggesting a generalized response to signal degradation. Task performance was best predicted by activation in the S-T and F-P networks, but in opposite directions (S-T: more activation = better performance; F-P: vice versa). Moreover, S-T network predictions were entirely ST-MTF mediated while F-P network predictions were ST-MTF mediated only in the Unison condition, suggesting an influence from non-acoustic sources (e.g., informational masking) in the Competing condition. Activation in the M-AG network was weakly positively correlated with performance and this relation was entirely superseded by those in the S-T and F-P networks. Regarding contributions to speech recognition, we conclude: (a) superior temporal regions play a bottom-up, perceptual role that is not qualitatively dependent on the presence of competing speech; (b) frontoparietal regions play a top-down role that is modulated by competing speech and scales with listening effort; and (c) performance ultimately relies on dynamic interactions between these networks, with ancillary contributions from networks not involved in speech processing per se (e.g., the M-AG network).

Speech comprehension across time, space, frequency, and age: MEG-MVPA classification of intertrial phase coherence

Language is a key part of human cognition, essential for our well-being at all stages of our lives. Whereas many neurocognitive abilities decline with age, for language the picture is much less clear, and how exactly speech comprehension changes with ageing is still unknown. To investigate this, we employed magnetoencephalography (MEG) and recorded neuromagnetic brain responses to auditory linguistic stimuli in healthy participants of younger and older age using a passive task-free paradigm and a range of different linguistic stimulus contrasts, which enabled us to assess neural processing of spoken language at multiple levels (lexical, semantic, morphosyntactic). Using machine learning-based classification algorithms to scrutinise intertrial phase coherence of MEG responses in cortical source space, we found that patterns of oscillatory neural activity diverged between younger and older participants across several frequency bands (alpha, beta, gamma) for all tested linguistic information types. The results suggest multiple age-related changes in the brain's neurolinguistic circuits, which may be due to both healthy ageing in general and compensatory processes in particular.

Morphological evolution of language-relevant brain areas

Human language is supported by a cortical network involving Broca's area, which comprises Brodmann Areas 44 and 45 (BA44 and BA45). While cytoarchitectonic homolog areas have been identified in nonhuman primates, it remains unknown how these regions evolved to support human language. Here, we use histological data and advanced cortical registration methods to precisely compare the morphology of BA44 and BA45 in humans and chimpanzees. We found a general expansion of Broca's areas in humans, with the left BA44 enlarging the most, growing anteriorly into a region known to process syntax. Together with recent functional and receptorarchitectural studies, our findings support the conclusion that BA44 evolved from an action-related region to a bipartite system, with a posterior portion supporting action and an anterior portion supporting syntactic processes. Our findings add novel insights to the longstanding debate on the relationship between language and action, and the evolution of Broca's area.

Bilateral human laryngeal motor cortex in perceptual decision of lexical tone and voicing of consonant

Speech perception is believed to recruit the left motor cortex. However, the exact role of the laryngeal subregion and its right counterpart in speech perception, as well as their temporal patterns of involvement remain unclear. To address these questions, we conducted a hypothesis-driven study, utilizing transcranial magnetic stimulation on the left or right dorsal laryngeal motor cortex (dLMC) when participants performed perceptual decision on Mandarin lexical tone or consonant (voicing contrast) presented with or without noise. We used psychometric function and hierarchical drift-diffusion model to disentangle perceptual sensitivity and dynamic decision-making parameters. Results showed that bilateral dLMCs were engaged with effector specificity, and this engagement was left-lateralized with right upregulation in noise. Furthermore, the dLMC contributed to various decision stages depending on the hemisphere and task difficulty. These findings substantially advance our understanding of the hemispherical lateralization and temporal dynamics of bilateral dLMC in sensorimotor integration during speech perceptual decision-making.

Role of Articulatory Motor Networks in Perceptual Categorization of Speech Signals: A 7 T fMRI Study

BACKGROUND

The association between brain regions involved in speech production and those that play a role in speech perception is not yet fully understood. We compared speech production related brain activity with activations resulting from perceptual categorization of syllables using high field 7 Tesla functional magnetic resonance imaging (fMRI) at 1-mm isotropic voxel resolution, enabling high localization accuracy compared to previous studies.

METHODS

Blood oxygenation level dependent (BOLD) signals were obtained in 20 normal hearing subjects using a simultaneous multi-slice (SMS) 7T echo-planar imaging (EPI) acquisition with whole-head coverage and 1 mm isotropic resolution. In a speech production localizer task, subjects were asked to produce a silent lip-round vowel /u/ in response to the visual cue "U" or purse their lips when they saw the cue "P". In a phoneme discrimination task, subjects were presented with pairs of syllables, which were equiprobably identical or different along an 8-step continuum between the prototypic /ba/ and /da/ sounds. After the presentation of each stimulus pair, the subjects were asked to indicate whether the two syllables they heard were identical or different by pressing one of two buttons. In a phoneme classification task, the subjects heard only one syllable and asked to indicate whether it was /ba/ or /da/.

RESULTS

Univariate fMRI analyses using a parametric modulation approach suggested that left motor, premotor, and frontal cortex BOLD activations correlate with phoneme category variability in the /ba/-/da/ discrimination task. In contrast, the variability related to acoustic features of the phonemes were the highest in the right primary auditory cortex. Our multivariate pattern analysis (MVPA) suggested that left precentral/inferior frontal cortex areas, which were associated with speech production according to the localizer task, play a role also in perceptual categorization of the syllables.

CONCLUSIONS

The results support the hypothesis that articulatory motor networks in the left hemisphere that are activated during speech production could also have a role in perceptual categorization of syllables. Importantly, high voxel-resolution combined with advanced coil technology allowed us to pinpoint the exact brain regions involved in both perception and production tasks.

Impacts of Cortical Regions on EEG-based Classification of Lexical Tones and Vowels in Spoken Speech

Speech impairment is one of the most serious problems for patients with communication disorders, e.g., stroke survivors. The brain-computer interface (BCI) systems have shown the potential to alternatively control or rehabilitate the neurological damages in speech production. The effects of different cortical regions in speech-based BCI systems are essential to be studied, which are favorable for improving the performance of speech-based BCI systems. This work aimed to explore the impacts of different speech-related cortical regions in the electroencephalogram (EEG) based classification of seventy spoken Mandarin monosyllables carrying four vowels and four lexical tones. Seven audible speech production-related cortical regions were studied, involving Broca's and Wernicke's areas, auditory cortex, motor cortex, prefrontal cortex, sensory cortex, left brain, right brain, and whole brain. Following the previous studies in which EEG signals were collected from ten subjects during Mandarin speech production, the features of EEG signals were extracted by the Riemannian manifold method, and a linear discriminant analysis (LDA) was regarded as a classifier to classify different vowels and lexical tones. The results showed that when using electrodes from whole brain, the classifier reached the best performances, which were 48.5% for lexical tones and 70.0% for vowels, respectively. The vowel classification results under Broca's and Wernicke's areas, auditory cortex, or prefrontal cortex were higher than those under the motor cortex or sensory cortex. No such differences were observed in the lexical tone classification task.

Classification of autism based on short-term spontaneous hemodynamic fluctuations using an adaptive graph neural network

BACKGROUND

Short-term spontaneous hemodynamic fluctuations were collected by the functional near-infrared spectroscopy (fNIRS) system to classify children with autism spectrum disorder (ASD) and typical development (TD), and to explore abnormalities in the left inferior frontal gyrus in ASD.

METHODS

Using the fNIRS data of 25 children with ASD and 22 children with TD, a graph neural network combined with the temporal convolution module and the graph convolution module was used, to extract the spatio-temporal features of the data and achieve accurate classification of ASD.

RESULTS

The graph neural network was used to obtain a good classification result in the left inferior frontal gyrus, with an accuracy of 97.1%, precision of 95.1%, and specificity of 93.4%. It was found that the 5th channel (which is located in BA 10) and the 8th channel (which is located in BA 47) in the left inferior frontal gyrus were closely correlated with ASD.

COMPARISON WITH PREVIOUSLY USED METHOD(S)

Compared with the previous deep learning model using the same input, the accuracy of our model has increased by up to 13%, and the correlation between channels in the left inferior frontal gyrus area with the best classification effect was explored through the graph neural network.

CONCLUSION

The adaptive graph neural network (AGNN) model may be able to mine more valuable information to distinguish ASD from TD and in addition, the left inferior frontal gyrus may have greater investigative value.

Temporal lobe perceptual predictions for speech are instantiated in motor cortex and reconciled by inferior frontal cortex

Humans use predictions to improve speech perception, especially in noisy environments. Here we use 7-T functional MRI (fMRI) to decode brain representations of written phonological predictions and degraded speech signals in healthy humans and people with selective frontal neurodegeneration (non-fluent variant primary progressive aphasia [nfvPPA]). Multivariate analyses of item-specific patterns of neural activation indicate dissimilar representations of verified and violated predictions in left inferior frontal gyrus, suggestive of processing by distinct neural populations. In contrast, precentral gyrus represents a combination of phonological information and weighted prediction error. In the presence of intact temporal cortex, frontal neurodegeneration results in inflexible predictions. This manifests neurally as a failure to suppress incorrect predictions in anterior superior temporal gyrus and reduced stability of phonological representations in precentral gyrus. We propose a tripartite speech perception network in which inferior frontal gyrus supports prediction reconciliation in echoic memory, and precentral gyrus invokes a motor model to instantiate and refine perceptual predictions for speech.

Uncovering the Morphological Evolution of Language-Relevant Brain Areas

Human language is supported by a cortical network involving Broca's area which comprises Brodmann Areas 44 and 45 (BA44, BA45). While cytoarchitectonic homolog areas have been identified in nonhuman primates, it remains unknown how these regions evolved to support human language. Here, we use histological data and advanced cortical registration methods to precisely compare the morphology of BA44 and 45 between humans and chimpanzees. We found a general expansion of Broca's areas in humans, with the left BA44 enlarging the most, growing anteriorly into a region known to process syntax. Together with recent functional studies, our findings show that BA44 evolved from a purely action-related region to a more expanded region in humans, with a posterior portion supporting action and an anterior portion supporting syntactic processes. Furthermore, our findings provide a solution for the longstanding debate concerning the structural and functional evolution of Broca's area and its role in action and language.

Spatiotemporal Dynamics of Activation in Motor and Language Areas Suggest a Compensatory Role of the Motor Cortex in Second Language Processing

The involvement of the motor cortex in language understanding has been intensively discussed in the framework of embodied cognition. Although some studies have provided evidence for the involvement of the motor cortex in different receptive language tasks, the role that it plays in language perception and understanding is still unclear. In the present study, we explored the degree of involvement of language and motor areas in a visually presented sentence comprehension task, modulated by language proficiency (L1: native language, L2: second language) and linguistic abstractness (literal, metaphorical, and abstract). Magnetoencephalography data were recorded from 26 late Chinese learners of English. A cluster-based permutation F test was performed on the amplitude of the source waveform for each motor and language region of interest (ROI). Results showed a significant effect of language proficiency in both language and motor ROIs, manifested as overall greater involvement of language ROIs (short insular gyri and planum polare of the superior temporal gyrus) in the L1 than the L2 during 300-500 ms, and overall greater involvement of motor ROI (central sulcus) in the L2 than the L1 during 600-800 ms. We interpreted the over-recruitment of the motor area in the L2 as a higher demand for cognitive resources to compensate for the inadequate engagement of the language network. In general, our results indicate a compensatory role of the motor cortex in L2 understanding.

A deep hierarchy of predictions enables online meaning extraction in a computational model of human speech comprehension

Understanding speech requires mapping fleeting and often ambiguous soundwaves to meaning. While humans are known to exploit their capacity to contextualize to facilitate this process, how internal knowledge is deployed online remains an open question. Here, we present a model that extracts multiple levels of information from continuous speech online. The model applies linguistic and nonlinguistic knowledge to speech processing, by periodically generating top-down predictions and incorporating bottom-up incoming evidence in a nested temporal hierarchy. We show that a nonlinguistic context level provides semantic predictions informed by sensory inputs, which are crucial for disambiguating among multiple meanings of the same word. The explicit knowledge hierarchy of the model enables a more holistic account of the neurophysiological responses to speech compared to using lexical predictions generated by a neural network language model (GPT-2). We also show that hierarchical predictions reduce peripheral processing via minimizing uncertainty and prediction error. With this proof-of-concept model, we demonstrate that the deployment of hierarchical predictions is a possible strategy for the brain to dynamically utilize structured knowledge and make sense of the speech input.

Coevolution of language and tools in the human brain: An ALE meta-analysis of neural activation during syntactic processing and tool use

Language and complex tool use are often cited as behaviors unique to humans and may be evolutionarily linked owing to the underlying cognitive processes they have in common. We executed a quantitative activation likelihood estimation (ALE) meta-analysis (GingerALE 2.3) on published, whole-brain neuroimaging studies to identify areas associated with syntactic processing and/or tool use in humans. Significant clusters related to syntactic processing were identified in areas known to be related to language production and comprehension, including bilateral Broca's area in the inferior frontal gyrus. Tool use activation clusters were all in the left hemisphere and included the primary motor cortex and premotor cortex, in addition to other areas involved with sensorimotor transformation. Activation shared by syntactic processing and tool use was only significant at one cluster, located in the pars opercularis of the left inferior frontal gyrus. This minimal overlap between syntactic processing and tool use activation from our meta-analysis of neuroimaging studies indicates that there is not a widespread common neural network between the two. Broca's area may serve as an important hub that was initially recruited in early human evolution in the context of simple tool use, but was eventually co-opted for linguistic purposes, including the sequential and hierarchical ordering processes that characterize syntax. In the future, meta-analyses of additional components of language may allow for a more comprehensive examination of the functional networks that underlie the coevolution of human language and complex tool use.

Presurgical Language Mapping: What Are We Testing?

Gliomas are brain tumors infiltrating healthy cortical and subcortical areas that may host cognitive functions, such as language. If these areas are damaged during surgery, the patient might develop word retrieval or articulation problems. For this reason, many glioma patients are operated on awake, while their language functions are tested. For this practice, quite simple tests are used, for example, picture naming. This paper describes the process and timeline of picture naming (noun retrieval) and shows the timeline and localization of the distinguished stages. This is relevant information for presurgical language testing with navigated Magnetic Stimulation (nTMS). This novel technique allows us to identify cortical involved in the language production process and, thus, guides the neurosurgeon in how to approach and remove the tumor. We argue that not only nouns, but also verbs should be tested, since sentences are built around verbs, and sentences are what we use in daily life. This approach’s relevance is illustrated by two case studies of glioma patients.

Developmental mechanisms underlying the evolution of human cortical circuits

The brain of modern humans has evolved remarkable computational abilities that enable higher cognitive functions. These capacities are tightly linked to an increase in the size and connectivity of the cerebral cortex, which is thought to have resulted from evolutionary changes in the mechanisms of cortical development. Convergent progress in evolutionary genomics, developmental biology and neuroscience has recently enabled the identification of genomic changes that act as human-specific modifiers of cortical development. These modifiers influence most aspects of corticogenesis, from the timing and complexity of cortical neurogenesis to synaptogenesis and the assembly of cortical circuits. Mutations of human-specific genetic modifiers of corticogenesis have started to be linked to neurodevelopmental disorders, providing evidence for their physiological relevance and suggesting potential relationships between the evolution of the human brain and its sensitivity to specific diseases.

Verb and sentence processing with TMS: A systematic review and meta-analysis

Transcranial magnetic stimulation (TMS) has provided relevant evidence regarding the neural correlates of language. The aim of the present study is to summarize and assess previous findings regarding linguistic levels (i.e., semantic and morpho-syntactic) and brain structures utilized during verb and sentence processing. To do that, we systematically reviewed TMS research on verb and sentence processing in healthy speakers, and meta-analyzed TMS-induced effects according to the region of stimulation and experimental manipulation. Findings from 45 articles show that approximately half of the reviewed work focuses on the embodiment of action verbs. The majority of studies (60%) target only one cortical region in relation to a specific linguistic process. Frontal areas are most frequently stimulated in connection to morphosyntactic processes and action verb semantics, and temporoparietal regions in relation to integration of sentential meaning and thematic role assignment. A meta-analysis of 72 effect sizes of the reviewed papers indicates that TMS has a small overall effect size, but effect sizes for anterior compared to posterior regions do not differ for semantic or morphosyntactic contrasts. Our findings stress the need to increase the number of targeted areas, while using the same linguistic contrasts in order to disentangle the contributions of different cortical regions to distinct linguistic processes.

Unintentional response priming from verbal action-effect instructions

Action-effect learning is based on a theoretical concept that actions are associated with their perceivable consequences through bidirectional associations. Past research has mostly investigated how these bidirectional associations are formed through actual behavior and perception of the consequences. The present research expands this idea by investigating how verbally formulated action-effect instructions contribute to action-effect learning. In two online experiments (Exp. 1, N = 41, student sample; Exp. 2, N = 349, non-student sample), participants memorized a specific action-effect instruction before completing a speeded categorization task. We assessed the consequences of the instructions by presenting the instructed effect as an irrelevant stimulus in the classification task and compared response errors and response times for instruction-compatible and instruction-incompatible responses. Overall, we found evidence that verbal action-effect instructions led to associations between an action and perception (effect) that are automatically activated upon encountering the previously verbally presented effect. In addition, we discuss preliminary evidence suggesting that the order of the action-effect components plays a role; only instructions in a perception-action order showed the expected effect. The present research contributes evidence to the idea that action-effect learning is not exclusively related to actual behavior but also achievable through verbally formulated instructions, thereby providing a flexible learning mechanism that does not rely on specific actual experiences.