Active perception: sensorimotor circuits as a cortical basis for language

Network dynamics of Broca's area during word selection

Current models of word-production in Broca's area (i.e. left ventro-lateral prefrontal cortex, VLPFC) posit that sequential and staggered semantic, lexical, phonological and articulatory processes precede articulation. Using millisecond-resolution intra-cranial recordings, we evaluated spatiotemporal dynamics and high frequency functional interconnectivity between left VLPFC regions during single-word production. Through the systematic variation of retrieval, selection, and phonological loads, we identified specific activation profiles and functional coupling patterns between these regions that fit within current psycholinguistic theories of word production. However, network interactions underpinning these processes activate in parallel (not sequentially), while the processes themselves are indexed by specific changes in network state. We found evidence that suggests that pars orbitalis is coupled with pars triangularis during lexical retrieval, while lexical selection is terminated via coupled activity with M1 at articulation onset. Taken together, this work reveals that speech production relies on very specific inter-regional couplings in rapid sequence in the language dominant hemisphere.

Exploring the effects of demonstration and enactment in facilitating recall of instructions in working memory

Across the lifespan the ability to follow instructions is essential for the successful completion of a multitude of daily activities. This ability will often rely on the storage and processing of information in working memory, and previous research in this domain has found that self-enactment at encoding or observing other-enactment at encoding (demonstration) improves performance at recall. However, no working memory research has directly compared these manipulations. Experiment 1 explored the effects of both self-enactment and demonstration on young adults’ (N=48) recall of action-object instruction sequences (e.g. ‘spin the circle, tap the square’). Both manipulations improved recall, with demonstration providing relatively larger boosts to performance across conditions. More detailed analyses suggested that this improvement was driven by improving the representations of actions, rather than objects, in these action-object sequences. Experiment 2 (N=24) explored this further, removing the objects from the physical environment and comparing partial demonstration (i.e. action-only or object-only) with no or full demonstration. The results showed that partial demonstration only benefitted features that were demonstrated, while full demonstration improved memory for actions, objects and their pairings. Overall these experiments indicate how self-enactment, and particularly demonstration, can benefit verbal recall of instruction sequences through the engagement of visuo-motor processes that provide additional forms of coding to support working memory performance.

Grey matter volume in developmental speech and language disorder

Developmental language disorder (DLD) and developmental speech disorder (DSD) are common, yet their etiologies are not well understood. Atypical volume of the inferior and posterior language regions and striatum have been reported in DLD; however, variability in both methodology and study findings limits interpretations. Imaging research within DSD, on the other hand, is scarce. The present study compared grey matter volume in children with DLD, DSD, and typically developing speech and language. Compared to typically developing controls, children with DLD had larger volume in the right cerebellum, possibly associated with the procedural learning deficits that have been proposed in DLD. Children with DSD showed larger volume in the left inferior occipital lobe compared to controls, which may indicate a compensatory role of the visual processing regions due to sub-optimal auditory-perceptual processes. Overall, these findings suggest that different neural systems may be involved in the specific deficits related to DLD and DSD.

Prediction and Mismatch Negativity Responses Reflect Impairments in Action Semantic Processing in Adults With Autism Spectrum Disorders

The neurophysiological mechanisms underlying motor and language difficulties in autism spectrum disorders (ASD) are still largely unclear. The present work investigates biological indicators of sound processing, (action-) semantic understanding and predictive coding and their correlation with clinical symptoms of ASD. Twenty-two adults with high-functioning ASD and 25 typically developed (TD) participants engaged in an auditory, passive listening, Mismatch Negativity (MMN) task while high-density electroencephalography (EEG) was recorded. Action and non-action words were presented in the context of sounds, which were either semantically congruent with regard to the body part they relate to or semantically incongruent or unrelated. The anticipatory activity before sound onset, the Prediction Potential (PP), was significantly reduced in the ASD group specifically for action, but not for non-action sounds. The early-MMN-like responses to words (latency: 120 ms) were differentially modulated across groups: controls showed larger amplitudes for words in action-sound compared to non-action contexts, whereas ASD participants demonstrated enlarged early-MMN-like responses only in a pure tone context, with no other modulation dependent on action sound context. Late-MMN-like responses around 560 ms post-stimulus onset revealed body-part-congruent action-semantic priming for words in control participants, but not in the ASD group. Importantly, neurophysiological indices of semantic priming in ASD participants correlated with the extent of autistic traits as revealed by the Autism Spectrum Quotient (AQ). The data suggest that high-functioning adults with ASD show a specific deficit in semantic processing and predictive coding of sounds and words related to action, which is absent for neutral, non-action, sounds.

Neurophysiological evidence for rapid processing of verbal and gestural information in understanding communicative actions

During everyday social interaction, gestures are a fundamental part of human communication. The communicative pragmatic role of hand gestures and their interaction with spoken language has been documented at the earliest stage of language development, in which two types of indexical gestures are most prominent: the pointing gesture for directing attention to objects and the give-me gesture for making requests. Here we study, in adult human participants, the neurophysiological signatures of gestural-linguistic acts of communicating the pragmatic intentions of naming and requesting by simultaneously presenting written words and gestures. Already at ~150 ms, brain responses diverged between naming and request actions expressed by word-gesture combination, whereas the same gestures presented in isolation elicited their earliest neurophysiological dissociations significantly later (at ~210 ms). There was an early enhancement of request-evoked brain activity as compared with naming, which was due to sources in the frontocentral cortex, consistent with access to action knowledge in request understanding. In addition, an enhanced N400-like response indicated late semantic integration of gesture-language interaction. The present study demonstrates that word-gesture combinations used to express communicative pragmatic intentions speed up the brain correlates of comprehension processes – compared with gesture-only understanding – thereby calling into question current serial linguistic models viewing pragmatic function decoding at the end of a language comprehension cascade. Instead, information about the social-interactive role of communicative acts is processed instantaneously.

Transcranial Direct Current Stimulation to Enhance Training Effectiveness in Chronic Post-Stroke Aphasia: A Randomized Controlled Trial Protocol

Background: Intensive speech-language therapy (SLT) can promote recovery from chronic post-stroke aphasia, a major consequence of stroke. However, effect sizes of intensive SLT are moderate, potentially reflecting a physiological limit of training-induced progress. Transcranial direct current stimulation (tDCS) is an easy-to-use, well-tolerated and low-cost approach that may enhance effectiveness of intensive SLT. In a recent phase-II randomized controlled trial, 26 individuals with chronic post-stroke aphasia received intensive SLT combined with anodal-tDCS of the left primary motor cortex (M1), resulting in improved naming and proxy-rated communication ability, with medium-to-large effect sizes.

Aims: The proposed protocol seeks to establish the incremental benefit from anodal-tDCS of M1 in a phase-III randomized controlled trial with adequate power, ecologically valid outcomes, and evidence-based SLT.

Methods: The planned study is a prospective randomized placebo-controlled (using sham-tDCS), parallel-group, double-blind, multi-center, phase-III superiority trial. A sample of 130 individuals with aphasia at least 6 months post-stroke will be recruited in more than 18 in- and outpatient rehabilitation centers.

Outcomes: The primary outcome focuses on communication ability in chronic post-stroke aphasia, as revealed by changes on the Amsterdam-Nijmegen Everyday Language Test (A-scale; primary endpoint: 6-month follow-up; secondary endpoints: immediately after treatment, and 12-month follow-up). Secondary outcomes include measures assessing linguistic-executive skills, attention, memory, emotional well-being, quality of life, health economic costs, and adverse events (endpoints: 6-month follow-up, immediately after treatment, and 12-month follow-up).

Discussion: Positive results will increase the quality of life for persons with aphasia and their families while reducing societal costs. After trial completion, a workshop with relevant stakeholders will ensure transfer into best-practice guidelines and successful integration within clinical routine.

Clinical Trial Registration:www.ClinicalTrials.gov, identifier: NCT03930121.

Processing of Action and Sound Verbs in Context: An FMRI Study

Recent theories propose a flexible recruitment of sensory and motor brain regions during conceptual processing depending on context and task. The present functional magnetic resonance imaging study investigated the influence of context and task on conceptual processing of action and sound verbs. Participants first performed an explicit semantic context decision task, in which action and sound verbs were presented together with a context noun. The same verbs were repeatedly presented in a subsequent implicit lexical decision task together with new action and sound verbs. Thereafter, motor and acoustic localizer tasks were administered to identify brain regions involved in perception and action. During the explicit task, we found differential activations to action and sound verbs near corresponding sensorimotor brain regions. During the implicit lexical decision task, differences between action and sound verbs were absent. However, feature-specific repetition effects were observed near corresponding sensorimotor brain regions. The present results suggest flexible conceptual representations depending on context and task. Feature-specific effects were observed only near, but not within corresponding sensorimotor brain regions, as defined by the localizer tasks. Our results therefore only provide limited evidence in favor of grounded cognition theories assuming a close link between the conceptual and the sensorimotor systems.

The white matter architecture underlying semantic processing: A systematic review

From a holistic point of view, semantic processes are subserved by large-scale subcortico-cortical networks. The dynamic routing of information between grey matter structures depends on the integrity of subcortical white matter pathways. Nonetheless, controversy remains on which of these pathways support semantic processing. Therefore, a systematic review of the literature was performed with a focus on anatomo-functional correlations obtained from direct electrostimulation during awake tumor surgery, and conducted between diffusion tensor imaging metrics and behavioral semantic performance in healthy and aphasic individuals. The 43 included studies suggest that the left inferior fronto-occipital fasciculus contributes to the essential connectivity that allows semantic processing. However, it remains uncertain whether its contributive role is limited to the organization of semantic knowledge or extends to the level of semantic control. Moreover, the functionality of the left uncinate fasciculus, inferior longitudinal fasciculus and the posterior segment of the indirect arcuate fasciculus in semantic processing has to be confirmed by future research.

Large-scale plurimodal networks common to listening to, producing and reading word lists: an fMRI study combining task-induced activation and intrinsic connectivity in 144 right-handers

We aimed at identifying plurimodal large-scale networks for producing, listening to and reading word lists based on the combined analyses of task-induced activation and resting-state intrinsic connectivity in 144 healthy right-handers. In the first step, we identified the regions in each hemisphere showing joint activation and joint asymmetry during the three tasks. In the left hemisphere, 14 homotopic regions of interest (hROIs) located in the left Rolandic sulcus, precentral gyrus, cingulate gyrus, cuneus and inferior supramarginal gyrus (SMG) met this criterion, and 7 hROIs located in the right hemisphere were located in the preSMA, medial superior frontal gyrus, precuneus and superior temporal sulcus (STS). In a second step, we calculated the BOLD temporal correlations across these 21 hROIs at rest and conducted a hierarchical clustering analysis to unravel their network organization. Two networks were identified, including the WORD-LIST_CORE network that aggregated 14 motor, premotor and phonemic areas in the left hemisphere plus the right STS that corresponded to the posterior human voice area (pHVA). The present results revealed that word-list processing is based on left articulatory and storage areas supporting the action-perception cycle common not only to production and listening but also to reading. The inclusion of the right pHVA acting as a prosodic integrative area highlights the importance of prosody in the three modalities and reveals an intertwining across hemispheres between prosodic (pHVA) and phonemic (left SMG) processing. These results are consistent with the motor theory of speech postulating that articulatory gestures are the central motor units on which word perception, production, and reading develop and act together.

Sound symbolic congruency detection in humans but not in great apes

Theories on the evolution of language highlight iconicity as one of the unique features of human language. One important manifestation of iconicity is sound symbolism, the intrinsic relationship between meaningless speech sounds and visual shapes, as exemplified by the famous correspondences between the pseudowords 'maluma' vs. 'takete' and abstract curved and angular shapes. Although sound symbolism has been studied extensively in humans including young children and infants, it has never been investigated in non-human primates lacking language. In the present study, we administered the classic "takete-maluma" paradigm in both humans (N = 24 and N = 31) and great apes (N = 8). In a forced choice matching task, humans but not great apes, showed crossmodal sound symbolic congruency effects, whereby effects were more pronounced for shape selections following round-sounding primes than following edgy-sounding primes. These results suggest that the ability to detect sound symbolic correspondences is the outcome of a phylogenetic process, whose underlying emerging mechanism may be relevant to symbolic ability more generally.

Neural correlates and functional connectivity of lexical tone processing in reading

Lexical tone processing in speech is mediated by bilateral superior temporal and inferior prefrontal regions, but little is known concerning the neural circuitries of lexical tone phonology in reading. Using fMRI, we examined the neural systems for lexical tone in visual Chinese word recognition. We found that the extraction of lexical tone phonology in print was subserved by bilateral fronto-parietal regions. Seed-to-voxel analyses showed that functionally connected cortical regions involved right inferior frontal gyrus and SMA, right middle frontal gyrus and right inferior parietal lobule, and SMA and bilateral cingulate gyri. Our results indicate that in Chinese tone reading, a bilateral network of frontal, parietal, motor, and cingulate regions is engaged, without involvement of temporal regions crucial for tone identification in auditory domain. Although neural couplings for lexical tone processing are different in speech and reading to some degree, the motor cortex seems to be a key component independent of modality.

How words impact on pain

INTRODUCTION

The wording used before and during painful medical procedures might significantly affect the painfulness and discomfort of the procedures. Two theories might account for these effects: the motivational priming theory (Lang, 1995, American Psychologist, 50, 372) and the theory of neural networks (Hebb, 1949, The organization of behavior. New York, NY: Wiley; Pulvermuller, 1999, Behavioral and Brain Sciences, 22, 253; Pulvermüller and Fadiga, 2010, Nature Reviews Neuroscience, 11, 351).

METHODS

Using fMRI, we investigated how negative, pain-related, and neutral words that preceded the application of noxious stimuli as priming stimuli affect the cortical processing and pain ratings of following noxious stimuli.

RESULTS

Here, we show that both theories are applicable: Stronger pain and stronger activation were observed in several brain areas in response to noxious stimuli preceded by both, negative and pain-related words, respectively, as compared to preceding neutral words, thus supporting motivational priming theory. Furthermore, pain ratings and activation in somatosensory cortices, primary motor cortex, premotor cortex, thalamus, putamen, and precuneus were even stronger for preceding pain-related than for negative words supporting the theory of neural networks.

CONCLUSION

Our results explain the influence of wording on pain perception and might have important consequences for clinical work.

Frequency-tagged visual evoked responses track syllable effects in visual word recognition

The processing of syllables in visual word recognition was investigated using a novel paradigm based on steady-state visual evoked potentials (SSVEPs). French words were presented to proficient readers in a delayed naming task. Words were split into two segments, the first of which was flickered at 18.75 Hz and the second at 25 Hz. The first segment either matched (congruent condition) or did not match (incongruent condition) the first syllable. The SSVEP responses in the congruent condition showed increased power compared to the responses in the incongruent condition, providing new evidence that syllables are important sublexical units in visual word recognition and reading aloud. With respect to the neural correlates of the effect, syllables elicited an early activation of a right hemisphere network. This network is typically associated with the programming of complex motor sequences, cognitive control and timing. Subsequently, responses were obtained in left hemisphere areas related to phonological processing.

Action Semantic Deficits and Impaired Motor Skills in Autistic Adults Without Intellectual Impairment

Several studies indicate the functional importance of the motor cortex for higher cognition, language and semantic processing, and place the neural substrate of these processes in sensorimotor action-perception circuits linking motor, sensory and perisylvian language regions. Interestingly, in individuals with autism spectrum disorder (ASD), semantic processing of action and emotion words seems to be impaired and is associated with hypoactivity of the motor cortex during semantic processing. In this study, the relationship between semantic processing, fine motor skills and clinical symptoms was investigated in 19 individuals with ASD and 22 typically-developing matched controls. Participants completed two semantic decision tasks involving words from different semantic categories, a test of alexithymia (the Toronto Alexithymia Scale), and a test of fine motor skills (the Purdue Pegboard Test). A significant Group × Word Category interaction in accuracy (p < 0.05) demonstrated impaired semantic processing for action words, but not object words in the autistic group. There was no significant group difference when processing abstract emotional words or abstract neutral words. Moreover, our study revealed deficits in fine motor skills as well as evidence for alexithymia in the ASD group, but not in neurotypical controls. However, these motor deficits did not correlate significantly with impairments in action-semantic processing. We interpret the data in terms of an underlying dysfunction of the action-perception system in ASD and its specific impact on semantic language processing.

MVPA Analysis of Intertrial Phase Coherence of Neuromagnetic Responses to Words Reliably Classifies Multiple Levels of Language Processing in the Brain

Neural processing of language is still among the most poorly understood functions of the human brain, whereas a need to objectively assess the neurocognitive status of the language function in a participant-friendly and noninvasive fashion arises in various situations. Here, we propose a solution for this based on a short task-free recording of MEG responses to a set of spoken linguistic contrasts. We used spoken stimuli that diverged lexically (words/pseudowords), semantically (action-related/abstract), or morphosyntactically (grammatically correct/ungrammatical). Based on beamformer source reconstruction we investigated intertrial phase coherence (ITPC) in five canonical bands (α, β, and low, medium, and high γ) using multivariate pattern analysis (MVPA). Using this approach, we could successfully classify brain responses to meaningful words from meaningless pseudowords, correct from incorrect syntax, as well as semantic differences. The best classification results indicated distributed patterns of activity dominated by core temporofrontal language circuits and complemented by other areas. They varied between the different neurolinguistic properties across frequency bands, with lexical processes classified predominantly by broad γ, semantic distinctions by α and β, and syntax by low γ feature patterns. Crucially, all types of processing commenced in a near-parallel fashion from ∼100 ms after the auditory information allowed for disambiguating the spoken input. This shows that individual neurolinguistic processes take place simultaneously and involve overlapping yet distinct neuronal networks that operate at different frequency bands. This brings further hope that brain imaging can be used to assess neurolinguistic processes objectively and noninvasively in a range of populations.

Mapping critical hubs of receptive and expressive language using MEG: A comparison against fMRI

The complexity of the widespread language network makes it challenging for accurate localization and lateralization. Using large-scale connectivity and graph-theoretical analyses of task-based magnetoencephalography (MEG), we aimed to provide robust representations of receptive and expressive language processes, comparable with spatial profiles of corresponding functional magnetic resonance imaging (fMRI). We examined MEG and fMRI data from 12 healthy young adults (age 20-37 years) completing covert auditory word-recognition task (WRT) and covert auditory verb-generation task (VGT). For MEG language mapping, broadband (3-30 Hz) beamformer sources were estimated, voxel-level connectivity was quantified using phase locking value, and highly connected hubs were characterized using eigenvector centrality graph measure. fMRI data were analyzed using a classic general linear model approach. A laterality index (LI) was computed for 20 language-specific frontotemporal regions for both MEG and fMRI. MEG network analysis showed bilateral and symmetrically distributed hubs within the left and right superior temporal gyrus (STG) during WRT and predominant hubs in left inferior prefrontal gyrus (IFG) during VGT. MEG and fMRI localization maps showed high correlation values within frontotemporal regions during WRT and VGT (r = 0.63, 0.74, q < 0.05, respectively). Despite good concordance in localization, notable discordances were observed in lateralization between MEG and fMRI. During WRT, MEG favored a left-hemispheric dominance of left STG (LI = 0.25 ± 0.22) whereas fMRI supported a bilateral representation of STG (LI = 0.08 ± 0.2). Laterality of MEG and fMRI during VGT consistently showed a strong asymmetry in left IFG regions (MEG-LI = 0.45 ± 0.35 and fMRI-LI = 0.46 ± 0.13). Our results demonstrate the utility of a large-scale connectivity and graph theoretical analyses for robust identification of language-specific regions. MEG hubs are in great agreement with the literature in revealing with canonical and extra-canonical language sites, thus providing additional support for the underlying topological organization of receptive and expressive language cortices. Discordances in lateralization may emphasize the need for multimodal integration of MEG and fMRI to obtain an excellent predictive value in a heterogeneous healthy population and patients with neurosurgical conditions.

A replication attempt of hemispheric differences in semantic-relatedness judgments (Zwaan & Yaxley, 2003)

In a study by Zwaan and Yaxley (2003, Cognition, 87, B79-B86), participants judged the semantic relatedness of word pairs presented one above the other either in the left or right visual field with all related pairs requiring right-handed responses. If the vertical orientation of the word pairs matched their referents' typical vertical orientation ("roof" above "basement") a match effect was observed, but only when the word pair was presented in the left visual field. We replicated this study with response side as an additional factor and found a main effect of match, as well as a Simon effect with faster responses when the required response matched the visual field in which the word pair was presented. We did not, however, observe an interaction between the match effect and the visual field. This challenges the assumption that coarse semantic representations, including spatial properties of objects, are mainly processed in the right hemisphere.

Motor modules account for active perception of force

Despite longstanding evidence suggesting a relation between action and perception, the mechanisms underlying their integration are still unclear. It has been proposed that to simplify the sensorimotor integration processes underlying active perception, the central nervous system (CNS) selects patterns of movements aimed at maximizing sampling of task-related sensory input. While previous studies investigated the action-perception loop focusing on the role of higher-level features of motor behavior (e.g., kinematic invariants, effort), the present study explored and quantified the contribution of lower-level organization of motor control. We tested the hypothesis that the coordinated recruitment of group of muscles (i.e., motor modules) engaged to counteract an external force contributes to participants’ perception of the same force. We found that: 1) a model describing the modulation of a subset of motor modules involved in the motor task accounted for about 70% of participants’ perceptual variance; 2) an alternative model, incompatible with the motor modules hypothesis, accounted for significantly lower variance of participants’ detection performance. Our results provide empirical evidence of the potential role played by muscle activation patterns in active perception of force. They also suggest that a modular organization of motor control may mediate not only coordination of multiple muscles, but also perceptual inference.

Auditory-Motor Matching in Vocal Recognition and Imitative Learning

Songbirds possess mirror neurons (MNs) activating during the perception and execution of specific features of songs. These neurons are located in high vocal center (HVC), a premotor nucleus implicated in song perception, production and learning, making worth to inquire their properties and functions in vocal recognition and imitative learning. By integrating a body of brain and behavioral data, we discuss neurophysiology, anatomical, computational properties and possible functions of songbird MNs. We state that the neurophysiological properties of songbird MNs depends on sensorimotor regions that are outside the auditory neural system. Interestingly, songbirds MNs can be the result of the specific type of song representation possessed by some songbird species. At the functional level, we discuss whether songbird MNs are involved in others' song recognition, by dissecting the function of recognition in various different but possible overlapping processes: action-oriented perception, discriminative-oriented perception and identification of the signaler. We conclude that songbird MNs may be involved in recognizing other singer's vocalizations, while their role in imitative learning still require to solve how auditory feedback are used to correct own vocal performance to match the tutor song. Finally, we compare songbird and human mirror responses, hypothesizing a case of convergent evolution, and proposing new experimental directions.

Musical training improves the ability to understand speech-in-noise in older adults

It is well known that hearing abilities decline with age, and one of the most commonly reported hearing difficulties reported in older adults is a reduced ability to understand speech in noisy environments. Older adult musicians have an enhanced ability to understand speech in noise, and this has been associated with enhanced brain responses related to both speech processing and the deployment of attention; however, the causal impact of music lessons in older adults has not yet been demonstrated. To investigate whether a causal relationship exists between short-term musical training and performance on auditory tests in older adults and to determine if musical training can be used to improve hearing in older adult nonmusicians, we conducted a longitudinal training study with random assignment. A sample of older adults was randomly assigned to learn to play piano (Music), to learn to play a visuospatially demanding video game (Video), or to serve as a no-contact control (No-contact). After 6 months, the Music group improved their ability to understand a word presented in loud background noise, whereas the other 2 groups did not. This improvement was related to an increase in positive-going electrical brain activity at fronto-left electrodes 200-1000 ms after the presentation of a word in noise. Source analyses suggest that this activity was due to sources located in the left inferior frontal gyrus and other regions involved in the speech-motor system. These findings support the idea that musical training provides a causal benefit to hearing abilities. Importantly, these findings suggest that musical training could be used as a foundation to develop auditory rehabilitation programs for older adults.

Current status and potential application of navigated transcranial magnetic stimulation in neurosurgery: a literature review

Transcranial magnetic stimulation (TMS) is a noninvasive neurophysiologic technique that can stimulate the human brain. Positioning of the coil was often performed based merely on external landmarks on the head, meaning that the anatomical target in the cortex remains inaccurate. Navigated transcranial magnetic stimulation (nTMS) combines a frameless stereotactic navigational system and TMS coil and can provide a highly accurate delivery of TMS pulses with the guidance of imaging. Therefore, many novel utilities for TMS could be explored due to the ability of precise localization. Many studies have been published, which indicate nTMS enables presurgical functional mapping. This review aimed to provide a comprehensive literature review on nTMS, especially the principles and clinical applications of nTMS. All articles in PubMed with keywords of "motor mapping," "presurgical mapping," "navigated transcranial magnetic stimulation," and "language mapping" published from 2000 to 2018 were included in the study. Frequently cited publications before 2000 were also included. The most valuable published original and review articles related to our objective were selected. Motor mapping of nTMS is validated to be a trustful tool to recognize functional areas belonging to both normal and lesioned primary motor cortex. It can offer reliable mapping of speech and motor regions at cortex prior to operation and has comparable accuracy as direct electrical cortical stimulation. nTMS is a powerful tool for mapping of motor and linguistic function prior to operation, has high application value in neurosurgery and the treatment of neurological and psychiatric diseases, and has gained increasing acceptance in neurosurgical centers across the world.

Effortful verb retrieval from semantic memory drives beta suppression in mesial frontal regions involved in action initiation

The contribution of the motor cortex to the semantic retrieval of verbs remains a subject of debate in neuroscience. Here, we examined whether additional engagement of the cortical motor system was required when access to verbs semantics was hindered during a verb generation task. We asked participants to produce verbs related to presented noun cues that were either strongly associated with a single verb to prompt fast and effortless verb retrieval, or were weakly associated with multiple verbs and more difficult to respond to. Using power suppression of magnetoencephalography beta oscillations (15-30 Hz) as an index of cortical activation, we performed a whole-brain analysis in order to identify the cortical regions sensitive to the difficulty of verb semantic retrieval. Highly reliable suppression of beta oscillations occurred 250 ms after the noun cue presentation and was sustained until the onset of verbal response. This was localized to multiple cortical regions, mainly in the temporal and frontal lobes of the left hemisphere. Crucially, the only cortical regions where beta suppression was sensitive to the task difficulty, were the higher order motor areas on the medial and lateral surfaces of the frontal lobe. Stronger activation of the premotor cortex and supplementary motor area accompanied the effortful verb retrieval and preceded the preparation of verbal responses for more than 500 ms, thus, overlapping with the time window of verb retrieval from semantic memory. Our results suggest that reactivation of verb-related motor plans in higher order motor circuitry promotes the semantic retrieval of target verbs.

The Ontogenesis of Action Syntax

Language and action share similar organizational principles. Both are thought to be hierarchical and recursive in nature. Here we address the relationship between language and action from developmental and neurophysiological perspectives. We discuss three major aspects: The extent of the analogy between language and action; the necessity to extend research on the yet largely neglected aspect of action syntax; the positive contribution of a developmental approach to this topic. We elaborate on the claim that adding an ontogenetic approach will help to obtain a comprehensive picture about both the interplay between language and action and its development, and to answer the question whether the underlying mechanisms of detecting syntactic violations of action sequences are similar to or different from the processing of language syntactic violations.

How meaning unfolds in neural time: Embodied reactivations can precede multimodal semantic effects during language processing

Research on how the brain construes meaning during language use has prompted two conflicting accounts. According to the 'grounded view', word understanding involves quick reactivations of sensorimotor (embodied) experiences evoked by the stimuli, with simultaneous or later engagement of multimodal (conceptual) systems integrating information from various sensory streams. Contrariwise, for the 'symbolic view', this capacity depends crucially on multimodal operations, with embodied systems playing epiphenomenal roles after comprehension. To test these contradictory hypotheses, the present magnetoencephalography study assessed implicit semantic access to grammatically constrained action and non-action verbs (n = 100 per category) while measuring spatiotemporally precise signals from the primary motor cortex (M1, a core region subserving bodily movements) and the anterior temporal lobe (ATL, a putative multimodal semantic hub). Convergent evidence from sensor- and source-level analyses revealed that increased modulations for action verbs occurred earlier in M1 (∼130-190 ms) than in specific ATL hubs (∼250-410 ms). Moreover, machine-learning decoding showed that trial-by-trial classification peaks emerged faster in M1 (∼100-175 ms) than in the ATL (∼345-500 ms), with over 71% accuracy in both cases. Considering their latencies, these results challenge the 'symbolic view' and its implication that sensorimotor mechanisms play only secondary roles in semantic processing. Instead, our findings support the 'grounded view', showing that early semantic effects are critically driven by embodied reactivations and that these cannot be reduced to post-comprehension epiphenomena, even when words are individually classified. Briefly, our study offers non-trivial insights to constrain fine-grained models of language and understand how meaning unfolds in neural time.

Steady state visual evoked potentials in reading aloud: Effects of lexicality, frequency and orthographic familiarity

The present study explored the possibility to use Steady-State Visual Evoked Potentials (SSVEPs) as a tool to investigate the core mechanisms in visual word recognition. In particular, we investigated three benchmark effects of reading aloud: lexicality (words vs. pseudowords), frequency (high-frequency vs. low-frequency words), and orthographic familiarity ('familiar' versus 'unfamiliar' pseudowords). We found that words and pseudowords elicited robust SSVEPs. Words showed larger SSVEPs than pseudowords and high-frequency words showed larger SSVEPs than low-frequency words. SSVEPs were not sensitive to orthographic familiarity. We further localized the neural generators of the SSVEP effects. The lexicality effect was located in areas associated with early level of visual processing, i.e. in the right occipital lobe and in the right precuneus. Pseudowords produced more activation than words in left sensorimotor areas, rolandic operculum, insula, supramarginal gyrus and in the right temporal gyrus. These areas are devoted to speech processing and/or spelling-to-sound conversion. The frequency effect involved the left temporal pole and orbitofrontal cortex, areas previously implicated in semantic processing and stimulus-response associations respectively, and the right postcentral and parietal inferior gyri, possibly indicating the involvement of the right attentional network.

Varieties of abstract concepts: development, use and representation in the brain

The capacity for abstract thought is one of the hallmarks of human cognition. However, the mechanisms underlying the ability to form and use abstract concepts like 'fantasy' and 'grace' have not been elucidated yet. This theme issue brings together developmental, social and cognitive psychologists, linguists, anthropologists, cognitive scientists, neuroscientists, philosophers and computer scientists to present theoretical insights and novel evidence on how abstract concepts are acquired, used and represented in the brain. Many of the contributions conceive concepts as grounded in sensorimotor systems and constrained by bodily mechanisms and structures. The theme issue develops along two main axes, related to the most promising research directions on abstract concepts. The axes focus on (i) the different kinds of abstract concepts (numbers, emotions, evaluative concepts like moral and aesthetic ones, social concepts); (ii) the role played by perception and action, language and sociality, and inner processes (emotions, interoception, metacognition) in grounding abstract concepts. Most papers adopt a cognitive science/neuroscience approach, but the theme issue also includes studies on development, on social cognition, and on how linguistic diversity shapes abstract concepts. Overall, the theme issue provides an integrated theoretical account that highlights the importance of language, sociality and inner processes for abstract concepts, and that offers new methodological tools to investigate them.This article is part of the theme issue 'Varieties of abstract concepts: development, use and representation in the brain'.

Verbal Fluency Is Affected by Altered Brain Lateralization in Adults Who Were Born Very Preterm

Language difficulties have been reported in children and adolescents who were born very preterm (<32 weeks’ gestation) and associated with an atypical lateralization of language processing, i.e., increased right-hemispheric engagement. This study used functional magnetic resonance imaging (fMRI) and spherical deconvolution tractography to study the hemodynamic responses associated with verbal fluency processing (easy and hard letter trials) and verbal fluency-related white matter fiber tracts in 64 very preterm born adults and 36 adult controls (mean age: 30 years). Tractography of the arcuate fasciculus (AF) and frontal aslant tract (FAT) was performed. Tracts were quantified in terms of mean volume, hindrance modulated orientational anisotropy, and lateralization, assessed using a laterality index (LI) to indicate hemispheric dominance. During verbal fluency fMRI, very preterm participants displayed decreased hemodynamic response suppression in both the Easy > Rest and Hard > Rest conditions, compared to controls, in superior temporal gyrus (STG), insula, thalamus, and sensorimotor cortex, particularly in the right hemisphere. At the whole-group level, decreased hemodynamic response suppression in the right sensorimotor cortex was associated with worse on-line performance on the hard letter trials. Increased left-laterality in the AF was present alongside increased right hemispheric hemodynamic response suppression in controls. When only right-handed participants were considered, decreased hemodynamic response suppression in the right STG during hard letter trials was related to weaker left and right FAT white matter integrity in the preterm group only. These results show that verbal fluency is affected by altered functional lateralization in adults who were born very preterm.

Moved by Reading in a Spanish-Speaking, Dual Language Learner Population

Purpose

The aim of this study was to evaluate the effectiveness of an English-only version and a Spanish-support version of an embodied reading comprehension intervention (Moved by Reading) consisting of 3 stages (physical manipulation, imagined manipulation, and transfer) for Spanish-English dual language learners.

Method

Sixty-one dual language learners in Arizona were randomly assigned to 4 groups (Spanish-support control, Spanish-support intervention, English-only control, and English-only intervention). Analyses of variance were used to compare control and intervention groups and to compare groups according to the language of the intervention.

Results

Children in the Spanish-support intervention group significantly outperformed both control groups during the physical manipulation stage, whereas children in the English-only intervention group outperformed both control groups in the imagined manipulation stage, but there was little transfer to a new, unrelated text.

Conclusions

The Moved by Reading intervention, in both its English-only and Spanish-support versions, improved performance on comprehension questions, but in different stages of the intervention. The Spanish-support version of the intervention was most effective in the physical manipulation stage, whereas the English-only version was more effective in the imagined manipulation stage. Neither version was effective in producing significant transfer effects.

Connection between movements of mouth and hand: Perspectives on development and evolution of speech

Mounting evidence shows interaction between manipulative hand movements and movements of tongue, lips and mouth in a vocal and non-vocal context. The current article reviews this evidence and discusses its contribution to perspectives of development and evolution of speech. In particular, the article aims to present novel insight on how processes controlling the two primary grasp components of manipulative hand movements, the precision and power grip, might be systematically connected to motor processes involved in producing certain articulatory gestures. This view assumes that due to these motor overlaps between grasping and articulation, development of these grip types in infancy can facilitate development of specific articulatory gestures. In addition, the hand-mouth connections might have even boosted the evolution of some articulatory gestures. This account also proposes that some semantic sound-symbolic pairings between a speech sound and a referent concept might be partially based on these hand-mouth interactions.

Visual cortex recruitment during language processing in blind individuals is explained by Hebbian learning

In blind people, the visual cortex takes on higher cognitive functions, including language. Why this functional reorganisation mechanistically emerges at the neuronal circuit level is still unclear. Here, we use a biologically constrained network model implementing features of anatomical structure, neurophysiological function and connectivity of fronto-temporal-occipital areas to simulate word-meaning acquisition in visually deprived and undeprived brains. We observed that, only under visual deprivation, distributed word-related neural circuits 'grew into' the deprived visual areas, which therefore adopted a linguistic-semantic role. Three factors are crucial for explaining this deprivation-related growth: changes in the network's activity balance brought about by the absence of uncorrelated sensory input, the connectivity structure of the network, and Hebbian correlation learning. In addition, the blind model revealed long-lasting spiking neural activity compared to the sighted model during word recognition, which is a neural correlate of enhanced verbal working memory. The present neurocomputational model offers a neurobiological account for neural changes following sensory deprivation, thus closing the gap between cellular-level mechanisms, system-level linguistic and semantic function.

Spontaneous synchronization to speech reveals neural mechanisms facilitating language learning

We introduce a deceptively simple behavioral task that robustly identifies two qualitatively different groups within the general population. When presented with an isochronous train of random syllables, some listeners are compelled to align their own concurrent syllable production with the perceived rate, while others remain impervious to the external rhythm. Using both neurophysiological and structural imaging approaches, we show group differences with clear consequences for speech processing and language learning. When listening passively to speech, high synchronizers show increased brain-to-stimulus synchronization over frontal areas and this localized pattern correlates with precise microstructural differences in the white matter pathway connecting frontal to auditory regions. Finally, the data expose a mechanism that underpins performance on an ecologically relevant word-learning task. We suggest that this task will helps to better understand and characterize individual performance in speech processing and language learning.

Origin and evolution of human speech: Emergence from a trimodal auditory, visual and vocal network

In recent years, there have been important additions to the classical model of speech processing as originally depicted by the Broca-Wernicke model consisting of an anterior, productive region and a posterior, perceptive region, both connected via the arcuate fasciculus. The modern view implies a separation into a dorsal and a ventral pathway conveying different kinds of linguistic information, which parallels the organization of the visual system. Furthermore, this organization is highly conserved in evolution and can be seen as the neural scaffolding from which the speech networks originated. In this chapter we emphasize that the speech networks are embedded in a multimodal system encompassing audio-vocal and visuo-vocal connections, which can be referred to an ancestral audio-visuo-motor pathway present in nonhuman primates. Likewise, we propose a trimodal repertoire for speech processing and acquisition involving auditory, visual and motor representations of the basic elements of speech: phoneme, observation of mouth movements, and articulatory processes. Finally, we discuss this proposal in the context of a scenario for early speech acquisition in infants and in human evolution.

Language as a Predictor of Motor Recovery: The Case for a More Global Approach to Stroke Rehabilitation

Stroke is the third leading cause of death in the developed world and the primary cause of adult disability. The most common site of stroke is the middle cerebral artery (MCA), an artery that supplies a range of areas involved in both language and motor function. As a consequence, many stroke patients experience a combination of language and motor deficits. Indeed, those suffering from Broca's aphasia have an 80% chance of also suffering hemiplegia. Despite the prevalence of multifaceted disability in patients, the current trend in both clinical trials and clinical practice is toward compartmentalization of dysfunction. In this article, we review evidence that aphasia and hemiplegia do not just coexist, but that they interact. We review a number of clinical reports describing how therapies for one type of deficit can improve recovery in the other and vice versa. We go on to describe how language deficits should be seen as a warning to clinicians that the patient is likely to experience motor impairment and slower motor recovery, aiding clinicians to optimize their choice of therapy. We explore these findings and offer a tentative link between language and arm function through their shared need for sequential action, which we term fluency. We propose that area BA44 (part of Broca's area) acts as a hub for fluency in both movement and language, both in terms of production and comprehension.

Is Embodied Cognition Bilingual? Current Evidence and Perspectives of the Embodied Cognition Approach to Bilingual Language Processing

Accumulating behavioral and neurophysiological evidence supports the idea of language being grounded in sensorimotor processes, with indications of a functional role of motor, sensory and emotional systems in processing both concrete and abstract linguistic concepts. However, most of the available studies focused on native language speakers (L1), with only a limited number of investigations testing embodied language processing in the case of a second language (L2). In this paper we review the available evidence on embodied effects in L2 and discuss their possible integration into existing models of linguistic processing in L1 and L2. Finally, we discuss possible avenues for future research towards an integrated model of L1 and L2 sensorimotor and emotional grounding.

Concepts dissolve artificial boundaries in the study of emotion and cognition, uniting body, brain, and mind

Theories of emotion have often maintained artificial boundaries: for instance, that cognition and emotion are separable, and that an emotion concept is separable from the emotional events that comprise its category (e.g. "fear" is distinct from instances of fear). Over the past several years, research has dissolved these artificial boundaries, suggesting instead that conceptual construction is a domain-general process-a process by which the brain makes meaning of the world. The brain constructs emotion concepts, but also cognitions and perceptions, all in the service of guiding action. In this view, concepts are multimodal constructions, dynamically prepared from a set of highly variable instances. This approach obviates old questions (e.g. how does cognition regulate emotion?) but generates new ones (e.g. how does a brain learn emotion concepts?). In this paper, we review this constructionist, predictive coding account of emotion, considering its implications for health and well-being, culture and development.

Eye activity tracks task-relevant structures during speech and auditory sequence perception

The sensory and motor systems jointly contribute to complex behaviors, but whether motor systems are involved in high-order perceptual tasks such as speech and auditory comprehension remain debated. Here, we show that ocular muscle activity is synchronized to mentally constructed sentences during speech listening, in the absence of any sentence-related visual or prosodic cue. Ocular tracking of sentences is observed in the vertical electrooculogram (EOG), whether the eyes are open or closed, and in eye blinks measured by eyetracking. Critically, the phase of sentence-tracking ocular activity is strongly modulated by temporal attention, i.e., which word in a sentence is attended. Ocular activity also tracks high-level structures in non-linguistic auditory and visual sequences, and captures rapid fluctuations in temporal attention. Ocular tracking of non-visual rhythms possibly reflects global neural entrainment to task-relevant temporal structures across sensory and motor areas, which could serve to implement temporal attention and coordinate cortical networks.

Role of Sensorimotor Cortex in Gestural-Verbal Integration

Action comprehension that is related to language or gestural integration has been shown to engage the motor system in the brain, thus providing preliminary evidence for the gestural-verbal embodiment concept. Based on the involvement of the sensorimotor cortex (M1) in language processing, we aimed to further explore its role in the cognitive embodiment necessary for gestural-verbal integration. As such, we applied anodal (excitatory) and sham transcranial direct current stimulation (tDCS) over the left M1 (with reference electrode over the contralateral supraorbital region) during a gestural-verbal integration task where subjects had to make a decision about the semantic congruency of the gesture (prime) and the word (target). We used a cross-over within-subject design in young subjects. Attentional load and simple reaction time (RT) tasks served as control conditions, applied during stimulation (order of three tasks was counterbalanced). Our results showed that anodal (atDCS) compared to sham tDCS (stDCS) reduced RTs in the gestural-verbal integration task, specifically for incongruent pairs of gestures and verbal expressions, with no effect on control task performance. Our findings provide evidence for the involvement of the sensorimotor system in gestural-verbal integration performance. Further, our results suggest that functional modulation induced by sensorimotor tDCS may be specific to gestural-verbal integration. Future studies should now evaluate the modulatory effect of tDCS on semantic congruency by using tDCS over additional brain regions and include assessments of neural connectivity.

An interactive model of auditory-motor speech perception

Mounting evidence indicates a role in perceptual decoding of speech for the dorsal auditory stream connecting between temporal auditory and frontal-parietal articulatory areas. The activation time course in auditory, somatosensory and motor regions during speech processing is seldom taken into account in models of speech perception. We critically review the literature with a focus on temporal information, and contrast between three alternative models of auditory-motor speech processing: parallel, hierarchical, and interactive. We argue that electrophysiological and transcranial magnetic stimulation studies support the interactive model. The findings reveal that auditory and somatomotor areas are engaged almost simultaneously, before 100 ms. There is also evidence of early interactions between auditory and motor areas. We propose a new interactive model of auditory-motor speech perception in which auditory and articulatory somatomotor areas are connected from early stages of speech processing. We also discuss how attention and other factors can affect the timing and strength of auditory-motor interactions and propose directions for future research.

Hierarchy of speech-driven spectrotemporal receptive fields in human auditory cortex

Existing data indicate that cortical speech processing is hierarchically organized. Numerous studies have shown that early auditory areas encode fine acoustic details while later areas encode abstracted speech patterns. However, it remains unclear precisely what speech information is encoded across these hierarchical levels. Estimation of speech-driven spectrotemporal receptive fields (STRFs) provides a means to explore cortical speech processing in terms of acoustic or linguistic information associated with characteristic spectrotemporal patterns. Here, we estimate STRFs from cortical responses to continuous speech in fMRI. Using a novel approach based on filtering randomly-selected spectrotemporal modulations (STMs) from aurally-presented sentences, STRFs were estimated for a group of listeners and categorized using a data-driven clustering algorithm. 'Behavioral STRFs' highlighting STMs crucial for speech recognition were derived from intelligibility judgments. Clustering revealed that STRFs in the supratemporal plane represented a broad range of STMs, while STRFs in the lateral temporal lobe represented circumscribed STM patterns important to intelligibility. Detailed analysis recovered a bilateral organization with posterior-lateral regions preferentially processing STMs associated with phonological information and anterior-lateral regions preferentially processing STMs associated with word- and phrase-level information. Regions in lateral Heschl's gyrus preferentially processed STMs associated with vocalic information (pitch).

Motor system recruitment during action observation: No correlation between mu-rhythm desynchronization and corticospinal excitability

Observing others’ actions desynchronizes electroencephalographic (EEG) rhythms and modulates corticospinal excitability as assessed by transcranial magnetic stimulation (TMS). However, it remains unclear if these measures reflect similar neurofunctional mechanisms at the individual level. In the present study, a within-subject experiment was designed to assess these two neurophysiological indexes and to quantify their mutual correlation. Participants observed reach-to-grasp actions directed towards a small (precision grip) or a large object (power grip). We focused on two specific time points for both EEG and TMS. The first time point (t1) coincided with the maximum hand aperture, i.e. the moment at which a significant modulation of corticospinal excitability is expected. The second (t2), coincided with the EEG resynchronization occurring at the end of the action, i.e. the moment at which a hypothetic minimum for action observation effect is expected. Results showed a Mu rhythm bilateral desynchronization at t1 with differential resynchronization at t2 in the two hemispheres. Beta rhythm was more desynchronized in the left hemisphere at both time points. These EEG differences, however, were not influenced by grip type. Conversely, motor potentials evoked by TMS in an intrinsic hand muscle revealed an interaction effect of grip and time. No significant correlations between Mu/Beta rhythms and motor evoked potentials were found. These findings are discussed considering the spatial and temporal resolution of the two investigated techniques and argue over two alternative explanations: i. each technique provides different measures of the same process or ii. they describe complementary features of the action observation network in humans.

Shared neural and cognitive mechanisms in action and language: The multiscale information transfer framework

This review compares how humans process action and language sequences produced by other humans. On the one hand, we identify commonalities between action and language processing in terms of cognitive mechanisms (e.g., perceptual segmentation, predictive processing, integration across multiple temporal scales), neural resources (e.g., the left inferior frontal cortex), and processing algorithms (e.g., comprehension based on changes in signal entropy). On the other hand, drawing on sign language with its particularly strong motor component, we also highlight what differentiates (both oral and signed) linguistic communication from nonlinguistic action sequences. We propose the multiscale information transfer framework (MSIT) as a way of integrating these insights and highlight directions into which future empirical research inspired by the MSIT framework might fruitfully evolve. This article is categorized under: Psychology > Language Linguistics > Language in Mind and Brain Psychology > Motor Skill and Performance Psychology > Prediction.