Phonatory and articulatory representations of speech production in cortical and subcortical fMRI responses

Considerations for implanting speech brain computer interfaces based on functional magnetic resonance imaging

Objective.Brain-computer interfaces (BCIs) have the potential to reinstate lost communication faculties. Results from speech decoding studies indicate that a usable speech BCI based on activity in the sensorimotor cortex (SMC) can be achieved using subdurally implanted electrodes. However, the optimal characteristics for a successful speech implant are largely unknown. We address this topic in a high field blood oxygenation level dependent functional magnetic resonance imaging (fMRI) study, by assessing the decodability of spoken words as a function of hemisphere, gyrus, sulcal depth, and position along the ventral/dorsal-axis.Approach.Twelve subjects conducted a 7T fMRI experiment in which they pronounced 6 different pseudo-words over 6 runs. We divided the SMC by hemisphere, gyrus, sulcal depth, and position along the ventral/dorsal axis. Classification was performed on in these SMC areas using multiclass support vector machine (SVM).Main results.Significant classification was possible from the SMC, but no preference for the left or right hemisphere, nor for the precentral or postcentral gyrus for optimal word classification was detected. Classification while using information from the cortical surface was slightly better than when using information from deep in the central sulcus and was highest within the ventral 50% of SMC. Confusion matrices where highly similar across the entire SMC. An SVM-searchlight analysis revealed significant classification in the superior temporal gyrus and left planum temporale in addition to the SMC.Significance.The current results support a unilateral implant using surface electrodes, covering the ventral 50% of the SMC. The added value of depth electrodes is unclear. We did not observe evidence for variations in the qualitative nature of information across SMC. The current results need to be confirmed in paralyzed patients performing attempted speech.

Decoding kinematic information from beta-band motor rhythms of speech motor cortex: a methodological/analytic approach using concurrent speech movement tracking and magnetoencephalography

Introduction

Articulography and functional neuroimaging are two major tools for studying the neurobiology of speech production. Until now, however, it has generally not been feasible to use both in the same experimental setup because of technical incompatibilities between the two methodologies.

Methods

Here we describe results from a novel articulography system dubbed Magneto-articulography for the Assessment of Speech Kinematics (MASK), which is technically compatible with magnetoencephalography (MEG) brain scanning systems. In the present paper we describe our methodological and analytic approach for extracting brain motor activities related to key kinematic and coordination event parameters derived from time-registered MASK tracking measurements. Data were collected from 10 healthy adults with tracking coils on the tongue, lips, and jaw. Analyses targeted the gestural landmarks of reiterated utterances/ipa/ and /api/, produced at normal and faster rates.

Results

The results show that (1) Speech sensorimotor cortex can be reliably located in peri-rolandic regions of the left hemisphere; (2) mu (8-12 Hz) and beta band (13-30 Hz) neuromotor oscillations are present in the speech signals and contain information structures that are independent of those present in higher-frequency bands; and (3) hypotheses concerning the information content of speech motor rhythms can be systematically evaluated with multivariate pattern analytic techniques.

Discussion

These results show that MASK provides the capability, for deriving subject-specific articulatory parameters, based on well-established and robust motor control parameters, in the same experimental setup as the MEG brain recordings and in temporal and spatial co-register with the brain data. The analytic approach described here provides new capabilities for testing hypotheses concerning the types of kinematic information that are encoded and processed within specific components of the speech neuromotor system.

Neural basis of speech and grammar symptoms in non-fluent variant primary progressive aphasia spectrum

The non-fluent/agrammatic variant of primary progressive aphasia (nfvPPA) is a neurodegenerative syndrome primarily defined by the presence of apraxia of speech (AoS) and/or expressive agrammatism. In addition, many patients exhibit dysarthria and/or receptive agrammatism. This leads to substantial phenotypic variation within the speech-language domain across individuals and time, in terms of both the specific combination of symptoms as well as their severity. How to resolve such phenotypic heterogeneity in nfvPPA is a matter of debate. 'Splitting' views propose separate clinical entities: 'primary progressive apraxia of speech' when AoS occurs in the absence of expressive agrammatism, 'progressive agrammatic aphasia' (PAA) in the opposite case, and 'AOS + PAA' when mixed motor speech and language symptoms are clearly present. While therapeutic interventions typically vary depending on the predominant symptom (e.g. AoS versus expressive agrammatism), the existence of behavioural, anatomical and pathological overlap across these phenotypes argues against drawing such clear-cut boundaries. In the current study, we contribute to this debate by mapping behaviour to brain in a large, prospective cohort of well characterized patients with nfvPPA (n = 104). We sought to advance scientific understanding of nfvPPA and the neural basis of speech-language by uncovering where in the brain the degree of MRI-based atrophy is associated with inter-patient variability in the presence and severity of AoS, dysarthria, expressive agrammatism or receptive agrammatism. Our cross-sectional examination of brain-behaviour relationships revealed three main observations. First, we found that the neural correlates of AoS and expressive agrammatism in nfvPPA lie side by side in the left posterior inferior frontal lobe, explaining their behavioural dissociation/association in previous reports. Second, we identified a 'left-right' and 'ventral-dorsal' neuroanatomical distinction between AoS versus dysarthria, highlighting (i) that dysarthria, but not AoS, is significantly influenced by tissue loss in right-hemisphere motor-speech regions; and (ii) that, within the left hemisphere, dysarthria and AoS map onto dorsally versus ventrally located motor-speech regions, respectively. Third, we confirmed that, within the large-scale grammar network, left frontal tissue loss is preferentially involved in expressive agrammatism and left temporal tissue loss in receptive agrammatism. Our findings thus contribute to define the function and location of the epicentres within the large-scale neural networks vulnerable to neurodegenerative changes in nfvPPA. We propose that nfvPPA be redefined as an umbrella term subsuming a spectrum of speech and/or language phenotypes that are closely linked by the underlying neuroanatomy and neuropathology.

Decoding Single and Paired Phonemes Using 7T Functional MRI

Several studies have shown that mouth movements related to the pronunciation of individual phonemes are represented in the sensorimotor cortex. This would theoretically allow for brain computer interfaces that are capable of decoding continuous speech by training classifiers based on the activity in the sensorimotor cortex related to the production of individual phonemes. To address this, we investigated the decodability of trials with individual and paired phonemes (pronounced consecutively with one second interval) using activity in the sensorimotor cortex. Fifteen participants pronounced 3 different phonemes and 3 combinations of two of the same phonemes in a 7T functional MRI experiment. We confirmed that support vector machine (SVM) classification of single and paired phonemes was possible. Importantly, by combining classifiers trained on single phonemes, we were able to classify paired phonemes with an accuracy of 53% (33% chance level), demonstrating that activity of isolated phonemes is present and distinguishable in combined phonemes. A SVM searchlight analysis showed that the phoneme representations are widely distributed in the ventral sensorimotor cortex. These findings provide insights about the neural representations of single and paired phonemes. Furthermore, it supports the notion that speech BCI may be feasible based on machine learning algorithms trained on individual phonemes using intracranial electrode grids.

Premotor cortex is hypoactive during sustained vowel production in individuals with Parkinson's disease and hypophonia

Introduction

Hypophonia is a common feature of Parkinson's disease (PD); however, the contribution of motor cortical activity to reduced phonatory scaling in PD is still not clear.

Methods

In this study, we employed a sustained vowel production task during functional magnetic resonance imaging to compare brain activity between individuals with PD and hypophonia and an older healthy control (OHC) group.

Results

When comparing vowel production versus rest, the PD group showed fewer regions with significant BOLD activity compared to OHCs. Within the motor cortices, both OHC and PD groups showed bilateral activation of the laryngeal/phonatory area (LPA) of the primary motor cortex as well as activation of the supplementary motor area. The OHC group also recruited additional activity in the bilateral trunk motor area and right dorsal premotor cortex (PMd). A voxel-wise comparison of PD and HC groups showed that activity in right PMd was significantly lower in the PD group compared to OHC (p < 0.001, uncorrected). Right PMd activity was positively correlated with maximum phonation time in the PD group and negatively correlated with perceptual severity ratings of loudness and pitch.

Discussion

Our findings suggest that hypoactivation of PMd may be associated with abnormal phonatory control in PD.

A somato-cognitive action network alternates with effector regions in motor cortex

Motor cortex (M1) has been thought to form a continuous somatotopic homunculus extending down the precentral gyrus from foot to face representations1,2, despite evidence for concentric functional zones3 and maps of complex actions4. Here, using precision functional magnetic resonance imaging (fMRI) methods, we find that the classic homunculus is interrupted by regions with distinct connectivity, structure and function, alternating with effector-specific (foot, hand and mouth) areas. These inter-effector regions exhibit decreased cortical thickness and strong functional connectivity to each other, as well as to the cingulo-opercular network (CON), critical for action5 and physiological control6, arousal7, errors8 and pain9. This interdigitation of action control-linked and motor effector regions was verified in the three largest fMRI datasets. Macaque and pediatric (newborn, infant and child) precision fMRI suggested cross-species homologues and developmental precursors of the inter-effector system. A battery of motor and action fMRI tasks documented concentric effector somatotopies, separated by the CON-linked inter-effector regions. The inter-effectors lacked movement specificity and co-activated during action planning (coordination of hands and feet) and axial body movement (such as of the abdomen or eyebrows). These results, together with previous studies demonstrating stimulation-evoked complex actions4 and connectivity to internal organs10 such as the adrenal medulla, suggest that M1 is punctuated by a system for whole-body action planning, the somato-cognitive action network (SCAN). In M1, two parallel systems intertwine, forming an integrate-isolate pattern: effector-specific regions (foot, hand and mouth) for isolating fine motor control and the SCAN for integrating goals, physiology and body movement.

The importance of deep speech phenotyping for neurodevelopmental and genetic disorders: a conceptual review

Background

Speech is the most common modality through which language is communicated, and delayed, disordered, or absent speech production is a hallmark of many neurodevelopmental and genetic disorders. Yet, speech is not often carefully phenotyped in neurodevelopmental disorders. In this paper, we argue that such deep phenotyping, defined as phenotyping that is specific to speech production and not conflated with language or cognitive ability, is vital if we are to understand how genetic variations affect the brain regions that are associated with spoken language.

Speech is distinct from language, though the two are related behaviorally and share neural substrates. We present a brief taxonomy of developmental speech production disorders, with particular emphasis on the motor speech disorders childhood apraxia of speech (a disorder of motor planning) and childhood dysarthria (a set of disorders of motor execution). We review the history of discoveries concerning the KE family, in whom a hereditary form of communication impairment was identified as childhood apraxia of speech and linked to dysfunction in the FOXP2 gene. The story demonstrates how instrumental deep phenotyping of speech production was in this seminal discovery in the genetics of speech and language. There is considerable overlap between the neural substrates associated with speech production and with FOXP2 expression, suggesting that further genes associated with speech dysfunction will also be expressed in similar brain regions. We then show how a biologically accurate computational model of speech production, in combination with detailed information about speech production in children with developmental disorders, can generate testable hypotheses about the nature, genetics, and neurology of speech disorders.

Conclusions

Though speech and language are distinct, specific types of developmental speech disorder are associated with far-reaching effects on verbal communication in children with neurodevelopmental disorders. Therefore, detailed speech phenotyping, in collaboration with experts on pediatric speech development and disorders, can lead us to a new generation of discoveries about how speech development is affected in genetic disorders.

Effects of Transcranial Direct Current Stimulation Over the Left Primary Motor Cortex on Verbal Intelligence

Previous studies have shown that changes in gray matter density and volume in the left primary motor cortex are significantly associated with changes in individuals’ verbal intelligence quotient (VIQ), but not with their performance intelligence quotient (PIQ). In the present study, we examined the effects of transcranial direct current stimulation (tDCS) over the left primary motor cortex on performance in intelligence tests. We chose four subtests (two each for VIQ and PIQ) of the Wechsler Adult Intelligence Scale-Chinese Revised version and randomized participants into anodal, cathodal, and sham groups. We found that anodal stimulation significantly improved performance in verbal intelligence subtests compared to cathodal and sham stimulation, while performance intelligence subtest scores did not change in any stimulation condition. These findings suggest that the excitation level of the left primary motor cortex has a unique effect on verbal intelligence.

Immediate and long-term effects of speech treatment targets and intensive dosage on Parkinson's disease dysphonia and the speech motor network: Randomized controlled trial

This study compared acoustic and neural changes accompanying two treatments matched for intensive dosage but having two different treatment targets (voice or articulation) to dissociate the effects of treatment target and intensive dosage in speech therapies. Nineteen participants with Parkinsonian dysphonia (11 F) were randomized to three groups: intensive treatment targeting voice (voice group, n = 6), targeting articulation (articulation group, n = 7), or an untreated group (no treatment, n = 6). The severity of dysphonia was assessed by the smoothed cepstral peak prominence (CPPS) and neuronal changes were evaluated by cerebral blood flow (CBF) recorded at baseline, posttreatment, and 7-month follow-up. Only the voice treatment resulted in significant posttreatment improvement in CPPS, which was maintained at 7 months. Following voice treatment, increased activity in left premotor and bilateral auditory cortices was observed at posttreatment, and in the left motor and auditory cortices at 7-month follow-up. Articulation treatment resulted in increased activity in bilateral premotor and left insular cortices that were sustained at a 7-month follow-up. Activation in the auditory cortices and a significant correlation between the CPPS and CBF in motor and auditory cortices was observed only in the voice group. The intensive dosage resulted in long-lasting behavioral and neural effects as the no-treatment group showed a progressive decrease in activity in areas of the speech motor network out to a 7-month follow-up. These results indicate that dysphonia and the speech motor network can be differentially modified by treatment targets, while intensive dosage contributes to long-lasting effects of speech treatments.

A dual larynx motor networks hypothesis

Humans are vocal modulators par excellence. This ability is supported in part by the dual representation of the laryngeal muscles in the motor cortex. Movement, however, is not the product of motor cortex alone but of a broader motor network. This network consists of brain regions that contain somatotopic maps that parallel the organization in motor cortex. We therefore present a novel hypothesis that the dual laryngeal representation is repeated throughout the broader motor network. In support of the hypothesis, we review existing literature that demonstrates the existence of network-wide somatotopy and present initial evidence for the hypothesis' plausibility. Understanding how this uniquely human phenotype in motor cortex interacts with broader brain networks is an important step toward understanding how humans evolved the ability to speak. We further suggest that this system may provide a means to study how individual components of the nervous system evolved within the context of neuronal networks. This article is part of the theme issue 'Voice modulation: from origin and mechanism to social impact (Part I)'.

The maturational gradient of infant vocalizations: Developmental stages and functional modules

Stage models have been influential in characterizing infant vocalizations in the first year of life. These models are basically descriptive and do not explain why certain types of vocal behaviors occur within a particular stage or why successive patterns of vocalization occur. This review paper summarizes and elaborates a theory of Developmental Functional Modules (DFMs) and discusses how maturational gradients in the DFMs explain age typical vocalizations as well as the transitions between successive stages or other static forms. Maturational gradients are based on biological processes that effect the reconfiguration and remodeling of the respiratory, laryngeal, and craniofacial systems during infancy. From a dynamic systems perspective, DFMs are part of a complex system with multiple degrees of freedom that can achieve stable performance with relatively few control variables by relying on principles such as synergies, self-organization, nonlinear performance, and movement variability.

Substrates of speech treatment-induced neuroplasticity in adults and children with motor speech disorders: A systematic scoping review of neuroimaging evidence

Purpose: Neuroimaging may provide clinical evidence for speech treatment-induced neuroplasticity. This review aimed to report the current scope of evidence relating to brain changes identified using neuroimaging techniques, following effective speech intervention in adults and children with motor speech disorders (MSD).Method: Studies were retrieved from five electronic databases (PubMed, CINAHL, EMBASE (Medline), SCOPUS, and Web of Science) and a general internet search.Result: Seven studies met the inclusion criteria. Using structural or functional neuroimaging techniques, five studies reported on the effects of the Lee Silverman Voice Treatment for dysarthria in adults and children, one study on the outcome of rhythmic-melodic voice training in adults with apraxia of speech, and one study on the effects of Prompts for Restructuring Oral Muscular Phonetic Targets therapy in children with idiopathic apraxia of speech. Identified brain changes included: enhanced white matter tract integrity; normalisation of baseline cortical activity; right-hemisphere shifts in re-organisation; perilesional activations; and cortical thinning.Conclusion: The current review identified preliminary evidence for treatment-dependent brain changes in adults and children with MSD. Although important to interpret within the context of Phase I research, the identification of therapeutic effects across seven heterogeneous studies suggests that treatment-induced improvements in speech performance are underpinned by demonstrable alterations in brain structure and/or function. Future research is required to better define these mechanisms of neuronal re-organisation in individuals receiving treatment for MSD, including their prognostic potential.

Right cerebral motor areas that support accurate speech production following damage to cerebellar speech areas

•

Participants with damage to cerebellar speech regions were studied with fMRI.

•

At the time of test, their speech production was accurate and precise.

•

Their speech production activation was enhanced in right hemisphere motor regions.

•

We provide hypotheses for targeting future fMRI and brain stimulation studies.

Specific regions of the cerebellum are activated when neurologically intact adults speak, and cerebellar damage can impair speech production early after stroke, but how the brain supports accurate speech production years after cerebellar damage remains unknown. We investigated this in patients with cerebellar lesions affecting regions that are normally recruited during speech production. Functional MRI activation in these patients, measured during various single word production tasks, was compared to that of neurologically intact controls, and patient controls with lesions that spared the cerebellar speech production regions. Our analyses revealed that, during a range of speech production tasks, patients with damage to cerebellar speech production regions had greater activation in the right dorsal premotor cortex (r-PMd) and right supplementary motor area (r-SMA) compared to neurologically intact controls.

The loci of increased activation in cerebral motor speech areas motivate future studies to delineate the functional contributions of different parts of the speech production network, and test whether non-invasive stimulation to r-PMd and r-SMA facilitates speech recovery after cerebellar stroke.

The Effect of Focal Damage to the Right Medial Posterior Cerebellum on Word and Sentence Comprehension and Production

Functional imaging studies of neurologically intact adults have demonstrated that the right posterior cerebellum is activated during verb generation, semantic processing, sentence processing, and verbal fluency. Studies of patients with cerebellar damage converge to show that the cerebellum supports sentence processing and verbal fluency. However, to date there are no patient studies that investigated the specific importance of the right posterior cerebellum in language processing, because: (i) case studies presented patients with lesions affecting the anterior cerebellum (with or without damage to the posterior cerebellum), and (ii) group studies combined patients with lesions to different cerebellar regions, without specifically reporting the effects of right posterior cerebellar damage. Here we investigated whether damage to the right posterior cerebellum is critical for sentence processing and verbal fluency in four patients with focal stroke damage to different parts of the right posterior cerebellum (all involving Crus II, and lobules VII and VIII). We examined detailed lesion location by going beyond common anatomical definitions of cerebellar anatomy (i.e., according to lobules or vascular territory), and employed a recently proposed functional parcellation of the cerebellum. All four patients experienced language difficulties that persisted for at least a month after stroke but three performed in the normal range within a year. In contrast, one patient with more damage to lobule IX than the other patients had profound long-lasting impairments in the comprehension and repetition of sentences, and the production of spoken sentences during picture description. Spoken and written word comprehension and visual recognition memory were also impaired, however, verbal fluency was within the normal range, together with object naming, visual perception and verbal short-term memory. This is the first study to show that focal damage to the right posterior cerebellum leads to language difficulties after stroke; and that processing impairments persisted in the case with most damage to lobule IX. We discuss these results in relation to current theories of cerebellar contribution to language processing. Overall, our study highlights the need for longitudinal studies of language function in patients with focal damage to different cerebellar regions, with functional imaging to understand the mechanisms that support recovery.

Region-specific preservation of Purkinje cell morphology and motor behavior in the ATXN1[82Q] mouse model of spinocerebellar ataxia 1

Purkinje cells are the primary processing units of the cerebellar cortex and display molecular heterogeneity that aligns with differences in physiological properties, projection patterns, and susceptibility to disease. In particular, multiple mouse models that feature Purkinje cell degeneration are characterized by incomplete and patterned Purkinje cell degeneration, suggestive of relative sparing of Purkinje cell subpopulations, such as those expressing Aldolase C/zebrinII (AldoC) or residing in the vestibulo‐cerebellum. Here, we investigated a well‐characterized Purkinje cell‐specific mouse model for spinocerebellar ataxia type 1 (SCA1) that expresses human ATXN1 with a polyQ expansion (82Q). Our pathological analysis confirms previous findings that Purkinje cells of the vestibulo‐cerebellum, i.e., the flocculonodular lobes, and crus I are relatively spared from key pathological hallmarks: somatodendritic atrophy, and the appearance of p62/SQSTM1‐positive inclusions. However, immunohistological analysis of transgene expression revealed that spared Purkinje cells do not express mutant ATXN1 protein, indicating the sparing of Purkinje cells can be explained by an absence of transgene expression. Additionally, we found that Purkinje cells in other cerebellar lobules that typically express AldoC, not only display severe pathology but also show loss of AldoC expression. The relatively preserved flocculonodular lobes and crus I showed a substantial fraction of Purkinje cells that expressed the mutant protein and displayed pathology as well as loss of AldoC expression. Despite considerable pathology in these lobules, behavioral analyses demonstrated a relative sparing of related functions, suggestive of sufficient functional cerebellar reserve. Together, the data indicate that mutant ATXN1 affects both AldoC‐positive and AldoC‐negative Purkinje cells and disrupts normal parasagittal AldoC expression in Purkinje cells. Our results show that, in a mouse model otherwise characterized by widespread Purkinje cell degeneration, sparing of specific subpopulations is sufficient to maintain normal performance of specific behaviors within the context of the functional, modular map of the cerebellum.