Inferior frontal sensitivity to common speech sounds is amplified by increasing word intelligibility

Neural evidence suggests phonological acceptability judgments reflect similarity, not constraint evaluation

Acceptability judgments are a primary source of evidence in formal linguistic research. Within the generative linguistic tradition, these judgments are attributed to evaluation of novel forms based on implicit knowledge of rules or constraints governing well-formedness. In the domain of phonological acceptability judgments, other factors including ease of articulation and similarity to known forms have been hypothesized to influence evaluation. We used data-driven neural techniques to identify the relative contributions of these factors. Granger causality analysis of magnetic resonance imaging (MRI)-constrained magnetoencephalography (MEG) and electroencephalography (EEG) data revealed patterns of interaction between brain regions that support explicit judgments of the phonological acceptability of spoken nonwords. Comparisons of data obtained with nonwords that varied in terms of onset consonant cluster attestation and acceptability revealed different cortical regions and effective connectivity patterns associated with phonological acceptability judgments. Attested forms produced stronger influences of brain regions implicated in lexical representation and sensorimotor simulation on acoustic-phonetic regions, whereas unattested forms produced stronger influence of phonological control mechanisms on acoustic-phonetic processing. Unacceptable forms produced widespread patterns of interaction consistent with attempted search or repair. Together, these results suggest that speakers' phonological acceptability judgments reflect lexical and sensorimotor factors.

The cortical organization of listening effort: New insight from functional near-infrared spectroscopy

Everyday challenges impact our ability to hear and comprehend spoken language with ease, such as accented speech (source factors), spectral degradation (transmission factors), complex or unfamiliar language use (message factors), and predictability (context factors). Auditory degradation and linguistic complexity in the brain and behavior have been well investigated, and several computational models have emerged. The work here provides a novel test of the hypotheses that listening effort is partially reliant on higher cognitive auditory attention and working memory mechanisms in the frontal lobe, and partially reliant on hierarchical linguistic computation in the brain's left hemisphere. We specifically hypothesize that these models are robust and can be applied in ecologically relevant and coarse-grain contexts that rigorously control for acoustic and linguistic listening challenges. Using functional near-infrared spectroscopy during an auditory plausibility judgment task, we show the hierarchical cortical organization for listening effort in the frontal and left temporal-parietal brain regions. In response to increasing levels of cognitive demand, we found (i) poorer comprehension, (ii) slower reaction times, (iii) increasing levels of perceived mental effort, (iv) increasing levels of brain activity in the prefrontal cortex, (v) hierarchical modulation of core language processing regions that reflect increasingly higher-order auditory-linguistic processing, and (vi) a correlation between participants' mental effort ratings and their performance on the task. Our results demonstrate that listening effort is partly reliant on higher cognitive auditory attention and working memory mechanisms in the frontal lobe and partly reliant on hierarchical linguistic computation in the brain's left hemisphere. Further, listening effort is driven by a voluntary, motivation-based attention system for which our results validate the use of a single-item post-task questionnaire for measuring perceived levels of mental effort and predicting listening performance. We anticipate our study to be a starting point for more sophisticated models of listening effort and even cognitive neuroplasticity in hearing aid and cochlear implant users.

Behavioral and Neurodynamic Effects of Word Learning on Phonotactic Repair

Processes governing the creation, perception and production of spoken words are sensitive to the patterns of speech sounds in the language user's lexicon. Generative linguistic theory suggests that listeners infer constraints on possible sound patterning from the lexicon and apply these constraints to all aspects of word use. In contrast, emergentist accounts suggest that these phonotactic constraints are a product of interactive associative mapping with items in the lexicon. To determine the degree to which phonotactic constraints are lexically mediated, we observed the effects of learning new words that violate English phonotactic constraints (e.g., srigin) on phonotactic perceptual repair processes in nonword consonant-consonant-vowel (CCV) stimuli (e.g., /sre/). Subjects who learned such words were less likely to "repair" illegal onset clusters (/sr/) and report them as legal ones (/∫r/). Effective connectivity analyses of MRI-constrained reconstructions of simultaneously collected magnetoencephalography (MEG) and EEG data showed that these behavioral shifts were accompanied by changes in the strength of influences of lexical areas on acoustic-phonetic areas. These results strengthen the interpretation of previous results suggesting that phonotactic constraints on perception are produced by top-down lexical influences on speech processing.

Neuroanatomical structures supporting lexical diversity, sophistication, and phonological word features during discourse

Deficits in lexical retrieval are commonly observed in individuals with post-stroke aphasia. Successful lexical retrieval is related to lexical diversity, lexical sophistication, and phonological word properties; however, the crucial brain regions supporting these different features are not fully understood. We performed MRI-based lesion symptom mapping in 58 individuals with a chronic left hemisphere stroke to assess how regional damage relates to spoken discourse-extracted measures of lexical diversity, lexical sophistication, and phonological word properties. For discourse transcription and word feature analysis, we used the Computerized Language Analysis (CLAN) program, Stanford Core Natural Language Processing, Irvine Phonotactic Online Dictionary, Lexical Complexity Analyzer, and Gramulator. Lesions involving the left posterior insula and supramarginal gyri and inferior fronto-occipital fasciculus were significant predictors of utterances with, on average, lower lexical diversity. Low lexical sophistication was associated with damage to the left pole of the superior temporal gyrus. Production of words with lower phonological complexity (fewer phonemes, higher phonological similarity) was associated with damage to the left supramarginal gyrus. Our findings indicate that discourse-extracted features of lexical retrieval depend on the integrity of specific brain regions involving insular and peri-Sylvian areas. The identified regions provide insight into potentially underlying mechanisms of lexically diverse, sophisticated and phonologically complex words produced during discourse.

•

Word production in connected speech of individuals with post-stroke aphasia depends on lesion locations

•

Low lexical diversity is linked to lesions to the left insula, supramarginal gyrus and inferior fronto-occipital fasciculus

•

Lexical sophistication is linked to lesions to the left pole of the temporal gyrus

•

Phonological word features are linked to lesions to the left supramarginal gyrus

•

Features of lexical retrieval in connected speech depend on the integrity of ventral and dorsal language processing streams

Listening under difficult conditions: An activation likelihood estimation meta-analysis

The brain networks supporting speech identification and comprehension under difficult listening conditions are not well specified. The networks hypothesized to underlie effortful listening include regions responsible for executive control. We conducted meta-analyses of auditory neuroimaging studies to determine whether a common activation pattern of the frontal lobe supports effortful listening under different speech manipulations. Fifty-three functional neuroimaging studies investigating speech perception were divided into three independent Activation Likelihood Estimate analyses based on the type of speech manipulation paradigm used: Speech-in-noise (SIN, 16 studies, involving 224 participants); spectrally degraded speech using filtering techniques (15 studies involving 270 participants); and linguistic complexity (i.e., levels of syntactic, lexical and semantic intricacy/density, 22 studies, involving 348 participants). Meta-analysis of the SIN studies revealed higher effort was associated with activation in left inferior frontal gyrus (IFG), left inferior parietal lobule, and right insula. Studies using spectrally degraded speech demonstrated increased activation of the insula bilaterally and the left superior temporal gyrus (STG). Studies manipulating linguistic complexity showed activation in the left IFG, right middle frontal gyrus, left middle temporal gyrus and bilateral STG. Planned contrasts revealed left IFG activation in linguistic complexity studies, which differed from activation patterns observed in SIN or spectral degradation studies. Although there were no significant overlap in prefrontal activation across these three speech manipulation paradigms, SIN and spectral degradation showed overlapping regions in left and right insula. These findings provide evidence that there is regional specialization within the left IFG and differential executive networks underlie effortful listening.

Orthographic influence on spoken word identification: Behavioral and fMRI evidence

The current study investigated behavioral and neuroimaging evidence for orthographic influences on auditory word identification. To assess such influences, the proportion of similar sounding words (i.e. phonological neighbors) that were also spelled similarly (i.e., orthographic neighbors) was computed for each auditorily presented word as the Orthographic-to-Phonological Overlap Ratio (OPOR). Speech intelligibility was manipulated by presenting monosyllabic words in multi-talker babble at two signal-to-noise ratios: + 3 and + 10 dB SNR. Identification rates were lower for high overlap words in the challenging + 3 dB SNR condition. In addition, BOLD contrast increased with OPOR at the more difficult SNR, and decreased with OPOR under more favorable SNR conditions. Both voxel-based and region of interest analyses demonstrated robust effects of OPOR in several cingulo-opercular regions. However, contrary to prior theoretical accounts, no task-related activity was observed in posterior regions associated with phonological or orthographic processing. We suggest that, when processing is difficult, orthographic-to-phonological feature overlap increases the availability of competing responses, which then requires additional support from domain general performance systems in order to produce a single response.

Phonotactic processing deficit following left-hemisphere stroke

The neural basis of speech processing is still a matter of great debate. Phonotactic knowledge-knowledge of the allowable sound combinations in a language-remains particularly understudied. The purpose of this study was to investigate the brain regions crucial to phonotactic knowledge in left-hemisphere stroke survivors. Results were compared to areas in which gray matter anatomy related to phonotactic knowledge in healthy controls. 44 patients with chronic left-hemisphere stroke, and 32 controls performed an English-likeness rating task on 60 auditory non-words of varying phonotactic regularities. They were asked to rate on a 1-5 scale, how close each non-word sounded to English. Patients' performance was compared to that of healthy controls, using mixed effects modeling. Multivariate lesion-symptom mapping and voxel-based morphometry were used to find the brain regions important for phonotactic processing in patients and controls respectively. The results showed that compared to controls, stroke survivors were less sensitive to phonotactic regularity differences. Lesion-symptom mapping demonstrated that a loss of sensitivity to phonotactic regularities was associated with lesions in left angular gyrus and posterior middle temporal gyrus. Voxel-based morphometry also revealed a positive correlation between gray matter density in left angular gyrus and sensitivity to phonotactic regularities in controls. We suggest that the angular gyrus is used to compare the incoming speech stream to internal predictions based on the frequency of sound sequences in the language derived from stored lexical representations in the posterior middle temporal gyrus.

Neural sensitivity to syllable frequency and mutual information in speech perception and production

Many factors affect our ability to decode the speech signal, including its quality, the complexity of the elements that compose it, as well as their frequency of occurrence and co-occurrence in a language. Syllable frequency effects have been described in the behavioral literature, including facilitatory effects during speech production and inhibitory effects during word recognition, but the neural mechanisms underlying these effects remain largely unknown. The objective of this study was to examine, using functional neuroimaging, the neurobiological correlates of three different distributional statistics in simple 2-syllable nonwords: the frequency of the first and second syllables, and the mutual information between the syllables. We examined these statistics during nonword perception and production using a powerful single-trial analytical approach. We found that repetition accuracy was higher for nonwords in which the frequency of the first syllable was high. In addition, brain responses to distributional statistics were widespread and almost exclusively cortical. Importantly, brain activity was modulated in a distinct manner for each statistic, with the strongest facilitatory effects associated with the frequency of the first syllable and mutual information. These findings show that distributional statistics modulate nonword perception and production. We discuss the common and unique impact of each distributional statistic on brain activity, as well as task differences.