Contribution of consonant versus vowel information to sentence intelligibility for young normal-hearing and elderly hearing-impaired listeners

Increased vowel contrast and intelligibility in connected speech induced by sensorimotor adaptation

Alterations to sensory feedback can drive robust adaptive changes to the production of consonants and vowels, but these changes often have no behavioral relevance or benefit to communication (e.g., making "head" more like "had"). This work aims to align the outcomes of adaptation with changes known to increase speech intelligibility - specifically, adaptations that increase the acoustic contrast between vowels in running speech. To this end, we implemented a vowel centralization feedback perturbation paradigm that pushes all vowels towards the center of vowel space, making them sound less distinct from one another. Speakers across the adult lifespan adapted to the centralization perturbation during sentence production, increasing the global acoustic contrast among vowels and the articulatory excursions for individual vowels. These changes persisted after the perturbation was removed, including after a silent delay, and showed robust transfer to words that were not present in the sentences. Control analyses demonstrated that these effects were unlikely to be due to explicit pronunciation strategies and occurred in the face of increasingly more rapid and less distinct production of familiar sentences. Finally, sentence transcription by crowd-sourced listeners showed that speakers' vowel contrast predicted their baseline intelligibility and that experimentally-induced increases in contrast predicted intelligibility gains. These findings establish the validity of a sensorimotor adaptation paradigm to implicitly increase vowel contrast and intelligibility in connected speech, an outcome that has the potential to enhance rehabilitation in individuals who present with a reduced vowel space due to motor speech disorders, such as the hypokinetic dysarthria associated with Parkinson's disease.

Uncertainty of Vowel Predictions as a Digital Biomarker for Ataxic Dysarthria

Dysarthria is a common manifestation across cerebellar ataxias leading to impairments in communication, reduced social connections, and decreased quality of life. While dysarthria symptoms may be present in other neurological conditions, ataxic dysarthria is a perceptually distinct motor speech disorder, with the most prominent characteristics being articulation and prosody abnormalities along with distorted vowels. We hypothesized that uncertainty of vowel predictions by an automatic speech recognition system can capture speech changes present in cerebellar ataxia. Speech of participants with ataxia (N=61) and healthy controls (N=25) was recorded during the "picture description" task. Additionally, participants' dysarthric speech and ataxia severity were assessed on a Brief Ataxia Rating Scale (BARS). Eight participants with ataxia had speech and BARS data at two timepoints. A neural network trained for phoneme prediction was applied to speech recordings. Average entropy of vowel tokens predictions (AVE) was computed for each participant's recording, together with mean pitch and intensity standard deviations (MPSD and MISD) in the vowel segments. AVE and MISD demonstrated associations with BARS speech score (Spearman's rho=0.45 and 0.51), and AVE demonstrated associations with BARS total (rho=0.39). In the longitudinal cohort, Wilcoxon pairwise signed rank test demonstrated an increase in BARS total and AVE, while BARS speech and acoustic measures did not significantly increase. Relationship of AVE to both BARS speech and BARS total, as well as the ability to capture disease progression even in absence of measured speech decline, indicates the potential of AVE as a digital biomarker for cerebellar ataxia.

English vowel recognition in multi-talker babbles mixed with different numbers of talkersa)

The present study examined English vowel recognition in multi-talker babbles (MTBs) in 20 normal-hearing, native-English-speaking adult listeners. Twelve vowels, embedded in the h-V-d structure, were presented in MTBs consisting of 1, 2, 4, 6, 8, 10, and 12 talkers (numbers of talkers [N]) and a speech-shaped noise at signal-to-noise ratios of -12, -6, and 0 dB. Results showed that vowel recognition performance was a non-monotonic function of N when signal-to-noise ratios were less favorable. The masking effects of MTBs on vowel recognition were most similar to consonant recognition but less so to word and sentence recognition reported in previous studies.

The effects of estimation accuracy, estimation approach, and number of selected channels using formant-priority channel selection for an "n-of-m" sound processing strategy for cochlear implants

Previously, selection of l channels was prioritized according to formant frequency locations in an l-of-n-of-m-based signal processing strategy to provide important voicing information independent of listening environments for cochlear implant (CI) users. In this study, ideal, or ground truth, formants were incorporated into the selection stage to determine the effect of accuracy on (1) subjective speech intelligibility, (2) objective channel selection patterns, and (3) objective stimulation patterns (current). An average +11% improvement (p < 0.05) was observed across six CI users in quiet, but not for noise or reverberation conditions. Analogous increases in channel selection and current for the upper range of F1 and a decrease across mid-frequencies with higher corresponding current, were both observed at the expense of noise-dominant channels. Objective channel selection patterns were analyzed a second time to determine the effects of estimation approach and number of selected channels (n). A significant effect of estimation approach was only observed in the noise and reverberation condition with minor differences in channel selection and significantly decreased stimulated current. Results suggest that estimation method, accuracy, and number of channels in the proposed strategy using ideal formants may improve intelligibility when corresponding stimulated current of formant channels are not masked by noise-dominant channels.

The Formant Bandwidth as a Measure of Vowel Intelligibility in Dysphonic Speech

OBJECTIVE

The current paper examined the impact of dysphonia on the bandwidth of the first two formants of vowels, and the relationship between the formant bandwidth and vowel intelligibility.

METHODS

Speaker participants of the study were 10 adult females with healthy voice and 10 adult females with dysphonic voice. Eleven vowels in American English were recorded in /h/-vowel-/d/ format. The vowels were presented to 10 native speakers of American English with normal hearing, who were asked to select a vowel they heard from a list of /h/-vowel-/d/ words. The vowels were acoustically analyzed to measure the bandwidth of the first and second formants (B1 and B2). Separate Wilcoxon rank sum tests were conducted for each vowel for normal and dysphonic speech because the differences in B1 and B2 were found to not be normally distributed. Spearman correlation tests were conducted to evaluate the association between the difference in formant bandwidths and vowel intelligibility between the healthy and dysphonic speakers.

RESULTS

B1 was significantly greater in dysphonic vowels for seven of the eleven vowels, and lesser for only one of the vowels. There was no statistically significant difference in B2 between the normal and dysphonic vowels, except for the vowel /i/. The difference in B1 between normal and dysphonic vowels strongly predicted the intelligibility difference.

CONCLUSION

Dysphonia significantly affects B1, and the difference in B1 may serve as an acoustic marker for the intelligibility reduction in dysphonic vowels. This acoustic-perceptual relationship should be confirmed by a larger-scale study in the future.

Can Closed-Set Word Recognition Differentially Assess Vowel and Consonant Perception for School-Age Children With and Without Hearing Loss?

PURPOSE

Vowels and consonants play different roles in language acquisition and speech recognition, yet standard clinical tests do not assess vowel and consonant perception separately. As a result, opportunities for targeted intervention may be lost. This study evaluated closed-set word recognition tests designed to rely predominantly on either vowel or consonant perception and compared results with sentence recognition scores.

METHOD

Participants were children (5-17 years of age) and adults (18-38 years of age) with normal hearing and children with sensorineural hearing loss (7-17 years of age). Speech reception thresholds (SRTs) were measured in speech-shaped noise. Children with hearing loss were tested with their hearing aids. Word recognition was evaluated using a three-alternative forced-choice procedure, with a picture-pointing response; monosyllabic target words varied with respect to either consonant or vowel content. Sentence recognition was evaluated for low- and high-probability sentences. In a subset of conditions, stimuli were low-pass filtered to simulate a steeply sloping hearing loss in participants with normal hearing.

RESULTS

Children's SRTs improved with increasing age for words and sentences. Low-pass filtering had a larger effect for consonant-variable words than vowel-variable words for both children and adults with normal hearing, consistent with the greater high-frequency content of consonants. Children with hearing loss tested with hearing aids tended to perform more poorly than age-matched children with normal hearing, particularly for sentence recognition, but consonant- and vowel-variable word recognition did not appear to be differentially affected by the amount of high- and low-frequency hearing loss.

CONCLUSIONS

Closed-set recognition of consonant- and vowel-variable words appeared to differentially evaluate vowel and consonant perception but did not vary by configuration of hearing loss in this group of pediatric hearing aid users. Word scores obtained in this manner do not fully characterize the auditory abilities necessary for open-set sentence recognition, but they do provide a general estimate.

A temporal-based therapy for children with inconsistent phonological disorder: A case-series

Deficits in temporal auditory processing, and in particular higher gap detection thresholds have been reported in children with inconsistent phonological disorder (IPD). Here we hypothesized that providing these children with extra time for phoneme identification may in turn enhance their phonological planning abilities for production, and accordingly improve not only consistency but also accuracy of their speech. We designed and tested a new temporal-based therapy, inspired by Core Vocabulary Therapy and called it T-CVT, where we digitally lengthened formant transitions between phonemes of words used for therapy. This allowed to target both temporal auditory processing and word phonological planning. Four preschool Persian native children with IPD received T-CVT for eight weeks. We measured changes in speech consistency (% inconsistency) and accuracy (percentage of consonants correct PCC) to assess the effects of the intervention. Therapy significantly improved both consistency and accuracy of word production in the four children: % inconsistency decreased from 59% on average before therapy to 2% post-T-CVT, and PCC increased from 61% to 92% on average. Consistency and accuracy were furthermore maintained or even still improved at three-month follow-up (2% inconsistency and 99% PCC). Results in a nonword repetition task showed the generalization of these effects to non-treated material: % inconsistency for nonwords decreased from 67% to 10% post-therapy, and PCC increased from 63% to 90%. These preliminary findings support the efficacy of the T-CVT intervention for children with IPD who show temporal auditory processing deficits as reflected by higher gap detection thresholds.

Effect of Protective Face Coverings on Sentence Recognition in Noise for Cochlear Implant Patients

PURPOSE

The purpose of this study was to assess the influence of talker protective face coverings on sentence recognition in noise for cochlear implant users.

METHOD

The AzBio sentences were recorded in three conditions: (a) without any face covering (uncovered), (b) with an N95 mask, or (c) with an N95 mask plus face shield. Target sentences were presented at 60 dB SPL, and the 10-talker masker was presented at 50 dB SPL (10 dB signal-to-noise ratio. Speech recognition for these auditory stimuli was compared across conditions for 21 adult subjects with at least 6 months of cochlear implant (CI) use.

RESULTS

Significant deterioration in sentence recognition was observed for the N95 plus face shield (Mdn = 27% [IQR: 14%-35%]) compared with the N95 (Mdn = 72% [IQR: 55%-78%]) condition and for the N95 compared to uncovered (Mdn = 86% [IQR: 68%-91%]) condition.

CONCLUSIONS

Talker protective face coverings have a significant influence on speech recognition in noise for CI users. More research is needed to understand the influence of visual cues with protective face coverings that include a plastic component allowing visualization of the talker's face.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.19326395.

The effects of Lombard perturbation on speech intelligibility in noise for normal hearing and cochlear implant listeners

Natural compensation of speech production in challenging listening environments is referred to as the Lombard effect (LE). The resulting acoustic differences between neutral and Lombard speech have been shown to provide intelligibility benefits for normal hearing (NH) and cochlear implant (CI) listeners alike. Motivated by this outcome, three LE perturbation approaches consisting of pitch, duration, formant, intensity, and spectral contour modifications were designed specifically for CI listeners to combat speech-in-noise performance deficits. Experiment 1 analyzed the effects of loudness, quality, and distortion of approaches on speech intelligibility with and without formant-shifting. Significant improvements of +9.4% were observed in CI listeners without the formant-shifting approach at +5 dB signal-to-noise ratio (SNR) large-crowd-noise (LCN) when loudness was controlled, however, performance was found to be significantly lower for NH listeners. Experiment 2 evaluated the non-formant-shifting approach with additional spectral contour and high pass filtering to reduce spectral smearing and decrease distortion observed in Experiment 1. This resulted in significant intelligibility benefits of +30.2% for NH and +21.2% for CI listeners at 0 and +5 dB SNR LCN, respectively. These results suggest that LE perturbation may be useful as front-end speech modification approaches to improve intelligibility for CI users in noise.

The role of glimpses with different energy in speech-in-noise recognition

Listeners can understand speech in noise by "glimpsing" some of the speech regions less affected by noise. This study investigates the contributions of those spectro-temporal regions, known as glimpses, at different energy levels to speech intelligibility in noise. Two listening experiments were conducted to examine the intelligibility of speech in different glimpse compositions in two types of noise. The results suggest that glimpsed spectro-temporal regions with energy above the mean noise level are the primary cue for speech perception in noise, and that listeners can use less-robust cues until at least 15 dB below the glimpsing threshold.

Speech-Language Pathologists' Ratings of Speech Accuracy in Children With Speech Sound Disorders

PURPOSE

Forming accurate and consistent speech judgments can be challenging when working with children with speech sound disorders who produce a large number and varied types of error patterns. Rating scales offer a systematic approach to assessing the whole word rather than individual sounds. Thus, these scales can be an efficient way for speech-language pathologists (SLPs) to monitor treatment progress. This study evaluated the interrater reliability of an existing 3-point rating scale using a large group of SLPs as raters.

METHOD

Utilizing an online platform, 30 SLPs completed a brief training and then rated single words produced by children with typical speech patterns and children with speech sound disorders. Words were closely balanced across the three rating categories of the scale. The interrater reliability of the SLPs ratings to a consensus judgment was examined.

RESULTS

The majority of SLPs (87%) reached substantial interrater reliability to a consensus judgment using the 3-point rating scale. Correct productions had the highest interrater reliability. Productions with extensive errors had higher agreement than those with minor errors. Certain error types, such as vowel distortions, were especially challenging for SLPs to judge.

CONCLUSIONS

This study demonstrated substantial interrater reliability to a consensus judgment among a large majority of 30 SLPs using a 3-point rating. The clinical implications of the findings are discussed along with proposed modifications to the training procedure to guide future research.

Single-Channel Focused Thresholds Relate to Vowel Identification in Pediatric and Adult Cochlear Implant Listeners

Speech recognition outcomes are highly variable among pediatric and adult cochlear implant (CI) listeners. Although there is some evidence that the quality of the electrode-neuron interface (ENI) contributes to this large variability in auditory perception, its relationship with speech outcomes is not well understood. Single-channel auditory detection thresholds measured in response to focused electrical fields (i.e., focused thresholds) are sensitive to properties of ENI quality, including electrode-neuron distance, intracochlear resistance, and neural health. In the present study, focused thresholds and speech perception abilities were assessed in 15 children and 21 adult CI listeners. Focused thresholds were measured for all active electrodes using a fast sweep procedure. Speech perception performance was evaluated by assessing listeners’ ability to identify vowels presented in /h-vowel-d/ context. Consistent with prior literature, focused thresholds were lower for children than for adults, but vowel identification did not differ significantly across age groups. Higher across-array average focused thresholds, which may indicate a relatively poor ENI quality, were associated with poorer vowel identification scores in both children and adults. Adult CI listeners with longer durations of deafness had higher focused thresholds. Findings from this study demonstrate that poor-quality ENIs may contribute to reduced speech outcomes for pediatric and adult CI listeners. Estimates of ENI quality (e.g., focused thresholds) may assist in developing customized programming interventions that serve to improve the transmission of spectral cues that are important in vowel identification.

Relative Weights of Temporal Envelope Cues in Different Frequency Regions for Mandarin Vowel, Consonant, and Lexical Tone Recognition

Objectives: Mandarin-speaking users of cochlear implants (CI) perform poorer than their English counterpart. This may be because present CI speech coding schemes are largely based on English. This study aims to evaluate the relative contributions of temporal envelope (E) cues to Mandarin phoneme (including vowel, and consonant) and lexical tone recognition to provide information for speech coding schemes specific to Mandarin.

Design: Eleven normal hearing subjects were studied using acoustic temporal E cues that were extracted from 30 continuous frequency bands between 80 and 7,562 Hz using the Hilbert transform and divided into five frequency regions. Percent-correct recognition scores were obtained with acoustic E cues presented in three, four, and five frequency regions and their relative weights calculated using the least-square approach.

Results: For stimuli with three, four, and five frequency regions, percent-correct scores for vowel recognition using E cues were 50.43–84.82%, 76.27–95.24%, and 96.58%, respectively; for consonant recognition 35.49–63.77%, 67.75–78.87%, and 87.87%; for lexical tone recognition 60.80–97.15%, 73.16–96.87%, and 96.73%. For frequency region 1 to frequency region 5, the mean weights in vowel recognition were 0.17, 0.31, 0.22, 0.18, and 0.12, respectively; in consonant recognition 0.10, 0.16, 0.18, 0.23, and 0.33; in lexical tone recognition 0.38, 0.18, 0.14, 0.16, and 0.14.

Conclusion: Regions that contributed most for vowel recognition was Region 2 (502–1,022 Hz) that contains first formant (F1) information; Region 5 (3,856–7,562 Hz) contributed most to consonant recognition; Region 1 (80–502 Hz) that contains fundamental frequency (F0) information contributed most to lexical tone recognition.

Intelligibility of dysphonic speech in auralized classrooms

Voice disorders can reduce the speech intelligibility of affected speakers. This study evaluated the effect of noise, voice disorders, and room acoustics on vowel intelligibility, listening easiness, and the listener's reaction time. Three adult females with dysphonia and three adult females with normal voice quality recorded a series of nine vowels of American English in /h/-V-/d/ format (e.g., "had"). The recordings were convolved with two oral-binaural impulse responses acquired from measurements in two classrooms with 0.4 and 3.1 s of reverberation time, respectively. The stimuli were presented in a forced-choice format to 29 college students. The intelligibility and the listening easiness were significantly higher in quiet than in noisy conditions, when the speakers had normal voice quality compared to a dysphonic voice, and in low reverberated environments compared to high reverberated environments. The response time of the listener was significantly longer for speech presented in noisy conditions compared to quiet conditions and when the voice was dysphonic compared with healthy voice quality.

Optimizing linguistic materials for feature-based intelligibility assessment in speech impairments

Assessing the intelligibility of speech-disordered individuals generally involves asking them to read aloud texts such as word lists, a procedure that can be time-consuming if the materials are lengthy. This paper seeks to optimize such elicitation materials by identifying an optimal trade-off between the quantity of material needed for assessment purposes and its capacity to elicit a robust intelligibility metrics. More specifically, it investigates the effect of reducing the number of pseudowords used in a phonetic-acoustic decoding task in a speech-impaired population in terms of the subsequent impact on the intelligibility classifier as quantified by accuracy indexes (AUC of ROC, Balanced Accuracy index and F-scores). A comparison of obtained accuracy indexes shows that when reduction of the amount of elicitation material is based on a phonetic criterion-here, related to phonotactic complexity-the classifier has a higher classifying ability than when the material is arbitrarily reduced. Crucially, downsizing the material to about 30% of the original dataset does not diminish the classifier's performance nor affect its stability. This result is of significant interest to clinicians as well as patients since it validates a tool that is both reliable and efficient.

EEG-based auditory attention decoding using speech-level-based segmented computational models

Objective.Auditory attention in complex scenarios can be decoded by electroencephalography (EEG)-based cortical speech-envelope tracking. The relative root-mean-square (RMS) intensity is a valuable cue for the decomposition of speech into distinct characteristic segments. To improve auditory attention decoding (AAD) performance, this work proposed a novel segmented AAD approach to decode target speech envelopes from different RMS-level-based speech segments.Approach.Speech was decomposed into higher- and lower-RMS-level speech segments with a threshold of -10 dB relative RMS level. A support vector machine classifier was designed to identify higher- and lower-RMS-level speech segments, using clean target and mixed speech as reference signals based on corresponding EEG signals recorded when subjects listened to target auditory streams in competing two-speaker auditory scenes. Segmented computational models were developed with the classification results of higher- and lower-RMS-level speech segments. Speech envelopes were reconstructed based on segmented decoding models for either higher- or lower-RMS-level speech segments. AAD accuracies were calculated according to the correlations between actual and reconstructed speech envelopes. The performance of the proposed segmented AAD computational model was compared to those of traditional AAD methods with unified decoding functions.Main results.Higher- and lower-RMS-level speech segments in continuous sentences could be identified robustly with classification accuracies that approximated or exceeded 80% based on corresponding EEG signals at 6 dB, 3 dB, 0 dB, -3 dB and -6 dB signal-to-mask ratios (SMRs). Compared with unified AAD decoding methods, the proposed segmented AAD approach achieved more accurate results in the reconstruction of target speech envelopes and in the detection of attentional directions. Moreover, the proposed segmented decoding method had higher information transfer rates (ITRs) and shorter minimum expected switch times compared with the unified decoder.Significance.This study revealed that EEG signals may be used to classify higher- and lower-RMS-level-based speech segments across a wide range of SMR conditions (from 6 dB to -6 dB). A novel finding was that the specific information in different RMS-level-based speech segments facilitated EEG-based decoding of auditory attention. The significantly improved AAD accuracies and ITRs of the segmented decoding method suggests that this proposed computational model may be an effective method for the application of neuro-controlled brain-computer interfaces in complex auditory scenes.

Speech aging: Production and perception

In this overview we describe literature on how speech production and speech perception change in healthy or normal aging across the adult lifespan. In the production section we review acoustic characteristics that have been investigated as potentially distinguishing younger and older adults. In the speech perception section studies concerning speaker age estimation and those investigating older listeners' perception are addressed. Our discussion focuses on major themes and other fruitful areas for future research. This article is categorized under: Linguistics > Language in Mind and Brain Linguistics > Linguistic Theory Psychology > Development and Aging.

Influence of Protective Face Coverings on the Speech Recognition of Cochlear Implant Patients

Objectives

The objectives were to characterize the effects of wearing face coverings on: 1) acoustic speech cues, and 2) speech recognition of patients with hearing loss who listen with a cochlear implant.

Methods

A prospective cohort study was performed in a tertiary referral center between July and September 2020. A female talker recorded sentences in three conditions: no face covering, N95 mask, and N95 mask plus a face shield. Spectral differences were analyzed between speech produced in each condition. The speech recognition in each condition for twenty‐three adult patients with at least 6 months of cochlear implant use was assessed.

Results

Spectral analysis demonstrated preferential attenuation of high‐frequency speech information with the N95 mask plus face shield condition compared to the other conditions. Speech recognition did not differ significantly between the uncovered (median 90% [IQR 89%–94%]) and N95 mask conditions (91% [IQR 86%–94%]; P = .253); however, speech recognition was significantly worse in the N95 mask plus face shield condition (64% [IQR 48%–75%]) compared to the uncovered (P < .001) or N95 mask (P < .001) conditions.

Conclusions

The type and combination of protective face coverings used have differential effects on attenuation of speech information, influencing speech recognition of patients with hearing loss. In the face of the COVID‐19 pandemic, there is a need to protect patients and clinicians from spread of disease while maximizing patient speech recognition. The disruptive effect of wearing a face shield in conjunction with a mask may prompt clinicians to consider alternative eye protection, such as goggles, in appropriate clinical situations.

Level of Evidence

3 Laryngoscope, 131:E2038–E2043, 2021

Robust EEG-Based Decoding of Auditory Attention With High-RMS-Level Speech Segments in Noisy Conditions

The attended speech stream can be detected robustly, even in adverse auditory scenarios with auditory attentional modulation, and can be decoded using electroencephalographic (EEG) data. Speech segmentation based on the relative root-mean-square (RMS) intensity can be used to estimate segmental contributions to perception in noisy conditions. High-RMS-level segments contain crucial information for speech perception. Hence, this study aimed to investigate the effect of high-RMS-level speech segments on auditory attention decoding performance under various signal-to-noise ratio (SNR) conditions. Scalp EEG signals were recorded when subjects listened to the attended speech stream in the mixed speech narrated concurrently by two Mandarin speakers. The temporal response function was used to identify the attended speech from EEG responses of tracking to the temporal envelopes of intact speech and high-RMS-level speech segments alone, respectively. Auditory decoding performance was then analyzed under various SNR conditions by comparing EEG correlations to the attended and ignored speech streams. The accuracy of auditory attention decoding based on the temporal envelope with high-RMS-level speech segments was not inferior to that based on the temporal envelope of intact speech. Cortical activity correlated more strongly with attended than with ignored speech under different SNR conditions. These results suggest that EEG recordings corresponding to high-RMS-level speech segments carry crucial information for the identification and tracking of attended speech in the presence of background noise. This study also showed that with the modulation of auditory attention, attended speech can be decoded more robustly from neural activity than from behavioral measures under a wide range of SNR.

What Acoustic Studies Tell Us About Vowels in Developing and Disordered Speech

Purpose Literature was reviewed on the development of vowels in children's speech and on vowel disorders in children and adults, with an emphasis on studies using acoustic methods. Method Searches were conducted with PubMed/MEDLINE, Google Scholar, CINAHL, HighWire Press, and legacy sources in retrieved articles. The primary search items included, but were not limited to, vowels, vowel development, vowel disorders, vowel formants, vowel therapy, vowel inherent spectral change, speech rhythm, and prosody. Results/Discussion The main conclusions reached in this review are that vowels are (a) important to speech intelligibility; (b) intrinsically dynamic; (c) refined in both perceptual and productive aspects beyond the age typically given for their phonetic mastery; (d) produced to compensate for articulatory and auditory perturbations; (e) influenced by language and dialect even in early childhood; (f) affected by a variety of speech, language, and hearing disorders in children and adults; (g) inadequately assessed by standardized articulation tests; and (h) characterized by at least three factors-articulatory configuration, extrinsic and intrinsic regulation of duration, and role in speech rhythm and prosody. Also discussed are stages in typical vowel ontogeny, acoustic characterization of rhotic vowels, a sensory-motor perspective on vowel production, and implications for clinical assessment of vowels.

Effect of a single lateral diffuse reflection on spatial percepts and speech intelligibility

This study examines the influence of an early lateral reflection on spatial perceptual attributes and speech reception. To this aim, a diffuse reflection is compared with a specular one. Although diffusive surfaces have widespread applications in room acoustics design, the knowledge of the perceptual and behavioral outcomes of these surfaces has yet to be fully developed. Two experiments were conducted to investigate how the reflection type, its temporal delay, and its azimuth affect spatial percepts (source distance, width, and focus) and speech intelligibility (SI) in diffuse stationary noise. The experimental setup included ecological elements: field measurements, a speaker-like source directivity, and real flat and diffusive surfaces. The results indicate that the presence of a single diffuse reflection reduces the perceived distance of a frontal speech source and makes it clearer. SI is higher with a diffuse reflection than with a specular one. Perceptual and behavioral outcomes both depend on the angle of reflection given the frequency- and angular-dependent properties of the diffusing surface and the directivity of the speech source. The results are interpreted with reference to loudness and binaural cues and to the precedence effect. Implications of the findings for acoustic design are also discussed.

Spectro-temporal weighting of interaural time differences in speech

Numerous studies have demonstrated that the perceptual weighting of interaural time differences (ITDs) is non-uniform in time and frequency, leading to reports of spectral and temporal "dominance" regions. It is unclear however, how these dominance regions apply to spectro-temporally complex stimuli such as speech. The authors report spectro-temporal weighting functions for ITDs in a pair of naturally spoken speech tokens ("two" and "eight"). Each speech token was composed of two phonemes, and was partitioned into eight frequency regions over two time bins (one time bin for each phoneme). To derive lateralization weights, ITDs for each time-frequency bin were drawn independently from a normal distribution with a mean of 0 and a standard deviation of 200 μs, and listeners were asked to indicate whether the speech token was presented from the left or right. ITD thresholds were also obtained for each of the 16 time-frequency bins in isolation. The results suggest that spectral dominance regions apply to speech, and that ITDs carried by phonemes in the first position of the syllable contribute more strongly to lateralization judgments than ITDs carried by phonemes in the second position. The results also show that lateralization judgments are partially accounted for by ITD sensitivity across time-frequency bins.

A speech perturbation strategy based on "Lombard effect" for enhanced intelligibility for cochlear implant listeners

The goal of this study is to determine potential intelligibility benefits from Lombard speech for cochlear implant (CI) listeners in speech-in-noise conditions. "Lombard effect" (LE) is the natural response of adjusting speech production via auditory feedback due to noise exposure within acoustic environments. To evaluate intelligibility performance of natural and artificially induced Lombard speech, a corpus was generated to create natural LE from large crowd noise (LCN) exposure at 70, 80, and 90 dB sound pressure level (SPL). Clean speech was mixed with 15 and 10 dB SNR LCN and presented to five CI users. First, speech intelligibility was analyzed as a function of increasing LE and decreasing SNR. Results indicate significant improvements (p < 0.05) with Lombard speech intelligibility in noise conditions for 80 and 90 dB SPL. Next, an offline perturbation strategy was formulated to modify/perturb neutral speech so as to mimic LE through amplification of highly intelligible segments, uniform time stretching, and spectral mismatch filtering. This process effectively introduces aspects of LE into the neutral speech, with the hypothesis that this would benefit intelligibility for CI users. Significant (p < 0.01) intelligibility improvements of 13% and 16% percentage points were observed for 15 and 10 dB SNR conditions respectively for CI users. The results indicate how LE and LE-inspired acoustic and frequency-based modifications can be leveraged within signal processing to improve intelligibility of speech for CI users.

Perception and Acoustic Studies of Vowel Intelligibility in Dysphonic Speech

PURPOSE

This study aimed to (1) examine the effect of dysphonia and background noise on the identifiability of vowels, and (2) evaluate the relationship between the degree of vowel intelligibility and vowel-related acoustic measurements.

METHOD

A speech perception experiment was conducted with speech samples collected from 10 adult females with healthy voices and 10 adult females with dysphonia. The speech material was 11 vowels of American English in /h/-vowel-/d/ format. Cafeteria noise was added to these samples at a signal-to-noise ratio of -6 dB. A total of 10 adults with normal hearing participated in a speech perception experiment, in which the vowels were presented with and without the noise. F1 and F2 frequencies of the vowels were measured, and their relationships with the vowel intelligibility were statistically evaluated.

RESULTS

The group-level analysis showed that vowel intelligibility was lower in dysphonic speech than normal speech, both in quiet and at signal-to-noise ratio of -6 dB. The intelligibility was higher for the high vowels than the low vowels. In general, the vowel confusion pattern was similar between normal and dysphonic speech. However, data from a speaker with severe diplophonia showed a distinct confusion pattern. Voice quality ratings did not significantly correlate with the vowel intelligibility. There was a significant correlation between F2 and the vowel intelligibility in quiet. A post-hoc acoustic analysis revealed that vowels of the speakers with lower vowel intelligibility had lower acoustic energy above 1 kHz.

CONCLUSION

Dysphonia negatively affects vowel intelligibility. Low vowels were more vulnerable to the effect of dysphonia than high vowels. Among different types of dysphonic voice qualities, diplophonia appears to be particularly detrimental to vowel intelligibility. F2 significantly correlated with vowel intelligibility; however, this result requires a careful interpretation. Given that the acoustic energy above 1 kHz resulted in better intelligibility in noise, a treatment strategy that targets this frequency region may help improve intelligibility in noise. Future studies should examine the generalizability of this finding to different age and gender groups, and intelligibility as a whole.

Perception of American-English Vowels by Early and Late Spanish-English Bilinguals

Increasing numbers of Hispanic immigrants are entering the US and learning American-English (AE) as a second language (L2). Previous studies investigating the relationship between AE and Spanish vowels have revealed an advantage for early L2 learners for their accuracy of L2 vowel perception. Replicating and extending such previous research, this study examined the patterns with which early and late Spanish-English bilingual adults assimilated naturally-produced AE vowels to their native vowel inventory and the accuracy with which they discriminated the vowels. Twelve early Spanish-English bilingual, 12 late Spanish-English bilingual, and 10 monolingual listeners performed perceptual-assimilation and categorical-discrimination tasks involving AE /i,ɪ,ɛ,ʌ,æ,ɑ,o/. Early bilinguals demonstrated similar assimilation patterns to late bilinguals. Late bilinguals' discrimination was less accurate than early bilinguals' and AE monolinguals'. Certain contrasts, such as /æ-ɑ/, /ʌ-ɑ/, and /ʌ-æ/, were particularly difficult to discriminate for both bilingual groups. Consistent with previous research, findings suggest that early L2 learning heightens Spanish-English bilinguals' ability to perceive cross-language phonetic differences. However, even early bilinguals' native-vowel system continues to influence their L2 perception.

Factors affecting the intelligibility of high-intensity-level-based speech

The present work examined factors affecting the intelligibility of high-intensity-level-based speech. Mandarin sentences were processed to contain only high-intensity segments confined by a 5-dB selected intensity range (SIR), with other segments replaced by noise. The processed stimuli were presented to normal-hearing listeners to recognize. The greatest intensity density occurred in the SIR with an upper boundary 3 dB below the peak intensity level, and this SIR yielded the highest intelligibility score in quiet. The SIR with the upper boundary at the peak intensity level yielded better intelligibility performance under noisy conditions, due largely to the relatively high effective signal-to-noise ratio.

Is the consonant bias specifically human? Long-Evans rats encode vowels better than consonants in words

In natural languages, vowels tend to convey structures (syntax, prosody) while consonants are more important lexically. The consonant bias, which is the tendency to rely more on consonants than on vowels to process words, is well attested in human adults and infants after the first year of life. Is the consonant bias based on evolutionarily ancient mechanisms, potentially present in other species? The current study investigated this issue in a species phylogenetically distant from humans: Long-Evans rats. During training, the animals were presented with four natural word-forms (e.g., mano, "hand"). We then compared their responses to novel words carrying either a consonant (pano) or a vowel change (meno). Results show that the animals were less disrupted by consonantal alterations than by vocalic alterations of words. That is, word recognition was more affected by the alteration of a vowel than a consonant. Together with previous findings in very young human infants, this reliance on vocalic information we observe in rats suggests that the emergence of the consonant bias may require a combination of vocal, cognitive and auditory skills that rodents do not seem to possess.

Cross-Situational Learning of Phonologically Overlapping Words Across Degrees of Ambiguity

Cross-situational word learning (XSWL) tasks present multiple words and candidate referents within a learning trial such that word-referent pairings can be inferred only across trials. Adults encode fine phonological detail when two words and candidate referents are presented in each learning trial (2 × 2 scenario; Escudero, Mulak, & Vlach, ). To test the relationship between XSWL task difficulty and phonological encoding, we examined XSWL of words differing by one vowel or consonant across degrees of within-learning trial ambiguity (1 × 1 to 4 × 4). Word identification was assessed alongside three distractors. Adults finely encoded words via XSWL: Learning occurred in all conditions, though accuracy decreased across the 1 × 1 to 3 × 3 conditions. Accuracy was highest for the 1 × 1 condition, suggesting fast-mapping is a stronger learning strategy here. Accuracy was higher for consonant than vowel set targets, and having more distractors from the same set mitigated identification of vowel set targets only, suggesting possible stronger encoding of consonants than vowels.

The Use of Static and Dynamic Cues for Vowel Identification by Children Wearing Hearing Aids or Cochlear Implants

OBJECTIVE

To examine vowel perception based on dynamic formant transition and/or static formant pattern cues in children with hearing loss while using their hearing aids or cochlear implants. We predicted that the sensorineural hearing loss would degrade formant transitions more than static formant patterns, and that shortening the duration of cues would cause more difficulty for vowel identification for these children than for their normal-hearing peers.

DESIGN

A repeated-measures, between-group design was used. Children 4 to 9 years of age from a university hearing services clinic who were fit for hearing aids (13 children) or who wore cochlear implants (10 children) participated. Chronologically age-matched children with normal hearing served as controls (23 children). Stimuli included three naturally produced syllables (/ba/, /bi/, and /bu/), which were presented either in their entirety or segmented to isolate the formant transition or the vowel static formant center. The stimuli were presented to listeners via loudspeaker in the sound field. Aided participants wore their own devices and listened with their everyday settings. Participants chose the vowel presented by selecting from corresponding pictures on a computer screen.

RESULTS

Children with hearing loss were less able to use shortened transition or shortened vowel centers to identify vowels as compared to their normal-hearing peers. Whole syllable and initial transition yielded better identification performance than the vowel center for /ɑ/, but not for /i/ or /u/.

CONCLUSIONS

The children with hearing loss may require a longer time window than children with normal hearing to integrate vowel cues over time because of altered peripheral encoding in spectrotemporal domains. Clinical implications include cognizance of the importance of vowel perception when developing habilitative programs for children with hearing loss.

Long-standing problems in speech perception dissolve within an information-theoretic perspective

An information theoretic framework is proposed to have the potential to dissolve (rather than attempt to solve) multiple long-standing problems concerning speech perception. By this view, speech perception can be reframed as a series of processes through which sensitivity to information-that which changes and/or is unpredictable-becomes increasingly sophisticated and shaped by experience. Problems concerning appropriate objects of perception (gestures vs. sounds), rate normalization, variance consequent to articulation, and talker normalization are reframed, or even dissolved, within this information-theoretic framework. Application of discriminative models founded on information theory provides a productive approach to answer questions concerning perception of speech, and perception most broadly.

Perceptual contributions of vowels and consonant-vowel transitions in simulated electric-acoustic hearing

The present work assessed the perceptual impact of vowels and consonant-vowel transitions in simulated electric-acoustic hearing. Mandarin sentences were processed by two vocoder models simulating electric and electric-acoustic stimulation, followed by a noise-replacement paradigm to preserve target speech segments and replace the rest with noise, and finally presented to normal-hearing listeners to recognize. The results demonstrated a much larger perceptual advantage of vowels than consonants to sentence intelligibility, and showed the combined-stimulation advantage under segmental conditions containing vowels. Adding consonant-vowel transitions in combined electric-acoustic stimulation yielded sentence recognition performance equivalent to that observed with electric stimulation and full speech segments.

The perceptual flow of phonetic information

Over a long and distinguished career, Randy Diehl has elucidated the brain mechanisms underlying spoken language processing. The present study touches on two of Randy's central interests, phonetic features and Bayesian statistics. How does the brain go from sound to meaning? Traditional approaches to the study of speech intelligibility and word recognition are unlikely to provide a definitive answer. A finer-grained, Bayesian-inspired approach may help. In this study, listeners identified 11 Danish consonants spoken in a Consonant + Vowel + [l] environment. Each syllable was filtered so that only a portion of the original audio spectrum was presented. Three-quarter-octave bands of speech, centered at 750, 1,500, and 3,000 Hz, were presented individually and in combination. The conditional, posterior probabilities associated with decoding the phonetic-features Voicing, Manner, and Place of Articulation were computed from confusion matrices to delineate the perceptual flow of phonetic information processing. Analysis of the conditional probabilities associated with both correct and incorrect feature decoding suggest that Manner of articulation is linked to the decoding of Voicing (but not vice-versa), and that decoding of Place of articulation is associated with decoding of Manner of articulation (but not the converse). Such feature-decoding asymmetries may reflect processing strategies in which the decoding of lower-level features, such as Voicing and Manner, is leveraged to enhance the recognition of more complex linguistic elements (e.g., phonetic segments, syllables, and words), especially in adverse listening conditions. Such asymmetric feature decoding patterns are consistent with a hierarchical, perceptual flow model of phonetic processing.

Formant priority channel selection for an "n-of-m" sound processing strategy for cochlear implants

The Advanced Combination Encoder (ACE) signal processing strategy is used in the majority of cochlear implant (CI) sound processors manufactured by Cochlear Corporation. This "n-of-m" strategy selects "n" out of "m" available frequency channels with the highest spectral energy in each stimulation cycle. It is hypothesized that at low signal-to-noise ratio (SNR) conditions, noise-dominant frequency channels are susceptible for selection, neglecting channels containing target speech cues. In order to improve speech segregation in noise, explicit encoding of formant frequency locations within the standard channel selection framework of ACE is suggested. Two strategies using the direct formant estimation algorithms are developed within this study, FACE (formant-ACE) and VFACE (voiced-activated-formant-ACE). Speech intelligibility from eight CI users is compared across 11 acoustic conditions, including mixtures of noise and reverberation at multiple SNRs. Significant intelligibility gains were observed with VFACE over ACE in 5 dB babble noise; however, results with FACE/VFACE in all other conditions were comparable to standard ACE. An increased selection of channels associated with the second formant frequency is observed for FACE and VFACE. Both proposed methods may serve as potential supplementary channel selection techniques for the ACE sound processing strategy for cochlear implants.

Glimpsing speech interrupted by speech-modulated noise

Everyday environments frequently present speech in modulated noise backgrounds, such as from a competing talker. Under such conditions, temporal glimpses of speech may be preserved at favorable signal-to-noise ratios during the amplitude dips of the masker. Speech recognition is determined, in part, by these speech glimpses. However, properties of the noise when it dominates the speech may also be important. This study interrupted speech to provide either high-intensity or low-intensity speech glimpses derived from measurements of speech-on-speech masking. These interrupted intervals were deleted and subsequently filled by steady-state noise or one of four different types of noise amplitude modulated by the same or different sentence. Noise was presented at two different levels. Interruption by silence was also examined. Speech recognition was best with high-intensity glimpses and improved when the noise was modulated by missing high-intensity segments. Additional noise conditions detailed significant interactions between the noise level and glimpsed speech level. Overall, high-intensity speech segments, and the amplitude modulation (AM) of the segments, are crucial for speech recognition. Speech recognition is further influenced by the properties of the competing noise (i.e., level and AM) which interact with the glimpsed speech level. Acoustic properties of both speech-dominated and noise-dominated intervals of speech-noise mixtures determine speech recognition.

Consonant and Vowel Identification in Cochlear Implant Users Measured by Nonsense Words: A Systematic Review and Meta-Analysis

PURPOSE

The purpose of this systematic review and meta-analysis was to establish a baseline of the vowel and consonant identification scores in prelingually and postlingually deaf users of multichannel cochlear implants (CIs) tested with consonant-vowel-consonant and vowel-consonant-vowel nonsense syllables.

METHOD

Six electronic databases were searched for peer-reviewed articles reporting consonant and vowel identification scores in CI users measured by nonsense words. Relevant studies were independently assessed and screened by 2 reviewers. Consonant and vowel identification scores were presented in forest plots and compared between studies in a meta-analysis.

RESULTS

Forty-seven articles with 50 studies, including 647 participants, thereof 581 postlingually deaf and 66 prelingually deaf, met the inclusion criteria of this study. The mean performance on vowel identification tasks for the postlingually deaf CI users was 76.8% (N = 5), which was higher than the mean performance for the prelingually deaf CI users (67.7%; N = 1). The mean performance on consonant identification tasks for the postlingually deaf CI users was higher (58.4%; N = 44) than for the prelingually deaf CI users (46.7%; N = 6). The most common consonant confusions were found between those with same manner of articulation (/k/ as /t/, /m/ as /n/, and /p/ as /t/).

CONCLUSIONS

The mean performance on consonant identification tasks for the prelingually and postlingually deaf CI users was found. There were no statistically significant differences between the scores for prelingually and postlingually deaf CI users. The consonants that were incorrectly identified were typically confused with other consonants with the same acoustic properties, namely, voicing, duration, nasality, and silent gaps. A univariate metaregression model, although not statistically significant, indicated that duration of implant use in postlingually deaf adults predict a substantial portion of their consonant identification ability. As there is no ceiling effect, a nonsense syllable identification test may be a useful addition to the standard test battery in audiology clinics when assessing the speech perception of CI users.

Talker Differences in Clear and Conversational Speech: Perceived Sentence Clarity for Young Adults With Normal Hearing and Older Adults With Hearing Loss

Purpose

The purpose of this study is to examine talker differences for subjectively rated speech clarity in clear versus conversational speech, to determine whether ratings differ for young adults with normal hearing (YNH listeners) and older adults with hearing impairment (OHI listeners), and to explore effects of certain talker characteristics (e.g., gender) on perceived clarity. Relationships among clarity ratings and other speech perceptual and acoustic measures were also explored.

Method

Twenty-one YNH and 15 OHI listeners rated clear and conversational sentences produced by 41 talkers on a scale of 1 (lowest possible clarity) to 7 (highest possible clarity).

Results

While clarity ratings varied significantly among talkers, listeners rated clear speech significantly clearer than conversational speech for all but 1 talker. OHI and YNH listeners gave similar ratings for conversational speech, but ratings for clear speech were significantly higher for OHI listeners. Talker gender effects differed for YNH and OHI listeners. Ratings of clear speech varied among subgroups of talkers with different amounts of experience talking to people with hearing loss.

Conclusions

Perceived clarity varies widely among talkers, but nearly all produce clear speech that sounds significantly clearer than their conversational speech. Few differences were seen between OHI and YNH listeners except the effect of talker gender.

Perception of American English vowels by sequential Spanish-English bilinguals

Research on American-English (AE) vowel perception by Spanish-English bilinguals has focused on the vowels /i/-/ɪ/ (e.g., in sheep/ship). Other AE vowel contrasts may present perceptual challenges for this population, especially those requiring both spectral and durational discrimination. We used Event-Related Potentials (ERPs), MMN (Mismatch Negativity) and P300, to index discrimination of AE vowels /ɑ/-/ʌ/ by sequential adult Spanish-English bilingual listeners compared to AE monolinguals. Listening tasks were non-attended and attended, and vowels were presented with natural and neutralized durations. Regardless of vowel duration, bilingual listeners showed no MMN to unattended sounds, and P300 responses were elicited to /ɑ/ but not /ʌ/ in the attended condition. Monolingual listeners showed pre-attentive discrimination (MMN) for /ɑ/ only; while both vowels elicited P300 responses when attended. Findings suggest that Spanish-English bilinguals recruit attentional and cognitive resources enabling native-like use of both spectral and durational cues to discriminate between AE vowels /ɑ/ and /ʌ/.

Formant-frequency discrimination of synthesized vowels in budgerigars (Melopsittacus undulatus) and humans

Vowels are complex sounds with four to five spectral peaks known as formants. The frequencies of the two lowest formants, F1and F2, are sufficient for vowel discrimination. Behavioral studies show that many birds and mammals can discriminate vowels. However, few studies have quantified thresholds for formant-frequency discrimination. The present study examined formant-frequency discrimination in budgerigars (Melopsittacus undulatus) and humans using stimuli with one or two formants and a constant fundamental frequency of 200 Hz. Stimuli had spectral envelopes similar to natural speech and were presented with random level variation. Thresholds were estimated for frequency discrimination of F1, F2, and simultaneous F1 and F2 changes. The same two-down, one-up tracking procedure and single-interval, two-alternative task were used for both species. Formant-frequency discrimination thresholds were as sensitive in budgerigars as in humans and followed the same patterns across all conditions. Thresholds expressed as percent frequency difference were higher for F1 than for F2, and were unchanged between stimuli with one or two formants. Thresholds for simultaneous F1 and F2 changes indicated that discrimination was based on combined information from both formant regions. Results were consistent with previous human studies and show that budgerigars provide an exceptionally sensitive animal model of vowel feature discrimination.

Effect of extreme adaptive frequency compression in bimodal listeners on sound localization and speech perception

OBJECTIVES

This study aimed to improve access to high-frequency interaural level differences (ILD), by applying extreme frequency compression (FC) in the hearing aid (HA) of 13 bimodal listeners, using a cochlear implant (CI) and conventional HA in opposite ears.

DESIGN

An experimental signal-adaptive frequency-lowering algorithm was tested, compressing frequencies above 160 Hz into the individual audible range of residual hearing, but only for consonants (adaptive FC), thus protecting vowel formants, with the aim to preserve speech perception. In a cross-over design with at least 5 weeks of acclimatization between sessions, bimodal performance with and without adaptive FC was compared for horizontal sound localization, speech understanding in quiet and in noise, and vowel, consonant and voice-pitch perception.

RESULTS

On average, adaptive FC did not significantly affect any of the test results. Yet, two subjects who were fitted with a relatively weak frequency compression ratio, showed improved horizontal sound localization. After the study, four subjects preferred adaptive FC, four preferred standard frequency mapping, and four had no preference. Noteworthy, the subjects preferring adaptive FC were those with best performance on all tasks, both with and without adaptive FC.

CONCLUSION

On a group level, extreme adaptive FC did not change sound localization and speech understanding in bimodal listeners. Possible reasons are too strong compression ratios, insufficient residual hearing or that the adaptive switching, although preserving vowel perception, may have been ineffective to produce consistent ILD cues. Individual results suggested that two subjects were able to integrate the frequency-compressed HA input with that of the CI, and benefitted from enhanced binaural cues for horizontal sound localization.

Midbrain Synchrony to Envelope Structure Supports Behavioral Sensitivity to Single-Formant Vowel-Like Sounds in Noise

Vowels make a strong contribution to speech perception under natural conditions. Vowels are encoded in the auditory nerve primarily through neural synchrony to temporal fine structure and to envelope fluctuations rather than through average discharge rate. Neural synchrony is thought to contribute less to vowel coding in central auditory nuclei, consistent with more limited synchronization to fine structure and the emergence of average-rate coding of envelope fluctuations. However, this hypothesis is largely unexplored, especially in background noise. The present study examined coding mechanisms at the level of the midbrain that support behavioral sensitivity to simple vowel-like sounds using neurophysiological recordings and matched behavioral experiments in the budgerigar. Stimuli were harmonic tone complexes with energy concentrated at one spectral peak, or formant frequency, presented in quiet and in noise. Behavioral thresholds for formant-frequency discrimination decreased with increasing amplitude of stimulus envelope fluctuations, increased in noise, and were similar between budgerigars and humans. Multiunit recordings in awake birds showed that the midbrain encodes vowel-like sounds both through response synchrony to envelope structure and through average rate. Whereas neural discrimination thresholds based on either coding scheme were sufficient to support behavioral thresholds in quiet, only synchrony-based neural thresholds could account for behavioral thresholds in background noise. These results reveal an incomplete transformation to average-rate coding of vowel-like sounds in the midbrain. Model simulations suggest that this transformation emerges due to modulation tuning, which is shared between birds and mammals. Furthermore, the results underscore the behavioral relevance of envelope synchrony in the midbrain for detection of small differences in vowel formant frequency under real-world listening conditions.

The Impact of Contrastive Stress on Vowel Acoustics and Intelligibility in Dysarthria

PURPOSE

To compare vowel acoustics and intelligibility in words produced with and without contrastive stress by speakers with spastic (mixed-spastic) dysarthria secondary to cerebral palsy (DYSCP) and healthy controls (HCs).

METHOD

Fifteen participants (9 men, 6 women; age M = 42 years) with DYSCP and 15 HCs (9 men, 6 women; age M = 36 years) produced sentences containing target words with and without contrastive stress. Forty-five healthy listeners (age M = 25 years) completed a vowel identification task of DYSCP productions. Vowel acoustics were compared across stress conditions and groups using 1st (F1) and 2nd (F2) formant measures. Perceptual intelligibility was compared across stress conditions and dysarthria severity.

RESULTS

F1 and F2 significantly increased in stressed words for both groups, although the degree of change differed. Mean Euclidian distance between vowels also increased with stress. The relative probability of vowels falling within the target F1 × F2 space was greater for HCs but did not differ with stress. Stress production resulted in greater listener vowel identification accuracy for speakers with mild dysarthria.

CONCLUSIONS

Contrastive stress affected vowel formants for both groups. Perceptual results suggest that some speakers with dysarthria may benefit from a contrastive stress strategy to improve vowel intelligibility.

Influences of noise-interruption and information-bearing acoustic changes on understanding simulated electric-acoustic speech

In simulations of electrical-acoustic stimulation (EAS), vocoded speech intelligibility is aided by preservation of low-frequency acoustic cues. However, the speech signal is often interrupted in everyday listening conditions, and effects of interruption on hybrid speech intelligibility are poorly understood. Additionally, listeners rely on information-bearing acoustic changes to understand full-spectrum speech (as measured by cochlea-scaled entropy [CSE]) and vocoded speech (CSE_CI), but how listeners utilize these informational changes to understand EAS speech is unclear. Here, normal-hearing participants heard noise-vocoded sentences with three to six spectral channels in two conditions: vocoder-only (80-8000 Hz) and simulated hybrid EAS (vocoded above 500 Hz; original acoustic signal below 500 Hz). In each sentence, four 80-ms intervals containing high-CSE_CI or low-CSE_CI acoustic changes were replaced with speech-shaped noise. As expected, performance improved with the preservation of low-frequency fine-structure cues (EAS). This improvement decreased for continuous EAS sentences as more spectral channels were added, but increased as more channels were added to noise-interrupted EAS sentences. Performance was impaired more when high-CSE_CI intervals were replaced by noise than when low-CSE_CI intervals were replaced, but this pattern did not differ across listening modes. Utilizing information-bearing acoustic changes to understand speech is predicted to generalize to cochlear implant users who receive EAS inputs.

Assessing the perceptual contributions of level-dependent segments to sentence intelligibility

The present work assessed the contributions of high root-mean-square (RMS) level (H-level, containing primarily vowels) and middle-RMS-level (M-level, with mostly consonants and vowel-consonant transitions) segments to the intelligibility of noise-masked and noise-suppressed sentences. In experiment 1, noise-masked (by speech-spectrum shaped noise and 6-talker babble) Mandarin sentences were edited to preserve only H- or M-level segments, while replacing the non-target segments with silence. In experiment 2, Mandarin sentences were subjected to four commonly-used single-channel noise-suppression algorithms before generating H-level-only and M-level-only noise-suppressed sentences. To test the influence of an effective signal-to-noise ratio (SNR) on intelligibility, both experiments incorporated a condition in which the SNRs of H-level segments and M-level segments were matched. The processed sentences were presented to normal-hearing listeners to recognize. Experimental results showed that (1) H-level-only sentences carried more perceptual information than M-level-only sentences under both noise-masked and noise-suppressed conditions; and (2) this intelligibility advantage of H-level-only sentences over M-level-only sentences persisted even when effective SNR levels were matched, and it might be attributed to the perceptual advantage of vowels in speech intelligibility. In addition, the lesser distortion in H-level segments than in M-level segments following noise-suppression processing suggests that differential processing distortion might contribute to the H-level advantage observed.

Glimpsing Speech in the Presence of Nonsimultaneous Amplitude Modulations From a Competing Talker: Effect of Modulation Rate, Age, and Hearing Loss

PURPOSE

This study investigated how listeners process acoustic cues preserved during sentences interrupted by nonsimultaneous noise that was amplitude modulated by a competing talker.

METHOD

Younger adults with normal hearing and older adults with normal or impaired hearing listened to sentences with consonants or vowels replaced with noise amplitude modulated by a competing talker. Sentences were spectrally shaped according to individual audiograms or to the mean audiogram from the listeners with hearing impairment for a younger spectrally shaped control group. The modulation spectrum of the noise was low-pass filtered at different modulation cutoff frequencies. The effect of noise level was also examined.

RESULTS

Performance declined when nonsimultaneous masker modulation included faster rates and was maximized when masker modulation matched the preserved primary speech modulation. Vowels resulted in better performance compared with consonants at slower modulation cutoff rates, likely due to suprasegmental features. Poorer overall performance was observed with increased age or hearing loss, and for listeners who received spectrally shaped speech.

CONCLUSIONS

Nonsimultaneous amplitude modulations from a competing talker significantly interacted with the preserved speech segment, and additional listener factors were observed for age and hearing loss. Importantly, listeners may obtain benefit from nonsimultaneous competing modulations when they match the preserved modulations of the sentence.