Spatial inattention abolishes voice adaptation

Phonetic perception but not perception of speaker gender is impaired in chronic tinnitus

While tinnitus is known to compromise the perception of speech, it is unclear if the same holds for extralinguistic speaker information. Furthermore, research with simple tone stimuli showed that unilateral tinnitus binds spatial attention, thereby impeding the detection of auditory changes in the non-affected ear. Using dichotic listening tasks, we tested left-ear tinnitus patients and control patients for their ability to ignore speech and speaker information in the task-irrelevant ear. To this end they heard vowel-consonant-vowel (VCV) syllables simultaneously spoken by gender-ambiguous voices in one ear and male or female voices in the contralateral ear. They selectively attended to speech (Exp. 1) or speaker (Exp. 2) information in a designated target ear, by classifying either the consonant (/b/ or /g/) in VCV syllables or voice gender (male or female) while ignoring distractor voices in the other ear. While performance was comparable across groups in the gender task, tinnitus patients responded slower than controls in the consonant task, with no effect of target ear. This suggests that tinnitus hampers phonetic perception in speech, while preserving the processing of extralinguistic speaker information. These findings support the growing evidence for speech perception impairments in tinnitus.

Are Face-Incongruent Voices Harder to Process?

Based on current integration theories of face-voice processing, the present study had participants process 1,152 videos of faces uttering digits. Half of the videos contained face-voice gender-incongruent stimuli (vs. congruent stimuli in the other half). Participants indicated digit magnitude or parity. Tasks were presented in pure blocks (only 1 task) and in task switching blocks (using colored cues to specify task). The results indicate significant congruency effects in pure blocks, but partially reversed congruency effects in task switching, probably due to enhanced assignment of capacity toward resolving difficult situational demands. Congruency effects did not dissipate over time, ruling out that initial surprise associated with incongruent stimuli drove the effects. The results show that interference between two task-irrelevant person-related dimensions (face/voice gender) can affect processing of a third, task-relevant dimension (digit identity), suggesting greater processing ease associated with more authentic voices (i.e., voices that do not violate face-based expectancies).

To hear or not to hear: Voice processing under visual load

Adaptation to female voices causes subsequent voices to be perceived as more male, and vice versa. This contrastive aftereffect disappears under spatial inattention to adaptors, suggesting that voices are not encoded automatically. According to Lavie, Hirst, de Fockert, and Viding (2004), the processing of task-irrelevant stimuli during selective attention depends on perceptual resources and working memory. Possibly due to their social significance, faces may be an exceptional domain: That is, task-irrelevant faces can escape perceptual load effects. Here we tested voice processing, to study whether voice gender aftereffects (VGAEs) depend on low or high perceptual (Exp. 1) or working memory (Exp. 2) load in a relevant visual task. Participants adapted to irrelevant voices while either searching digit displays for a target (Exp. 1) or recognizing studied digits (Exp. 2). We found that the VGAE was unaffected by perceptual load, indicating that task-irrelevant voices, like faces, can also escape perceptual-load effects. Intriguingly, the VGAE was increased under high memory load. Therefore, visual working memory load, but not general perceptual load, determines the processing of task-irrelevant voices.

Re-examining selective adaptation: Fatiguing feature detectors, or distributional learning?

When a listener hears many good examples of a /b/ in a row, they are less likely to classify other sounds on, e.g., a /b/-to-/d/ continuum as /b/. This phenomenon is known as selective adaptation and is a well-studied property of speech perception. Traditionally, selective adaptation is seen as a mechanistic property of the speech perception system, and attributed to fatigue in acoustic-phonetic feature detectors. However, recent developments in our understanding of non-linguistic sensory adaptation and higher-level adaptive plasticity in speech perception and language comprehension suggest that it is time to re-visit the phenomenon of selective adaptation. We argue that selective adaptation is better thought of as a computational property of the speech perception system. Drawing on a common thread in recent work on both non-linguistic sensory adaptation and plasticity in language comprehension, we furthermore propose that selective adaptation can be seen as a consequence of distributional learning across multiple levels of representation. This proposal opens up new questions for research on selective adaptation itself, and also suggests that selective adaptation can be an important bridge between work on adaptation in low-level sensory systems and the complicated plasticity of the adult language comprehension system.