The synergy between speech production and perception

Speech listening entails neural encoding of invisible articulatory features

Speech processing entails a complex interplay between bottom-up and top-down computations. The former is reflected in the neural entrainment to the quasi-rhythmic properties of speech acoustics while the latter is supposed to guide the selection of the most relevant input subspace. Top-down signals are believed to originate mainly from motor regions, yet similar activities have been shown to tune attentional cycles also for simpler, non-speech stimuli. Here we examined whether, during speech listening, the brain reconstructs articulatory patterns associated to speech production. We measured electroencephalographic (EEG) data while participants listened to sentences during the production of which articulatory kinematics of lips, jaws and tongue were also recorded (via Electro-Magnetic Articulography, EMA). We captured the patterns of articulatory coordination through Principal Component Analysis (PCA) and used Partial Information Decomposition (PID) to identify whether the speech envelope and each of the kinematic components provided unique, synergistic and/or redundant information regarding the EEG signals. Interestingly, tongue movements contain both unique as well as synergistic information with the envelope that are encoded in the listener's brain activity. This demonstrates that during speech listening the brain retrieves highly specific and unique motor information that is never accessible through vision, thus leveraging audio-motor maps that arise most likely from the acquisition of speech production during development.

A comparison of vocal tract perturbation patterns based on statistical and acoustic considerations

The purpose of this study was to investigate the relation between vocal tract deformation patterns obtained from statistical analyses of a set of area functions representative of a vowel repertoire, and the acoustic properties of a neutral vocal tract shape. Acoustic sensitivity functions were calculated for a mean area function based on seven different speakers. Specific linear combinations of the sensitivity functions corresponding to the first two formant frequencies were shown to possess essentially the same amplitude variation along the vocal tract length as the statistically derived deformation patterns reported in previous studies.

Early maturation of evoked otoacoustic emissions and medial olivocochlear reflex in preterm neonates

The present study was designed to investigate the early maturation of the brainstem regulation of the cochlear function in preterm neonates. Evoked otoacoustic emissions (EOAE) and their regulation via the medial olivocochlear efferent (MOC) reflex were investigated in a large population of preterm neonates and compared with full-term neonates and young babies from birth to 4 y and school-aged children. In 28-wk preterm neonates, EOAE were seen in the mid-frequency range. These responses extended both to the low (down to 1025 Hz) and high (up to 6152 Hz) frequency ranges at 38 wk of gestational age and remained stable up to 4 mo. At this stage, the amplitude of EOAE overlapped adult values. EOAE amplitudes then decreased to reach adult values at 3 y of age. Maturation of MOC efferents innervating the outer hair cells was investigated by studying the suppressive effect of contralateral sound on the EOAE amplitudes (MOC reflex). The first MOC responses were recorded in preterm neonates of 32-33 wk of gestational age, reaching adult-like values at 37 wk of gestational age. The maximum effect of MOC efferent activation occurred between 2000 and 4000 Hz. These results suggest that, in humans, MOC efferents mature in utero. Thus, testing the MOC reflex may have a clinical relevance to detect an abnormal development of the auditory pathways, particularly of a brainstem circuitry not explored through conventional testing.