Neural adaptation to silence in the human auditory cortex: a magnetoencephalographic study

Intensity and inter-stimulus-interval effects on human middle- and long-latency auditory evoked potentials in an unpredictable auditory context

It is not known how Auditory-Evoked Responses (AERs) comprising Middle Latency Responses (MLRs) and Long Latency Responses (LLRs) are modulated by stimulus intensity and inter-stimulus interval (ISI) in an unpredictable auditory context. Further, intensity and ISI effects on MLR and LLR have never been assessed simultaneously in the same humans. To address this important question, thirty participants passively listened to a random sequence of auditory clicks of three possible intensities (65, 75, and 85 dB) at five possible ISI ranges (0.25 to 0.5 s, 0.5 to 1 s, 1 to 2 s, 2 to 4 s, 4 to 8 s) over four to seven one-hour sessions while EEG was recorded. P0, Na, Pa, Nb, and Pb MLR peaks and N1 and P2 LLR peaks were measured. MLRs P0 (p = .005), Pa (p = .021), and Pb (p = <.001) were modulated by intensity, while only MLR Pb (p = <.001) was modulated by ISI. LLR N1 and P2 were modulated by both intensity and ISI (all p values < .001). Intensity and ISI interacted at Pb, N1, and P2 (all p values < .001), with greater intensity effects at longer ISIs and greater ISI effects at louder intensities. Together, these results provide a comprehensive picture of intensity and ISI effects on AER across the entire thalamocortical auditory pathway, while controlling for stimulus predictability. Moreover, they highlight P0 as the earliest MLR response sensitive to stimulus intensity and Pb (~50 ms) as the earliest cortical response coding for ISIs above 250 ms and showing an interdependence between intensity and ISI effects.

Repetition Suppression in Visual and Auditory Modalities Affects the Sound-Induced Flash Illusion

Sound-induced flash illusion (SiFI) refers to the illusion that the number of visual flashes is equal to the number of auditory sounds when the visual flashes are accompanied by an unequal number of auditory sounds presented within 100 ms. The effect of repetition suppression (RS), an adaptive effect caused by stimulus repetition, upon the SiFI has not been investigated. Based on the classic SiFI paradigm, the present study investigated whether RS would affect the SiFI differently by adding preceding stimuli in visual and auditory modalities prior to the appearance of audiovisual stimuli. The results showed the auditory RS effect on the SiFI varied with the number of preceding auditory stimuli. The hit rate was higher with two preceding auditory stimuli than one preceding auditory stimulus in fission illusion, but it did not affect the size of the fusion illusion. However, the visual RS had no effect on the size of the fission and fusion illusions. The present study suggested that RS could affect the SiFI, indicating that the RS effect in different modalities would differentially affect the magnitude of the SiFI. In the process of multisensory integration, the visual and auditory modalities had asymmetrical RS effects.

Effects of Repetition Suppression on Sound Induced Flash Illusion With Aging

The sound-induced flash illusion (SiFI) is a classical auditory-dominated multisensory integration phenomenon in which the observer misperceives the number of visual flashes due to the simultaneous presentation of a different number of auditory beeps. Although the SiFI has been documented to correlate with perceptual sensitivity, to date there is no consensus as to how it corresponds to sensitivity with aging. The present study was based on the SiFI paradigm (Shams et al., 2000), adding repeated auditory stimuli prior to the appearance of audiovisual stimuli to investigate the effects of repetition suppression (RS) on the SiFI with aging. The repeated auditory stimuli consisted of one or two of the same auditory stimuli presented twice in succession, which were then followed by the audiovisual stimuli. By comparing the illusions in old and young adults, we aimed to explore the influence of aging on the RS of auditory stimuli on the SiFI. The results showed that both age groups showed SiFI effects, however, the RS performance of the two age groups had different effects on the fusion and fission illusions. The illusion effect in old adults was weaker than in young adults. Specifically, RS only affected fission illusions in the old adults but both fission and fusion illusions in young adults. Thus, the present study indicated that the decreased perceptual sensitivity based on auditory RS could weaken the SiFI effect in multisensory integration and that old adults are more susceptible to RS, showing that old adults perceived the SiFI effect weakly under auditory RS.

Endogenous Expectations for Sequence Continuation after Auditory Beat Accelerations and Decelerations Revealed by P3a and Induced Beta-Band Responses

People commonly synchronize taps to rhythmic sounds and can continue tapping after the sounds stop, indicating that time intervals between sounds can be internalized. Here, we investigate what happens in the brain after simply listening to auditory beats in order to understand more about the automatic internalization of temporal intervals without tapping. Electroencephalograms were recorded while musicians attended to accelerating, decelerating, or steady click sequences. Evoked responses and induced beta power modulations (13-30 Hz) were examined for one beat following the last physical beat of each sequence (termed the silent beat) and compared to responses obtained during physical beats near the sequence endings. In response to the silent beat, P3a was observed with the largest amplitude occurring after accelerations and the smallest after decelerations. Late beta power modulations were also found after the silent beat, and the magnitude of the beta-power suppressions was significantly correlated with the concurrent P3a amplitudes. In contrast, physical beats elicited P2 responses and early beta suppressions, likely reflecting a combination of stimulus-related processing and temporal prediction. These results suggest that the activities observed after the silent beat were not produced via sustained entrainment after the physical beats, but via automatically-formed expectation for an additional beat. Therefore, beta modulations may be generated endogenously by expectation violation, while P3a amplitudes may relate to strength of expectation, with acceleration endings causing the strongest expectations for sequence continuation.

Shared Neural Mechanisms for the Prediction of Own and Partner Musical Sequences after Short-term Piano Duet Training

Predictive mechanisms in the human brain can be investigated using markers for prediction violations like the mismatch negativity (MMN). Short-term piano training increases the MMN for melodic and rhythmic deviations in the training material. This increase occurs only when the material is actually played, not when it is only perceived through listening, suggesting that learning predictions about upcoming musical events are derived from motor involvement. However, music is often performed in concert with others. In this case, predictions about upcoming actions from a partner are a crucial part of the performance. In the present experiment, we use magnetoencephalography (MEG) to measure MMNs to deviations in one's own and a partner's musical material after both engaged in musical duet training. Event-related field (ERF) results revealed that the MMN increased significantly for own and partner material suggesting a neural representation of the partner's part in a duet situation. Source analysis using beamforming revealed common activations in auditory, inferior frontal, and parietal areas, similar to previous results for single players, but also a pronounced contribution from the cerebellum. In addition, activation of the precuneus and the medial frontal cortex was observed, presumably related to the need to distinguish between own and partner material.

Neuromagnetic signatures of syllable processing in fetuses and infants provide no evidence for habituation

BACKGROUND

Habituation, as a basic form of learning, is characterized by decreasing amplitudes of neuronal reaction following repeated stimuli. Recent studies indicate that habituation to pure tones of different frequencies occurs in fetuses and infants.

AIMS

Neural processing of different syllables in fetuses and infants was investigated.

STUDY DESIGN

An auditory habituation paradigm including two different sequences of syllables was presented to each subject. Each sequence consisted of eight syllables (sequence /ba/: 5× /ba/, 1× /bi/ (dishabituator), 2× /ba/; sequence /bi/: 5× /bi/, 1× /ba/ (dishabituator), 2× /bi/). Each subject was stimulated with 140 sequences. Neuromagnetic signatures of auditory-evoked responses (AER) were recorded by fetal magnetoencephalography (fMEG).

SUBJECTS

Magnetic brain signals of N=30 fetuses (age: 28-39weeks of gestation) and N=28 infants (age: 0-3months) were recorded. Forty-two of the 60 fetal recordings and 29 of the 58 infant recordings were included in the final analysis.

OUTCOME MEASURES

AERs were recorded and amplitudes were normalized to the amplitude of the first stimulus.

RESULTS

In both fetuses and infants, the amplitudes of AERs were found not to decrease with repeated stimulation. In infants, however, amplitude of syllable 6 (dishabituator) was significantly increased compared to syllable 5 (p=0.026).

CONCLUSIONS

Fetuses and infants showed AERs to syllables. Unlike fetuses, infants showed a discriminative neural response to syllables. Habituation was not observed in either fetuses or infants. These findings could be important for the investigation of early cognitive competencies and may help to gain a better understanding of language acquisition during child development.

Neural speech recognition: continuous phoneme decoding using spatiotemporal representations of human cortical activity

OBJECTIVE

The superior temporal gyrus (STG) and neighboring brain regions play a key role in human language processing. Previous studies have attempted to reconstruct speech information from brain activity in the STG, but few of them incorporate the probabilistic framework and engineering methodology used in modern speech recognition systems. In this work, we describe the initial efforts toward the design of a neural speech recognition (NSR) system that performs continuous phoneme recognition on English stimuli with arbitrary vocabulary sizes using the high gamma band power of local field potentials in the STG and neighboring cortical areas obtained via electrocorticography.

APPROACH

The system implements a Viterbi decoder that incorporates phoneme likelihood estimates from a linear discriminant analysis model and transition probabilities from an n-gram phonemic language model. Grid searches were used in an attempt to determine optimal parameterizations of the feature vectors and Viterbi decoder.

MAIN RESULTS

The performance of the system was significantly improved by using spatiotemporal representations of the neural activity (as opposed to purely spatial representations) and by including language modeling and Viterbi decoding in the NSR system.

SIGNIFICANCE

These results emphasize the importance of modeling the temporal dynamics of neural responses when analyzing their variations with respect to varying stimuli and demonstrate that speech recognition techniques can be successfully leveraged when decoding speech from neural signals. Guided by the results detailed in this work, further development of the NSR system could have applications in the fields of automatic speech recognition and neural prosthetics.