1
|
López-Caballero F, Coffman B, Seebold D, Teichert T, Salisbury DF. Intensity and inter-stimulus-interval effects on human middle- and long-latency auditory evoked potentials in an unpredictable auditory context. Psychophysiology 2023; 60:e14217. [PMID: 36371684 PMCID: PMC10463565 DOI: 10.1111/psyp.14217] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2022] [Revised: 10/06/2022] [Accepted: 10/22/2022] [Indexed: 11/14/2022]
Abstract
It is not known how Auditory-Evoked Responses (AERs) comprising Middle Latency Responses (MLRs) and Long Latency Responses (LLRs) are modulated by stimulus intensity and inter-stimulus interval (ISI) in an unpredictable auditory context. Further, intensity and ISI effects on MLR and LLR have never been assessed simultaneously in the same humans. To address this important question, thirty participants passively listened to a random sequence of auditory clicks of three possible intensities (65, 75, and 85 dB) at five possible ISI ranges (0.25 to 0.5 s, 0.5 to 1 s, 1 to 2 s, 2 to 4 s, 4 to 8 s) over four to seven one-hour sessions while EEG was recorded. P0, Na, Pa, Nb, and Pb MLR peaks and N1 and P2 LLR peaks were measured. MLRs P0 (p = .005), Pa (p = .021), and Pb (p = <.001) were modulated by intensity, while only MLR Pb (p = <.001) was modulated by ISI. LLR N1 and P2 were modulated by both intensity and ISI (all p values < .001). Intensity and ISI interacted at Pb, N1, and P2 (all p values < .001), with greater intensity effects at longer ISIs and greater ISI effects at louder intensities. Together, these results provide a comprehensive picture of intensity and ISI effects on AER across the entire thalamocortical auditory pathway, while controlling for stimulus predictability. Moreover, they highlight P0 as the earliest MLR response sensitive to stimulus intensity and Pb (~50 ms) as the earliest cortical response coding for ISIs above 250 ms and showing an interdependence between intensity and ISI effects.
Collapse
Affiliation(s)
- Fran López-Caballero
- Clinical Neurophysiology Research Laboratory, Western Psychiatric Hospital, Department of Psychiatry, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania, USA
| | - Brian Coffman
- Clinical Neurophysiology Research Laboratory, Western Psychiatric Hospital, Department of Psychiatry, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania, USA
| | - Dylan Seebold
- Clinical Neurophysiology Research Laboratory, Western Psychiatric Hospital, Department of Psychiatry, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania, USA
| | - Tobias Teichert
- Department of Psychiatry, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
| | - Dean F. Salisbury
- Clinical Neurophysiology Research Laboratory, Western Psychiatric Hospital, Department of Psychiatry, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania, USA
| |
Collapse
|
2
|
Wang A, Zhou H, Yu W, Zhang F, Sang H, Tang X, Zhang T, Zhang M. Repetition Suppression in Visual and Auditory Modalities Affects the Sound-Induced Flash Illusion. Perception 2021; 50:489-507. [PMID: 34034565 DOI: 10.1177/03010066211018614] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Sound-induced flash illusion (SiFI) refers to the illusion that the number of visual flashes is equal to the number of auditory sounds when the visual flashes are accompanied by an unequal number of auditory sounds presented within 100 ms. The effect of repetition suppression (RS), an adaptive effect caused by stimulus repetition, upon the SiFI has not been investigated. Based on the classic SiFI paradigm, the present study investigated whether RS would affect the SiFI differently by adding preceding stimuli in visual and auditory modalities prior to the appearance of audiovisual stimuli. The results showed the auditory RS effect on the SiFI varied with the number of preceding auditory stimuli. The hit rate was higher with two preceding auditory stimuli than one preceding auditory stimulus in fission illusion, but it did not affect the size of the fusion illusion. However, the visual RS had no effect on the size of the fission and fusion illusions. The present study suggested that RS could affect the SiFI, indicating that the RS effect in different modalities would differentially affect the magnitude of the SiFI. In the process of multisensory integration, the visual and auditory modalities had asymmetrical RS effects.
Collapse
Affiliation(s)
| | | | - Wei Yu
- Changchun University of Chinese Medicine, China
| | | | | | | | | | | |
Collapse
|
3
|
Sun Y, Liu X, Li B, Sava-Segal C, Wang A, Zhang M. Effects of Repetition Suppression on Sound Induced Flash Illusion With Aging. Front Psychol 2020; 11:216. [PMID: 32153456 PMCID: PMC7047336 DOI: 10.3389/fpsyg.2020.00216] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2019] [Accepted: 01/30/2020] [Indexed: 11/13/2022] Open
Abstract
The sound-induced flash illusion (SiFI) is a classical auditory-dominated multisensory integration phenomenon in which the observer misperceives the number of visual flashes due to the simultaneous presentation of a different number of auditory beeps. Although the SiFI has been documented to correlate with perceptual sensitivity, to date there is no consensus as to how it corresponds to sensitivity with aging. The present study was based on the SiFI paradigm (Shams et al., 2000), adding repeated auditory stimuli prior to the appearance of audiovisual stimuli to investigate the effects of repetition suppression (RS) on the SiFI with aging. The repeated auditory stimuli consisted of one or two of the same auditory stimuli presented twice in succession, which were then followed by the audiovisual stimuli. By comparing the illusions in old and young adults, we aimed to explore the influence of aging on the RS of auditory stimuli on the SiFI. The results showed that both age groups showed SiFI effects, however, the RS performance of the two age groups had different effects on the fusion and fission illusions. The illusion effect in old adults was weaker than in young adults. Specifically, RS only affected fission illusions in the old adults but both fission and fusion illusions in young adults. Thus, the present study indicated that the decreased perceptual sensitivity based on auditory RS could weaken the SiFI effect in multisensory integration and that old adults are more susceptible to RS, showing that old adults perceived the SiFI effect weakly under auditory RS.
Collapse
Affiliation(s)
- Yawen Sun
- Department of Psychology, Soochow University, Suzhou, China
| | - Xiaole Liu
- Department of Psychology, Soochow University, Suzhou, China
- Research Center for Psychology and Behavioral Sciences, Soochow University, Suzhou, China
| | - Biqin Li
- Laboratory of Psychology and Cognition Science, School of Psychology, Jiangxi Normal University, Nanchang, China
| | - Clara Sava-Segal
- Department of Neurology & Neurological Sciences, Stanford University, Palo Alto, CA, United States
| | - Aijun Wang
- Department of Psychology, Soochow University, Suzhou, China
- Research Center for Psychology and Behavioral Sciences, Soochow University, Suzhou, China
| | - Ming Zhang
- Department of Psychology, Soochow University, Suzhou, China
- Research Center for Psychology and Behavioral Sciences, Soochow University, Suzhou, China
| |
Collapse
|
4
|
Graber E, Fujioka T. Endogenous Expectations for Sequence Continuation after Auditory Beat Accelerations and Decelerations Revealed by P3a and Induced Beta-Band Responses. Neuroscience 2019; 413:11-21. [PMID: 31220540 DOI: 10.1016/j.neuroscience.2019.06.010] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2018] [Revised: 05/06/2019] [Accepted: 06/08/2019] [Indexed: 10/26/2022]
Abstract
People commonly synchronize taps to rhythmic sounds and can continue tapping after the sounds stop, indicating that time intervals between sounds can be internalized. Here, we investigate what happens in the brain after simply listening to auditory beats in order to understand more about the automatic internalization of temporal intervals without tapping. Electroencephalograms were recorded while musicians attended to accelerating, decelerating, or steady click sequences. Evoked responses and induced beta power modulations (13-30 Hz) were examined for one beat following the last physical beat of each sequence (termed the silent beat) and compared to responses obtained during physical beats near the sequence endings. In response to the silent beat, P3a was observed with the largest amplitude occurring after accelerations and the smallest after decelerations. Late beta power modulations were also found after the silent beat, and the magnitude of the beta-power suppressions was significantly correlated with the concurrent P3a amplitudes. In contrast, physical beats elicited P2 responses and early beta suppressions, likely reflecting a combination of stimulus-related processing and temporal prediction. These results suggest that the activities observed after the silent beat were not produced via sustained entrainment after the physical beats, but via automatically-formed expectation for an additional beat. Therefore, beta modulations may be generated endogenously by expectation violation, while P3a amplitudes may relate to strength of expectation, with acceleration endings causing the strongest expectations for sequence continuation.
Collapse
Affiliation(s)
- Emily Graber
- Center for Computer Research in Music and Acoustics, 660 Lomita Drive, Stanford University, Stanford, CA 94305, USA.
| | - Takako Fujioka
- Center for Computer Research in Music and Acoustics, 660 Lomita Drive, Stanford University, Stanford, CA 94305, USA; Wu Tsai Neurosciences Institute, 318 Campus Drive, Stanford University, Stanford, CA 94305, USA.
| |
Collapse
|
5
|
Lappe C, Bodeck S, Lappe M, Pantev C. Shared Neural Mechanisms for the Prediction of Own and Partner Musical Sequences after Short-term Piano Duet Training. Front Neurosci 2017; 11:165. [PMID: 28420951 PMCID: PMC5378800 DOI: 10.3389/fnins.2017.00165] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2016] [Accepted: 03/13/2017] [Indexed: 11/22/2022] Open
Abstract
Predictive mechanisms in the human brain can be investigated using markers for prediction violations like the mismatch negativity (MMN). Short-term piano training increases the MMN for melodic and rhythmic deviations in the training material. This increase occurs only when the material is actually played, not when it is only perceived through listening, suggesting that learning predictions about upcoming musical events are derived from motor involvement. However, music is often performed in concert with others. In this case, predictions about upcoming actions from a partner are a crucial part of the performance. In the present experiment, we use magnetoencephalography (MEG) to measure MMNs to deviations in one's own and a partner's musical material after both engaged in musical duet training. Event-related field (ERF) results revealed that the MMN increased significantly for own and partner material suggesting a neural representation of the partner's part in a duet situation. Source analysis using beamforming revealed common activations in auditory, inferior frontal, and parietal areas, similar to previous results for single players, but also a pronounced contribution from the cerebellum. In addition, activation of the precuneus and the medial frontal cortex was observed, presumably related to the need to distinguish between own and partner material.
Collapse
Affiliation(s)
- Claudia Lappe
- Department of Medicine, Institute for Biomagnetism and Biosignalanalysis, University of MünsterMünster, Germany
| | - Sabine Bodeck
- Department of Medicine, Institute for Biomagnetism and Biosignalanalysis, University of MünsterMünster, Germany
| | - Markus Lappe
- Department of Psychology, University of MünsterMünster, Germany
| | - Christo Pantev
- Department of Medicine, Institute for Biomagnetism and Biosignalanalysis, University of MünsterMünster, Germany
| |
Collapse
|
6
|
Hartkopf J, Schleger F, Weiss M, Hertrich I, Kiefer-Schmidt I, Preissl H, Muenssinger J. Neuromagnetic signatures of syllable processing in fetuses and infants provide no evidence for habituation. Early Hum Dev 2016; 100:61-6. [PMID: 27423115 DOI: 10.1016/j.earlhumdev.2016.04.002] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/07/2015] [Revised: 04/10/2016] [Accepted: 04/18/2016] [Indexed: 10/21/2022]
Abstract
BACKGROUND Habituation, as a basic form of learning, is characterized by decreasing amplitudes of neuronal reaction following repeated stimuli. Recent studies indicate that habituation to pure tones of different frequencies occurs in fetuses and infants. AIMS Neural processing of different syllables in fetuses and infants was investigated. STUDY DESIGN An auditory habituation paradigm including two different sequences of syllables was presented to each subject. Each sequence consisted of eight syllables (sequence /ba/: 5× /ba/, 1× /bi/ (dishabituator), 2× /ba/; sequence /bi/: 5× /bi/, 1× /ba/ (dishabituator), 2× /bi/). Each subject was stimulated with 140 sequences. Neuromagnetic signatures of auditory-evoked responses (AER) were recorded by fetal magnetoencephalography (fMEG). SUBJECTS Magnetic brain signals of N=30 fetuses (age: 28-39weeks of gestation) and N=28 infants (age: 0-3months) were recorded. Forty-two of the 60 fetal recordings and 29 of the 58 infant recordings were included in the final analysis. OUTCOME MEASURES AERs were recorded and amplitudes were normalized to the amplitude of the first stimulus. RESULTS In both fetuses and infants, the amplitudes of AERs were found not to decrease with repeated stimulation. In infants, however, amplitude of syllable 6 (dishabituator) was significantly increased compared to syllable 5 (p=0.026). CONCLUSIONS Fetuses and infants showed AERs to syllables. Unlike fetuses, infants showed a discriminative neural response to syllables. Habituation was not observed in either fetuses or infants. These findings could be important for the investigation of early cognitive competencies and may help to gain a better understanding of language acquisition during child development.
Collapse
Affiliation(s)
- Julia Hartkopf
- fMEG Center, University of Tuebingen, Tuebingen, Germany.
| | - Franziska Schleger
- fMEG Center, University of Tuebingen, Tuebingen, Germany; German Center for Diabetes Research (DZD e.V.), Tuebingen, Germany; Institute for Diabetes Research and Metabolic Diseases of the Helmholtz Center Munich at the University of Tuebingen, Tuebingen, Germany
| | - Magdalene Weiss
- fMEG Center, University of Tuebingen, Tuebingen, Germany; Department of Obstetrics and Gynecology, University Hospital Tuebingen, Tuebingen, Germany
| | - Ingo Hertrich
- Hertie Center for Neurology, Institute for Clinical Brain Research, University of Tuebingen, Tuebingen, Germany
| | - Isabelle Kiefer-Schmidt
- fMEG Center, University of Tuebingen, Tuebingen, Germany; Department of Obstetrics and Gynecology, University Hospital Tuebingen, Tuebingen, Germany
| | - Hubert Preissl
- German Center for Diabetes Research (DZD e.V.), Tuebingen, Germany; Institute for Diabetes Research and Metabolic Diseases of the Helmholtz Center Munich at the University of Tuebingen, Tuebingen, Germany; Department of Internal Medicine, Division of Endocrinology, Diabetology, Angiology, Nephrology and Clinical Chemistry, University Hospital Tuebingen, Tuebingen, Germany; Department of Pharmacy and Biochemistry, Faculty of Science, University of Tuebingen, Tuebingen, Germany
| | - Jana Muenssinger
- Department of Neurology, Klinikum Bayreuth GmbH, Bayreuth, Germany
| |
Collapse
|
7
|
Moses DA, Mesgarani N, Leonard MK, Chang EF. Neural speech recognition: continuous phoneme decoding using spatiotemporal representations of human cortical activity. J Neural Eng 2016; 13:056004. [PMID: 27484713 DOI: 10.1088/1741-2560/13/5/056004] [Citation(s) in RCA: 44] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
OBJECTIVE The superior temporal gyrus (STG) and neighboring brain regions play a key role in human language processing. Previous studies have attempted to reconstruct speech information from brain activity in the STG, but few of them incorporate the probabilistic framework and engineering methodology used in modern speech recognition systems. In this work, we describe the initial efforts toward the design of a neural speech recognition (NSR) system that performs continuous phoneme recognition on English stimuli with arbitrary vocabulary sizes using the high gamma band power of local field potentials in the STG and neighboring cortical areas obtained via electrocorticography. APPROACH The system implements a Viterbi decoder that incorporates phoneme likelihood estimates from a linear discriminant analysis model and transition probabilities from an n-gram phonemic language model. Grid searches were used in an attempt to determine optimal parameterizations of the feature vectors and Viterbi decoder. MAIN RESULTS The performance of the system was significantly improved by using spatiotemporal representations of the neural activity (as opposed to purely spatial representations) and by including language modeling and Viterbi decoding in the NSR system. SIGNIFICANCE These results emphasize the importance of modeling the temporal dynamics of neural responses when analyzing their variations with respect to varying stimuli and demonstrate that speech recognition techniques can be successfully leveraged when decoding speech from neural signals. Guided by the results detailed in this work, further development of the NSR system could have applications in the fields of automatic speech recognition and neural prosthetics.
Collapse
Affiliation(s)
- David A Moses
- Department of Neurological Surgery, UC San Francisco, CA, USA. Center for Integrative Neuroscience, UC San Francisco, CA, USA. Graduate Program in Bioengineering, UC Berkeley-UC San Francisco, CA, USA
| | | | | | | |
Collapse
|