1
|
Nourski KV, Steinschneider M, Rhone AE, Berger JI, Dappen ER, Kawasaki H, Howard III MA. Intracranial electrophysiology of spectrally degraded speech in the human cortex. Front Hum Neurosci 2024; 17:1334742. [PMID: 38318272 PMCID: PMC10839784 DOI: 10.3389/fnhum.2023.1334742] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2023] [Accepted: 12/28/2023] [Indexed: 02/07/2024] Open
Abstract
Introduction Cochlear implants (CIs) are the treatment of choice for severe to profound hearing loss. Variability in CI outcomes remains despite advances in technology and is attributed in part to differences in cortical processing. Studying these differences in CI users is technically challenging. Spectrally degraded stimuli presented to normal-hearing individuals approximate input to the central auditory system in CI users. This study used intracranial electroencephalography (iEEG) to investigate cortical processing of spectrally degraded speech. Methods Participants were adult neurosurgical epilepsy patients. Stimuli were utterances /aba/ and /ada/, spectrally degraded using a noise vocoder (1-4 bands) or presented without vocoding. The stimuli were presented in a two-alternative forced choice task. Cortical activity was recorded using depth and subdural iEEG electrodes. Electrode coverage included auditory core in posteromedial Heschl's gyrus (HGPM), superior temporal gyrus (STG), ventral and dorsal auditory-related areas, and prefrontal and sensorimotor cortex. Analysis focused on high gamma (70-150 Hz) power augmentation and alpha (8-14 Hz) suppression. Results Chance task performance occurred with 1-2 spectral bands and was near-ceiling for clear stimuli. Performance was variable with 3-4 bands, permitting identification of good and poor performers. There was no relationship between task performance and participants demographic, audiometric, neuropsychological, or clinical profiles. Several response patterns were identified based on magnitude and differences between stimulus conditions. HGPM responded strongly to all stimuli. A preference for clear speech emerged within non-core auditory cortex. Good performers typically had strong responses to all stimuli along the dorsal stream, including posterior STG, supramarginal, and precentral gyrus; a minority of sites in STG and supramarginal gyrus had a preference for vocoded stimuli. In poor performers, responses were typically restricted to clear speech. Alpha suppression was more pronounced in good performers. In contrast, poor performers exhibited a greater involvement of posterior middle temporal gyrus when listening to clear speech. Discussion Responses to noise-vocoded speech provide insights into potential factors underlying CI outcome variability. The results emphasize differences in the balance of neural processing along the dorsal and ventral stream between good and poor performers, identify specific cortical regions that may have diagnostic and prognostic utility, and suggest potential targets for neuromodulation-based CI rehabilitation strategies.
Collapse
Affiliation(s)
- Kirill V. Nourski
- Department of Neurosurgery, The University of Iowa, Iowa City, IA, United States
- Iowa Neuroscience Institute, The University of Iowa, Iowa City, IA, United States
| | - Mitchell Steinschneider
- Department of Neurosurgery, The University of Iowa, Iowa City, IA, United States
- Departments of Neurology and Neuroscience, Albert Einstein College of Medicine, Bronx, NY, United States
| | - Ariane E. Rhone
- Department of Neurosurgery, The University of Iowa, Iowa City, IA, United States
| | - Joel I. Berger
- Department of Neurosurgery, The University of Iowa, Iowa City, IA, United States
| | - Emily R. Dappen
- Department of Neurosurgery, The University of Iowa, Iowa City, IA, United States
- Iowa Neuroscience Institute, The University of Iowa, Iowa City, IA, United States
| | - Hiroto Kawasaki
- Department of Neurosurgery, The University of Iowa, Iowa City, IA, United States
| | - Matthew A. Howard III
- Department of Neurosurgery, The University of Iowa, Iowa City, IA, United States
- Iowa Neuroscience Institute, The University of Iowa, Iowa City, IA, United States
- Pappajohn Biomedical Institute, The University of Iowa, Iowa City, IA, United States
| |
Collapse
|
2
|
Glennon E, Valtcheva S, Zhu A, Wadghiri YZ, Svirsky MA, Froemke RC. Locus coeruleus activity improves cochlear implant performance. Nature 2023; 613:317-323. [PMID: 36544024 PMCID: PMC10681749 DOI: 10.1038/s41586-022-05554-8] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2021] [Accepted: 11/10/2022] [Indexed: 12/24/2022]
Abstract
Cochlear implants (CIs) are neuroprosthetic devices that can provide hearing to deaf people1. Despite the benefits offered by CIs, the time taken for hearing to be restored and perceptual accuracy after long-term CI use remain highly variable2,3. CI use is believed to require neuroplasticity in the central auditory system, and differential engagement of neuroplastic mechanisms might contribute to the variability in outcomes4-7. Despite extensive studies on how CIs activate the auditory system4,8-12, the understanding of CI-related neuroplasticity remains limited. One potent factor enabling plasticity is the neuromodulator noradrenaline from the brainstem locus coeruleus (LC). Here we examine behavioural responses and neural activity in LC and auditory cortex of deafened rats fitted with multi-channel CIs. The rats were trained on a reward-based auditory task, and showed considerable individual differences of learning rates and maximum performance. LC photometry predicted when CI subjects began responding to sounds and longer-term perceptual accuracy. Optogenetic LC stimulation produced faster learning and higher long-term accuracy. Auditory cortical responses to CI stimulation reflected behavioural performance, with enhanced responses to rewarded stimuli and decreased distinction between unrewarded stimuli. Adequate engagement of central neuromodulatory systems is thus a potential clinically relevant target for optimizing neuroprosthetic device use.
Collapse
Affiliation(s)
- Erin Glennon
- Skirball Institute for Biomolecular Medicine, New York University School of Medicine, New York, NY, USA
- Neuroscience Institute, New York University School of Medicine, New York, NY, USA
- Department of Otolaryngology, New York University School of Medicine, New York, NY, USA
- Department of Neuroscience and Physiology, New York University School of Medicine, New York, NY, USA
| | - Silvana Valtcheva
- Skirball Institute for Biomolecular Medicine, New York University School of Medicine, New York, NY, USA
- Neuroscience Institute, New York University School of Medicine, New York, NY, USA
- Department of Otolaryngology, New York University School of Medicine, New York, NY, USA
- Department of Neuroscience and Physiology, New York University School of Medicine, New York, NY, USA
| | - Angela Zhu
- Skirball Institute for Biomolecular Medicine, New York University School of Medicine, New York, NY, USA
- Neuroscience Institute, New York University School of Medicine, New York, NY, USA
- Department of Otolaryngology, New York University School of Medicine, New York, NY, USA
- Department of Neuroscience and Physiology, New York University School of Medicine, New York, NY, USA
| | - Youssef Z Wadghiri
- Center for Advanced Imaging Innovation and Research, Bernard and Irene Schwartz Center for Biomedical Imaging, Department of Radiology, New York University School of Medicine, New York, NY, USA
| | - Mario A Svirsky
- Neuroscience Institute, New York University School of Medicine, New York, NY, USA.
- Department of Otolaryngology, New York University School of Medicine, New York, NY, USA.
- Department of Neuroscience and Physiology, New York University School of Medicine, New York, NY, USA.
| | - Robert C Froemke
- Skirball Institute for Biomolecular Medicine, New York University School of Medicine, New York, NY, USA.
- Neuroscience Institute, New York University School of Medicine, New York, NY, USA.
- Department of Otolaryngology, New York University School of Medicine, New York, NY, USA.
- Department of Neuroscience and Physiology, New York University School of Medicine, New York, NY, USA.
| |
Collapse
|
3
|
Bauernfeind G, Teschner MJ, Wriessnegger S, Büchner A, Lenarz T, Haumann S. Towards single-trial classification of invasively recorded auditory evoked potentials in cochlear implant users. J Neural Eng 2022; 19. [PMID: 35189612 DOI: 10.1088/1741-2552/ac572d] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2021] [Accepted: 02/21/2022] [Indexed: 11/12/2022]
Abstract
OBJECTIVE One promising approach towards further improving cochlear implants (CIs) is to use brain signals controlling the device in order to close the auditory loop. Initial electroencephalography (EEG) studies have already shown promising results. However, they are based on noninvasive measurements, whereas implanted electrodes are expected to be more convenient in terms of everyday-life usability. If additional measurement electrodes were implanted during CI surgery, then invasive recordings should be possible. Furthermore, implantation will provide better signal quality, greater robustness to artefacts, and thus enhanced classification accuracy. APPROACH In an initial project, three additional epidural electrodes were temporarily implanted during the surgical procedure. After surgery, different auditory evoked potentials (AEPs) were recorded both invasively (epidural) and using surface electrodes, with invasively recorded signals demonstrated as being markedly superior. In this present analysis, cortical evoked response audiometry (CERA) signals recorded in seven patients were used for single-trial classification of sounds with different intensities. For classification purposes, we used shrinkage-regularized linear discriminant analysis (sLDA). Clinical speech perception scores were also investigated. MAIN RESULTS Analysis of CERA data from different subjects showed single-trial classification accuracies of up to 99.2% for perceived vs. non-perceived sounds. Accuracies of up to 89.1% were achieved in classification of sounds perceived at different intensities. Highest classification accuracies were achieved by means of epidural recordings. Required loudness differences seemed to correspond to speech perception in noise. Significance: The proposed epidural recording approach showed good classification accuracy into sound perceived and not perceived when the best-performing electrodes were selected. Classifying different levels of sound stimulation accurately proved more challenging. At present, the methods explored in this study would not be sufficiently reliable to allow automated closed-loop control of CI parameters. However, our findings are an important initial contribution towards improving applicability of closed auditory loops and for next-generation automatic fitting approaches.
Collapse
Affiliation(s)
- Guenther Bauernfeind
- Independent researcher; Former member of the Department of Otolaryngology, Hannover Medical School, Carl-Neuberg-Str. 1, Hannover, 30625, GERMANY
| | - Magnus Johannes Teschner
- Department of Otolaryngology, Hannover Medical School, Carl-Neuberg-Str. 1, Hannover, Niedersachsen, 30625, GERMANY
| | - Selina Wriessnegger
- Department of Psychology, Karl Franzens Universitaet Graz, Universitätsplatz 2 / III, A-8010 Graz, Austria, Graz, A-8010, AUSTRIA
| | - Andreas Büchner
- Department of Otolaryngology, Hannover Medical School, Carl-Neuberg-Str.1, Hannover, Niedersachsen, 30625, GERMANY
| | - Thomas Lenarz
- Department of Otolaryngology, Hannover Medical School, Carl-Neubergstr. 1, 30625 Hannover, Germany, Hannover, Niedersachsen, 30625, GERMANY
| | - Sabine Haumann
- Department of Otolaryngology, Hannover Medical School, Carl-Neuberg-Str.1, Hannover, Niedersachsen, 30625, GERMANY
| |
Collapse
|
4
|
Kang H, Macherey O, Roman S, Pressnitzer D. Auditory memory for random time patterns in cochlear implant listeners. THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2021; 150:1934. [PMID: 34598651 DOI: 10.1121/10.0005728] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/25/2020] [Accepted: 07/01/2021] [Indexed: 06/13/2023]
Abstract
Learning about new sounds is essential for cochlear-implant and normal-hearing listeners alike, with the additional challenge for implant listeners that spectral resolution is severely degraded. Here, a task measuring the rapid learning of slow or fast stochastic temporal sequences [Kang, Agus, and Pressnitzer (2017). J. Acoust. Soc. Am. 142, 2219-2232] was performed by cochlear-implant (N = 10) and normal-hearing (N = 9) listeners, using electric or acoustic pulse sequences, respectively. Rapid perceptual learning was observed for both groups, with highly similar characteristics. Moreover, for cochlear-implant listeners, an additional condition tested ultra-fast electric pulse sequences that would be impossible to represent temporally when presented acoustically. This condition also demonstrated learning. Overall, the results suggest that cochlear-implant listeners have access to the neural plasticity mechanisms needed for the rapid perceptual learning of complex temporal sequences.
Collapse
Affiliation(s)
- HiJee Kang
- Laboratoire des Systèmes Perceptifs, Département d'études Cognitives, École Normale Supérieure, PSL University, CNRS, 29 Rue d'Ulm, 75005 Paris, France
| | - Olivier Macherey
- Aix-Marseille University, CNRS, Centrale Marseille, LMA, 4 impasse Nikola Tesla, CS40006, 13453 Marseille, Cedex 13, France
| | - Stéphane Roman
- Department of Pediatric Otolaryngology and Neck Surgery, Aix-Marseille University, 264 Rue Saint Pierre, 13005 Marseille, France
| | - Daniel Pressnitzer
- Laboratoire des Systèmes Perceptifs, Département d'études Cognitives, École Normale Supérieure, PSL University, CNRS, 29 Rue d'Ulm, 75005 Paris, France
| |
Collapse
|
5
|
Zhang M, Alamatsaz N, Ihlefeld A. Hemodynamic Responses Link Individual Differences in Informational Masking to the Vicinity of Superior Temporal Gyrus. Front Neurosci 2021; 15:675326. [PMID: 34366772 PMCID: PMC8339305 DOI: 10.3389/fnins.2021.675326] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2021] [Accepted: 05/13/2021] [Indexed: 01/20/2023] Open
Abstract
Suppressing unwanted background sound is crucial for aural communication. A particularly disruptive type of background sound, informational masking (IM), often interferes in social settings. However, IM mechanisms are incompletely understood. At present, IM is identified operationally: when a target should be audible, based on suprathreshold target/masker energy ratios, yet cannot be heard because target-like background sound interferes. We here confirm that speech identification thresholds differ dramatically between low- vs. high-IM background sound. However, speech detection thresholds are comparable across the two conditions. Moreover, functional near infrared spectroscopy recordings show that task-evoked blood oxygenation changes near the superior temporal gyrus (STG) covary with behavioral speech detection performance for high-IM but not low-IM background sound, suggesting that the STG is part of an IM-dependent network. Moreover, listeners who are more vulnerable to IM show increased hemodynamic recruitment near STG, an effect that cannot be explained based on differences in task difficulty across low- vs. high-IM. In contrast, task-evoked responses near another auditory region of cortex, the caudal inferior frontal sulcus (cIFS), do not predict behavioral sensitivity, suggesting that the cIFS belongs to an IM-independent network. Results are consistent with the idea that cortical gating shapes individual vulnerability to IM.
Collapse
Affiliation(s)
- Min Zhang
- Department of Biomedical Engineering, New Jersey Institute of Technology, Newark, NJ, United States
- Rutgers Biomedical and Health Sciences, Rutgers University, Newark, NJ, United States
| | - Nima Alamatsaz
- Department of Biomedical Engineering, New Jersey Institute of Technology, Newark, NJ, United States
- Rutgers Biomedical and Health Sciences, Rutgers University, Newark, NJ, United States
| | - Antje Ihlefeld
- Department of Biomedical Engineering, New Jersey Institute of Technology, Newark, NJ, United States
| |
Collapse
|
6
|
EEG-based diagnostics of the auditory system using cochlear implant electrodes as sensors. Sci Rep 2021; 11:5383. [PMID: 33686155 PMCID: PMC7940426 DOI: 10.1038/s41598-021-84829-y] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2020] [Accepted: 02/18/2021] [Indexed: 01/31/2023] Open
Abstract
The cochlear implant is one of the most successful medical prostheses, allowing deaf and severely hearing-impaired persons to hear again by electrically stimulating the auditory nerve. A trained audiologist adjusts the stimulation settings for good speech understanding, known as "fitting" the implant. This process is based on subjective feedback from the user, making it time-consuming and challenging, especially in paediatric or communication-impaired populations. Furthermore, fittings only happen during infrequent sessions at a clinic, and therefore cannot take into account variable factors that affect the user's hearing, such as physiological changes and different listening environments. Objective audiometry, in which brain responses evoked by auditory stimulation are collected and analysed, removes the need for active patient participation. However, recording of brain responses still requires expensive equipment that is cumbersome to use. An elegant solution is to record the neural signals using the implant itself. We demonstrate for the first time the recording of continuous electroencephalographic (EEG) signals from the implanted intracochlear electrode array in human subjects, using auditory evoked potentials originating from different brain regions. This was done using a temporary recording set-up with a percutaneous connector used for research purposes. Furthermore, we show that the response morphologies and amplitudes depend crucially on the recording electrode configuration. The integration of an EEG system into cochlear implants paves the way towards chronic neuro-monitoring of hearing-impaired patients in their everyday environment, and neuro-steered hearing prostheses, which can autonomously adjust their output based on neural feedback.
Collapse
|
7
|
Neural Correlates of Vocal Auditory Feedback Processing: Unique Insights from Electrocorticography Recordings in a Human Cochlear Implant User. eNeuro 2021; 8:ENEURO.0181-20.2020. [PMID: 33419861 PMCID: PMC7877459 DOI: 10.1523/eneuro.0181-20.2020] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2020] [Revised: 12/18/2020] [Accepted: 12/21/2020] [Indexed: 11/21/2022] Open
Abstract
There is considerable interest in understanding cortical processing and the function of top-down and bottom-up human neural circuits that control speech production. Research efforts to investigate these circuits are aided by analysis of spectro-temporal response characteristics of neural activity recorded by electrocorticography (ECoG). Further, cortical processing may be altered in the case of hearing-impaired cochlear implant (CI) users, as electric excitation of the auditory nerve creates a markedly different neural code for speech compared with that of the functionally intact hearing system. Studies of cortical activity in CI users typically record scalp potentials and are hampered by stimulus artifact contamination and by spatiotemporal filtering imposed by the skull. We present a unique case of a CI user who required direct recordings from the cortical surface using subdural electrodes implanted for epilepsy assessment. Using experimental conditions where the subject vocalized in the presence (CIs ON) or absence (CIs OFF) of auditory feedback, or listened to playback of self-vocalizations without production, we observed ECoG activity primarily in γ (32–70 Hz) and high γ (70–150 Hz) bands at focal regions on the lateral surface of the superior temporal gyrus (STG). High γ band responses differed in their amplitudes across conditions and cortical sites, possibly reflecting different rates of stimulus presentation and differing levels of neural adaptation. STG γ responses to playback and vocalization with auditory feedback were not different from responses to vocalization without feedback, indicating this activity reflects not only auditory, but also attentional, efference-copy, and sensorimotor processing during speech production.
Collapse
|
8
|
Glennon E, Svirsky MA, Froemke RC. Auditory cortical plasticity in cochlear implant users. Curr Opin Neurobiol 2019; 60:108-114. [PMID: 31864104 DOI: 10.1016/j.conb.2019.11.003] [Citation(s) in RCA: 40] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2019] [Revised: 10/26/2019] [Accepted: 11/08/2019] [Indexed: 12/31/2022]
Abstract
Cochlear implants are one of the most successful neuroprosthetic devices that have been developed to date. Profoundly deaf patients can achieve speech perception after complete loss of sensory input. Despite the improvements many patients experience, there is still a large degree of outcome variability. It has been proposed that central plasticity may be a major factor in the different levels of benefit that patients experience. However, the neural mechanisms of how plasticity impacts cochlear implant learning and the degree of plasticity's influence remain unknown. Here, we review the human and animal research on three of the main ways that central plasticity affects cochlear implant outcomes.
Collapse
Affiliation(s)
- Erin Glennon
- Skirball Institute for Biomolecular Medicine, New York University School of Medicine, New York, NY, USA; Neuroscience Institute, New York University School of Medicine, New York, NY, USA; Department of Otolaryngology, New York University School of Medicine, New York, NY, USA; Department of Neuroscience and Physiology, New York University School of Medicine, New York, NY, USA
| | - Mario A Svirsky
- Skirball Institute for Biomolecular Medicine, New York University School of Medicine, New York, NY, USA; Neuroscience Institute, New York University School of Medicine, New York, NY, USA; Department of Otolaryngology, New York University School of Medicine, New York, NY, USA; Department of Neuroscience and Physiology, New York University School of Medicine, New York, NY, USA.
| | - Robert C Froemke
- Skirball Institute for Biomolecular Medicine, New York University School of Medicine, New York, NY, USA; Neuroscience Institute, New York University School of Medicine, New York, NY, USA; Department of Otolaryngology, New York University School of Medicine, New York, NY, USA; Department of Neuroscience and Physiology, New York University School of Medicine, New York, NY, USA; Center for Neural Science, New York University, New York, NY, USA; Howard Hughes Medical Institute Faculty Scholar, USA.
| |
Collapse
|
9
|
Haumann S, Bauernfeind G, Teschner MJ, Schierholz I, Bleichner MG, Büchner A, Lenarz T. Epidural recordings in cochlear implant users. J Neural Eng 2019; 16:056008. [PMID: 31042688 DOI: 10.1088/1741-2552/ab1e80] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
OBJECTIVE In the long term it is desirable for CI users to control their device via brain signals. A possible strategy is the use of auditory evoked potentials (AEPs). Several studies have shown the suitability of auditory paradigms for such an approach. However, these investigations are based on non-invasive recordings. When thinking about everyday life applications, it would be more convenient to use implanted electrodes for signal acquisition. Ideally, the electrodes would be directly integrated into the CI. Further it is to be expected that invasively recorded signals have higher signal quality and are less affected by artifacts. APPROACH In this project we investigated the feasibility of implanting epidural electrodes temporarily during CI surgery and the possibility to record AEPs in the course of several days after implantation. Intraoperatively, auditory brainstem responses were recorded, whereas various kinds of AEPs were recorded postoperatively. After a few days the epidural electrodes were removed. MAIN RESULTS Data sets of ten subjects were obtained. Invasively recorded potentials were compared subjectively and objectively to clinical standard recordings using surface electrodes. Especially the cortical evoked response audiometry depicted clearer N1 waves for the epidural electrodes which were also visible at lower stimulation intensities compared to scalp electrodes. Furthermore the signal was less disturbed by artifacts. The objective quality measure (based on data sets of six patients) showed a significant better signal quality for the epidural compared to the scalp recordings. SIGNIFICANCE Altogether the approach revealed to be feasible and well tolerated by the patients. The epidural recordings showed a clearly better signal quality than the scalp recordings with AEPs being clearer recognizable. The results of the present study suggest that including epidural recording electrodes in future CI systems will improve the everyday life applicability of auditory closed loop systems for CI subjects.
Collapse
Affiliation(s)
- S Haumann
- Department of Otolaryngology, Hannover Medical School, Hannover, Germany. Cluster of Excellence 'Hearing4all', Hannover & Oldenburg, Germany
| | | | | | | | | | | | | |
Collapse
|
10
|
Nourski KV, Steinschneider M, Rhone AE, Kovach CK, Kawasaki H, Howard MA. Differential responses to spectrally degraded speech within human auditory cortex: An intracranial electrophysiology study. Hear Res 2018; 371:53-65. [PMID: 30500619 DOI: 10.1016/j.heares.2018.11.009] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/13/2018] [Revised: 11/15/2018] [Accepted: 11/19/2018] [Indexed: 12/28/2022]
Abstract
Understanding cortical processing of spectrally degraded speech in normal-hearing subjects may provide insights into how sound information is processed by cochlear implant (CI) users. This study investigated electrocorticographic (ECoG) responses to noise-vocoded speech and related these responses to behavioral performance in a phonemic identification task. Subjects were neurosurgical patients undergoing chronic invasive monitoring for medically refractory epilepsy. Stimuli were utterances /aba/ and /ada/, spectrally degraded using a noise vocoder (1-4 bands). ECoG responses were obtained from Heschl's gyrus (HG) and superior temporal gyrus (STG), and were examined within the high gamma frequency range (70-150 Hz). All subjects performed at chance accuracy with speech degraded to 1 and 2 spectral bands, and at or near ceiling for clear speech. Inter-subject variability was observed in the 3- and 4-band conditions. High gamma responses in posteromedial HG (auditory core cortex) were similar for all vocoded conditions and clear speech. A progressive preference for clear speech emerged in anterolateral segments of HG, regardless of behavioral performance. On the lateral STG, responses to all vocoded stimuli were larger in subjects with better task performance. In contrast, both behavioral and neural responses to clear speech were comparable across subjects regardless of their ability to identify degraded stimuli. Findings highlight differences in representation of spectrally degraded speech across cortical areas and their relationship to perception. The results are in agreement with prior non-invasive results. The data provide insight into the neural mechanisms associated with variability in perception of degraded speech and potentially into sources of such variability in CI users.
Collapse
Affiliation(s)
- Kirill V Nourski
- Department of Neurosurgery, The University of Iowa, Iowa City, IA, USA; Iowa Neuroscience Institute, The University of Iowa, Iowa City, IA, USA.
| | - Mitchell Steinschneider
- Departments of Neurology and Neuroscience, Albert Einstein College of Medicine, Bronx, NY, USA
| | - Ariane E Rhone
- Department of Neurosurgery, The University of Iowa, Iowa City, IA, USA
| | | | - Hiroto Kawasaki
- Department of Neurosurgery, The University of Iowa, Iowa City, IA, USA
| | - Matthew A Howard
- Department of Neurosurgery, The University of Iowa, Iowa City, IA, USA; Iowa Neuroscience Institute, The University of Iowa, Iowa City, IA, USA; Pappajohn Biomedical Institute, The University of Iowa, Iowa City, IA, USA
| |
Collapse
|
11
|
Johnson LA, Della Santina CC, Wang X. Selective Neuronal Activation by Cochlear Implant Stimulation in Auditory Cortex of Awake Primate. J Neurosci 2016; 36:12468-12484. [PMID: 27927962 PMCID: PMC5148231 DOI: 10.1523/jneurosci.1699-16.2016] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2016] [Revised: 10/05/2016] [Accepted: 10/10/2016] [Indexed: 11/21/2022] Open
Abstract
Despite the success of cochlear implants (CIs) in human populations, most users perform poorly in noisy environments and music and tonal language perception. How CI devices engage the brain at the single neuron level has remained largely unknown, in particular in the primate brain. By comparing neuronal responses with acoustic and CI stimulation in marmoset monkeys unilaterally implanted with a CI electrode array, we discovered that CI stimulation was surprisingly ineffective at activating many neurons in auditory cortex, particularly in the hemisphere ipsilateral to the CI. Further analyses revealed that the CI-nonresponsive neurons were narrowly tuned to frequency and sound level when probed with acoustic stimuli; such neurons likely play a role in perceptual behaviors requiring fine frequency and level discrimination, tasks that CI users find especially challenging. These findings suggest potential deficits in central auditory processing of CI stimulation and provide important insights into factors responsible for poor CI user performance in a wide range of perceptual tasks. SIGNIFICANCE STATEMENT The cochlear implant (CI) is the most successful neural prosthetic device to date and has restored hearing in hundreds of thousands of deaf individuals worldwide. However, despite its huge successes, CI users still face many perceptual limitations, and the brain mechanisms involved in hearing through CI devices remain poorly understood. By directly comparing single-neuron responses to acoustic and CI stimulation in auditory cortex of awake marmoset monkeys, we discovered that neurons unresponsive to CI stimulation were sharply tuned to frequency and sound level. Our results point out a major deficit in central auditory processing of CI stimulation and provide important insights into mechanisms underlying the poor CI user performance in a wide range of perceptual tasks.
Collapse
Affiliation(s)
| | - Charles C Della Santina
- Departments of Biomedical Engineering and
- Otolaryngology-Head and Neck Surgery, Johns Hopkins University School of Medicine, Baltimore, Maryland 21025
| | | |
Collapse
|
12
|
King J, Shehu I, Roland JT, Svirsky MA, Froemke RC. A physiological and behavioral system for hearing restoration with cochlear implants. J Neurophysiol 2016; 116:844-58. [PMID: 27281743 DOI: 10.1152/jn.00048.2016] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2016] [Accepted: 05/31/2016] [Indexed: 12/31/2022] Open
Abstract
Cochlear implants are neuroprosthetic devices that provide hearing to deaf patients, although outcomes are highly variable even with prolonged training and use. The central auditory system must process cochlear implant signals, but it is unclear how neural circuits adapt-or fail to adapt-to such inputs. The knowledge of these mechanisms is required for development of next-generation neuroprosthetics that interface with existing neural circuits and enable synaptic plasticity to improve perceptual outcomes. Here, we describe a new system for cochlear implant insertion, stimulation, and behavioral training in rats. Animals were first ensured to have significant hearing loss via physiological and behavioral criteria. We developed a surgical approach for multichannel (2- or 8-channel) array insertion, comparable with implantation procedures and depth in humans. Peripheral and cortical responses to stimulation were used to program the implant objectively. Animals fitted with implants learned to use them for an auditory-dependent task that assesses frequency detection and recognition in a background of environmentally and self-generated noise and ceased responding appropriately to sounds when the implant was temporarily inactivated. This physiologically calibrated and behaviorally validated system provides a powerful opportunity to study the neural basis of neuroprosthetic device use and plasticity.
Collapse
Affiliation(s)
- Julia King
- Skirball Institute of Biomolecular Medicine, New York University School of Medicine, New York, New York; Neuroscience Institute, New York University School of Medicine, New York, New York; Department of Otolaryngology, New York University School of Medicine, New York, New York; Department of Neuroscience and Physiology, New York University School of Medicine, New York, New York
| | - Ina Shehu
- Skirball Institute of Biomolecular Medicine, New York University School of Medicine, New York, New York; Department of Otolaryngology, New York University School of Medicine, New York, New York; Department of Biology, Hunter College, New York, New York; and
| | - J Thomas Roland
- Department of Otolaryngology, New York University School of Medicine, New York, New York
| | - Mario A Svirsky
- Neuroscience Institute, New York University School of Medicine, New York, New York; Department of Otolaryngology, New York University School of Medicine, New York, New York; Department of Neuroscience and Physiology, New York University School of Medicine, New York, New York; Center for Neural Science, New York University, New York, New York. *, co-senior authors
| | - Robert C Froemke
- Skirball Institute of Biomolecular Medicine, New York University School of Medicine, New York, New York; Neuroscience Institute, New York University School of Medicine, New York, New York; Department of Otolaryngology, New York University School of Medicine, New York, New York; Department of Neuroscience and Physiology, New York University School of Medicine, New York, New York; Center for Neural Science, New York University, New York, New York. *, co-senior authors.
| |
Collapse
|
13
|
Di Lella F, Bacciu A, Falcioni M, Guida M, Vincenti V. Long-term clinical outcomes of cochlear implantation in children with symptomatic epilepsy. Int J Pediatr Otorhinolaryngol 2016; 82:23-7. [PMID: 26857310 DOI: 10.1016/j.ijporl.2015.12.021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/06/2015] [Revised: 12/27/2015] [Accepted: 12/28/2015] [Indexed: 11/26/2022]
Abstract
OBJECTIVES To describe long-term clinical outcomes of cochlear implantation in deaf children with symptomatic epilepsy. MATERIALS AND METHODS A retrospective data analysis review of patients implanted at the Cochlear Implant Center of the University of Parma, Italy, was performed, searching for implanted children with a confirmed diagnosis of symptomatic epilepsy. Clinical data, imaging findings, pre- and post-operative epilepsy pattern and EEG traces were analyzed; communicative skills were assessed using the Profile of Actual Linguistic Skills. RESULTS Search retrieved two patients affected by profound bilateral sensorineural hearing loss and symptomatic epilepsy (associated respectively with methylmalonic acidemia and cerebral palsy). After careful parental counselling both patients were offered and underwent cochlear implantation. Activation and use of cochlear implant did not determine substantial changes of pre-existing seizure pattern and EEG traces. Both patients showed substantial development of their communicative abilities. CONCLUSIONS Cochlear implantation in children with symptomatic epilepsy did not determine variations in seizure pattern or EEG traces. Both patients experienced substantial benefit from cochlear implantation.
Collapse
Affiliation(s)
- Filippo Di Lella
- Department of Clinical and Experimental Medicine, Unit of Audiology and Paediatric Otorhinolaryngology, University of Parma, Via Gramsci 14, Parma 43126, Italy.
| | - Andrea Bacciu
- Department of Clinical and Experimental Medicine, Unit of Audiology and Paediatric Otorhinolaryngology, University of Parma, Via Gramsci 14, Parma 43126, Italy
| | - Maurizio Falcioni
- Department of Clinical and Experimental Medicine, Unit of Audiology and Paediatric Otorhinolaryngology, University of Parma, Via Gramsci 14, Parma 43126, Italy
| | - Maurizio Guida
- Department of Clinical and Experimental Medicine, Unit of Audiology and Paediatric Otorhinolaryngology, University of Parma, Via Gramsci 14, Parma 43126, Italy
| | - Vincenzo Vincenti
- Department of Clinical and Experimental Medicine, Unit of Audiology and Paediatric Otorhinolaryngology, University of Parma, Via Gramsci 14, Parma 43126, Italy
| |
Collapse
|
14
|
Pham CQ, Bremen P, Shen W, Yang SM, Middlebrooks JC, Zeng FG, Mc Laughlin M. Central Auditory Processing of Temporal and Spectral-Variance Cues in Cochlear Implant Listeners. PLoS One 2015; 10:e0132423. [PMID: 26176553 PMCID: PMC4503639 DOI: 10.1371/journal.pone.0132423] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2014] [Accepted: 06/13/2015] [Indexed: 11/25/2022] Open
Abstract
Cochlear implant (CI) listeners have difficulty understanding speech in complex listening environments. This deficit is thought to be largely due to peripheral encoding problems arising from current spread, which results in wide peripheral filters. In normal hearing (NH) listeners, central processing contributes to segregation of speech from competing sounds. We tested the hypothesis that basic central processing abilities are retained in post-lingually deaf CI listeners, but processing is hampered by degraded input from the periphery. In eight CI listeners, we measured auditory nerve compound action potentials to characterize peripheral filters. Then, we measured psychophysical detection thresholds in the presence of multi-electrode maskers placed either inside (peripheral masking) or outside (central masking) the peripheral filter. This was intended to distinguish peripheral from central contributions to signal detection. Introduction of temporal asynchrony between the signal and masker improved signal detection in both peripheral and central masking conditions for all CI listeners. Randomly varying components of the masker created spectral-variance cues, which seemed to benefit only two out of eight CI listeners. Contrastingly, the spectral-variance cues improved signal detection in all five NH listeners who listened to our CI simulation. Together these results indicate that widened peripheral filters significantly hamper central processing of spectral-variance cues but not of temporal cues in post-lingually deaf CI listeners. As indicated by two CI listeners in our study, however, post-lingually deaf CI listeners may retain some central processing abilities similar to NH listeners.
Collapse
Affiliation(s)
- Carol Q. Pham
- Center for Hearing Research, University of California Irvine, Irvine, California, United States of America
- Department of Anatomy and Neurobiology, University of California Irvine, Irvine, California, United States of America
- * E-mail:
| | - Peter Bremen
- Center for Hearing Research, University of California Irvine, Irvine, California, United States of America
- Department of Otolaryngology- Head and Neck Surgery, University of California Irvine, Irvine, California, United States of America
| | - Weidong Shen
- Institute of Otolaryngology, Chinese PLA Genera Hospital, Beijing, China
| | - Shi-Ming Yang
- Institute of Otolaryngology, Chinese PLA Genera Hospital, Beijing, China
| | - John C. Middlebrooks
- Center for Hearing Research, University of California Irvine, Irvine, California, United States of America
- Department of Otolaryngology- Head and Neck Surgery, University of California Irvine, Irvine, California, United States of America
- Department of Neurobiology and Behavior, University of California Irvine, Irvine, California, United States of America
- Department of Biomedical Engineering, University of California Irvine, Irvine, California, United States of America
- Department of Cognitive Sciences, University of California Irvine, Irvine, California, United States of America
| | - Fan-Gang Zeng
- Center for Hearing Research, University of California Irvine, Irvine, California, United States of America
- Department of Anatomy and Neurobiology, University of California Irvine, Irvine, California, United States of America
- Department of Otolaryngology- Head and Neck Surgery, University of California Irvine, Irvine, California, United States of America
- Department of Biomedical Engineering, University of California Irvine, Irvine, California, United States of America
- Department of Cognitive Sciences, University of California Irvine, Irvine, California, United States of America
| | - Myles Mc Laughlin
- Center for Hearing Research, University of California Irvine, Irvine, California, United States of America
- Department of Otolaryngology- Head and Neck Surgery, University of California Irvine, Irvine, California, United States of America
| |
Collapse
|
15
|
Sandmann P, Plotz K, Hauthal N, de Vos M, Schönfeld R, Debener S. Rapid bilateral improvement in auditory cortex activity in postlingually deafened adults following cochlear implantation. Clin Neurophysiol 2015; 126:594-607. [DOI: 10.1016/j.clinph.2014.06.029] [Citation(s) in RCA: 49] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2014] [Revised: 05/20/2014] [Accepted: 06/09/2014] [Indexed: 01/12/2023]
|
16
|
Abstract
This chapter provides an overview of current invasive recording methodology and experimental paradigms used in the studies of human auditory cortex. Invasive recordings can be obtained from neurosurgical patients undergoing clinical electrophysiologic evaluation for medically refractory epilepsy or brain tumors. This provides a unique research opportunity to study the human auditory cortex with high resolution both in time (milliseconds) and space (millimeters) and to generate valuable information about its organization and function. A historic overview presents the development of the experimental approaches from the pioneering works of Wilder Penfield to modern day. Practical issues regarding research subject population, stimulus presentation, data collection, and analysis are discussed for acute (intraoperative) and chronic experiments. Illustrative examples are provided from experimental paradigms, including studies of spectrotemporal processing, functional connectivity, and functional lesioning in human auditory cortex.
Collapse
Affiliation(s)
- Kirill V Nourski
- Department of Neurosurgery, University of Iowa, Iowa City, IA, USA.
| | - Matthew A Howard
- Department of Neurosurgery, University of Iowa, Iowa City, IA, USA
| |
Collapse
|
17
|
Millman RE, Johnson SR, Prendergast G. The role of phase-locking to the temporal envelope of speech in auditory perception and speech intelligibility. J Cogn Neurosci 2014; 27:533-45. [PMID: 25244119 DOI: 10.1162/jocn_a_00719] [Citation(s) in RCA: 44] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
The temporal envelope of speech is important for speech intelligibility. Entrainment of cortical oscillations to the speech temporal envelope is a putative mechanism underlying speech intelligibility. Here we used magnetoencephalography (MEG) to test the hypothesis that phase-locking to the speech temporal envelope is enhanced for intelligible compared with unintelligible speech sentences. Perceptual "pop-out" was used to change the percept of physically identical tone-vocoded speech sentences from unintelligible to intelligible. The use of pop-out dissociates changes in phase-locking to the speech temporal envelope arising from acoustical differences between un/intelligible speech from changes in speech intelligibility itself. Novel and bespoke whole-head beamforming analyses, based on significant cross-correlation between the temporal envelopes of the speech stimuli and phase-locked neural activity, were used to localize neural sources that track the speech temporal envelope of both intelligible and unintelligible speech. Location-of-interest analyses were carried out in a priori defined locations to measure the representation of the speech temporal envelope for both un/intelligible speech in both the time domain (cross-correlation) and frequency domain (coherence). Whole-brain beamforming analyses identified neural sources phase-locked to the temporal envelopes of both unintelligible and intelligible speech sentences. Crucially there was no difference in phase-locking to the temporal envelope of speech in the pop-out condition in either the whole-brain or location-of-interest analyses, demonstrating that phase-locking to the speech temporal envelope is not enhanced by linguistic information.
Collapse
|
18
|
Poremba A, Bigelow J, Rossi B. Processing of communication sounds: contributions of learning, memory, and experience. Hear Res 2013; 305:31-44. [PMID: 23792078 DOI: 10.1016/j.heares.2013.06.005] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/19/2012] [Revised: 05/09/2013] [Accepted: 06/10/2013] [Indexed: 11/17/2022]
Abstract
Abundant evidence from both field and lab studies has established that conspecific vocalizations (CVs) are of critical ecological significance for a wide variety of species, including humans, non-human primates, rodents, and other mammals and birds. Correspondingly, a number of experiments have demonstrated behavioral processing advantages for CVs, such as in discrimination and memory tasks. Further, a wide range of experiments have described brain regions in many species that appear to be specialized for processing CVs. For example, several neural regions have been described in both mammals and birds wherein greater neural responses are elicited by CVs than by comparison stimuli such as heterospecific vocalizations, nonvocal complex sounds, and artificial stimuli. These observations raise the question of whether these regions reflect domain-specific neural mechanisms dedicated to processing CVs, or alternatively, if these regions reflect domain-general neural mechanisms for representing complex sounds of learned significance. Inasmuch as CVs can be viewed as complex combinations of basic spectrotemporal features, the plausibility of the latter position is supported by a large body of literature describing modulated cortical and subcortical representation of a variety of acoustic features that have been experimentally associated with stimuli of natural behavioral significance (such as food rewards). Herein, we review a relatively small body of existing literature describing the roles of experience, learning, and memory in the emergence of species-typical neural representations of CVs and auditory system plasticity. In both songbirds and mammals, manipulations of auditory experience as well as specific learning paradigms are shown to modulate neural responses evoked by CVs, either in terms of overall firing rate or temporal firing patterns. In some cases, CV-sensitive neural regions gradually acquire representation of non-CV stimuli with which subjects have training and experience. These results parallel literature in humans describing modulation of responses in face-sensitive neural regions through learning and experience. Thus, although many questions remain, the available evidence is consistent with the notion that CVs may acquire distinct neural representation through domain-general mechanisms for representing complex auditory objects that are of learned importance to the animal. This article is part of a Special Issue entitled "Communication Sounds and the Brain: New Directions and Perspectives".
Collapse
Affiliation(s)
- Amy Poremba
- University of Iowa, Dept. of Psychology, Div. Behavioral & Cognitive Neuroscience, E11 SSH, Iowa City, IA 52242, USA; University of Iowa, Neuroscience Program, Iowa City, IA 52242, USA.
| | | | | |
Collapse
|