1
|
Mallikarjun A, Shroads E, Newman RS. Perception of vocoded speech in domestic dogs. Anim Cogn 2024; 27:34. [PMID: 38625429 PMCID: PMC11021312 DOI: 10.1007/s10071-024-01869-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2023] [Revised: 03/21/2024] [Accepted: 03/24/2024] [Indexed: 04/17/2024]
Abstract
Humans have an impressive ability to comprehend signal-degraded speech; however, the extent to which comprehension of degraded speech relies on human-specific features of speech perception vs. more general cognitive processes is unknown. Since dogs live alongside humans and regularly hear speech, they can be used as a model to differentiate between these possibilities. One often-studied type of degraded speech is noise-vocoded speech (sometimes thought of as cochlear-implant-simulation speech). Noise-vocoded speech is made by dividing the speech signal into frequency bands (channels), identifying the amplitude envelope of each individual band, and then using these envelopes to modulate bands of noise centered over the same frequency regions - the result is a signal with preserved temporal cues, but vastly reduced frequency information. Here, we tested dogs' recognition of familiar words produced in 16-channel vocoded speech. In the first study, dogs heard their names and unfamiliar dogs' names (foils) in vocoded speech as well as natural speech. In the second study, dogs heard 16-channel vocoded speech only. Dogs listened longer to their vocoded name than vocoded foils in both experiments, showing that they can comprehend a 16-channel vocoded version of their name without prior exposure to vocoded speech, and without immediate exposure to the natural-speech version of their name. Dogs' name recognition in the second study was mediated by the number of phonemes in the dogs' name, suggesting that phonological context plays a role in degraded speech comprehension.
Collapse
Affiliation(s)
- Amritha Mallikarjun
- Penn Vet Working Dog Center, University of Pennsylvania School of Veterinary Medicine, Philadelphia, USA.
| | - Emily Shroads
- Department of Hearing and Speech Sciences, University of Maryland, College Park, USA
| | - Rochelle S Newman
- Department of Hearing and Speech Sciences, University of Maryland, College Park, USA
| |
Collapse
|
2
|
Coventry BS, Lawlor GL, Bagnati CB, Krogmeier C, Bartlett EL. Characterization and closed-loop control of infrared thalamocortical stimulation produces spatially constrained single-unit responses. PNAS NEXUS 2024; 3:pgae082. [PMID: 38725532 PMCID: PMC11079674 DOI: 10.1093/pnasnexus/pgae082] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/19/2023] [Accepted: 02/07/2024] [Indexed: 05/12/2024]
Abstract
Deep brain stimulation (DBS) is a powerful tool for the treatment of circuitopathy-related neurological and psychiatric diseases and disorders such as Parkinson's disease and obsessive-compulsive disorder, as well as a critical research tool for perturbing neural circuits and exploring neuroprostheses. Electrically mediated DBS, however, is limited by the spread of stimulus currents into tissue unrelated to disease course and treatment, potentially causing undesirable patient side effects. In this work, we utilize infrared neural stimulation (INS), an optical neuromodulation technique that uses near to midinfrared light to drive graded excitatory and inhibitory responses in nerves and neurons, to facilitate an optical and spatially constrained DBS paradigm. INS has been shown to provide spatially constrained responses in cortical neurons and, unlike other optical techniques, does not require genetic modification of the neural target. We show that INS produces graded, biophysically relevant single-unit responses with robust information transfer in rat thalamocortical circuits. Importantly, we show that cortical spread of activation from thalamic INS produces more spatially constrained response profiles than conventional electrical stimulation. Owing to observed spatial precision of INS, we used deep reinforcement learning (RL) for closed-loop control of thalamocortical circuits, creating real-time representations of stimulus-response dynamics while driving cortical neurons to precise firing patterns. Our data suggest that INS can serve as a targeted and dynamic stimulation paradigm for both open and closed-loop DBS.
Collapse
Affiliation(s)
- Brandon S Coventry
- Weldon School of Biomedical Engineering, Purdue University, West Lafayette, IN 47907, USA
- Center for Implantable Devices and the Institute for Integrative Neuroscience, Purdue University, West Lafayette, IN 47907, USA
| | - Georgia L Lawlor
- Weldon School of Biomedical Engineering, Purdue University, West Lafayette, IN 47907, USA
- Center for Implantable Devices and the Institute for Integrative Neuroscience, Purdue University, West Lafayette, IN 47907, USA
| | - Christina B Bagnati
- Weldon School of Biomedical Engineering, Purdue University, West Lafayette, IN 47907, USA
| | - Claudia Krogmeier
- Department of Computer Graphics Technology, Purdue University, West Lafayette, IN 47907, USA
| | - Edward L Bartlett
- Weldon School of Biomedical Engineering, Purdue University, West Lafayette, IN 47907, USA
- Center for Implantable Devices and the Institute for Integrative Neuroscience, Purdue University, West Lafayette, IN 47907, USA
- Department of Biological Sciences, Purdue University, West Lafayette, IN 47907, USA
| |
Collapse
|
3
|
Nourski KV, Steinschneider M, Rhone AE, Berger JI, Dappen ER, Kawasaki H, Howard III MA. Intracranial electrophysiology of spectrally degraded speech in the human cortex. Front Hum Neurosci 2024; 17:1334742. [PMID: 38318272 PMCID: PMC10839784 DOI: 10.3389/fnhum.2023.1334742] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2023] [Accepted: 12/28/2023] [Indexed: 02/07/2024] Open
Abstract
Introduction Cochlear implants (CIs) are the treatment of choice for severe to profound hearing loss. Variability in CI outcomes remains despite advances in technology and is attributed in part to differences in cortical processing. Studying these differences in CI users is technically challenging. Spectrally degraded stimuli presented to normal-hearing individuals approximate input to the central auditory system in CI users. This study used intracranial electroencephalography (iEEG) to investigate cortical processing of spectrally degraded speech. Methods Participants were adult neurosurgical epilepsy patients. Stimuli were utterances /aba/ and /ada/, spectrally degraded using a noise vocoder (1-4 bands) or presented without vocoding. The stimuli were presented in a two-alternative forced choice task. Cortical activity was recorded using depth and subdural iEEG electrodes. Electrode coverage included auditory core in posteromedial Heschl's gyrus (HGPM), superior temporal gyrus (STG), ventral and dorsal auditory-related areas, and prefrontal and sensorimotor cortex. Analysis focused on high gamma (70-150 Hz) power augmentation and alpha (8-14 Hz) suppression. Results Chance task performance occurred with 1-2 spectral bands and was near-ceiling for clear stimuli. Performance was variable with 3-4 bands, permitting identification of good and poor performers. There was no relationship between task performance and participants demographic, audiometric, neuropsychological, or clinical profiles. Several response patterns were identified based on magnitude and differences between stimulus conditions. HGPM responded strongly to all stimuli. A preference for clear speech emerged within non-core auditory cortex. Good performers typically had strong responses to all stimuli along the dorsal stream, including posterior STG, supramarginal, and precentral gyrus; a minority of sites in STG and supramarginal gyrus had a preference for vocoded stimuli. In poor performers, responses were typically restricted to clear speech. Alpha suppression was more pronounced in good performers. In contrast, poor performers exhibited a greater involvement of posterior middle temporal gyrus when listening to clear speech. Discussion Responses to noise-vocoded speech provide insights into potential factors underlying CI outcome variability. The results emphasize differences in the balance of neural processing along the dorsal and ventral stream between good and poor performers, identify specific cortical regions that may have diagnostic and prognostic utility, and suggest potential targets for neuromodulation-based CI rehabilitation strategies.
Collapse
Affiliation(s)
- Kirill V. Nourski
- Department of Neurosurgery, The University of Iowa, Iowa City, IA, United States
- Iowa Neuroscience Institute, The University of Iowa, Iowa City, IA, United States
| | - Mitchell Steinschneider
- Department of Neurosurgery, The University of Iowa, Iowa City, IA, United States
- Departments of Neurology and Neuroscience, Albert Einstein College of Medicine, Bronx, NY, United States
| | - Ariane E. Rhone
- Department of Neurosurgery, The University of Iowa, Iowa City, IA, United States
| | - Joel I. Berger
- Department of Neurosurgery, The University of Iowa, Iowa City, IA, United States
| | - Emily R. Dappen
- Department of Neurosurgery, The University of Iowa, Iowa City, IA, United States
- Iowa Neuroscience Institute, The University of Iowa, Iowa City, IA, United States
| | - Hiroto Kawasaki
- Department of Neurosurgery, The University of Iowa, Iowa City, IA, United States
| | - Matthew A. Howard III
- Department of Neurosurgery, The University of Iowa, Iowa City, IA, United States
- Iowa Neuroscience Institute, The University of Iowa, Iowa City, IA, United States
- Pappajohn Biomedical Institute, The University of Iowa, Iowa City, IA, United States
| |
Collapse
|
4
|
Tamaoki Y, Pasapula V, Chandler C, Borland MS, Olajubutu OI, Tharakan LS, Engineer CT. Degraded inferior colliculus responses to complex sounds in prenatally exposed VPA rats. J Neurodev Disord 2024; 16:2. [PMID: 38166599 PMCID: PMC10759431 DOI: 10.1186/s11689-023-09514-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/13/2023] [Accepted: 12/07/2023] [Indexed: 01/05/2024] Open
Abstract
BACKGROUND Individuals with autism spectrum disorders (ASD) often exhibit altered sensory processing and deficits in language development. Prenatal exposure to valproic acid (VPA) increases the risk for ASD and impairs both receptive and expressive language. Like individuals with ASD, rodents prenatally exposed to VPA exhibit degraded auditory cortical processing and abnormal neural activity to sounds. Disrupted neuronal morphology has been documented in earlier processing areas of the auditory pathway in VPA-exposed rodents, but there are no studies documenting early auditory pathway physiology. Therefore, the objective of this study is to characterize inferior colliculus (IC) responses to different sounds in rats prenatally exposed to VPA compared to saline-exposed rats. METHODS In vivo extracellular multiunit recordings from the inferior colliculus were collected in response to tones, speech sounds, and noise burst trains. RESULTS Our results indicate that the overall response to speech sounds was degraded in VPA-exposed rats compared to saline-exposed controls, but responses to tones and noise burst trains were unaltered. CONCLUSIONS These results are consistent with observations in individuals with autism that neural responses to complex sounds, like speech, are often altered, and lays the foundation for future studies of potential therapeutics to improve auditory processing in the VPA rat model of ASD.
Collapse
Affiliation(s)
- Yuko Tamaoki
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, 800 West Campbell Road BSB11, Richardson, TX, 75080, USA.
- The University of Texas at Dallas, Texas Biomedical Device Center, 800 West Campbell Road BSB11, Richardson, TX, 75080, USA.
| | - Varun Pasapula
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, 800 West Campbell Road BSB11, Richardson, TX, 75080, USA
- The University of Texas at Dallas, Texas Biomedical Device Center, 800 West Campbell Road BSB11, Richardson, TX, 75080, USA
| | - Collin Chandler
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, 800 West Campbell Road BSB11, Richardson, TX, 75080, USA
- The University of Texas at Dallas, Texas Biomedical Device Center, 800 West Campbell Road BSB11, Richardson, TX, 75080, USA
| | - Michael S Borland
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, 800 West Campbell Road BSB11, Richardson, TX, 75080, USA
- The University of Texas at Dallas, Texas Biomedical Device Center, 800 West Campbell Road BSB11, Richardson, TX, 75080, USA
| | - Olayinka I Olajubutu
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, 800 West Campbell Road BSB11, Richardson, TX, 75080, USA
- The University of Texas at Dallas, Texas Biomedical Device Center, 800 West Campbell Road BSB11, Richardson, TX, 75080, USA
| | - Liza S Tharakan
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, 800 West Campbell Road BSB11, Richardson, TX, 75080, USA
- The University of Texas at Dallas, Texas Biomedical Device Center, 800 West Campbell Road BSB11, Richardson, TX, 75080, USA
| | - Crystal T Engineer
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, 800 West Campbell Road BSB11, Richardson, TX, 75080, USA
- The University of Texas at Dallas, Texas Biomedical Device Center, 800 West Campbell Road BSB11, Richardson, TX, 75080, USA
| |
Collapse
|
5
|
Coventry BS, Lawlor GL, Bagnati CB, Krogmeier C, Bartlett EL. Spatially specific, closed-loop infrared thalamocortical deep brain stimulation. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.10.04.560859. [PMID: 37904955 PMCID: PMC10614743 DOI: 10.1101/2023.10.04.560859] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/01/2023]
Abstract
Deep brain stimulation (DBS) is a powerful tool for the treatment of circuitopathy-related neurological and psychiatric diseases and disorders such as Parkinson's disease and obsessive-compulsive disorder, as well as a critical research tool for perturbing neural circuits and exploring neuroprostheses. Electrically-mediated DBS, however, is limited by the spread of stimulus currents into tissue unrelated to disease course and treatment, potentially causing undesirable patient side effects. In this work, we utilize infrared neural stimulation (INS), an optical neuromodulation technique that uses near to mid-infrared light to drive graded excitatory and inhibitory responses in nerves and neurons, to facilitate an optical and spatially constrained DBS paradigm. INS has been shown to provide spatially constrained responses in cortical neurons and, unlike other optical techniques, does not require genetic modification of the neural target. We show that INS produces graded, biophysically relevant single-unit responses with robust information transfer in thalamocortical circuits. Importantly, we show that cortical spread of activation from thalamic INS produces more spatially constrained response profiles than conventional electrical stimulation. Owing to observed spatial precision of INS, we used deep reinforcement learning for closed-loop control of thalamocortical circuits, creating real-time representations of stimulus-response dynamics while driving cortical neurons to precise firing patterns. Our data suggest that INS can serve as a targeted and dynamic stimulation paradigm for both open and closed-loop DBS.
Collapse
Affiliation(s)
- Brandon S Coventry
- Weldon School of Biomedical Engineering, Purdue University, West Lafayette, IN USA
- Center for Implantable Devices and the Institute for Integrative Neuroscience, Purdue University, West Lafayette, IN USA
| | - Georgia L Lawlor
- Weldon School of Biomedical Engineering, Purdue University, West Lafayette, IN USA
- Center for Implantable Devices and the Institute for Integrative Neuroscience, Purdue University, West Lafayette, IN USA
| | - Christina B Bagnati
- Weldon School of Biomedical Engineering, Purdue University, West Lafayette, IN USA
| | - Claudia Krogmeier
- Department of Computer Graphics Technology, Purdue University, West Lafayette, IN USA
| | - Edward L Bartlett
- Weldon School of Biomedical Engineering, Purdue University, West Lafayette, IN USA
- Center for Implantable Devices and the Institute for Integrative Neuroscience, Purdue University, West Lafayette, IN USA
- Department of Biological Sciences, Purdue University, West Lafayette, IN USA
| |
Collapse
|
6
|
Heard M, Li X, Lee YS. Hybrid auditory fMRI: In pursuit of increasing data acquisition while decreasing the impact of scanner noise. J Neurosci Methods 2021; 358:109198. [PMID: 33901568 DOI: 10.1016/j.jneumeth.2021.109198] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2020] [Revised: 03/28/2021] [Accepted: 04/16/2021] [Indexed: 11/17/2022]
Abstract
BACKGROUND Two challenges in auditory fMRI include the loud scanner noise during sound presentation and slow data acquisition. Here, we introduce a new auditory imaging protocol, termed "hybrid", that alleviates these obstacles. NEW METHOD We designed a within-subject experiment (N = 14) wherein language-driven activity was measured by hybrid, interleaved silent (ISSS), and continuous multiband acquisition. To determine the advantage of noise attenuation during sound presentation, hybrid was compared to multiband. To identify the benefits of increased temporal resolution, hybrid was compared to ISSS. Data were evaluated by whole-brain univariate general linear modeling (GLM) and multivariate pattern analysis (MVPA). RESULTS Comparison with existing methods: CONCLUSIONS: Our data revealed that hybrid imaging restored neural activity in the canonical language network that was absent due to the loud noise or slow sampling in the conventional imaging protocols. With its noise-attenuated sound presentation windows and increased acquisition speed, the hybrid protocol is well-suited for auditory fMRI research tracking neural activity pertaining to fast, time-varying acoustic events.
Collapse
Affiliation(s)
- Matthew Heard
- School of Behavioral and Brain Sciences, University of Texas at Dallas, United States
| | - Xiangrui Li
- Center for Cognitive and Behavioral Brain Imaging, The Ohio State University, United States
| | - Yune S Lee
- School of Behavioral and Brain Sciences, University of Texas at Dallas, United States; Center for BrainHealth, University of Texas at Dallas, United States.
| |
Collapse
|
7
|
Borland MS, Vrana WA, Moreno NA, Fogarty EA, Buell EP, Vanneste S, Kilgard MP, Engineer CT. Pairing vagus nerve stimulation with tones drives plasticity across the auditory pathway. J Neurophysiol 2019; 122:659-671. [PMID: 31215351 DOI: 10.1152/jn.00832.2018] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023] Open
Abstract
Previous studies have demonstrated that pairing vagus nerve stimulation (VNS) with sounds can enhance the primary auditory cortex (A1) response to the paired sound. The neural response to sounds following VNS-sound pairing in other subcortical and cortical auditory fields has not been documented. We predicted that VNS-tone pairing would increase neural responses to the paired tone frequency across the auditory pathway. In this study, we paired VNS with the presentation of a 9-kHz tone 300 times a day for 20 days. We recorded neural responses to tones from 2,950 sites in the inferior colliculus (IC), A1, anterior auditory field (AAF), and posterior auditory field (PAF) 24 h after the last pairing session in anesthetized rats. We found that VNS-tone pairing increased the percentage of IC, A1, AAF, and PAF that responds to the paired tone frequency. Across all tested auditory fields, the response strength to tones was strengthened in VNS-tone paired rats compared with control rats. VNS-tone pairing reduced spontaneous activity, frequency selectivity, and response threshold across the auditory pathway. This is the first study to document both cortical and subcortical plasticity following VNS-sound pairing. Our findings suggest that VNS paired with sound presentation is an effective method to enhance auditory processing.NEW & NOTEWORTHY Previous studies have reported primary auditory cortex plasticity following vagus nerve stimulation (VNS) paired with a sound. This study extends previous findings by documenting that fields across the auditory pathway are altered by VNS-tone pairing. VNS-tone pairing increases the percentage of each field that responds to the paired tone frequency. This is the first study to document both cortical and subcortical plasticity following VNS-sound pairing.
Collapse
Affiliation(s)
- Michael S Borland
- The University of Texas at Dallas, Texas Biomedical Device Center, Richardson, Texas.,The University of Texas at Dallas, School of Behavioral and Brain Sciences, Richardson, Texas
| | - Will A Vrana
- The University of Texas at Dallas, School of Behavioral and Brain Sciences, Richardson, Texas
| | - Nicole A Moreno
- The University of Texas at Dallas, Texas Biomedical Device Center, Richardson, Texas.,The University of Texas at Dallas, School of Behavioral and Brain Sciences, Richardson, Texas
| | - Elizabeth A Fogarty
- The University of Texas at Dallas, School of Behavioral and Brain Sciences, Richardson, Texas
| | - Elizabeth P Buell
- The University of Texas at Dallas, Texas Biomedical Device Center, Richardson, Texas.,The University of Texas at Dallas, School of Behavioral and Brain Sciences, Richardson, Texas
| | - Sven Vanneste
- The University of Texas at Dallas, Texas Biomedical Device Center, Richardson, Texas.,The University of Texas at Dallas, School of Behavioral and Brain Sciences, Richardson, Texas
| | - Michael P Kilgard
- The University of Texas at Dallas, Texas Biomedical Device Center, Richardson, Texas.,The University of Texas at Dallas, School of Behavioral and Brain Sciences, Richardson, Texas
| | - Crystal T Engineer
- The University of Texas at Dallas, Texas Biomedical Device Center, Richardson, Texas.,The University of Texas at Dallas, School of Behavioral and Brain Sciences, Richardson, Texas
| |
Collapse
|
8
|
Saunders JL, Wehr M. Mice can learn phonetic categories. THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2019; 145:1168. [PMID: 31067917 PMCID: PMC6910010 DOI: 10.1121/1.5091776] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/04/2018] [Revised: 01/26/2019] [Accepted: 02/04/2019] [Indexed: 06/09/2023]
Abstract
Speech is perceived as a series of relatively invariant phonemes despite extreme variability in the acoustic signal. To be perceived as nearly-identical phonemes, speech sounds that vary continuously over a range of acoustic parameters must be perceptually discretized by the auditory system. Such many-to-one mappings of undifferentiated sensory information to a finite number of discrete categories are ubiquitous in perception. Although many mechanistic models of phonetic perception have been proposed, they remain largely unconstrained by neurobiological data. Current human neurophysiological methods lack the necessary spatiotemporal resolution to provide it: speech is too fast, and the neural circuitry involved is too small. This study demonstrates that mice are capable of learning generalizable phonetic categories, and can thus serve as a model for phonetic perception. Mice learned to discriminate consonants and generalized consonant identity across novel vowel contexts and speakers, consistent with true category learning. A mouse model, given the powerful genetic and electrophysiological tools for probing neural circuits available for them, has the potential to powerfully augment a mechanistic understanding of phonetic perception.
Collapse
Affiliation(s)
- Jonny L Saunders
- University of Oregon, Institute of Neuroscience and Department of Psychology, Eugene, Oregon 97403, USA
| | - Michael Wehr
- University of Oregon, Institute of Neuroscience and Department of Psychology, Eugene, Oregon 97403, USA
| |
Collapse
|
9
|
Peng F, Innes-Brown H, McKay CM, Fallon JB, Zhou Y, Wang X, Hu N, Hou W. Temporal Coding of Voice Pitch Contours in Mandarin Tones. Front Neural Circuits 2018; 12:55. [PMID: 30087597 PMCID: PMC6066958 DOI: 10.3389/fncir.2018.00055] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2017] [Accepted: 06/27/2018] [Indexed: 11/13/2022] Open
Abstract
Accurate perception of time-variant pitch is important for speech recognition, particularly for tonal languages with different lexical tones such as Mandarin, in which different tones convey different semantic information. Previous studies reported that the auditory nerve and cochlear nucleus can encode different pitches through phase-locked neural activities. However, little is known about how the inferior colliculus (IC) encodes the time-variant periodicity pitch of natural speech. In this study, the Mandarin syllable /ba/ pronounced with four lexical tones (flat, rising, falling then rising and falling) were used as stimuli. Local field potentials (LFPs) and single neuron activity were simultaneously recorded from 90 sites within contralateral IC of six urethane-anesthetized and decerebrate guinea pigs in response to the four stimuli. Analysis of the temporal information of LFPs showed that 93% of the LFPs exhibited robust encoding of periodicity pitch. Pitch strength of LFPs derived from the autocorrelogram was significantly (p < 0.001) stronger for rising tones than flat and falling tones. Pitch strength are also significantly increased (p < 0.05) with the characteristic frequency (CF). On the other hand, only 47% (42 or 90) of single neuron activities were significantly synchronized to the fundamental frequency of the stimulus suggesting that the temporal spiking pattern of single IC neuron could encode the time variant periodicity pitch of speech robustly. The difference between the number of LFPs and single neurons that encode the time-variant F0 voice pitch supports the notion of a transition at the level of IC from direct temporal coding in the spike trains of individual neurons to other form of neural representation.
Collapse
Affiliation(s)
- Fei Peng
- Key Laboratory of Biorheological Science and Technology of Ministry of Education, Bioengineering College of Chongqing University, Chongqing, China
- Collaborative Innovation Center for Brain Science, Chongqing University, Chongqing, China
| | - Hamish Innes-Brown
- Bionics Institute, East Melbourne, VIC, Australia
- Department of Medical Bionics Department, University of Melbourne, Melbourne, VIC, Australia
| | - Colette M. McKay
- Bionics Institute, East Melbourne, VIC, Australia
- Department of Medical Bionics Department, University of Melbourne, Melbourne, VIC, Australia
| | - James B. Fallon
- Bionics Institute, East Melbourne, VIC, Australia
- Department of Medical Bionics Department, University of Melbourne, Melbourne, VIC, Australia
- Department of Otolaryngology, University of Melbourne, Melbourne, VIC, Australia
| | - Yi Zhou
- Chongqing Key Laboratory of Neurobiology, Department of Neurobiology, Third Military Medical University, Chongqing, China
| | - Xing Wang
- Key Laboratory of Biorheological Science and Technology of Ministry of Education, Bioengineering College of Chongqing University, Chongqing, China
- Chongqing Medical Electronics Engineering Technology Research Center, Chongqing University, Chongqing, China
| | - Ning Hu
- Key Laboratory of Biorheological Science and Technology of Ministry of Education, Bioengineering College of Chongqing University, Chongqing, China
- Collaborative Innovation Center for Brain Science, Chongqing University, Chongqing, China
| | - Wensheng Hou
- Key Laboratory of Biorheological Science and Technology of Ministry of Education, Bioengineering College of Chongqing University, Chongqing, China
- Collaborative Innovation Center for Brain Science, Chongqing University, Chongqing, China
- Chongqing Medical Electronics Engineering Technology Research Center, Chongqing University, Chongqing, China
| |
Collapse
|
10
|
White-Schwoch T, Nicol T, Warrier CM, Abrams DA, Kraus N. Individual Differences in Human Auditory Processing: Insights From Single-Trial Auditory Midbrain Activity in an Animal Model. Cereb Cortex 2018; 27:5095-5115. [PMID: 28334187 DOI: 10.1093/cercor/bhw293] [Citation(s) in RCA: 30] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2016] [Accepted: 08/29/2016] [Indexed: 11/13/2022] Open
Abstract
Auditory-evoked potentials are classically defined as the summations of synchronous firing along the auditory neuraxis. Converging evidence supports a model whereby timing jitter in neural coding compromises listening and causes variable scalp-recorded potentials. Yet the intrinsic noise of human scalp recordings precludes a full understanding of the biological origins of individual differences in listening skills. To delineate the mechanisms contributing to these phenomena, in vivo extracellular activity was recorded from inferior colliculus in guinea pigs to speech in quiet and noise. Here we show that trial-by-trial timing jitter is a mechanism contributing to auditory response variability. Identical variability patterns were observed in scalp recordings in human children, implicating jittered timing as a factor underlying reduced coding of dynamic speech features and speech in noise. Moreover, intertrial variability in human listeners is tied to language development. Together, these findings suggest that variable timing in inferior colliculus blurs the neural coding of speech in noise, and propose a consequence of this timing jitter for human behavior. These results hint both at the mechanisms underlying speech processing in general, and at what may go awry in individuals with listening difficulties.
Collapse
Affiliation(s)
- Travis White-Schwoch
- Auditory Neuroscience Laboratory (www.brainvolts.northwestern.edu) & Department of Communication Sciences, Northwestern University, Evanston, IL, 60208, USA
| | - Trent Nicol
- Auditory Neuroscience Laboratory (www.brainvolts.northwestern.edu) & Department of Communication Sciences, Northwestern University, Evanston, IL, 60208, USA
| | - Catherine M Warrier
- Auditory Neuroscience Laboratory (www.brainvolts.northwestern.edu) & Department of Communication Sciences, Northwestern University, Evanston, IL, 60208, USA
| | - Daniel A Abrams
- Auditory Neuroscience Laboratory (www.brainvolts.northwestern.edu) & Department of Communication Sciences, Northwestern University, Evanston, IL, 60208, USA.,Stanford Cognitive & Systems Neuroscience Laboratory, Stanford University, Palo Alto, CA, 94304, USA
| | - Nina Kraus
- Auditory Neuroscience Laboratory (www.brainvolts.northwestern.edu) & Department of Communication Sciences, Northwestern University, Evanston, IL, 60208, USA.,Department of Neurobiology & Physiology, Northwestern University, Evanston, IL, 60208, USA.,Department of Otolaryngology, Northwestern University, Chicago, IL, 60611, USA
| |
Collapse
|
11
|
Zheng XL, Fan XY, Hou WS. Neural representation of different mandarin tones in the inferior colliculus of the guinea pig. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2017; 2016:1608-1611. [PMID: 28268636 DOI: 10.1109/embc.2016.7591020] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Mandarin speech has four different tones and the coding mechanism underlying tone identification still remain unclear. Here in the inferior colliculus (IC) of anesthetized guinea pigs, we recorded single neuron activities to one word with four tones using tungsten electrode. Peri-stimulus time histograms (PSTHs) and inter-spike-interval (ISI) were used to evaluate the neural response. The results showed that PSTHs grouped into frequency band reflected the spectrotemporal patterns of different tones; average population PSTHs matched envelops of different tones; and the peaks of histogram of ISIs in three time segments exhibited a displacement which reflected the profile of fundamental frequency (F0). These preliminary results suggested IC neurons could encode the spectrotemporal acoustic features of different Mandarin tones.
Collapse
|
12
|
Engineer CT, Rahebi KC, Buell EP, Fink MK, Kilgard MP. Speech training alters consonant and vowel responses in multiple auditory cortex fields. Behav Brain Res 2015; 287:256-64. [PMID: 25827927 DOI: 10.1016/j.bbr.2015.03.044] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2014] [Revised: 03/19/2015] [Accepted: 03/22/2015] [Indexed: 10/23/2022]
Abstract
Speech sounds evoke unique neural activity patterns in primary auditory cortex (A1). Extensive speech sound discrimination training alters A1 responses. While the neighboring auditory cortical fields each contain information about speech sound identity, each field processes speech sounds differently. We hypothesized that while all fields would exhibit training-induced plasticity following speech training, there would be unique differences in how each field changes. In this study, rats were trained to discriminate speech sounds by consonant or vowel in quiet and in varying levels of background speech-shaped noise. Local field potential and multiunit responses were recorded from four auditory cortex fields in rats that had received 10 weeks of speech discrimination training. Our results reveal that training alters speech evoked responses in each of the auditory fields tested. The neural response to consonants was significantly stronger in anterior auditory field (AAF) and A1 following speech training. The neural response to vowels following speech training was significantly weaker in ventral auditory field (VAF) and posterior auditory field (PAF). This differential plasticity of consonant and vowel sound responses may result from the greater paired pulse depression, expanded low frequency tuning, reduced frequency selectivity, and lower tone thresholds, which occurred across the four auditory fields. These findings suggest that alterations in the distributed processing of behaviorally relevant sounds may contribute to robust speech discrimination.
Collapse
Affiliation(s)
- Crystal T Engineer
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, 800 West Campbell Road, GR41, Richardson, TX 75080, United States.
| | - Kimiya C Rahebi
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, 800 West Campbell Road, GR41, Richardson, TX 75080, United States
| | - Elizabeth P Buell
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, 800 West Campbell Road, GR41, Richardson, TX 75080, United States
| | - Melyssa K Fink
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, 800 West Campbell Road, GR41, Richardson, TX 75080, United States
| | - Michael P Kilgard
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, 800 West Campbell Road, GR41, Richardson, TX 75080, United States
| |
Collapse
|
13
|
Degraded speech sound processing in a rat model of fragile X syndrome. Brain Res 2014; 1564:72-84. [PMID: 24713347 DOI: 10.1016/j.brainres.2014.03.049] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2014] [Revised: 03/29/2014] [Accepted: 03/31/2014] [Indexed: 12/29/2022]
Abstract
Fragile X syndrome is the most common inherited form of intellectual disability and the leading genetic cause of autism. Impaired phonological processing in fragile X syndrome interferes with the development of language skills. Although auditory cortex responses are known to be abnormal in fragile X syndrome, it is not clear how these differences impact speech sound processing. This study provides the first evidence that the cortical representation of speech sounds is impaired in Fmr1 knockout rats, despite normal speech discrimination behavior. Evoked potentials and spiking activity in response to speech sounds, noise burst trains, and tones were significantly degraded in primary auditory cortex, anterior auditory field and the ventral auditory field. Neurometric analysis of speech evoked activity using a pattern classifier confirmed that activity in these fields contains significantly less information about speech sound identity in Fmr1 knockout rats compared to control rats. Responses were normal in the posterior auditory field, which is associated with sound localization. The greatest impairment was observed in the ventral auditory field, which is related to emotional regulation. Dysfunction in the ventral auditory field may contribute to poor emotional regulation in fragile X syndrome and may help explain the observation that later auditory evoked responses are more disturbed in fragile X syndrome compared to earlier responses. Rodent models of fragile X syndrome are likely to prove useful for understanding the biological basis of fragile X syndrome and for testing candidate therapies.
Collapse
|
14
|
Engineer CT, Perez CA, Carraway RS, Chang KQ, Roland JL, Sloan AM, Kilgard MP. Similarity of cortical activity patterns predicts generalization behavior. PLoS One 2013; 8:e78607. [PMID: 24147140 PMCID: PMC3797841 DOI: 10.1371/journal.pone.0078607] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2013] [Accepted: 09/20/2013] [Indexed: 11/23/2022] Open
Abstract
Humans and animals readily generalize previously learned knowledge to new situations. Determining similarity is critical for assigning category membership to a novel stimulus. We tested the hypothesis that category membership is initially encoded by the similarity of the activity pattern evoked by a novel stimulus to the patterns from known categories. We provide behavioral and neurophysiological evidence that activity patterns in primary auditory cortex contain sufficient information to explain behavioral categorization of novel speech sounds by rats. Our results suggest that category membership might be encoded by the similarity of the activity pattern evoked by a novel speech sound to the patterns evoked by known sounds. Categorization based on featureless pattern matching may represent a general neural mechanism for ensuring accurate generalization across sensory and cognitive systems.
Collapse
Affiliation(s)
- Crystal T. Engineer
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, Richardson, Texas, United States of America
- * E-mail:
| | - Claudia A. Perez
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, Richardson, Texas, United States of America
| | - Ryan S. Carraway
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, Richardson, Texas, United States of America
| | - Kevin Q. Chang
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, Richardson, Texas, United States of America
| | - Jarod L. Roland
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, Richardson, Texas, United States of America
| | - Andrew M. Sloan
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, Richardson, Texas, United States of America
| | - Michael P. Kilgard
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, Richardson, Texas, United States of America
| |
Collapse
|