1
|
Saddler MR, McDermott JH. Models optimized for real-world tasks reveal the task-dependent necessity of precise temporal coding in hearing. Nat Commun 2024; 15:10590. [PMID: 39632854 PMCID: PMC11618365 DOI: 10.1038/s41467-024-54700-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2024] [Accepted: 11/18/2024] [Indexed: 12/07/2024] Open
Abstract
Neurons encode information in the timing of their spikes in addition to their firing rates. Spike timing is particularly precise in the auditory nerve, where action potentials phase lock to sound with sub-millisecond precision, but its behavioral relevance remains uncertain. We optimized machine learning models to perform real-world hearing tasks with simulated cochlear input, assessing the precision of auditory nerve spike timing needed to reproduce human behavior. Models with high-fidelity phase locking exhibited more human-like sound localization and speech perception than models without, consistent with an essential role in human hearing. However, the temporal precision needed to reproduce human-like behavior varied across tasks, as did the precision that benefited real-world task performance. These effects suggest that perceptual domains incorporate phase locking to different extents depending on the demands of real-world hearing. The results illustrate how optimizing models for realistic tasks can clarify the role of candidate neural codes in perception.
Collapse
Affiliation(s)
- Mark R Saddler
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA, USA.
- McGovern Institute for Brain Research, MIT, Cambridge, MA, USA.
- Center for Brains, Minds, and Machines, MIT, Cambridge, MA, USA.
| | - Josh H McDermott
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA, USA.
- McGovern Institute for Brain Research, MIT, Cambridge, MA, USA.
- Center for Brains, Minds, and Machines, MIT, Cambridge, MA, USA.
- Program in Speech and Hearing Biosciences and Technology, Harvard, Cambridge, MA, USA.
| |
Collapse
|
2
|
Saddler MR, McDermott JH. Models optimized for real-world tasks reveal the task-dependent necessity of precise temporal coding in hearing. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.04.21.590435. [PMID: 38712054 PMCID: PMC11071365 DOI: 10.1101/2024.04.21.590435] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/08/2024]
Abstract
Neurons encode information in the timing of their spikes in addition to their firing rates. Spike timing is particularly precise in the auditory nerve, where action potentials phase lock to sound with sub-millisecond precision, but its behavioral relevance remains uncertain. We optimized machine learning models to perform real-world hearing tasks with simulated cochlear input, assessing the precision of auditory nerve spike timing needed to reproduce human behavior. Models with high-fidelity phase locking exhibited more human-like sound localization and speech perception than models without, consistent with an essential role in human hearing. However, the temporal precision needed to reproduce human-like behavior varied across tasks, as did the precision that benefited real-world task performance. These effects suggest that perceptual domains incorporate phase locking to different extents depending on the demands of real-world hearing. The results illustrate how optimizing models for realistic tasks can clarify the role of candidate neural codes in perception.
Collapse
Affiliation(s)
- Mark R Saddler
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA, USA
- McGovern Institute for Brain Research, MIT, Cambridge, MA, USA
- Center for Brains, Minds, and Machines, MIT, Cambridge, MA, USA
| | - Josh H McDermott
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA, USA
- McGovern Institute for Brain Research, MIT, Cambridge, MA, USA
- Center for Brains, Minds, and Machines, MIT, Cambridge, MA, USA
- Program in Speech and Hearing Biosciences and Technology, Harvard, Cambridge, MA, USA
| |
Collapse
|
3
|
de Nobel J, Martens SSM, Briaire JJ, Bäck THW, Kononova AV, Frijns JHM. Biophysics-inspired spike rate adaptation for computationally efficient phenomenological nerve modeling. Hear Res 2024; 447:109011. [PMID: 38692015 DOI: 10.1016/j.heares.2024.109011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/10/2023] [Revised: 04/11/2024] [Accepted: 04/18/2024] [Indexed: 05/03/2024]
Abstract
This study introduces and evaluates the PHAST+ model, part of a computational framework designed to simulate the behavior of auditory nerve fibers in response to the electrical stimulation from a cochlear implant. PHAST+ incorporates a highly efficient method for calculating accommodation and adaptation, making it particularly suited for simulations over extended stimulus durations. The proposed method uses a leaky integrator inspired by classic biophysical nerve models. Through evaluation against single-fiber animal data, our findings demonstrate the model's effectiveness across various stimuli, including short pulse trains with variable amplitudes and rates. Notably, the PHAST+ model performs better than its predecessor, PHAST (a phenomenological model by van Gendt et al.), particularly in simulations of prolonged neural responses. While PHAST+ is optimized primarily on spike rate decay, it shows good behavior on several other neural measures, such as vector strength and degree of adaptation. The future implications of this research are promising. PHAST+ drastically reduces the computational burden to allow the real-time simulation of neural behavior over extended periods, opening the door to future simulations of psychophysical experiments and multi-electrode stimuli for evaluating novel speech-coding strategies for cochlear implants.
Collapse
Affiliation(s)
- Jacob de Nobel
- Leiden Institute of Advanced Computer Science, Niels Bohrweg 1, Leiden, Netherlands
| | - Savine S M Martens
- Department of Otorhinolaryngology, Leiden University Medical Center, Albinusdreef 2, Leiden, Netherlands
| | - Jeroen J Briaire
- Department of Otorhinolaryngology, Leiden University Medical Center, Albinusdreef 2, Leiden, Netherlands
| | - Thomas H W Bäck
- Leiden Institute of Advanced Computer Science, Niels Bohrweg 1, Leiden, Netherlands
| | - Anna V Kononova
- Leiden Institute of Advanced Computer Science, Niels Bohrweg 1, Leiden, Netherlands
| | - Johan H M Frijns
- Department of Otorhinolaryngology, Leiden University Medical Center, Albinusdreef 2, Leiden, Netherlands; Leiden Institute for Brain and Cognition, Wassenaarseweg 52, Leiden, Netherlands.
| |
Collapse
|
4
|
Hrncirik F, Roberts I, Sevgili I, Swords C, Bance M. Models of Cochlea Used in Cochlear Implant Research: A Review. Ann Biomed Eng 2023; 51:1390-1407. [PMID: 37087541 PMCID: PMC10264527 DOI: 10.1007/s10439-023-03192-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Accepted: 03/20/2023] [Indexed: 04/24/2023]
Abstract
As the first clinically translated machine-neural interface, cochlear implants (CI) have demonstrated much success in providing hearing to those with severe to profound hearing loss. Despite their clinical effectiveness, key drawbacks such as hearing damage, partly from insertion forces that arise during implantation, and current spread, which limits focussing ability, prevent wider CI eligibility. In this review, we provide an overview of the anatomical and physical properties of the cochlea as a resource to aid the development of accurate models to improve future CI treatments. We highlight the advancements in the development of various physical, animal, tissue engineering, and computational models of the cochlea and the need for such models, challenges in their use, and a perspective on their future directions.
Collapse
Affiliation(s)
- Filip Hrncirik
- Cambridge Hearing Group, Cambridge, UK.
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, CB2 0QQ, UK.
| | - Iwan Roberts
- Cambridge Hearing Group, Cambridge, UK
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, CB2 0QQ, UK
| | - Ilkem Sevgili
- Cambridge Hearing Group, Cambridge, UK
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, CB2 0QQ, UK
| | - Chloe Swords
- Cambridge Hearing Group, Cambridge, UK
- Department of Physiology, Development and Neurosciences, University of Cambridge, Cambridge, CB2 3DY, UK
| | - Manohar Bance
- Cambridge Hearing Group, Cambridge, UK
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, CB2 0QQ, UK
| |
Collapse
|
5
|
Leclère T, Johannesen PT, Wijetillake A, Segovia-Martínez M, Lopez-Poveda EA. A computational modelling framework for assessing information transmission with cochlear implants. Hear Res 2023; 432:108744. [PMID: 37004271 DOI: 10.1016/j.heares.2023.108744] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/17/2022] [Revised: 03/05/2023] [Accepted: 03/24/2023] [Indexed: 03/28/2023]
Abstract
Computational models are useful tools to investigate scientific questions that would be complicated to address using an experimental approach. In the context of cochlear-implants (CIs), being able to simulate the neural activity evoked by these devices could help in understanding their limitations to provide natural hearing. Here, we present a computational modelling framework to quantify the transmission of information from sound to spikes in the auditory nerve of a CI user. The framework includes a model to simulate the electrical current waveform sensed by each auditory nerve fiber (electrode-neuron interface), followed by a model to simulate the timing at which a nerve fiber spikes in response to a current waveform (auditory nerve fiber model). Information theory is then applied to determine the amount of information transmitted from a suitable reference signal (e.g., the acoustic stimulus) to a simulated population of auditory nerve fibers. As a use case example, the framework is applied to simulate published data on modulation detection by CI users obtained using direct stimulation via a single electrode. Current spread as well as the number of fibers were varied independently to illustrate the framework capabilities. Simulations reasonably matched experimental data and suggested that the encoded modulation information is proportional to the total neural response. They also suggested that amplitude modulation is well encoded in the auditory nerve for modulation rates up to 1000 Hz and that the variability in modulation sensitivity across CI users is partly because different CI users use different references for detecting modulation.
Collapse
Affiliation(s)
- Thibaud Leclère
- Instituto de Neurociencias de Castilla y León, Universidad de Salamanca, Salamanca 37007, Spain; Instituto de Investigación Biomédica de Salamanca, Universidad de Salamanca, Salamanca 37007, Spain
| | - Peter T Johannesen
- Instituto de Neurociencias de Castilla y León, Universidad de Salamanca, Salamanca 37007, Spain; Instituto de Investigación Biomédica de Salamanca, Universidad de Salamanca, Salamanca 37007, Spain
| | | | | | - Enrique A Lopez-Poveda
- Instituto de Neurociencias de Castilla y León, Universidad de Salamanca, Salamanca 37007, Spain; Instituto de Investigación Biomédica de Salamanca, Universidad de Salamanca, Salamanca 37007, Spain; Departamento de Cirugía, Facultad de Medicina, Universidad de Salamanca, Salamanca 37007, Spain.
| |
Collapse
|
6
|
Takanen M, Seeber BU. A Phenomenological Model Reproducing Temporal Response Characteristics of an Electrically Stimulated Auditory Nerve Fiber. Trends Hear 2022; 26:23312165221117079. [PMID: 36071660 PMCID: PMC9459496 DOI: 10.1177/23312165221117079] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2021] [Revised: 06/30/2022] [Accepted: 07/15/2022] [Indexed: 11/17/2022] Open
Abstract
The ability of cochlear implants (CIs) to restore hearing to profoundly deaf people is based on direct electrical stimulation of the auditory nerve fibers (ANFs). Still, CI users do not achieve as good hearing outcomes as their normal-hearing peers. The development and optimization of CI stimulation strategies to reduce that gap could benefit from computational models that can predict responses evoked by different stimulation patterns, particularly temporal responses for coding of temporal fine structure information. To that end, we present the sequential biphasic leaky integrate-and-fire (S-BLIF) model for the ANF response to various pulse shapes and temporal sequences. The phenomenological S-BLIF model is adapted from the earlier BLIF model that can reproduce neurophysiological single-fiber cat ANF data from single-pulse stimulations. It was extended with elements that simulate refractoriness, facilitation, accommodation and long-term adaptation by affecting the threshold value of the model momentarily after supra- and subthreshold stimulation. Evaluation of the model demonstrated that it can reproduce neurophysiological data from single neuron recordings involving temporal phenomena related to inter-pulse interactions. Specifically, data for refractoriness, facilitation, accommodation and spike-rate adaptation can be reproduced. In addition, the model can account for effects of pulse rate on the synchrony between the pulsatile input and the spike-train output. Consequently, the model offers a versatile tool for testing new coding strategies for, e.g., temporal fine structure using pseudo-monophasic pulses, and for estimating the status of the electrode-neuron interface in the CI user's cochlea.
Collapse
Affiliation(s)
- Marko Takanen
- Audio Information Processing, Department of Electrical and
Computer Engineering, Technical University of Munich, Munich, Germany
| | - Bernhard U. Seeber
- Audio Information Processing, Department of Electrical and
Computer Engineering, Technical University of Munich, Munich, Germany
| |
Collapse
|