1
|
Kohler I, Perrotta MV, Ferreira T, Eagleman DM. Cross-Modal Sensory Boosting to Improve High-Frequency Hearing Loss: Device Development and Validation. JMIRX MED 2024; 5:e49969. [PMID: 38345294 PMCID: PMC11008433 DOI: 10.2196/49969] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/14/2023] [Revised: 11/23/2023] [Accepted: 12/13/2023] [Indexed: 04/13/2024]
Abstract
Background High-frequency hearing loss is one of the most common problems in the aging population and with those who have a history of exposure to loud noises. This type of hearing loss can be frustrating and disabling, making it difficult to understand speech communication and interact effectively with the world. Objective This study aimed to examine the impact of spatially unique haptic vibrations representing high-frequency phonemes on the self-perceived ability to understand conversations in everyday situations. Methods To address high-frequency hearing loss, a multi-motor wristband was developed that uses machine learning to listen for specific high-frequency phonemes. The wristband vibrates in spatially unique locations to represent which phoneme was present in real time. A total of 16 participants with high-frequency hearing loss were recruited and asked to wear the wristband for 6 weeks. The degree of disability associated with hearing loss was measured weekly using the Abbreviated Profile of Hearing Aid Benefit (APHAB). Results By the end of the 6-week study, the average APHAB benefit score across all participants reached 12.39 points, from a baseline of 40.32 to a final score of 27.93 (SD 13.11; N=16; P=.002, 2-tailed dependent t test). Those without hearing aids showed a 10.78-point larger improvement in average APHAB benefit score at 6 weeks than those with hearing aids (t14=2.14; P=.10, 2-tailed independent t test). The average benefit score across all participants for ease of communication was 15.44 (SD 13.88; N=16; P<.001, 2-tailed dependent t test). The average benefit score across all participants for background noise was 10.88 (SD 17.54; N=16; P=.03, 2-tailed dependent t test). The average benefit score across all participants for reverberation was 10.84 (SD 16.95; N=16; P=.02, 2-tailed dependent t test). Conclusions These findings show that vibrotactile sensory substitution delivered by a wristband that produces spatially distinguishable vibrations in correspondence with high-frequency phonemes helps individuals with high-frequency hearing loss improve their perceived understanding of verbal communication. Vibrotactile feedback provides benefits whether or not a person wears hearing aids, albeit in slightly different ways. Finally, individuals with the greatest perceived difficulty understanding speech experienced the greatest amount of perceived benefit from vibrotactile feedback.
Collapse
Affiliation(s)
| | | | | | - David M Eagleman
- Neosensory, Los Altos, CA, United States
- Department of Psychiatry, Stanford University, Stanford, CA, United States
| |
Collapse
|
2
|
Gueguen L, Henry S, Delbos M, Lemasson A, Hausberger M. Selected Acoustic Frequencies Have a Positive Impact on Behavioural and Physiological Welfare Indicators in Thoroughbred Racehorses. Animals (Basel) 2023; 13:2970. [PMID: 37760370 PMCID: PMC10525862 DOI: 10.3390/ani13182970] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2023] [Revised: 08/12/2023] [Accepted: 09/14/2023] [Indexed: 09/29/2023] Open
Abstract
(1) Background: Since antiquity, it is considered that sounds influence human emotional states and health. Acoustic enrichment has also been proposed for domestic animals. However, in both humans and animals, effects vary according to the type of sound. Human studies suggest that frequencies, more than melodies, play a key role. Low and high frequencies, music tuning frequency and even EEG slow waves used for 'neurofeedback' produce effects. (2) Methods: We tested the possible impact of such pure frequencies on racehorses' behavior and physiology. A commercial non-audible acoustic stimulus, composed of an array of the above-mentioned frequencies, was broadcasted twice daily and for three weeks to 12 thoroughbred horses in their home stall. (3) Results: The results show a decrease in stereotypic behaviors and other indicators such as yawning or vacuum chewing, an increase in the time spent in recumbent resting and foraging, and better hematological measures during and after the playback phase for 4 of the 10 physiological parameters measured. (4) Conclusions: These results open new lines of research on possible ways of alleviating the stress related to housing and training conditions in racehorses and of improving physical recovery.
Collapse
Affiliation(s)
- Léa Gueguen
- Univ Rennes, Normandie Univ, CNRS, EthoS (Éthologie Animale et Humaine)—UMR 6552, 35000 Rennes, France; (S.H.); (M.D.); (A.L.); (M.H.)
- UMR 8002 Integrative Neuroscience and Cognition Center, CNRS, Université Paris-Cité, 75006 Paris, France
| | - Séverine Henry
- Univ Rennes, Normandie Univ, CNRS, EthoS (Éthologie Animale et Humaine)—UMR 6552, 35000 Rennes, France; (S.H.); (M.D.); (A.L.); (M.H.)
| | - Maëlle Delbos
- Univ Rennes, Normandie Univ, CNRS, EthoS (Éthologie Animale et Humaine)—UMR 6552, 35000 Rennes, France; (S.H.); (M.D.); (A.L.); (M.H.)
| | - Alban Lemasson
- Univ Rennes, Normandie Univ, CNRS, EthoS (Éthologie Animale et Humaine)—UMR 6552, 35000 Rennes, France; (S.H.); (M.D.); (A.L.); (M.H.)
- Institut Universitaire de France, 75005 Paris, France
| | - Martine Hausberger
- Univ Rennes, Normandie Univ, CNRS, EthoS (Éthologie Animale et Humaine)—UMR 6552, 35000 Rennes, France; (S.H.); (M.D.); (A.L.); (M.H.)
- UMR 8002 Integrative Neuroscience and Cognition Center, CNRS, Université Paris-Cité, 75006 Paris, France
| |
Collapse
|
3
|
Cieśla K, Wolak T, Lorens A, Mentzel M, Skarżyński H, Amedi A. Effects of training and using an audio-tactile sensory substitution device on speech-in-noise understanding. Sci Rep 2022; 12:3206. [PMID: 35217676 PMCID: PMC8881456 DOI: 10.1038/s41598-022-06855-8] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2021] [Accepted: 01/28/2022] [Indexed: 11/09/2022] Open
Abstract
Understanding speech in background noise is challenging. Wearing face-masks, imposed by the COVID19-pandemics, makes it even harder. We developed a multi-sensory setup, including a sensory substitution device (SSD) that can deliver speech simultaneously through audition and as vibrations on the fingertips. The vibrations correspond to low frequencies extracted from the speech input. We trained two groups of non-native English speakers in understanding distorted speech in noise. After a short session (30-45 min) of repeating sentences, with or without concurrent matching vibrations, we showed comparable mean group improvement of 14-16 dB in Speech Reception Threshold (SRT) in two test conditions, i.e., when the participants were asked to repeat sentences only from hearing and also when matching vibrations on fingertips were present. This is a very strong effect, if one considers that a 10 dB difference corresponds to doubling of the perceived loudness. The number of sentence repetitions needed for both types of training to complete the task was comparable. Meanwhile, the mean group SNR for the audio-tactile training (14.7 ± 8.7) was significantly lower (harder) than for the auditory training (23.9 ± 11.8), which indicates a potential facilitating effect of the added vibrations. In addition, both before and after training most of the participants (70-80%) showed better performance (by mean 4-6 dB) in speech-in-noise understanding when the audio sentences were accompanied with matching vibrations. This is the same magnitude of multisensory benefit that we reported, with no training at all, in our previous study using the same experimental procedures. After training, performance in this test condition was also best in both groups (SRT ~ 2 dB). The least significant effect of both training types was found in the third test condition, i.e. when participants were repeating sentences accompanied with non-matching tactile vibrations and the performance in this condition was also poorest after training. The results indicate that both types of training may remove some level of difficulty in sound perception, which might enable a more proper use of speech inputs delivered via vibrotactile stimulation. We discuss the implications of these novel findings with respect to basic science. In particular, we show that even in adulthood, i.e. long after the classical "critical periods" of development have passed, a new pairing between a certain computation (here, speech processing) and an atypical sensory modality (here, touch) can be established and trained, and that this process can be rapid and intuitive. We further present possible applications of our training program and the SSD for auditory rehabilitation in patients with hearing (and sight) deficits, as well as healthy individuals in suboptimal acoustic situations.
Collapse
Affiliation(s)
- K Cieśla
- The Baruch Ivcher Institute for Brain, Cognition & Technology, The Baruch Ivcher School of Psychology and the Ruth and Meir Rosental Brain Imaging Center, Reichman University, Herzliya, Israel. .,World Hearing Centre, Institute of Physiology and Pathology of Hearing, Warsaw, Poland.
| | - T Wolak
- World Hearing Centre, Institute of Physiology and Pathology of Hearing, Warsaw, Poland
| | - A Lorens
- World Hearing Centre, Institute of Physiology and Pathology of Hearing, Warsaw, Poland
| | - M Mentzel
- The Baruch Ivcher Institute for Brain, Cognition & Technology, The Baruch Ivcher School of Psychology and the Ruth and Meir Rosental Brain Imaging Center, Reichman University, Herzliya, Israel
| | - H Skarżyński
- World Hearing Centre, Institute of Physiology and Pathology of Hearing, Warsaw, Poland
| | - A Amedi
- The Baruch Ivcher Institute for Brain, Cognition & Technology, The Baruch Ivcher School of Psychology and the Ruth and Meir Rosental Brain Imaging Center, Reichman University, Herzliya, Israel
| |
Collapse
|
4
|
Ivanova E, Panayotova T, Grechenliev I, Peshev B, Kolchakova P, Milanova V. A Complex Combination Therapy for a Complex Disease-Neuroimaging Evidence for the Effect of Music Therapy in Schizophrenia. Front Psychiatry 2022; 13:795344. [PMID: 35370834 PMCID: PMC8964524 DOI: 10.3389/fpsyt.2022.795344] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/14/2021] [Accepted: 01/31/2022] [Indexed: 11/29/2022] Open
Abstract
Schizophrenia is a disease characterized by clinical polymorphism: a combination of diverse syndromes defined by differences in structure, course and outcome. The etiology and pathogenesis of this mental disorder is still not completely understood, in spite of the achievements in the fields of neuroscience, genetics, neuroimaging and others. Different treatment strategies have been developed for patients with schizophrenia, but the search for new pharmacological agents continues with the mission of achieving a more effective control over the disease manifestations (positive and negative symptoms), improvement of the patients' social functioning and quality of life. The accumulated clinical experience has revealed that drug treatment and the inclusion in various rehabilitation programs and social skills training shows promising results in these patients. In recent years a plethora of evidence has been compiled regarding the role of music therapy as a possible alternative in the combination treatment of patients with mental disorders, schizophrenia included. Thus, the purpose of this review is to present the reader with a more detailed and science-based account of the beneficial effect of music therapy on the general wellbeing of patients diagnosed with schizophrenia. To fulfill our goal, we will focus mainly on the evidence provided by modern neuroimaging research.
Collapse
Affiliation(s)
- Elena Ivanova
- Psychiatric Clinic, Alexandrovska University Hospital, Sofia, Bulgaria.,Department of Psychiatry and Medical Psychology, Medical University, Sofia, Bulgaria
| | | | - Ivan Grechenliev
- Psychiatric Clinic, Alexandrovska University Hospital, Sofia, Bulgaria
| | - Bogomil Peshev
- Psychiatric Clinic, Alexandrovska University Hospital, Sofia, Bulgaria
| | | | - Vihra Milanova
- Psychiatric Clinic, Alexandrovska University Hospital, Sofia, Bulgaria
| |
Collapse
|
5
|
Gilmore SA, Russo FA. Neural and Behavioral Evidence for Vibrotactile Beat Perception and Bimodal Enhancement. J Cogn Neurosci 2021; 33:635-650. [PMID: 33475449 DOI: 10.1162/jocn_a_01673] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
The ability to synchronize movements to a rhythmic stimulus, referred to as sensorimotor synchronization (SMS), is a behavioral measure of beat perception. Although SMS is generally superior when rhythms are presented in the auditory modality, recent research has demonstrated near-equivalent SMS for vibrotactile presentations of isochronous rhythms [Ammirante, P., Patel, A. D., & Russo, F. A. Synchronizing to auditory and tactile metronomes: A test of the auditory-motor enhancement hypothesis. Psychonomic Bulletin & Review, 23, 1882-1890, 2016]. The current study aimed to replicate and extend this study by incorporating a neural measure of beat perception. Nonmusicians were asked to tap to rhythms or to listen passively while EEG data were collected. Rhythmic complexity (isochronous, nonisochronous) and presentation modality (auditory, vibrotactile, bimodal) were fully crossed. Tapping data were consistent with those observed by Ammirante et al. (2016), revealing near-equivalent SMS for isochronous rhythms across modality conditions and a drop-off in SMS for nonisochronous rhythms, especially in the vibrotactile condition. EEG data revealed a greater degree of neural entrainment for isochronous compared to nonisochronous trials as well as for auditory and bimodal compared to vibrotactile trials. These findings led us to three main conclusions. First, isochronous rhythms lead to higher levels of beat perception than nonisochronous rhythms across modalities. Second, beat perception is generally enhanced for auditory presentations of rhythm but still possible under vibrotactile presentation conditions. Finally, exploratory analysis of neural entrainment at harmonic frequencies suggests that beat perception may be enhanced for bimodal presentations of rhythm.
Collapse
|
6
|
Sharp A, Bacon BA, Champoux F. Enhanced tactile identification of musical emotion in the deaf. Exp Brain Res 2020; 238:1229-1236. [DOI: 10.1007/s00221-020-05789-9] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2020] [Accepted: 03/18/2020] [Indexed: 10/24/2022]
|
7
|
Cieśla K, Wolak T, Lorens A, Heimler B, Skarżyński H, Amedi A. Immediate improvement of speech-in-noise perception through multisensory stimulation via an auditory to tactile sensory substitution. Restor Neurol Neurosci 2019; 37:155-166. [PMID: 31006700 PMCID: PMC6598101 DOI: 10.3233/rnn-190898] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
BACKGROUND Hearing loss is becoming a real social and health problem. Its prevalence in the elderly is an epidemic. The risk of developing hearing loss is also growing among younger people. If left untreated, hearing loss can perpetuate development of neurodegenerative diseases, including dementia. Despite recent advancements in hearing aid (HA) and cochlear implant (CI) technologies, hearing impaired users still encounter significant practical and social challenges, with or without aids. In particular, they all struggle with understanding speech in challenging acoustic environments, especially in presence of a competing speaker. OBJECTIVES In the current proof-of-concept study we tested whether multisensory stimulation, pairing audition and a minimal-size touch device would improve intelligibility of speech in noise. METHODS To this aim we developed an audio-to-tactile sensory substitution device (SSD) transforming low-frequency speech signals into tactile vibrations delivered on two finger tips. Based on the inverse effectiveness law, i.e., multisensory enhancement is strongest when signal-to-noise ratio is lowest between senses, we embedded non-native language stimuli in speech-like noise and paired it with a low-frequency input conveyed through touch. RESULTS We found immediate and robust improvement in speech recognition (i.e. in the Signal-To-Noise-ratio) in the multisensory condition without any training, at a group level as well as in every participant. The reported improvement at the group-level of 6 dB was indeed major considering that an increase of 10 dB represents a doubling of the perceived loudness. CONCLUSIONS These results are especially relevant when compared to previous SSD studies showing effects in behavior only after a demanding cognitive training. We discuss the implications of our results for development of SSDs and of specific rehabilitation programs for the hearing impaired either using or not using HAs or CIs. We also discuss the potential application of such a set-up for sense augmentation, such as when learning a new language.
Collapse
Affiliation(s)
- Katarzyna Cieśla
- Institute of Physiology and Pathology of Hearing, World Hearing Center, Warsaw, Poland
- Department of Medical Neurobiology, Institute for Medical Research Israel-Canada, Faculty of Medicine, Hebrew University of Jerusalem, Hadassah Ein-Kerem, Jerusalem, Israel
| | - Tomasz Wolak
- Institute of Physiology and Pathology of Hearing, World Hearing Center, Warsaw, Poland
| | - Artur Lorens
- Institute of Physiology and Pathology of Hearing, World Hearing Center, Warsaw, Poland
| | - Benedetta Heimler
- Department of Medical Neurobiology, Institute for Medical Research Israel-Canada, Faculty of Medicine, Hebrew University of Jerusalem, Hadassah Ein-Kerem, Jerusalem, Israel
| | - Henryk Skarżyński
- Institute of Physiology and Pathology of Hearing, World Hearing Center, Warsaw, Poland
| | - Amir Amedi
- Department of Medical Neurobiology, Institute for Medical Research Israel-Canada, Faculty of Medicine, Hebrew University of Jerusalem, Hadassah Ein-Kerem, Jerusalem, Israel
- The Cognitive Science Program, The Hebrew University of Jerusalem, Jerusalem, Israel
| |
Collapse
|
8
|
Sharp A, Delcenserie A, Champoux F. Auditory Event-Related Potentials Associated With Music Perception in Cochlear Implant Users. Front Neurosci 2018; 12:538. [PMID: 30131673 PMCID: PMC6090478 DOI: 10.3389/fnins.2018.00538] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2018] [Accepted: 07/17/2018] [Indexed: 11/13/2022] Open
Abstract
A short review of the literature on auditory event-related potentials and mismatch negativities (MMN) in cochlear implant users engaged in music-related auditory perception tasks is presented. Behavioral studies that have measured the fundamental aspects of music perception in CI users have found that they usually experience poor perception of melody, pitch, harmony as well as timbre (Limb and Roy, 2014). This is thought to occur not only because of the technological and acoustic limitations of the device, but also because of the biological alterations that usually accompany deafness. In order to improve music perception and appreciation in individuals with cochlear implants, it is essential to better understand how they perceive music. As suggested by recent studies, several different electrophysiological paradigms can be used to reliably and objectively measure normal-hearing individuals' perception of fundamental musical features. These techniques, when used with individuals with cochlear implants, might contribute to determine how their peripheral and central auditory systems analyze musical excerpts. The investigation of these cortical activations can moreover give important information on other aspects related to music appreciation, such as pleasantness and emotional perception. The studies reviewed suggest that cochlear implantation alters most fundamental musical features, including pitch, timbre, melody perception, complex rhythm, and duration (e.g., Koelsch et al., 2004b; Timm et al., 2012, 2014; Zhang et al., 2013a,b; Limb and Roy, 2014). A better understanding of how individuals with cochlear implants perform on these tasks not only makes it possible to compare their performance to that of their normal-hearing peers, but can also lead to better clinical intervention and rehabilitation.
Collapse
Affiliation(s)
- Andréanne Sharp
- École d'orthophonie et d'audiologie, Université de Montréal, Montreal, QC, Canada
| | - Audrey Delcenserie
- École d'orthophonie et d'audiologie, Université de Montréal, Montreal, QC, Canada.,Département de psychologie, Université de Montréal, Montreal, QC, Canada
| | - François Champoux
- École d'orthophonie et d'audiologie, Université de Montréal, Montreal, QC, Canada
| |
Collapse
|
9
|
Synchronizing to auditory and tactile metronomes: a test of the auditory-motor enhancement hypothesis. Psychon Bull Rev 2017; 23:1882-1890. [PMID: 27246088 DOI: 10.3758/s13423-016-1067-9] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Humans show a striking advantage for synchronizing movements with discretely timed auditory metronomes (e.g., clicking sounds) over temporally matched visual metronomes (e.g., flashing lights), suggesting enhanced auditory-motor coupling for rhythmic processing. Does the auditory advantage persist for other modalities (not just vision)? Here, nonmusicians finger tapped to the beat of auditory, tactile, and bimodal metronomes. Stimulus magnitude and rhythmic complexity were also manipulated. In conditions involving a large area of stimulation and simple rhythmic sequences, tactile synchronization closely matched auditory. Although this finding shows a limitation to the hypothesis of enhanced auditory-motor coupling for rhythmic processing, other findings clearly support it. First, there was a robust advantage with auditory information for synchronization with complex rhythm sequences; moreover, in complex sequences a measure of error correction was found only when auditory information was present. Second, higher order grouping was evident only when auditory information was present.
Collapse
|
10
|
Heimler B, Striem-Amit E, Amedi A. Origins of task-specific sensory-independent organization in the visual and auditory brain: neuroscience evidence, open questions and clinical implications. Curr Opin Neurobiol 2015; 35:169-77. [DOI: 10.1016/j.conb.2015.09.001] [Citation(s) in RCA: 66] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2015] [Revised: 09/01/2015] [Accepted: 09/02/2015] [Indexed: 12/28/2022]
|
11
|
Abstract
Music with its instantaneous pleasing effect can be an answer to misery. It is a form of art that is easily accessible anytime and anywhere. This article gives an overview of music therapy practiced in ancient India, its influence on emotion and mind, and speculates its possible clinical applications in the modern era based on the available scientific literature.
Collapse
|