Compensatory plasticity in the deaf brain: effects on perception of music

Cross-Modal Sensory Boosting to Improve High-Frequency Hearing Loss: Device Development and Validation

Background

High-frequency hearing loss is one of the most common problems in the aging population and with those who have a history of exposure to loud noises. This type of hearing loss can be frustrating and disabling, making it difficult to understand speech communication and interact effectively with the world.

Objective

This study aimed to examine the impact of spatially unique haptic vibrations representing high-frequency phonemes on the self-perceived ability to understand conversations in everyday situations.

Methods

To address high-frequency hearing loss, a multi-motor wristband was developed that uses machine learning to listen for specific high-frequency phonemes. The wristband vibrates in spatially unique locations to represent which phoneme was present in real time. A total of 16 participants with high-frequency hearing loss were recruited and asked to wear the wristband for 6 weeks. The degree of disability associated with hearing loss was measured weekly using the Abbreviated Profile of Hearing Aid Benefit (APHAB).

Results

By the end of the 6-week study, the average APHAB benefit score across all participants reached 12.39 points, from a baseline of 40.32 to a final score of 27.93 (SD 13.11; N=16; P=.002, 2-tailed dependent t test). Those without hearing aids showed a 10.78-point larger improvement in average APHAB benefit score at 6 weeks than those with hearing aids (t14=2.14; P=.10, 2-tailed independent t test). The average benefit score across all participants for ease of communication was 15.44 (SD 13.88; N=16; P<.001, 2-tailed dependent t test). The average benefit score across all participants for background noise was 10.88 (SD 17.54; N=16; P=.03, 2-tailed dependent t test). The average benefit score across all participants for reverberation was 10.84 (SD 16.95; N=16; P=.02, 2-tailed dependent t test).

Conclusions

These findings show that vibrotactile sensory substitution delivered by a wristband that produces spatially distinguishable vibrations in correspondence with high-frequency phonemes helps individuals with high-frequency hearing loss improve their perceived understanding of verbal communication. Vibrotactile feedback provides benefits whether or not a person wears hearing aids, albeit in slightly different ways. Finally, individuals with the greatest perceived difficulty understanding speech experienced the greatest amount of perceived benefit from vibrotactile feedback.

Selected Acoustic Frequencies Have a Positive Impact on Behavioural and Physiological Welfare Indicators in Thoroughbred Racehorses

(1) Background: Since antiquity, it is considered that sounds influence human emotional states and health. Acoustic enrichment has also been proposed for domestic animals. However, in both humans and animals, effects vary according to the type of sound. Human studies suggest that frequencies, more than melodies, play a key role. Low and high frequencies, music tuning frequency and even EEG slow waves used for 'neurofeedback' produce effects. (2) Methods: We tested the possible impact of such pure frequencies on racehorses' behavior and physiology. A commercial non-audible acoustic stimulus, composed of an array of the above-mentioned frequencies, was broadcasted twice daily and for three weeks to 12 thoroughbred horses in their home stall. (3) Results: The results show a decrease in stereotypic behaviors and other indicators such as yawning or vacuum chewing, an increase in the time spent in recumbent resting and foraging, and better hematological measures during and after the playback phase for 4 of the 10 physiological parameters measured. (4) Conclusions: These results open new lines of research on possible ways of alleviating the stress related to housing and training conditions in racehorses and of improving physical recovery.

Effects of training and using an audio-tactile sensory substitution device on speech-in-noise understanding

Understanding speech in background noise is challenging. Wearing face-masks, imposed by the COVID19-pandemics, makes it even harder. We developed a multi-sensory setup, including a sensory substitution device (SSD) that can deliver speech simultaneously through audition and as vibrations on the fingertips. The vibrations correspond to low frequencies extracted from the speech input. We trained two groups of non-native English speakers in understanding distorted speech in noise. After a short session (30-45 min) of repeating sentences, with or without concurrent matching vibrations, we showed comparable mean group improvement of 14-16 dB in Speech Reception Threshold (SRT) in two test conditions, i.e., when the participants were asked to repeat sentences only from hearing and also when matching vibrations on fingertips were present. This is a very strong effect, if one considers that a 10 dB difference corresponds to doubling of the perceived loudness. The number of sentence repetitions needed for both types of training to complete the task was comparable. Meanwhile, the mean group SNR for the audio-tactile training (14.7 ± 8.7) was significantly lower (harder) than for the auditory training (23.9 ± 11.8), which indicates a potential facilitating effect of the added vibrations. In addition, both before and after training most of the participants (70-80%) showed better performance (by mean 4-6 dB) in speech-in-noise understanding when the audio sentences were accompanied with matching vibrations. This is the same magnitude of multisensory benefit that we reported, with no training at all, in our previous study using the same experimental procedures. After training, performance in this test condition was also best in both groups (SRT ~ 2 dB). The least significant effect of both training types was found in the third test condition, i.e. when participants were repeating sentences accompanied with non-matching tactile vibrations and the performance in this condition was also poorest after training. The results indicate that both types of training may remove some level of difficulty in sound perception, which might enable a more proper use of speech inputs delivered via vibrotactile stimulation. We discuss the implications of these novel findings with respect to basic science. In particular, we show that even in adulthood, i.e. long after the classical "critical periods" of development have passed, a new pairing between a certain computation (here, speech processing) and an atypical sensory modality (here, touch) can be established and trained, and that this process can be rapid and intuitive. We further present possible applications of our training program and the SSD for auditory rehabilitation in patients with hearing (and sight) deficits, as well as healthy individuals in suboptimal acoustic situations.

A Complex Combination Therapy for a Complex Disease-Neuroimaging Evidence for the Effect of Music Therapy in Schizophrenia

Schizophrenia is a disease characterized by clinical polymorphism: a combination of diverse syndromes defined by differences in structure, course and outcome. The etiology and pathogenesis of this mental disorder is still not completely understood, in spite of the achievements in the fields of neuroscience, genetics, neuroimaging and others. Different treatment strategies have been developed for patients with schizophrenia, but the search for new pharmacological agents continues with the mission of achieving a more effective control over the disease manifestations (positive and negative symptoms), improvement of the patients' social functioning and quality of life. The accumulated clinical experience has revealed that drug treatment and the inclusion in various rehabilitation programs and social skills training shows promising results in these patients. In recent years a plethora of evidence has been compiled regarding the role of music therapy as a possible alternative in the combination treatment of patients with mental disorders, schizophrenia included. Thus, the purpose of this review is to present the reader with a more detailed and science-based account of the beneficial effect of music therapy on the general wellbeing of patients diagnosed with schizophrenia. To fulfill our goal, we will focus mainly on the evidence provided by modern neuroimaging research.

Neural and Behavioral Evidence for Vibrotactile Beat Perception and Bimodal Enhancement

The ability to synchronize movements to a rhythmic stimulus, referred to as sensorimotor synchronization (SMS), is a behavioral measure of beat perception. Although SMS is generally superior when rhythms are presented in the auditory modality, recent research has demonstrated near-equivalent SMS for vibrotactile presentations of isochronous rhythms [Ammirante, P., Patel, A. D., & Russo, F. A. Synchronizing to auditory and tactile metronomes: A test of the auditory-motor enhancement hypothesis. Psychonomic Bulletin & Review, 23, 1882-1890, 2016]. The current study aimed to replicate and extend this study by incorporating a neural measure of beat perception. Nonmusicians were asked to tap to rhythms or to listen passively while EEG data were collected. Rhythmic complexity (isochronous, nonisochronous) and presentation modality (auditory, vibrotactile, bimodal) were fully crossed. Tapping data were consistent with those observed by Ammirante et al. (2016), revealing near-equivalent SMS for isochronous rhythms across modality conditions and a drop-off in SMS for nonisochronous rhythms, especially in the vibrotactile condition. EEG data revealed a greater degree of neural entrainment for isochronous compared to nonisochronous trials as well as for auditory and bimodal compared to vibrotactile trials. These findings led us to three main conclusions. First, isochronous rhythms lead to higher levels of beat perception than nonisochronous rhythms across modalities. Second, beat perception is generally enhanced for auditory presentations of rhythm but still possible under vibrotactile presentation conditions. Finally, exploratory analysis of neural entrainment at harmonic frequencies suggests that beat perception may be enhanced for bimodal presentations of rhythm.

Immediate improvement of speech-in-noise perception through multisensory stimulation via an auditory to tactile sensory substitution

BACKGROUND

Hearing loss is becoming a real social and health problem. Its prevalence in the elderly is an epidemic. The risk of developing hearing loss is also growing among younger people. If left untreated, hearing loss can perpetuate development of neurodegenerative diseases, including dementia. Despite recent advancements in hearing aid (HA) and cochlear implant (CI) technologies, hearing impaired users still encounter significant practical and social challenges, with or without aids. In particular, they all struggle with understanding speech in challenging acoustic environments, especially in presence of a competing speaker.

OBJECTIVES

In the current proof-of-concept study we tested whether multisensory stimulation, pairing audition and a minimal-size touch device would improve intelligibility of speech in noise.

METHODS

To this aim we developed an audio-to-tactile sensory substitution device (SSD) transforming low-frequency speech signals into tactile vibrations delivered on two finger tips. Based on the inverse effectiveness law, i.e., multisensory enhancement is strongest when signal-to-noise ratio is lowest between senses, we embedded non-native language stimuli in speech-like noise and paired it with a low-frequency input conveyed through touch.

RESULTS

We found immediate and robust improvement in speech recognition (i.e. in the Signal-To-Noise-ratio) in the multisensory condition without any training, at a group level as well as in every participant. The reported improvement at the group-level of 6 dB was indeed major considering that an increase of 10 dB represents a doubling of the perceived loudness.

CONCLUSIONS

These results are especially relevant when compared to previous SSD studies showing effects in behavior only after a demanding cognitive training. We discuss the implications of our results for development of SSDs and of specific rehabilitation programs for the hearing impaired either using or not using HAs or CIs. We also discuss the potential application of such a set-up for sense augmentation, such as when learning a new language.

Auditory Event-Related Potentials Associated With Music Perception in Cochlear Implant Users

A short review of the literature on auditory event-related potentials and mismatch negativities (MMN) in cochlear implant users engaged in music-related auditory perception tasks is presented. Behavioral studies that have measured the fundamental aspects of music perception in CI users have found that they usually experience poor perception of melody, pitch, harmony as well as timbre (Limb and Roy, 2014). This is thought to occur not only because of the technological and acoustic limitations of the device, but also because of the biological alterations that usually accompany deafness. In order to improve music perception and appreciation in individuals with cochlear implants, it is essential to better understand how they perceive music. As suggested by recent studies, several different electrophysiological paradigms can be used to reliably and objectively measure normal-hearing individuals' perception of fundamental musical features. These techniques, when used with individuals with cochlear implants, might contribute to determine how their peripheral and central auditory systems analyze musical excerpts. The investigation of these cortical activations can moreover give important information on other aspects related to music appreciation, such as pleasantness and emotional perception. The studies reviewed suggest that cochlear implantation alters most fundamental musical features, including pitch, timbre, melody perception, complex rhythm, and duration (e.g., Koelsch et al., 2004b; Timm et al., 2012, 2014; Zhang et al., 2013a,b; Limb and Roy, 2014). A better understanding of how individuals with cochlear implants perform on these tasks not only makes it possible to compare their performance to that of their normal-hearing peers, but can also lead to better clinical intervention and rehabilitation.

Synchronizing to auditory and tactile metronomes: a test of the auditory-motor enhancement hypothesis

Humans show a striking advantage for synchronizing movements with discretely timed auditory metronomes (e.g., clicking sounds) over temporally matched visual metronomes (e.g., flashing lights), suggesting enhanced auditory-motor coupling for rhythmic processing. Does the auditory advantage persist for other modalities (not just vision)? Here, nonmusicians finger tapped to the beat of auditory, tactile, and bimodal metronomes. Stimulus magnitude and rhythmic complexity were also manipulated. In conditions involving a large area of stimulation and simple rhythmic sequences, tactile synchronization closely matched auditory. Although this finding shows a limitation to the hypothesis of enhanced auditory-motor coupling for rhythmic processing, other findings clearly support it. First, there was a robust advantage with auditory information for synchronization with complex rhythm sequences; moreover, in complex sequences a measure of error correction was found only when auditory information was present. Second, higher order grouping was evident only when auditory information was present.

India's rich musical heritage has a lot to offer to modern psychiatry

Music with its instantaneous pleasing effect can be an answer to misery. It is a form of art that is easily accessible anytime and anywhere. This article gives an overview of music therapy practiced in ancient India, its influence on emotion and mind, and speculates its possible clinical applications in the modern era based on the available scientific literature.