1
|
Valzolgher C. Motor Strategies: The Role of Active Behavior in Spatial Hearing Research. Psychol Rep 2024:332941241260246. [PMID: 38857521 DOI: 10.1177/00332941241260246] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/12/2024]
Abstract
When completing a task, the ability to implement behavioral strategies to solve it in an effective and cognitively less-demanding way is extremely adaptive for humans. This behavior makes it possible to accumulate evidence and test one's own predictions about the external world. In this work, starting from examples in the field of spatial hearing research, I analyze the importance of considering motor strategies in perceptual tasks, and I stress the urgent need to create ecological experimental settings, which are essential in allowing the implementation of such behaviors and in measuring them. In particular, I will consider head movements as an example of strategic behavior implemented to solve acoustic space-perception tasks.
Collapse
Affiliation(s)
- Chiara Valzolgher
- Center for Mind/Brain Sciences, University of Trento, Rovereto, Italy
| |
Collapse
|
2
|
Mowery TM, Wackym PA, Nacipucha J, Dangcil E, Stadler RD, Tucker A, Carayannopoulos NL, Beshy MA, Hong SS, Yao JD. Superior semicircular canal dehiscence and subsequent closure induces reversible impaired decision-making. Front Neurol 2023; 14:1259030. [PMID: 37905188 PMCID: PMC10613502 DOI: 10.3389/fneur.2023.1259030] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2023] [Accepted: 09/14/2023] [Indexed: 11/02/2023] Open
Abstract
Background Vestibular loss and dysfunction has been associated with cognitive deficits, decreased spatial navigation, spatial memory, visuospatial ability, attention, executive function, and processing speed among others. Superior semicircular canal dehiscence (SSCD) is a vestibular-cochlear disorder in humans in which a pathological third mobile window of the otic capsule creates changes to the flow of sound pressure energy through the perilymph/endolymph. The primary symptoms include sound-induced dizziness/vertigo, inner ear conductive hearing loss, autophony, headaches, and visual problems; however, individuals also experience measurable deficits in basic decision-making, short-term memory, concentration, spatial cognition, and depression. These suggest central mechanisms of impairment are associated with vestibular disorders; therefore, we directly tested this hypothesis using both an auditory and visual decision-making task of varying difficulty levels in our model of SSCD. Methods Adult Mongolian gerbils (n = 33) were trained on one of four versions of a Go-NoGo stimulus presentation rate discrimination task that included standard ("easy") or more difficult ("hard") auditory and visual stimuli. After 10 days of training, preoperative ABR and c+VEMP testing was followed by a surgical fenestration of the left superior semicircular canal. Animals with persistent circling or head tilt were excluded to minimize effects from acute vestibular injury. Testing recommenced at postoperative day 5 and continued through postoperative day 15 at which point final ABR and c+VEMP testing was carried out. Results Behavioral data (d-primes) were compared between preoperative performance (training day 8-10) and postoperative days 6-8 and 13-15. Behavioral performance was measured during the peak of SSCD induced ABR and c + VEMP impairment and the return towards baseline as the dehiscence began to resurface by osteoneogenesis. There were significant differences in behavioral performance (d-prime) and its behavioral components (Hits, Misses, False Alarms, and Correct Rejections). These changes were highly correlated with persistent deficits in c + VEMPs at the end of training (postoperative day 15). The controls demonstrated additional learning post procedure that was absent in the SSCD group. Conclusion These results suggest that aberrant asymmetric vestibular output results in decision-making impairments in these discrimination tasks and could be associated with the other cognitive impairments resulting from vestibular dysfunction.
Collapse
Affiliation(s)
- Todd M. Mowery
- Department of Otolaryngology – Head and Neck Surgery, Rutgers Robert Wood Johnson Medical School, New Brunswick, NJ, United States
- Rutgers Brain Health Institute, New Brunswick, NJ, United States
| | - P. Ashley Wackym
- Department of Otolaryngology – Head and Neck Surgery, Rutgers Robert Wood Johnson Medical School, New Brunswick, NJ, United States
- Rutgers Brain Health Institute, New Brunswick, NJ, United States
| | - Jacqueline Nacipucha
- Department of Otolaryngology – Head and Neck Surgery, Rutgers Robert Wood Johnson Medical School, New Brunswick, NJ, United States
| | - Evelynne Dangcil
- Department of Otolaryngology – Head and Neck Surgery, Rutgers Robert Wood Johnson Medical School, New Brunswick, NJ, United States
| | - Ryan D. Stadler
- Department of Otolaryngology – Head and Neck Surgery, Rutgers Robert Wood Johnson Medical School, New Brunswick, NJ, United States
| | - Aaron Tucker
- Department of Otolaryngology – Head and Neck Surgery, Rutgers Robert Wood Johnson Medical School, New Brunswick, NJ, United States
| | - Nicolas L. Carayannopoulos
- Department of Otolaryngology – Head and Neck Surgery, Rutgers Robert Wood Johnson Medical School, New Brunswick, NJ, United States
| | - Mina A. Beshy
- Department of Otolaryngology – Head and Neck Surgery, Rutgers Robert Wood Johnson Medical School, New Brunswick, NJ, United States
| | - Sean S. Hong
- Department of Otolaryngology – Head and Neck Surgery, Rutgers Robert Wood Johnson Medical School, New Brunswick, NJ, United States
| | - Justin D. Yao
- Department of Otolaryngology – Head and Neck Surgery, Rutgers Robert Wood Johnson Medical School, New Brunswick, NJ, United States
- Rutgers Brain Health Institute, New Brunswick, NJ, United States
| |
Collapse
|
3
|
Zaidel A, Salomon R. Multisensory decisions from self to world. Philos Trans R Soc Lond B Biol Sci 2023; 378:20220335. [PMID: 37545311 PMCID: PMC10404927 DOI: 10.1098/rstb.2022.0335] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2023] [Accepted: 06/19/2023] [Indexed: 08/08/2023] Open
Abstract
Classic Bayesian models of perceptual inference describe how an ideal observer would integrate 'unisensory' measurements (multisensory integration) and attribute sensory signals to their origin(s) (causal inference). However, in the brain, sensory signals are always received in the context of a multisensory bodily state-namely, in combination with other senses. Moreover, sensory signals from both interoceptive sensing of one's own body and exteroceptive sensing of the world are highly interdependent and never occur in isolation. Thus, the observer must fundamentally determine whether each sensory observation is from an external (versus internal, self-generated) source to even be considered for integration. Critically, solving this primary causal inference problem requires knowledge of multisensory and sensorimotor dependencies. Thus, multisensory processing is needed to separate sensory signals. These multisensory processes enable us to simultaneously form a sense of self and form distinct perceptual decisions about the external world. In this opinion paper, we review and discuss the similarities and distinctions between multisensory decisions underlying the sense of self and those directed at acquiring information about the world. We call attention to the fact that heterogeneous multisensory processes take place all along the neural hierarchy (even in forming 'unisensory' observations) and argue that more integration of these aspects, in theory and experiment, is required to obtain a more comprehensive understanding of multisensory brain function. This article is part of the theme issue 'Decision and control processes in multisensory perception'.
Collapse
Affiliation(s)
- Adam Zaidel
- Gonda Multidisciplinary Brain Research Center, Bar-Ilan University, Ramat Gan 5290002, Israel
| | - Roy Salomon
- Gonda Multidisciplinary Brain Research Center, Bar-Ilan University, Ramat Gan 5290002, Israel
- Department of Cognitive Sciences, University of Haifa, Mount Carmel, Haifa 3498838, Israel
| |
Collapse
|
4
|
van Helvert MJL, Selen LPJ, van Beers RJ, Medendorp WP. Predictive steering: integration of artificial motor signals in self-motion estimation. J Neurophysiol 2022; 128:1395-1408. [PMID: 36350058 DOI: 10.1152/jn.00248.2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022] Open
Abstract
The brain's computations for active and passive self-motion estimation can be unified with a single model that optimally combines vestibular and visual signals with sensory predictions based on efference copies. It is unknown whether this theoretical framework also applies to the integration of artificial motor signals, such as those that occur when driving a car, or whether self-motion estimation in this situation relies on sole feedback control. Here, we examined if training humans to control a self-motion platform leads to the construction of an accurate internal model of the mapping between the steering movement and the vestibular reafference. Participants (n = 15) sat on a linear motion platform and actively controlled the platform's velocity using a steering wheel to translate their body to a memorized visual target (motion condition). We compared their steering behavior to that of participants (n = 15) who remained stationary and instead aligned a nonvisible line with the target (stationary condition). To probe learning, the gain between the steering wheel angle and the platform or line velocity changed abruptly twice during the experiment. These gain changes were virtually undetectable in the displacement error in the motion condition, whereas clear deviations were observed in the stationary condition, showing that participants in the motion condition made within-trial changes to their steering behavior. We conclude that vestibular feedback allows not only the online control of steering but also a rapid adaptation to the gain changes to update the brain's internal model of the mapping between the steering movement and the vestibular reafference.NEW & NOTEWORTHY Perception of self-motion is known to depend on the integration of sensory signals and, when the motion is self-generated, the predicted sensory reafference based on motor efference copies. Here we show, using a closed-loop steering experiment with a direct coupling between the steering movement and the vestibular self-motion feedback, that humans are also able to integrate artificial motor signals, like the motor signals that occur when driving a car.
Collapse
Affiliation(s)
- Milou J L van Helvert
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| | - Luc P J Selen
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| | - Robert J van Beers
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands.,Department of Human Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - W Pieter Medendorp
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| |
Collapse
|
5
|
Peetermans O, Dobbels B, Mertens G, Moyaert J, van de Berg R, Vanderveken O, Van de Heyning P, Pérez Fornos A, Guinand N, Lammers MJW, Van Rompaey V. Sound localization in patients with bilateral vestibulopathy. Eur Arch Otorhinolaryngol 2022; 279:5601-5613. [PMID: 35536383 DOI: 10.1007/s00405-022-07414-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2021] [Accepted: 04/19/2022] [Indexed: 01/04/2023]
Abstract
PURPOSE The goal of this study was to evaluate if bilaterally (partially) absent vestibular function during static sound localization testing, would have a negative impact on sound localization skills. Therefore, this study compared horizontal static sound localization skills of normal-hearing patients with bilateral vestibulopathy (BV) and healthy controls. METHODS Thirteen normal-hearing patients with BV and thirteen age-matched healthy controls were included. Sound localization skills were tested using seven loudspeakers in a frontal semicircle, ranging from - 90° to + 90°. Sound location accuracy was analyzed using the root-mean-square error (RMSE) and the mean absolute error (MAE). To evaluate the severity of the BV symptoms, the following questionnaires were used: Dizziness Handicap Inventory (DHI), Oscillopsia severity questionnaire (OSQ), 12-item Spatial, Speech, and Qualities Questionnaire (SSQ12), and Health Utilities Index Mark 3 (HUI3). RESULTS The RMSE and MAE were significantly larger (worse) in the BV group than in the healthy control group, with respective median RMSE of 4.6° and 0°, and a median MAE of 0.7° and 0°. The subjective reporting of speech perception, spatial hearing, and quality of life only demonstrated a moderate correlation between DHI (positive correlation) and HUI total score (negative correlation), and localization scores. CONCLUSION Static sound localization skills of patients with BV were only mildly worse compared to healthy controls. However, this difference was very small and therefore most likely due to impaired cognitive function. The vestibular system does not seem to have a modulating role in sound localization during static conditions, and its impact is negligible in contrast to the impact of hearing impairment. Furthermore, the subjective reporting of speech perception, spatial hearing, and quality of life was not strongly correlated with localization scores.
Collapse
Affiliation(s)
- Olivier Peetermans
- Faculty of Medicine and Health Sciences, University of Antwerp, Antwerp, Belgium. .,Department of Otorhinolaryngology and Head and Neck Surgery, Antwerp University Hospital, Antwerp, Belgium. .,Department of Otorhinolaryngology and Head and Neck Surgery, UZA, Drie Eikenstraat 655, 2650, Edegem, Belgium.
| | - Bieke Dobbels
- Faculty of Medicine and Health Sciences, University of Antwerp, Antwerp, Belgium.,Department of Otorhinolaryngology and Head and Neck Surgery, Antwerp University Hospital, Antwerp, Belgium
| | - Griet Mertens
- Faculty of Medicine and Health Sciences, University of Antwerp, Antwerp, Belgium.,Department of Otorhinolaryngology and Head and Neck Surgery, Antwerp University Hospital, Antwerp, Belgium
| | - Julie Moyaert
- Department of Otorhinolaryngology and Head and Neck Surgery, Antwerp University Hospital, Antwerp, Belgium
| | - Raymond van de Berg
- Department of Otolaryngology, Head and Neck Surgery, Maastricht University Medical Centre, Maastricht, The Netherlands.,Faculty of Physics, Tomsk State University, Tomsk, Russia
| | - Olivier Vanderveken
- Faculty of Medicine and Health Sciences, University of Antwerp, Antwerp, Belgium.,Department of Otorhinolaryngology and Head and Neck Surgery, Antwerp University Hospital, Antwerp, Belgium
| | - Paul Van de Heyning
- Faculty of Medicine and Health Sciences, University of Antwerp, Antwerp, Belgium.,Department of Otorhinolaryngology and Head and Neck Surgery, Antwerp University Hospital, Antwerp, Belgium
| | - Angélica Pérez Fornos
- Service of Otorhinolaryngology Head and Neck Surgery, Department of Clinical Neurosciences, Geneva University Hospitals, Geneva, Switzerland
| | - Nils Guinand
- Service of Otorhinolaryngology Head and Neck Surgery, Department of Clinical Neurosciences, Geneva University Hospitals, Geneva, Switzerland
| | - Marc J W Lammers
- Faculty of Medicine and Health Sciences, University of Antwerp, Antwerp, Belgium.,Department of Otorhinolaryngology and Head and Neck Surgery, Antwerp University Hospital, Antwerp, Belgium
| | - Vincent Van Rompaey
- Faculty of Medicine and Health Sciences, University of Antwerp, Antwerp, Belgium.,Department of Otorhinolaryngology and Head and Neck Surgery, Antwerp University Hospital, Antwerp, Belgium
| |
Collapse
|
6
|
Thurley K. Naturalistic neuroscience and virtual reality. Front Syst Neurosci 2022; 16:896251. [PMID: 36467978 PMCID: PMC9712202 DOI: 10.3389/fnsys.2022.896251] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2022] [Accepted: 10/31/2022] [Indexed: 04/04/2024] Open
Abstract
Virtual reality (VR) is one of the techniques that became particularly popular in neuroscience over the past few decades. VR experiments feature a closed-loop between sensory stimulation and behavior. Participants interact with the stimuli and not just passively perceive them. Several senses can be stimulated at once, large-scale environments can be simulated as well as social interactions. All of this makes VR experiences more natural than those in traditional lab paradigms. Compared to the situation in field research, a VR simulation is highly controllable and reproducible, as required of a laboratory technique used in the search for neural correlates of perception and behavior. VR is therefore considered a middle ground between ecological validity and experimental control. In this review, I explore the potential of VR in eliciting naturalistic perception and behavior in humans and non-human animals. In this context, I give an overview of recent virtual reality approaches used in neuroscientific research.
Collapse
Affiliation(s)
- Kay Thurley
- Faculty of Biology, Ludwig-Maximilians-Universität München, Munich, Germany
- Bernstein Center for Computational Neuroscience Munich, Munich, Germany
| |
Collapse
|
7
|
Gaveau V, Coudert A, Salemme R, Koun E, Desoche C, Truy E, Farnè A, Pavani F. Benefits of active listening during 3D sound localization. Exp Brain Res 2022; 240:2817-2833. [PMID: 36071210 PMCID: PMC9587935 DOI: 10.1007/s00221-022-06456-x] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2022] [Accepted: 08/28/2022] [Indexed: 11/29/2022]
Abstract
In everyday life, sound localization entails more than just the extraction and processing of auditory cues. When determining sound position in three dimensions, the brain also considers the available visual information (e.g., visual cues to sound position) and resolves perceptual ambiguities through active listening behavior (e.g., spontaneous head movements while listening). Here, we examined to what extent spontaneous head movements improve sound localization in 3D—azimuth, elevation, and depth—by comparing static vs. active listening postures. To this aim, we developed a novel approach to sound localization based on sounds delivered in the environment, brought into alignment thanks to a VR system. Our system proved effective for the delivery of sounds at predetermined and repeatable positions in 3D space, without imposing a physically constrained posture, and with minimal training. In addition, it allowed measuring participant behavior (hand, head and eye position) in real time. We report that active listening improved 3D sound localization, primarily by ameliorating accuracy and variability of responses in azimuth and elevation. The more participants made spontaneous head movements, the better was their 3D sound localization performance. Thus, we provide proof of concept of a novel approach to the study of spatial hearing, with potentials for clinical and industrial applications.
Collapse
Affiliation(s)
- V Gaveau
- Integrative Multisensory Perception Action & Cognition Team-ImpAct, Lyon Neuroscience Research Center, INSERM U1028, CNRS U5292, 16 Av. Doyen Lépine, BRON cedex, 69500, Lyon, France. .,University of Lyon 1, Lyon, France.
| | - A Coudert
- Integrative Multisensory Perception Action & Cognition Team-ImpAct, Lyon Neuroscience Research Center, INSERM U1028, CNRS U5292, 16 Av. Doyen Lépine, BRON cedex, 69500, Lyon, France.,University of Lyon 1, Lyon, France.,ENT Departments, Hôpital Femme-Mère-Enfant and Edouard Herriot University Hospitals, Lyon, France
| | - R Salemme
- Integrative Multisensory Perception Action & Cognition Team-ImpAct, Lyon Neuroscience Research Center, INSERM U1028, CNRS U5292, 16 Av. Doyen Lépine, BRON cedex, 69500, Lyon, France.,University of Lyon 1, Lyon, France.,Neuro-immersion, Lyon, France
| | - E Koun
- Integrative Multisensory Perception Action & Cognition Team-ImpAct, Lyon Neuroscience Research Center, INSERM U1028, CNRS U5292, 16 Av. Doyen Lépine, BRON cedex, 69500, Lyon, France.,University of Lyon 1, Lyon, France
| | - C Desoche
- Integrative Multisensory Perception Action & Cognition Team-ImpAct, Lyon Neuroscience Research Center, INSERM U1028, CNRS U5292, 16 Av. Doyen Lépine, BRON cedex, 69500, Lyon, France.,University of Lyon 1, Lyon, France.,Neuro-immersion, Lyon, France
| | - E Truy
- Integrative Multisensory Perception Action & Cognition Team-ImpAct, Lyon Neuroscience Research Center, INSERM U1028, CNRS U5292, 16 Av. Doyen Lépine, BRON cedex, 69500, Lyon, France.,University of Lyon 1, Lyon, France.,ENT Departments, Hôpital Femme-Mère-Enfant and Edouard Herriot University Hospitals, Lyon, France
| | - A Farnè
- Integrative Multisensory Perception Action & Cognition Team-ImpAct, Lyon Neuroscience Research Center, INSERM U1028, CNRS U5292, 16 Av. Doyen Lépine, BRON cedex, 69500, Lyon, France.,University of Lyon 1, Lyon, France.,Neuro-immersion, Lyon, France
| | - F Pavani
- Integrative Multisensory Perception Action & Cognition Team-ImpAct, Lyon Neuroscience Research Center, INSERM U1028, CNRS U5292, 16 Av. Doyen Lépine, BRON cedex, 69500, Lyon, France.,University of Lyon 1, Lyon, France.,Center for Mind/Brain Sciences - CIMeC, University of Trento, Rovereto, Italy
| |
Collapse
|
8
|
Zhang S, Liu D, Tian E, Wang J, Guo Z, Kong W. Central vestibular dysfunction: don't forget vestibular rehabilitation. Expert Rev Neurother 2022; 22:669-680. [PMID: 35912850 DOI: 10.1080/14737175.2022.2106129] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
INTRODUCTION Vestibular rehabilitation (VR) is now a subject of active studies and has been shown to be effective for multiple vestibular disorders, peripheral or central. VR is a physical therapy that helps train the central nervous system to compensate for vestibular dysfunction. There is moderate to strong evidence that VR is safe and effective for the management of peripheral vestibular dysfunction. Nonetheless, the studies on how VR works on central vestibular dysfunction remains scanty. AREAS COVERED This article addressed the rehabilitation strategies and possible mechanisms, including how central vestibular function might improve upon rehabilitation. In addition, it provides some examples concerning the effect of VR on central vestibular dysfunction. EXPERT OPINION VR works on the vestibular system through repetition of specific physical exercises that activate central neuroplastic mechanisms to achieve adaptive compensation of the impaired functions. VR has become a mainstay in the management of patients with dizziness and balance dysfunction. Individualized VR programs are a safe and effective treatment option for a large percentage of patients with central vestibular disease reporting imbalance and dizziness. Exploration of various treatment strategies and possible mechanisms will help develop the best and personalized VR treatment for patients with central vestibular dysfunction.
Collapse
Affiliation(s)
- Sulin Zhang
- Department of Otorhinolaryngology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, 430022, China.,Institute of Otorhinolaryngology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, 430022, China
| | - Dan Liu
- Department of Otorhinolaryngology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, 430022, China
| | - E Tian
- Department of Otorhinolaryngology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, 430022, China
| | - Jun Wang
- Department of Otorhinolaryngology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, 430022, China
| | - Zhaoqi Guo
- Department of Otorhinolaryngology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, 430022, China
| | - Weijia Kong
- Department of Otorhinolaryngology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, 430022, China.,Institute of Otorhinolaryngology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, 430022, China.,Key Laboratory of Neurological Disorders of Education Ministry, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430022, Hubei, China
| |
Collapse
|
9
|
Shayman CS, Peterka RJ, Gallun FJ, Oh Y, Chang NYN, Hullar TE. Frequency-dependent integration of auditory and vestibular cues for self-motion perception. J Neurophysiol 2020; 123:936-944. [PMID: 31940239 DOI: 10.1152/jn.00307.2019] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022] Open
Abstract
Recent evidence has shown that auditory information may be used to improve postural stability, spatial orientation, navigation, and gait, suggesting an auditory component of self-motion perception. To determine how auditory and other sensory cues integrate for self-motion perception, we measured motion perception during yaw rotations of the body and the auditory environment. Psychophysical thresholds in humans were measured over a range of frequencies (0.1-1.0 Hz) during self-rotation without spatial auditory stimuli, rotation of a sound source around a stationary listener, and self-rotation in the presence of an earth-fixed sound source. Unisensory perceptual thresholds and the combined multisensory thresholds were found to be frequency dependent. Auditory thresholds were better at lower frequencies, and vestibular thresholds were better at higher frequencies. Expressed in terms of peak angular velocity, multisensory vestibular and auditory thresholds ranged from 0.39°/s at 0.1 Hz to 0.95°/s at 1.0 Hz and were significantly better over low frequencies than either the auditory-only (0.54°/s to 2.42°/s at 0.1 and 1.0 Hz, respectively) or vestibular-only (2.00°/s to 0.75°/s at 0.1 and 1.0 Hz, respectively) unisensory conditions. Monaurally presented auditory cues were less effective than binaural cues in lowering multisensory thresholds. Frequency-independent thresholds were derived, assuming that vestibular thresholds depended on a weighted combination of velocity and acceleration cues, whereas auditory thresholds depended on displacement and velocity cues. These results elucidate fundamental mechanisms for the contribution of audition to balance and help explain previous findings, indicating its significance in tasks requiring self-orientation.NEW & NOTEWORTHY Auditory information can be integrated with visual, proprioceptive, and vestibular signals to improve balance, orientation, and gait, but this process is poorly understood. Here, we show that auditory cues significantly improve sensitivity to self-motion perception below 0.5 Hz, whereas vestibular cues contribute more at higher frequencies. Motion thresholds are determined by a weighted combination of displacement, velocity, and acceleration information. These findings may help understand and treat imbalance, particularly in people with sensory deficits.
Collapse
Affiliation(s)
- Corey S Shayman
- Department of Otolaryngology-Head and Neck Surgery, Oregon Health and Science University, Portland, Oregon.,School of Medicine, University of Utah, Salt Lake City, Utah
| | - Robert J Peterka
- Department of Neurology, Oregon Health and Science University, Portland, Oregon.,National Center for Rehabilitative Auditory Research-VA Portland Health Care System, Portland, Oregon
| | - Frederick J Gallun
- National Center for Rehabilitative Auditory Research-VA Portland Health Care System, Portland, Oregon.,Oregon Hearing Research Center, Department of Otolaryngology-Head and Neck Surgery, Oregon Health and Science University, Portland, Oregon
| | - Yonghee Oh
- Department of Speech, Language, and Hearing Sciences, University of Florida, Gainesville, Florida
| | - Nai-Yuan N Chang
- Department of Preventive and Restorative Dental Sciences-Division of Bioengineering and Biomaterials, University of California, San Francisco, San Francisco, California
| | - Timothy E Hullar
- Department of Otolaryngology-Head and Neck Surgery, Oregon Health and Science University, Portland, Oregon.,Department of Neurology, Oregon Health and Science University, Portland, Oregon.,National Center for Rehabilitative Auditory Research-VA Portland Health Care System, Portland, Oregon
| |
Collapse
|
10
|
Moroz M, Garzorz I, Folmer E, MacNeilage P. Sensitivity to Visual Speed Modulation in Head-Mounted Displays Depends on Fixation. DISPLAYS 2019; 58:12-19. [PMID: 32863474 PMCID: PMC7454227 DOI: 10.1016/j.displa.2018.09.001] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
A primary cause of simulator sickness in head-mounted displays (HMDs) is conflict between the visual scene displayed to the user and the visual scene expected by the brain when the user's head is in motion. It is useful to measure perceptual sensitivity to visual speed modulation in HMDs because conditions that minimize this sensitivity may prove less likely to elicit simulator sickness. In prior research, we measured sensitivity to visual gain modulation during slow, passive, full-body yaw rotations and observed that sensitivity was reduced when subjects fixated a head-fixed target compared with when they fixated a scene-fixed target. In the current study, we investigated whether this pattern of results persists when (1) movements are faster, active head turns, and (2) visual stimuli are presented on an HMD rather than on a monitor. Subjects wore an Oculus Rift CV1 HMD and viewed a 3D scene of white points on a black background. On each trial, subjects moved their head from a central position to face a 15° eccentric target. During the head movement they fixated a point that was either head-fixed or scene-fixed, depending on condition. They then reported if the visual scene motion was too fast or too slow. Visual speed on subsequent trials was modulated according to a staircase procedure to find the speed increment that was just noticeable. Sensitivity to speed modulation during active head movement was reduced during head-fixed fixation, similar to what we observed during passive whole-body rotation. We conclude that fixation of a head-fixed target is an effective way to reduce sensitivity to visual speed modulation in HMDs, and may also be an effective strategy to reduce susceptibility to simulator sickness.
Collapse
Affiliation(s)
- Matthew Moroz
- Department of Psychology, University of Nevada, Reno
| | - Isabelle Garzorz
- Graduate School of Systemic Neurosciences, Ludwig-Maximilians-Universität München
| | - Eelke Folmer
- Department of Computer Science, University of Nevada, Reno
| | | |
Collapse
|
11
|
Garzorz IT, Freeman TCA, Ernst MO, MacNeilage PR. Insufficient compensation for self-motion during perception of object speed: The vestibular Aubert-Fleischl phenomenon. J Vis 2018; 18:9. [DOI: 10.1167/18.13.9] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Isabelle T. Garzorz
- German Center for Vertigo and Balance Disorders (DSGZ), University Hospital of Munich, Ludwig Maximilian University, Munich, Germany
- Graduate School of Systemic Neurosciences (GSN), Ludwig Maximilian University, Planegg-Martinsried, Germany
| | | | - Marc O. Ernst
- Applied Cognitive Psychology, Faculty for Computer Science, Engineering, and Psychology, Ulm University, Ulm, Germany
| | - Paul R. MacNeilage
- German Center for Vertigo and Balance Disorders (DSGZ), University Hospital of Munich, Ludwig Maximilian University, Munich, Germany
- Present address: Department of Psychology, Cognitive and Brain Sciences, University of Nevada, Reno, NV, USA
| |
Collapse
|
12
|
Wu C, Shore SE. Multisensory activation of ventral cochlear nucleus D-stellate cells modulates dorsal cochlear nucleus principal cell spatial coding. J Physiol 2018; 596:4537-4548. [PMID: 30074618 DOI: 10.1113/jp276280] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2018] [Accepted: 08/02/2018] [Indexed: 01/27/2023] Open
Abstract
KEY POINTS Dorsal cochlear nucleus fusiform cells receive spectrally relevant auditory input for sound localization. Fusiform cells integrate auditory with other multisensory inputs. Here we elucidate how somatosensory and vestibular stimulation modify the fusiform cell spatial code through activation of an inhibitory interneuron: the ventral cochlear nucleus D-stellate cell. These results suggests that multisensory cues interact early in an ascending sensory pathway to serve an essential function. ABSTRACT In the cochlear nucleus (CN), the first central site for coding sound location, numerous multisensory projections and their modulatory effects have been reported. However, multisensory influences on sound location processing in the CN remain unknown. The principal output neurons of the dorsal CN, fusiform cells, encode spatial information through frequency-selective responses to direction-dependent spectral features. Here, single-unit recordings from the guinea pig CN revealed transient alterations by somatosensory and vestibular stimulation in fusiform cell spatial coding. Changes in fusiform cell spectral sensitivity correlated with multisensory modulation of ventral CN D-stellate cell responses, which provide direct, wideband inhibition to fusiform cells. These results suggest that multisensory inputs contribute to spatial coding in DCN fusiform cells via an inhibitory interneuron, the D-stellate cell. This early multisensory integration circuit likely confers important consequences on perceptual organization downstream.
Collapse
Affiliation(s)
- Calvin Wu
- Kresge Hearing Research Institute, Department of Otolaryngology, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Susan E Shore
- Kresge Hearing Research Institute, Department of Otolaryngology, University of Michigan, Ann Arbor, MI, 48109, USA
| |
Collapse
|
13
|
Abstract
By moving sounds around the head and asking listeners to report which ones moved more, it was found that sound sources at the side of a listener must move at least twice as much as ones in front to be judged as moving the same amount. A relative expansion of space in the front and compression at the side has consequences for spatial perception of moving sounds by both static and moving listeners. An accompanying prediction that the apparent location of static sound sources ought to also be distorted agrees with previous work and suggests that this is a general perceptual phenomenon that is not limited to moving signals. A mathematical model that mimics the measured expansion of space can be used to successfully capture several previous findings in spatial auditory perception. The inverse of this function could be used alongside individualized head-related transfer functions and motion tracking to produce hyperstable virtual acoustic environments.
Collapse
Affiliation(s)
- W Owen Brimijoin
- 1 MRC/CSO Institute of Hearing Research (Scottish Section), Glasgow Royal Infirmary, UK
| |
Collapse
|
14
|
Wirth AM, Frank SM, Greenlee MW, Beer AL. White Matter Connectivity of the Visual-Vestibular Cortex Examined by Diffusion-Weighted Imaging. Brain Connect 2018; 8:235-244. [PMID: 29571264 DOI: 10.1089/brain.2017.0544] [Citation(s) in RCA: 20] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022] Open
Abstract
The parieto-insular vestibular cortex (PIVC) and the posterior insular cortex (PIC) are key regions of the cortical vestibular network, both located in the midposterior section of the lateral sulcus. Little is known about the structural connectivity pattern of these areas. We used probabilistic fiber tracking based on diffusion-weighted magnetic resonance imaging (MRI) and compared the ipsilateral connectivity of PIVC and PIC. Seed areas for the tracking algorithm were identified in each brain by functional MRI activity during caloric and visual motion stimulation, respectively. Cortical track terminations were investigated by a surface-based approach. Both PIVC and PIC shared ipsilateral connections to the insular/lateral sulcus, superior temporal cortex, and inferior frontal gyrus. However, PIVC showed significantly more connections than PIC with the anterior insula and Heschl's gyrus in both hemispheres and with the precuneus, intraparietal sulcus, and posterior callosum of the right hemisphere. In contrast, PIC connectivity was more pronounced with the supramarginal gyrus and superior temporal sulcus. Subcortical tracks were examined by a region-of-interest-based approach, which was validated on cortico-thalamic motor tracts. Both PIVC and PIC were connected with lateral nuclei of the thalamus and the basal ganglia (primarily putamen). PIVC tracks but not PIC tracks showed a right-hemispheric lateralization in cortical and subcortical connectivity. Overall, these results suggest that human PIVC and PIC share cortical and even subcortical connections. Nevertheless, they also differ in their primary connectivity pattern: PIVC is linked with posterior parietal and inferior frontal cortex, whereas PIC is linked with superior temporal and inferior parietal cortex.
Collapse
Affiliation(s)
- Anna M Wirth
- 1 Institute of Psychology, University of Regensburg , Regensburg, Germany .,2 Department of Neurology, University Hospital of Regensburg , Regensburg, Germany
| | - Sebastian M Frank
- 1 Institute of Psychology, University of Regensburg , Regensburg, Germany .,3 Department of Psychological and Brain Sciences, Dartmouth College , Hanover, New Hampshire.,4 Department of Cognitive, Linguistic, and Psychological Sciences, Brown University , Providence, Rhode Island
| | - Mark W Greenlee
- 1 Institute of Psychology, University of Regensburg , Regensburg, Germany
| | - Anton L Beer
- 1 Institute of Psychology, University of Regensburg , Regensburg, Germany .,5 Institute of Psychology, Friedrich-Alexander-University Erlangen-Nürnberg , Erlangen, Germany
| |
Collapse
|
15
|
Auditory motion parallax. Proc Natl Acad Sci U S A 2018; 115:3998-4000. [PMID: 29622682 DOI: 10.1073/pnas.1803547115] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
|