1
|
Kim H, Kim JS, Chung CK. Visual Mental Imagery and Neural Dynamics of Sensory Substitution in the Blindfolded Subjects. Neuroimage 2024; 295:120621. [PMID: 38797383 DOI: 10.1016/j.neuroimage.2024.120621] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2023] [Revised: 04/16/2024] [Accepted: 04/18/2024] [Indexed: 05/29/2024] Open
Abstract
Although one can recognize the environment by soundscape substituting vision to auditory signal, whether subjects could perceive the soundscape as visual or visual-like sensation has been questioned. In this study, we investigated hierarchical process to elucidate the recruitment mechanism of visual areas by soundscape stimuli in blindfolded subjects. Twenty-two healthy subjects were repeatedly trained to recognize soundscape stimuli converted by visual shape information of letters. An effective connectivity method called dynamic causal modeling (DCM) was employed to reveal how the brain was hierarchically organized to recognize soundscape stimuli. The visual mental imagery model generated cortical source signals of five regions of interest better than auditory bottom-up, cross-modal perception, and mixed models. Spectral couplings between brain areas in the visual mental imagery model were analyzed. While within-frequency coupling is apparent in bottom-up processing where sensory information is transmitted, cross-frequency coupling is prominent in top-down processing, corresponding to the expectation and interpretation of information. Sensory substitution in the brain of blindfolded subjects derived visual mental imagery by combining bottom-up and top-down processing.
Collapse
Affiliation(s)
- HongJune Kim
- Dept. of Brain and Cognitive Sciences, Seoul National University, Seoul, Republic of Korea; Clinical Research Institute, Konkuk University Medical Center Seoul, Republic of Korea
| | - June Sic Kim
- Clinical Research Institute, Konkuk University Medical Center Seoul, Republic of Korea; Research Institute of Biomedical Science & Technology, Konkuk University, Seoul, Republic of Korea.
| | - Chun Kee Chung
- Dept. of Brain and Cognitive Sciences, Seoul National University, Seoul, Republic of Korea; Interdisciplinary Program in Neuroscience, Seoul National University, Seoul, Republic of Korea; Dept. of Neurosurgery, Seoul National University Hospital, Seoul, Republic of Korea; Neuroscience Research Institute, Seoul National University Medical Research Center, Seoul, Republic of Korea
| |
Collapse
|
2
|
Wang F, Zhou T, Wang P, Zhang Y, Jiang J. Study of vision-related resting-state activity in suprasellar tumor patients with postoperative visual damage. Brain Behav 2024; 14:e3462. [PMID: 38468484 PMCID: PMC10928331 DOI: 10.1002/brb3.3462] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Revised: 02/08/2024] [Accepted: 02/14/2024] [Indexed: 03/13/2024] Open
Abstract
INTRODUCTION The objective of this study was to investigate changes in vision-related resting-state activity in patients with suprasellar tumors (ST) who experienced vision deterioration after surgery. METHODS Twelve patients with ST and vision deterioration after surgery were included in the study. Resting-state functional connectivity (FC) was compared before and after surgery using a seed-based analysis with a priori specified regions of interest (ROIs) within the visual areas. The differences between the two groups were identified using a paired t-test. RESULTS The data showed a decrease in FC within and between the dorsal and ventral pathways, as well as in the third pathway in ST patients. The middle temporal visual cortex (MT+) showed a decreased FC with more regions than other visual ROIs. The data also revealed an increase in FC between the visual ROIs and higher-order cortex. The superior frontal gyrus/BA8 showed an increased FC with more ROIs than other high-order regions, and the hOC4d was involved in an increased FC with more high-order regions than other ROIs. CONCLUSIONS The study results indicate significant neural reorganization in the vision-related cortex of ST patients with postoperative vision damage. Most subareas within the visual cortex showed remarkable neural dysfunction, and some highe-order cortex may be primarily involved in top-down control of the subareas within the visual cortex. The hot zones may arise in the processing of "top-down" influence.
Collapse
Affiliation(s)
- Fuyu Wang
- Department of NeurosurgeryThe First Medical Center, Chinese PLA General HospitalBeijingChina
| | - Tao Zhou
- Department of NeurosurgeryThe First Medical Center, Chinese PLA General HospitalBeijingChina
| | - Peng Wang
- Department of NeurosurgeryThe First Medical Center, Chinese PLA General HospitalBeijingChina
| | - Yanyang Zhang
- Department of NeurosurgeryThe First Medical Center, Chinese PLA General HospitalBeijingChina
| | - Jinli Jiang
- Department of NeurosurgeryHainan Hospital of Chinese PLA General HospitalSanyaChina
| |
Collapse
|
3
|
Zhan L, Gao Y, Huang L, Zhang H, Huang G, Wang Y, Sun J, Xie Z, Li M, Jia X, Cheng L, Yu Y. Brain functional connectivity alterations of Wernicke's area in individuals with autism spectrum conditions in multi-frequency bands: A mega-analysis. Heliyon 2024; 10:e26198. [PMID: 38404781 PMCID: PMC10884452 DOI: 10.1016/j.heliyon.2024.e26198] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2023] [Revised: 02/05/2024] [Accepted: 02/08/2024] [Indexed: 02/27/2024] Open
Abstract
Characterized by severe deficits in communication, most individuals with autism spectrum conditions (ASC) experience significant language dysfunctions, thereby impacting their overall quality of life. Wernicke's area, a classical and traditional brain region associated with language processing, plays a substantial role in the manifestation of language impairments. The current study carried out a mega-analysis to attain a comprehensive understanding of the neural mechanisms underpinning ASC, particularly in the context of language processing. The study employed the Autism Brain Image Data Exchange (ABIDE) dataset, which encompasses data from 443 typically developing (TD) individuals and 362 individuals with ASC. The objective was to detect abnormal functional connectivity (FC) between Wernicke's area and other language-related functional regions, and identify frequency-specific altered FC using Wernicke's area as the seed region in ASC. The findings revealed that increased FC in individuals with ASC has frequency-specific characteristics. Further, in the conventional frequency band (0.01-0.08 Hz), individuals with ASC exhibited increased FC between Wernicke's area and the right thalamus compared with TD individuals. In the slow-5 frequency band (0.01-0.027 Hz), increased FC values were observed in the left cerebellum Crus II and the right lenticular nucleus, pallidum. These results provide novel insights into the potential neural mechanisms underlying communication deficits in ASC from the perspective of language impairments.
Collapse
Affiliation(s)
- Linlin Zhan
- School of Western Studies, Heilongjiang University, Harbin, China
| | - Yanyan Gao
- College of Teacher Education, Zhejiang Normal University, Jinhua, China
| | - Lina Huang
- Department of Radiology, Changshu No. 2 People's Hospital, The Affiliated Changshu Hospital of Xuzhou Medical University, Changshu, Jiangsu, China
| | - Hongqiang Zhang
- Department of Radiology, Changshu No. 2 People's Hospital, The Affiliated Changshu Hospital of Xuzhou Medical University, Changshu, Jiangsu, China
| | - Guofeng Huang
- School of Information and Electronics Technology, Jiamusi University, Jiamusi, China
| | - Yadan Wang
- School of Information and Electronics Technology, Jiamusi University, Jiamusi, China
| | - Jiawei Sun
- School of Information and Electronics Technology, Jiamusi University, Jiamusi, China
| | - Zhou Xie
- School of Information and Electronics Technology, Jiamusi University, Jiamusi, China
| | - Mengting Li
- College of Teacher Education, Zhejiang Normal University, Jinhua, China
| | - Xize Jia
- College of Teacher Education, Zhejiang Normal University, Jinhua, China
| | - Lulu Cheng
- School of Foreign Studies, China University of Petroleum (East China), Qingdao, China
- Shanghai Center for Research in English Language Education, Shanghai International Studies University, Shanghai, China
| | - Yang Yu
- Psychiatry Department, The Second Affiliated Hospital Zhejiang University School of Medicine, Zhejiang, Hangzhou, China
| |
Collapse
|
4
|
Bang JW, Hamilton-Fletcher G, Chan KC. Visual Plasticity in Adulthood: Perspectives from Hebbian and Homeostatic Plasticity. Neuroscientist 2023; 29:117-138. [PMID: 34382456 PMCID: PMC9356772 DOI: 10.1177/10738584211037619] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
Abstract
The visual system retains profound plastic potential in adulthood. In the current review, we summarize the evidence of preserved plasticity in the adult visual system during visual perceptual learning as well as both monocular and binocular visual deprivation. In each condition, we discuss how such evidence reflects two major cellular mechanisms of plasticity: Hebbian and homeostatic processes. We focus on how these two mechanisms work together to shape plasticity in the visual system. In addition, we discuss how these two mechanisms could be further revealed in future studies investigating cross-modal plasticity in the visual system.
Collapse
Affiliation(s)
- Ji Won Bang
- Department of Ophthalmology, NYU Grossman School of Medicine, NYU Langone Health, New York University, New York, NY, USA
| | - Giles Hamilton-Fletcher
- Department of Ophthalmology, NYU Grossman School of Medicine, NYU Langone Health, New York University, New York, NY, USA
| | - Kevin C. Chan
- Department of Ophthalmology, NYU Grossman School of Medicine, NYU Langone Health, New York University, New York, NY, USA
- Department of Radiology, NYU Grossman School of Medicine, NYU Langone Health, New York University, New York, NY, USA
- Neuroscience Institute, NYU Grossman School of Medicine, NYU Langone Health, New York University, New York, NY, USA
- Center for Neural Science, College of Arts and Science, New York University, New York, NY, USA
| |
Collapse
|
5
|
Bang JW, Chan RW, Parra C, Murphy MC, Schuman JS, Nau AC, Chan KC. Diverging patterns of plasticity in the nucleus basalis of Meynert in early- and late-onset blindness. Brain Commun 2023; 5:fcad119. [PMID: 37101831 PMCID: PMC10123399 DOI: 10.1093/braincomms/fcad119] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2022] [Revised: 02/01/2023] [Accepted: 04/07/2023] [Indexed: 04/28/2023] Open
Abstract
Plasticity in the brain is impacted by an individual's age at the onset of the blindness. However, what drives the varying degrees of plasticity remains largely unclear. One possible explanation attributes the mechanisms for the differing levels of plasticity to the cholinergic signals originating in the nucleus basalis of Meynert. This explanation is based on the fact that the nucleus basalis of Meynert can modulate cortical processes such as plasticity and sensory encoding through its widespread cholinergic projections. Nevertheless, there is no direct evidence indicating that the nucleus basalis of Meynert undergoes plastic changes following blindness. Therefore, using multiparametric magnetic resonance imaging, we examined if the structural and functional properties of the nucleus basalis of Meynert differ between early blind, late blind and sighted individuals. We observed that early and late blind individuals had a preserved volumetric size and cerebrovascular reactivity in the nucleus basalis of Meynert. However, we observed a reduction in the directionality of water diffusion in both early and late blind individuals compared to sighted individuals. Notably, the nucleus basalis of Meynert presented diverging patterns of functional connectivity between early and late blind individuals. This functional connectivity was enhanced at both global and local (visual, language and default-mode networks) levels in the early blind individuals, but there were little-to-no changes in the late blind individuals when compared to sighted controls. Furthermore, the age at onset of blindness predicted both global and local functional connectivity. These results suggest that upon reduced directionality of water diffusion in the nucleus basalis of Meynert, cholinergic influence may be stronger for the early blind compared to the late blind individuals. Our findings are important to unravelling why early blind individuals present stronger and more widespread cross-modal plasticity compared to late blind individuals.
Collapse
Affiliation(s)
- Ji Won Bang
- Correspondence may also be addressed to: Ji Won Bang, PhD.
| | - Russell W Chan
- Department of Ophthalmology, NYU Grossman School of Medicine, NYU Langone Health, New York University, New York, NY 10017, USA
| | - Carlos Parra
- Department of Ophthalmology, NYU Grossman School of Medicine, NYU Langone Health, New York University, New York, NY 10017, USA
| | - Matthew C Murphy
- Department of Radiology, Mayo Clinic, Rochester, MN 55905, USA
- Department of Ophthalmology, School of Medicine, University of Pittsburgh, Pittsburgh, PA 15213, USA
| | - Joel S Schuman
- Department of Ophthalmology, NYU Grossman School of Medicine, NYU Langone Health, New York University, New York, NY 10017, USA
- Neuroscience Institute, NYU Grossman School of Medicine, NYU Langone Health, New York University, New York, NY 10016, USA
- Center for Neural Science, College of Arts and Science, New York University, New York, NY 10003, USA
- Department of Biomedical Engineering, Tandon School of Engineering, New York University, New York, NY 11201, USA
| | - Amy C Nau
- Department of Ophthalmology, School of Medicine, University of Pittsburgh, Pittsburgh, PA 15213, USA
- Korb and Associates, Boston, MA 02215, USA
| | - Kevin C Chan
- Correspondence to: Kevin C. Chan, PhD, Departments of Ophthalmology and Radiology, NYU Grossman School of Medicine, NYU Langone Health, New York University. 222 E 41st Street, Room 362, New York, NY 10017, USA.
| |
Collapse
|
6
|
Nadvar N, Stiles N, Choupan J, Patel V, Ameri H, Shi Y, Liu Z, Jonides J, Weiland J. Sight restoration reverses blindness-induced cross-modal functional connectivity changes between the visual and somatosensory cortex at rest. Front Neurosci 2022; 16:902866. [PMID: 36213743 PMCID: PMC9539921 DOI: 10.3389/fnins.2022.902866] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2022] [Accepted: 08/29/2022] [Indexed: 11/28/2022] Open
Abstract
Resting-state functional connectivity (rsFC) has been used to assess the effect of vision loss on brain plasticity. With the emergence of vision restoration therapies, rsFC analysis provides a means to assess the functional changes following sight restoration. Our study demonstrates a partial reversal of blindness-induced rsFC changes in Argus II retinal prosthesis patients compared to those with severe retinitis pigmentosa (RP). For 10 healthy control (HC), 10 RP, and 7 Argus II subjects, four runs of resting-state functional magnetic resonance imaging (fMRI) per subject were included in our study. rsFC maps were created with the primary visual cortex (V1) as the seed. The rsFC group contrast maps for RP > HC, Argus II > RP, and Argus II > HC revealed regions in the post-central gyrus (PostCG) with significant reduction, significant enhancement, and no significant changes in rsFC to V1 for the three contrasts, respectively. These findings were also confirmed by the respective V1-PostCG ROI-ROI analyses between test groups. Finally, the extent of significant rsFC to V1 in the PostCG region was 5,961 in HC, 0 in RP, and 842 mm3 in Argus II groups. Our results showed a reduction of visual-somatosensory rsFC following blindness, consistent with previous findings. This connectivity was enhanced following sight recovery with Argus II, representing a reversal of changes in cross-modal functional plasticity as manifested during rest, despite the rudimentary vision obtained by Argus II patients. Future investigation with a larger number of test subjects into this rare condition can further unveil the profound ability of our brain to reorganize in response to vision restoration.
Collapse
Affiliation(s)
- Negin Nadvar
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States
| | - Noelle Stiles
- Laboratory of Neuro Imaging, USC Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of USC, University of Southern California, Los Angeles, CA, United States
| | - Jeiran Choupan
- Laboratory of Neuro Imaging, USC Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of USC, University of Southern California, Los Angeles, CA, United States
| | - Vivek Patel
- Irvine School of Medicine, The University of California, Irvine, Irvine, CA, United States
| | - Hossein Ameri
- Laboratory of Neuro Imaging, USC Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of USC, University of Southern California, Los Angeles, CA, United States
| | - Yonggang Shi
- Laboratory of Neuro Imaging, USC Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of USC, University of Southern California, Los Angeles, CA, United States
| | - Zhongming Liu
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States
- Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI, United States
| | - John Jonides
- Department of Psychology, University of Michigan, Ann Arbor, MI, United States
| | - James Weiland
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States
- Department of Ophthalmology and Visual Sciences, University of Michigan, Ann Arbor, MI, United States
| |
Collapse
|
7
|
Guerreiro MJS, Kekunnaya R, Röder B. Top-down modulation of visual cortical processing after transient congenital blindness. Neuropsychologia 2022; 174:108338. [PMID: 35931134 DOI: 10.1016/j.neuropsychologia.2022.108338] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2022] [Revised: 07/18/2022] [Accepted: 07/19/2022] [Indexed: 10/16/2022]
Abstract
Early visual experience has been shown to be critical for the development of visual and multisensory functions; however, its impact on functional brain organization remains largely unexplored. Here, we therefore investigated the effect of early visual deprivation on top-down attentional modulation of visual cortical processing within the occipito-temporal cortex. Furthermore, we explored whether early visual deprivation may affect the extent to which typically visual, motion-selective area hMT responds to moving visual stimuli. Using functional magnetic resonance imaging, we compared cortical responses in area hMT and in the fusiform face area (FFA) to moving face stimuli - which were either task relevant or task irrelevant - relative to stationary face stimuli between cataract-reversal participants and normally sighted controls. Although both groups exhibited significantly stronger visual cortical responses in area hMT to moving stimuli than during the stationary baseline, the magnitude of this effect was significantly lower in the cataract-reversal group. In contrast, both groups exhibited significantly enhanced visual cortical responses in area hMT and in the FFA when moving face stimuli were task relevant compared to when they were task irrelevant, with no significant differences between groups in the magnitude of these effects. These results indicate that top-down attentional modulation of visual cortical processing in area hMT and FFA does not depend on early visual experience. Furthermore, the present results suggest that the functional specialization of area hMT for visual motion processing may be partially disrupted by early visual deprivation.
Collapse
Affiliation(s)
- Maria J S Guerreiro
- Biological Psychology and Neuropsychology, Institute for Psychology, University of Hamburg, Von-Melle-Park 11, D-20146, Hamburg, Germany; Biological Psychology, Department of Psychology, School of Medicine and Health Sciences, Carl von Ossietzky University of Oldenburg, Ammerländer Heerstr. 114-118, 26111, Oldenburg, Germany.
| | - Ramesh Kekunnaya
- Child Sight Institute, Jasti V. Ramanamma Children's Eye Care Center, Department of Pediatric Ophthalmology, Strabismus and Neuro-Ophthalmology, L. V. Prasad Eye Institute, Kallam Anji Reddy Campus, Hyderabad, 500034, Telengana, India
| | - Brigitte Röder
- Biological Psychology and Neuropsychology, Institute for Psychology, University of Hamburg, Von-Melle-Park 11, D-20146, Hamburg, Germany
| |
Collapse
|
8
|
Kang L, Wan C. Application of advanced magnetic resonance imaging in glaucoma: a narrative review. Quant Imaging Med Surg 2022; 12:2106-2128. [PMID: 35284278 PMCID: PMC8899967 DOI: 10.21037/qims-21-790] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2021] [Accepted: 11/26/2021] [Indexed: 04/02/2024]
Abstract
Glaucoma is a group of eye diseases characterized by progressive degeneration of the optic nerve head and retinal ganglion cells and corresponding visual field defects. In recent years, mounting evidence has shown that glaucoma-related damage may not be limited to the degeneration of retinal ganglion cells or the optic nerve head. The entire structure of the visual pathway may be degraded, and the degradation may even extend to some non-visual brain regions. We know that advanced morphological, functional, and metabolic magnetic resonance technologies provide a means to observe quantitatively and in real time the state of brain function. Advanced magnetic resonance imaging (MRI) techniques provide additional diagnostic markers for glaucoma, which are related to known potential histopathological changes. Many researchers in China and globally have conducted clinical and imaging studies on glaucoma. However, they are scattered, and we still need to systematically sort out the advanced MRI related to glaucoma. We reviewed literature published in any language and included all studies that were able to be translated into English from 1 January 1980 to 31 July 2021. Our literature search focused on emerging magnetic resonance neuroimaging techniques for the study of glaucoma. We then identified each functional area of the brain of glaucoma patients through the integration of anatomy, image, and function. The aim was to provide more information about the occurrence and development of glaucoma diseases. From the perspective of neuroimaging, our study provides a research basis to explain the possible mechanism of the occurrence and development of glaucoma. This knowledge gained from these techniques enables us to more clearly observe the damage glaucoma causes to the whole visual pathway. Our study provides new insights into glaucoma-induced changes to the brain. Our findings may enable the progress of these changes to be analyzed and inspire new neuroprotective therapeutic strategies for patients with glaucoma in the future.
Collapse
Affiliation(s)
- Longdan Kang
- Department of Ophthalmology, the First Hospital of China Medical University, Shenyang, China
| | | |
Collapse
|
9
|
Sims JR, Chen AM, Sun Z, Deng W, Colwell NA, Colbert MK, Zhu J, Sainulabdeen A, Faiq MA, Bang JW, Chan KC. Role of Structural, Metabolic, and Functional MRI in Monitoring Visual System Impairment and Recovery. J Magn Reson Imaging 2021; 54:1706-1729. [PMID: 33009710 PMCID: PMC8099039 DOI: 10.1002/jmri.27367] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2020] [Revised: 08/24/2020] [Accepted: 08/27/2020] [Indexed: 12/13/2022] Open
Abstract
The visual system, consisting of the eyes and the visual pathways of the brain, receives and interprets light from the environment so that we can perceive the world around us. A wide variety of disorders can affect human vision, ranging from ocular to neurologic to systemic in nature. While other noninvasive imaging techniques such as optical coherence tomography and ultrasound can image particular sections of the visual system, magnetic resonance imaging (MRI) offers high resolution without depth limitations. MRI also gives superior soft-tissue contrast throughout the entire pathway compared to computed tomography. By leveraging different imaging sequences, MRI is uniquely capable of unveiling the intricate processes of ocular anatomy, tissue physiology, and neurological function in the human visual system from the microscopic to macroscopic levels. In this review we discuss how structural, metabolic, and functional MRI can be used in the clinical assessment of normal and pathologic states in the anatomic structures of the visual system, including the eyes, optic nerves, optic chiasm, optic tracts, visual brain nuclei, optic radiations, and visual cortical areas. We detail a selection of recent clinical applications of MRI at each position along the visual pathways, including the evaluation of pathology, plasticity, and the potential for restoration, as well as its limitations and key areas of ongoing exploration. Our discussion of the current and future developments in MR ocular and neuroimaging highlights its potential impact on our ability to understand visual function in new detail and to improve our protection and treatment of anatomic structures that are integral to this fundamental sensory system. LEVEL OF EVIDENCE 3: TECHNICAL EFFICACY STAGE 3: .
Collapse
Affiliation(s)
- Jeffrey R. Sims
- Department of Ophthalmology, NYU Grossman School of Medicine, NYU Langone Health, New York University, New York, New York, USA
| | - Anna M. Chen
- Department of Ophthalmology, NYU Grossman School of Medicine, NYU Langone Health, New York University, New York, New York, USA
- Sackler Institute of Graduate Biomedical Sciences, NYU Grossman School of Medicine, NYU Langone Health, New York University, New York, New York, USA
| | - Zhe Sun
- Department of Ophthalmology, NYU Grossman School of Medicine, NYU Langone Health, New York University, New York, New York, USA
- Sackler Institute of Graduate Biomedical Sciences, NYU Grossman School of Medicine, NYU Langone Health, New York University, New York, New York, USA
| | - Wenyu Deng
- Department of Ophthalmology, NYU Grossman School of Medicine, NYU Langone Health, New York University, New York, New York, USA
| | - Nicole A. Colwell
- Department of Ophthalmology, NYU Grossman School of Medicine, NYU Langone Health, New York University, New York, New York, USA
| | - Max K. Colbert
- Department of Ophthalmology, NYU Grossman School of Medicine, NYU Langone Health, New York University, New York, New York, USA
| | - Jingyuan Zhu
- Department of Ophthalmology, NYU Grossman School of Medicine, NYU Langone Health, New York University, New York, New York, USA
- Department of Ophthalmology, Beijing Tongren Eye Center, Beijing Tongren Hospital, Capital Medical University, Beijing, China
| | - Anoop Sainulabdeen
- Department of Ophthalmology, NYU Grossman School of Medicine, NYU Langone Health, New York University, New York, New York, USA
- Department of Surgery and Radiology, College of Veterinary and Animal Sciences, Kerala Veterinary and Animal Sciences University, Thrissur, India
| | - Muneeb A. Faiq
- Department of Ophthalmology, NYU Grossman School of Medicine, NYU Langone Health, New York University, New York, New York, USA
| | - Ji Won Bang
- Department of Ophthalmology, NYU Grossman School of Medicine, NYU Langone Health, New York University, New York, New York, USA
| | - Kevin C. Chan
- Department of Ophthalmology, NYU Grossman School of Medicine, NYU Langone Health, New York University, New York, New York, USA
- Sackler Institute of Graduate Biomedical Sciences, NYU Grossman School of Medicine, NYU Langone Health, New York University, New York, New York, USA
- Department of Radiology, NYU Grossman School of Medicine, NYU Langone Health, New York University, New York, New York, USA
- Neuroscience Institute, NYU Grossman School of Medicine, NYU Langone Health, New York University, New York, New York, USA
- Center for Neural Science, College of Arts and Science, New York University, New York, New York, USA
| |
Collapse
|
10
|
Guerreiro MJS, Linke M, Lingareddy S, Kekunnaya R, Röder B. The effect of congenital blindness on resting-state functional connectivity revisited. Sci Rep 2021; 11:12433. [PMID: 34127748 PMCID: PMC8203782 DOI: 10.1038/s41598-021-91976-9] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2021] [Accepted: 06/03/2021] [Indexed: 02/05/2023] Open
Abstract
Lower resting-state functional connectivity (RSFC) between 'visual' and non-'visual' neural circuits has been reported as a hallmark of congenital blindness. In sighted individuals, RSFC between visual and non-visual brain regions has been shown to increase during rest with eyes closed relative to rest with eyes open. To determine the role of visual experience on the modulation of RSFC by resting state condition-as well as to evaluate the effect of resting state condition on group differences in RSFC-, we compared RSFC between visual and somatosensory/auditory regions in congenitally blind individuals (n = 9) and sighted participants (n = 9) during eyes open and eyes closed conditions. In the sighted group, we replicated the increase of RSFC between visual and non-visual areas during rest with eyes closed relative to rest with eyes open. This was not the case in the congenitally blind group, resulting in a lower RSFC between 'visual' and non-'visual' circuits relative to sighted controls only in the eyes closed condition. These results indicate that visual experience is necessary for the modulation of RSFC by resting state condition and highlight the importance of considering whether sighted controls should be tested with eyes open or closed in studies of functional brain reorganization as a consequence of blindness.
Collapse
Affiliation(s)
- Maria J S Guerreiro
- Biological Psychology and Neuropsychology, Institute for Psychology, University of Hamburg, Von-Melle-Park 11, 20146, Hamburg, Germany.
- Biological Psychology, Department of Psychology, Carl Von Ossietzky University of Oldenburg, 26111, Oldenburg, Germany.
| | - Madita Linke
- Biological Psychology and Neuropsychology, Institute for Psychology, University of Hamburg, Von-Melle-Park 11, 20146, Hamburg, Germany
| | - Sunitha Lingareddy
- Department of Radiology, Lucid Medical Diagnostics, Banjara Hills, Hyderabad, Telengana, 500082, India
| | - Ramesh Kekunnaya
- Child Sight Institute, Jasti V. Ramanamma Children's Eye Care Center, Department of Pediatric Ophthalmology, Strabismus, and Neuro-Ophthalmology, L. V. Prasad Eye Institute, Kallam Anji Reddy Campus, Hyderabad, Telengana, 500034, India
| | - Brigitte Röder
- Biological Psychology and Neuropsychology, Institute for Psychology, University of Hamburg, Von-Melle-Park 11, 20146, Hamburg, Germany
| |
Collapse
|
11
|
Wang F, Wang P, Liu Y, Zhou T, Meng X, Jiang J. Study of rapid reorganization of visual neurofunctions with the resting-state functional MRI in pituitary adenoma patients with vision improvement after transsphenoidal surgery. Brain Behav 2021; 11:e01917. [PMID: 33503315 PMCID: PMC7994690 DOI: 10.1002/brb3.1917] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/02/2020] [Revised: 08/01/2020] [Accepted: 09/07/2020] [Indexed: 01/13/2023] Open
Abstract
INTRODUCTION To investigate changes of vision-related resting-state activity in pituitary adenoma (PA) patients with visual improvement after transsphenoidal surgery. METHODS 14 PA patients with visual improvement after surgery were enrolled. The resting-state functional MRI and neuro-ophthalmologic evaluation were performed before and after the operation. The functional connectivity (FC) of 8 seeds (the primary visual cortex (V1), the secondary visual cortex (V2), the middle temporal visual cortex (MT+), and fusiform gyrus(FG)) was evaluated. A paired t test was conducted to identify the differences between the two groups. RESULTS Compared with the preoperation counterparts, the PA patients with improved vision exhibited decreased FC with the V1, V2, MT+, FG in the left paracentral lobule, bilateral lingual gyrus, precentral gyrus(BA 4), right superior temporal gyrus(BA 22), left fusiform gyrus, bilateral middle occipital gyrus (BA 19), left cuneus, right inferior occipital gyrus, left superior frontal gyrus, right cuneus, left superior parietal lobule(BA 7),the medulla, right postcentral gyrus, and increased FC in the right middle frontal gyrus, left inferior parietal lobule (BA 40), left declive, right lentiform nucleus, inferior frontal gyrus, right superior frontal gyrus(BA 11), cingulate gyrus(BA 32), right putamen, right thalamus, left medial frontal gyrus, left claustrum, left superior frontal Medial, right rectal gyrus(BA 25) and right parahippocampal gyrus. CONCLUSIONS The results show most subareas within the visual cortex exhibit decreased functional connectivity. The functional changes in subareas within default mode network (DMN), action observation network (AON) and the multisensory system in PAs propose that vision improvement may lead to function remodeling in higher-order cortex.
Collapse
Affiliation(s)
- Fuyu Wang
- Department of Neurosurgery, Chinese PLA General Hospital, Beijing, China
| | - Peng Wang
- Department of Neurosurgery, Chinese PLA General Hospital, Beijing, China
| | - Yuyang Liu
- Department of Neurosurgery, Chinese PLA General Hospital, Beijing, China
| | - Tao Zhou
- Department of Neurosurgery, Chinese PLA General Hospital, Beijing, China
| | - Xianghui Meng
- Department of Neurosurgery, Chinese PLA General Hospital, Beijing, China
| | - Jinli Jiang
- Department of Neurosurgery, Chinese PLA General Hospital, Beijing, China
| |
Collapse
|
12
|
Ptito M, Bleau M, Djerourou I, Paré S, Schneider FC, Chebat DR. Brain-Machine Interfaces to Assist the Blind. Front Hum Neurosci 2021; 15:638887. [PMID: 33633557 PMCID: PMC7901898 DOI: 10.3389/fnhum.2021.638887] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2020] [Accepted: 01/19/2021] [Indexed: 12/31/2022] Open
Abstract
The loss or absence of vision is probably one of the most incapacitating events that can befall a human being. The importance of vision for humans is also reflected in brain anatomy as approximately one third of the human brain is devoted to vision. It is therefore unsurprising that throughout history many attempts have been undertaken to develop devices aiming at substituting for a missing visual capacity. In this review, we present two concepts that have been prevalent over the last two decades. The first concept is sensory substitution, which refers to the use of another sensory modality to perform a task that is normally primarily sub-served by the lost sense. The second concept is cross-modal plasticity, which occurs when loss of input in one sensory modality leads to reorganization in brain representation of other sensory modalities. Both phenomena are training-dependent. We also briefly describe the history of blindness from ancient times to modernity, and then proceed to address the means that have been used to help blind individuals, with an emphasis on modern technologies, invasive (various type of surgical implants) and non-invasive devices. With the advent of brain imaging, it has become possible to peer into the neural substrates of sensory substitution and highlight the magnitude of the plastic processes that lead to a rewired brain. Finally, we will address the important question of the value and practicality of the available technologies and future directions.
Collapse
Affiliation(s)
- Maurice Ptito
- École d’Optométrie, Université de Montréal, Montréal, QC, Canada
- Department of Nuclear Medicine, University of Southern Denmark, Odense, Denmark
- Department of Neuroscience, University of Copenhagen, Copenhagen, Denmark
| | - Maxime Bleau
- École d’Optométrie, Université de Montréal, Montréal, QC, Canada
| | - Ismaël Djerourou
- École d’Optométrie, Université de Montréal, Montréal, QC, Canada
| | - Samuel Paré
- École d’Optométrie, Université de Montréal, Montréal, QC, Canada
| | - Fabien C. Schneider
- TAPE EA7423 University of Lyon-Saint Etienne, Saint Etienne, France
- Neuroradiology Unit, University Hospital of Saint-Etienne, Saint-Etienne, France
| | - Daniel-Robert Chebat
- Visual and Cognitive Neuroscience Laboratory (VCN Lab), Department of Psychology, Faculty of Social Sciences and Humanities, Ariel University, Ariel, Israël
- Navigation and Accessibility Research Center of Ariel University (NARCA), Ariel, Israël
| |
Collapse
|
13
|
Tapu R, Mocanu B, Zaharia T. Wearable assistive devices for visually impaired: A state of the art survey. Pattern Recognit Lett 2020. [DOI: 10.1016/j.patrec.2018.10.031] [Citation(s) in RCA: 47] [Impact Index Per Article: 11.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
14
|
Kirsch LP, Job X, Auvray M. Mixing up the Senses: Sensory Substitution Is Not a Form of Artificially Induced Synaesthesia. Multisens Res 2020; 34:297-322. [PMID: 33706280 DOI: 10.1163/22134808-bja10010] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2020] [Accepted: 05/26/2020] [Indexed: 11/19/2022]
Abstract
Sensory Substitution Devices (SSDs) are typically used to restore functionality of a sensory modality that has been lost, like vision for the blind, by recruiting another sensory modality such as touch or audition. Sensory substitution has given rise to many debates in psychology, neuroscience and philosophy regarding the nature of experience when using SSDs. Questions first arose as to whether the experience of sensory substitution is represented by the substituted information, the substituting information, or a multisensory combination of the two. More recently, parallels have been drawn between sensory substitution and synaesthesia, a rare condition in which individuals involuntarily experience a percept in one sensory or cognitive pathway when another one is stimulated. Here, we explore the efficacy of understanding sensory substitution as a form of 'artificial synaesthesia'. We identify several problems with previous suggestions for a link between these two phenomena. Furthermore, we find that sensory substitution does not fulfil the essential criteria that characterise synaesthesia. We conclude that sensory substitution and synaesthesia are independent of each other and thus, the 'artificial synaesthesia' view of sensory substitution should be rejected.
Collapse
Affiliation(s)
- Louise P Kirsch
- Institut des Systèmes Intelligents et de Robotique (ISIR), Sorbonne Université, Paris, France
| | - Xavier Job
- Institut des Systèmes Intelligents et de Robotique (ISIR), Sorbonne Université, Paris, France
| | - Malika Auvray
- Institut des Systèmes Intelligents et de Robotique (ISIR), Sorbonne Université, Paris, France
| |
Collapse
|
15
|
Nanay B. Synesthesia as (Multimodal) Mental Imagery. Multisens Res 2020; 34:281-296. [PMID: 33706281 DOI: 10.1163/22134808-bja10027] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2019] [Accepted: 05/23/2020] [Indexed: 11/19/2022]
Abstract
It has been repeatedly suggested that synesthesia is intricately connected with unusual ways of exercising one's mental imagery, although it is not always entirely clear what the exact connection is. My aim is to show that all forms of synesthesia are forms of (often very different kinds of) mental imagery and, further, if we consider synesthesia to be a form of mental imagery, we get significant explanatory benefits, especially concerning less central cases of synesthesia where the inducer is not sensory stimulation.
Collapse
Affiliation(s)
- Bence Nanay
- Centre for Philosophical Psychology, University of Antwerp, Prinsstraat 15, Antwerp 2000, Belgium
| |
Collapse
|
16
|
Abstract
Background Several neuroimaging studies demonstrated that visual deprivation led to significant cross-modal plasticity in the brain’s functional and anatomical architecture. Purpose To investigate the pattern of the interhemispheric functional connectivity in individuals with late blindness using the voxel-mirrored homotopic connectivity (VMHC) and seed-based functional connectivity (FC) methods. Material and Methods Forty-four individuals with late blindness (22 men, 22 women; mean age = 39.88 ± 12.84 years) and 55 sighted control individuals (35 men, 20 women; mean age = 43.13 ± 13.98 years)—closely matched for age, sex, and education—underwent resting-state magnetic resonance imaging scans. The VMHC and seed-based FC methods were applied to assess interhemispheric coordination in a voxel-wise manner. Results Compared with the sighted control groups, the late blindness groups showed decreased VMHC values in the bilateral cuneus/calcarine/lingual gyrus (CUN/CAL/LING) (BA 17/18/19) (voxel level: P < 0.001, Gaussian random field [GRF] correction, cluster level: P < 0.005). Meanwhile, for seed-based FC analysis, compared with the sighted control group, the late blindness group showed a decreased FC between the right lower VMHC regions and the bilateral CUN/LING/CAL/precuneus (PreCUN)/left middle occipital gyrus (MOG) (BA 18/19/30/31) and left precentral gyrus (PreCG) and postcentral gyrus (PostCG) (BA 2/3/4/6). The late blindness group showed a decreased FC between the left lower VMHC regions and the bilateral CUN/LING/CAL/PreCUN (BA 18/19/31) and left PreCG and PostCG (BA 2/3/4/6) relative to the sighted control group (voxel level: P < 0.001, GRF correction, cluster level: P < 0.005). Moreover, a negative correlation was observed between the duration of blindness and VMHC values in the bilateral CUN/CAL/LING (r = −0.393, P = 0.008) in individuals with late blindness. Conclusion Our results indicated that late blindness induced substantial impairment of interhemispheric coordination in the visual cortex. This might reflect impaired visual fusion, visual recognition function, and top-down modulations in individuals with late blindness.
Collapse
Affiliation(s)
- Xin Huang
- Eye Center, Renmin Hospital of Wuhan University, Wuhan, PR China
| | - Fu-Qing Zhou
- Department of Radiology, The First Affiliated Hospital of Nanchang University, Jiangxi Province Medical Imaging Research Institute, Nanchang, PR China
| | - Han-Dong Dan
- Eye Center, Renmin Hospital of Wuhan University, Wuhan, PR China
| | - Yin Shen
- Eye Center, Renmin Hospital of Wuhan University, Wuhan, PR China
| |
Collapse
|
17
|
Chan KC, Murphy MC, Bang JW, Sims J, Kashkoush J, Nau AC. Functional MRI of Sensory Substitution in the Blind. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2019; 2018:5519-5522. [PMID: 30441587 DOI: 10.1109/embc.2018.8513622] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/12/2023]
Abstract
Visual cortex functionality in the blind has been shown to shift away from sensory networks toward task-positive networks that are involved in top-down modulation. However, how such modulation is shaped by experience and reflected behaviorally remains unclear. This study evaluates the visual cortex activity and functional connectivity among congenitally blind, acquired blind, and sighted subjects using blood-oxygenation-level-dependent functional MRI during sensory substitution tasks and at rest. We found that primary visual cortex activity due to active interpretation not only depends on the blindness duration, but also negatively associates with behavioral reaction time. In addition, alterations in visual and task-positive functional connectivity progress over the duration of blindness. In summary, this work suggests that functional plasticity in the primary visual cortex can be reshaped in the blind over time, even in the adult stage. Furthermore, the degree of top-down activity in the primary visual cortex may reflect the speed of performance during sensory substitution.
Collapse
|
18
|
Cross-modal size-contrast illusion: Acoustic increases in intensity and bandwidth modulate haptic representation of object size. Sci Rep 2019; 9:14440. [PMID: 31595003 PMCID: PMC6783429 DOI: 10.1038/s41598-019-50912-8] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2019] [Accepted: 09/12/2019] [Indexed: 01/20/2023] Open
Abstract
Changes in the retinal size of stationary objects provide a cue to the observer's motion in the environment: Increases indicate the observer's forward motion, and decreases backward motion. In this study, a series of images each comprising a pair of pine-tree figures were translated into auditory modality using sensory substitution software. Resulting auditory stimuli were presented in an ascending sequence (i.e. increasing in intensity and bandwidth compatible with forward motion), descending sequence (i.e. decreasing in intensity and bandwidth compatible with backward motion), or in a scrambled order. During the presentation of stimuli, blindfolded participants estimated the lengths of wooden sticks by haptics. Results showed that those exposed to the stimuli compatible with forward motion underestimated the lengths of the sticks. This consistent underestimation may share some aspects with visual size-contrast effects such as the Ebbinghaus illusion. In contrast, participants in the other two conditions did not show such magnitude of error in size estimation; which is consistent with the "adaptive perceptual bias" towards acoustic increases in intensity and bandwidth. In sum, we report a novel cross-modal size-contrast illusion, which reveals that auditory motion cues compatible with listeners' forward motion modulate haptic representations of object size.
Collapse
|
19
|
Alterations of the Brain Microstructure and Corresponding Functional Connectivity in Early-Blind Adolescents. Neural Plast 2019; 2019:2747460. [PMID: 30996726 PMCID: PMC6408999 DOI: 10.1155/2019/2747460] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2018] [Revised: 10/17/2018] [Accepted: 12/27/2018] [Indexed: 11/17/2022] Open
Abstract
Although evidence from studies on blind adults indicates that visual deprivation early in life leads to structural and functional disruption and reorganization of the brain, whether young blind people show similar patterns remains unknown. Therefore, this study is aimed at exploring the structural and functional alterations of the brain of early-blind adolescents (EBAs) compared to normal-sighted controls (NSCs) and investigating the effects of residual light perception on brain microstructure and function in EBAs. We obtained magnetic resonance imaging (MRI) data from 23 EBAs (8 with residual light perception (LPs), 15 without light perception (NLPs)) and 21 NSCs (age range 11-19 years old). Whole-brain voxel-based analyses of diffusion tensor imaging metrics and region-of-interest analyses of resting-state functional connectivity (RSFC) were performed to compare patterns of brain microstructure and the corresponding RSFC between the groups. The results showed that structural disruptions of LPs and NLPs were mainly located in the occipital visual pathway. Compared with NLPs, LPs showed increased fractional anisotropy (FA) in the superior frontal gyrus and reduced diffusivity in the caudate nucleus. Moreover, the correlations between FA of the occipital cortices or mean diffusivity of the lingual gyrus and age were consistent with the development trajectory of the brain in NSCs, but inconsistent or even opposite in EBAs. Additionally, we found functional, but not structural, reorganization in NLPs compared with NSCs, suggesting that functional neuroplasticity occurs earlier than structural neuroplasticity in EBAs. Altogether, these findings provided new insights into the mechanisms underlying the neural reorganization of the brain in adolescents with early visual deprivation.
Collapse
|
20
|
de Borst AW, de Gelder B. Mental Imagery Follows Similar Cortical Reorganization as Perception: Intra-Modal and Cross-Modal Plasticity in Congenitally Blind. Cereb Cortex 2018; 29:2859-2875. [DOI: 10.1093/cercor/bhy151] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2018] [Revised: 05/27/2018] [Accepted: 06/05/2018] [Indexed: 11/14/2022] Open
Abstract
Abstract
Cortical plasticity in congenitally blind individuals leads to cross-modal activation of the visual cortex and may lead to superior perceptual processing in the intact sensory domains. Although mental imagery is often defined as a quasi-perceptual experience, it is unknown whether it follows similar cortical reorganization as perception in blind individuals. In this study, we show that auditory versus tactile perception evokes similar intra-modal discriminative patterns in congenitally blind compared with sighted participants. These results indicate that cortical plasticity following visual deprivation does not influence broad intra-modal organization of auditory and tactile perception as measured by our task. Furthermore, not only the blind, but also the sighted participants showed cross-modal discriminative patterns for perception modality in the visual cortex. During mental imagery, both groups showed similar decoding accuracies for imagery modality in the intra-modal primary sensory cortices. However, no cross-modal discriminative information for imagery modality was found in early visual cortex of blind participants, in contrast to the sighted participants. We did find evidence of cross-modal activation of higher visual areas in blind participants, including the representation of specific-imagined auditory features in visual area V4.
Collapse
Affiliation(s)
- A W de Borst
- Department of Computer Science, University College London, London, UK
- Brain and Emotion Lab, Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, the Netherlands
| | - B de Gelder
- Department of Computer Science, University College London, London, UK
- Brain and Emotion Lab, Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, the Netherlands
| |
Collapse
|
21
|
Blazquez Freches G, Chavarrias C, Shemesh N. BOLD-fMRI in the mouse auditory pathway. Neuroimage 2018; 165:265-277. [DOI: 10.1016/j.neuroimage.2017.10.027] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2017] [Revised: 10/09/2017] [Accepted: 10/13/2017] [Indexed: 01/31/2023] Open
|
22
|
Abstract
When I am looking at my coffee machine that makes funny noises, this is an instance of multisensory perception – I perceive this event by means of both vision and audition. But very often we only receive sensory stimulation from a multisensory event by means of one sense modality, for example, when I hear the noisy coffee machine in the next room, that is, without seeing it. The aim of this paper is to bring together empirical findings about multimodal perception and empirical findings about (visual, auditory, tactile) mental imagery and argue that on occasions like this, we have multimodal mental imagery: perceptual processing in one sense modality (here: vision) that is triggered by sensory stimulation in another sense modality (here: audition). Multimodal mental imagery is not a rare and obscure phenomenon. The vast majority of what we perceive are multisensory events: events that can be perceived in more than one sense modality – like the noisy coffee machine. And most of the time we are only acquainted with these multisensory events via a subset of the sense modalities involved – all the other aspects of these multisensory events are represented by means of multisensory mental imagery. This means that multisensory mental imagery is a crucial element of almost all instances of everyday perception.
Collapse
Affiliation(s)
- Bence Nanay
- University of Antwerp, Antwerp, Belgium; Peterhouse, University of Cambridge, Cambridge, UK.
| |
Collapse
|
23
|
Abstract
Many philosophers use findings about sensory substitution devices in the grand debate about how we should individuate the senses. The big question is this: Is "vision" assisted by (tactile) sensory substitution really vision? Or is it tactile perception? Or some sui generis novel form of perception? My claim is that sensory substitution assisted "vision" is neither vision nor tactile perception, because it is not perception at all. It is mental imagery: visual mental imagery triggered by tactile sensory stimulation. But it is a special form of mental imagery that is triggered by corresponding sensory stimulation in a different sense modality, which I call "multimodal mental imagery."
Collapse
Affiliation(s)
- Bence Nanay
- University of Antwerp, Belgium; Peterhouse, University of Cambridge, UK
| |
Collapse
|
24
|
Arnold G, Pesnot-Lerousseau J, Auvray M. Individual Differences in Sensory Substitution. Multisens Res 2017; 30:579-600. [DOI: 10.1163/22134808-00002561] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2016] [Accepted: 03/16/2017] [Indexed: 12/23/2022]
Abstract
Sensory substitution devices were developed in the context of perceptual rehabilitation and they aim at compensating one or several functions of a deficient sensory modality by converting stimuli that are normally accessed through this deficient sensory modality into stimuli accessible by another sensory modality. For instance, they can convert visual information into sounds or tactile stimuli. In this article, we review those studies that investigated the individual differences at the behavioural, neural, and phenomenological levels when using a sensory substitution device. We highlight how taking into account individual differences has consequences for the optimization and learning of sensory substitution devices. We also discuss the extent to which these studies allow a better understanding of the experience with sensory substitution devices, and in particular how the resulting experience is not akin to a single sensory modality. Rather, it should be conceived as a multisensory experience, involving both perceptual and cognitive processes, and emerging on each user’s pre-existing sensory and cognitive capacities.
Collapse
Affiliation(s)
- Gabriel Arnold
- Institut des Systèmes Intelligents et de Robotique, CNRS UMR 7222, Université Pierre et Marie Curie, 4 place Jussieu, 75005 Paris, France
| | - Jacques Pesnot-Lerousseau
- Institut des Systèmes Intelligents et de Robotique, CNRS UMR 7222, Université Pierre et Marie Curie, 4 place Jussieu, 75005 Paris, France
| | - Malika Auvray
- Institut des Systèmes Intelligents et de Robotique, CNRS UMR 7222, Université Pierre et Marie Curie, 4 place Jussieu, 75005 Paris, France
| |
Collapse
|
25
|
Cecchetti L, Kupers R, Ptito M, Pietrini P, Ricciardi E. Are Supramodality and Cross-Modal Plasticity the Yin and Yang of Brain Development? From Blindness to Rehabilitation. Front Syst Neurosci 2016; 10:89. [PMID: 27877116 PMCID: PMC5099160 DOI: 10.3389/fnsys.2016.00089] [Citation(s) in RCA: 42] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2016] [Accepted: 10/27/2016] [Indexed: 12/20/2022] Open
Abstract
Research in blind individuals has primarily focused for a long time on the brain plastic reorganization that occurs in early visual areas. Only more recently, scientists have developed innovative strategies to understand to what extent vision is truly a mandatory prerequisite for the brain's fine morphological architecture to develop and function. As a whole, the studies conducted to date in sighted and congenitally blind individuals have provided ample evidence that several "visual" cortical areas develop independently from visual experience and do process information content regardless of the sensory modality through which a particular stimulus is conveyed: a property named supramodality. At the same time, lack of vision leads to a structural and functional reorganization within "visual" brain areas, a phenomenon known as cross-modal plasticity. Cross-modal recruitment of the occipital cortex in visually deprived individuals represents an adaptative compensatory mechanism that mediates processing of non-visual inputs. Supramodality and cross-modal plasticity appears to be the "yin and yang" of brain development: supramodal is what takes place despite the lack of vision, whereas cross-modal is what happens because of lack of vision. Here we provide a critical overview of the research in this field and discuss the implications that these novel findings have for the development of educative/rehabilitation approaches and sensory substitution devices (SSDs) in sensory-impaired individuals.
Collapse
Affiliation(s)
- Luca Cecchetti
- Department of Surgical, Medical, Molecular Pathology and Critical Care, University of PisaPisa, Italy; Clinical Psychology Branch, Pisa University HospitalPisa, Italy
| | - Ron Kupers
- BRAINlab, Department of Neuroscience and Pharmacology, Panum Institute, University of CopenhagenCopenhagen, Denmark; Department of Radiology and Biomedical Imaging, Yale UniversityNew Haven, CT, USA
| | - Maurice Ptito
- Laboratory of Neuropsychiatry, Psychiatric Centre CopenhagenCopenhagen, Denmark; School of Optometry, Université de MontréalMontréal, QC, Canada
| | | | - Emiliano Ricciardi
- Department of Surgical, Medical, Molecular Pathology and Critical Care, University of PisaPisa, Italy; MOMILab, IMT School for Advanced Studies LuccaLucca, Italy
| |
Collapse
|
26
|
Kristjánsson Á, Moldoveanu A, Jóhannesson ÓI, Balan O, Spagnol S, Valgeirsdóttir VV, Unnthorsson R. Designing sensory-substitution devices: Principles, pitfalls and potential1. Restor Neurol Neurosci 2016; 34:769-87. [PMID: 27567755 PMCID: PMC5044782 DOI: 10.3233/rnn-160647] [Citation(s) in RCA: 28] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
An exciting possibility for compensating for loss of sensory function is to augment deficient senses by conveying missing information through an intact sense. Here we present an overview of techniques that have been developed for sensory substitution (SS) for the blind, through both touch and audition, with special emphasis on the importance of training for the use of such devices, while highlighting potential pitfalls in their design. One example of a pitfall is how conveying extra information about the environment risks sensory overload. Related to this, the limits of attentional capacity make it important to focus on key information and avoid redundancies. Also, differences in processing characteristics and bandwidth between sensory systems severely constrain the information that can be conveyed. Furthermore, perception is a continuous process and does not involve a snapshot of the environment. Design of sensory substitution devices therefore requires assessment of the nature of spatiotemporal continuity for the different senses. Basic psychophysical and neuroscientific research into representations of the environment and the most effective ways of conveying information should lead to better design of sensory substitution systems. Sensory substitution devices should emphasize usability, and should not interfere with other inter- or intramodal perceptual function. Devices should be task-focused since in many cases it may be impractical to convey too many aspects of the environment. Evidence for multisensory integration in the representation of the environment suggests that researchers should not limit themselves to a single modality in their design. Finally, we recommend active training on devices, especially since it allows for externalization, where proximal sensory stimulation is attributed to a distinct exterior object.
Collapse
Affiliation(s)
- Árni Kristjánsson
- Laboratory of Visual Perception and Visuomotor control, University of Iceland, Faculty of Psychology, School of Health Sciences, Reykjavik, Iceland
| | - Alin Moldoveanu
- University Politehnica of Bucharest, Faculty of Automatic Control and Computers, Computer Science and Engineering Department, Bucharest, Romania
| | - Ómar I. Jóhannesson
- Laboratory of Visual Perception and Visuomotor control, University of Iceland, Faculty of Psychology, School of Health Sciences, Reykjavik, Iceland
| | - Oana Balan
- University Politehnica of Bucharest, Faculty of Automatic Control and Computers, Computer Science and Engineering Department, Bucharest, Romania
| | - Simone Spagnol
- Faculty of Industrial Engineering, Mechanical Engineering and Computer Science, School of Engineering and Natural Sciences, Reykjavik, Iceland
| | - Vigdís Vala Valgeirsdóttir
- Laboratory of Visual Perception and Visuomotor control, University of Iceland, Faculty of Psychology, School of Health Sciences, Reykjavik, Iceland
| | - Rúnar Unnthorsson
- Faculty of Industrial Engineering, Mechanical Engineering and Computer Science, School of Engineering and Natural Sciences, Reykjavik, Iceland
| |
Collapse
|
27
|
Ho LC, Sigal IA, Jan NJ, Yang X, van der Merwe Y, Yu Y, Chau Y, Leung CK, Conner IP, Jin T, Wu EX, Kim SG, Wollstein G, Schuman JS, Chan KC. Non-invasive MRI Assessments of Tissue Microstructures and Macromolecules in the Eye upon Biomechanical or Biochemical Modulation. Sci Rep 2016; 6:32080. [PMID: 27561353 PMCID: PMC5000015 DOI: 10.1038/srep32080] [Citation(s) in RCA: 29] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2016] [Accepted: 08/02/2016] [Indexed: 02/07/2023] Open
Abstract
The microstructural organization and composition of the corneoscleral shell (CSS) determine the biomechanical behavior of the eye, and are important in diseases such as glaucoma and myopia. However, limited techniques can assess these properties globally, non-invasively and quantitatively. In this study, we hypothesized that multi-modal magnetic resonance imaging (MRI) can reveal the effects of biomechanical or biochemical modulation on CSS. Upon intraocular pressure (IOP) elevation, CSS appeared hyperintense in both freshly prepared ovine eyes and living rat eyes using T2-weighted MRI. Quantitatively, transverse relaxation time (T2) of CSS increased non-linearly with IOP at 0-40 mmHg and remained longer than unloaded tissues after being unpressurized. IOP loading also increased fractional anisotropy of CSS in diffusion tensor MRI without apparent change in magnetization transfer MRI, suggestive of straightening of microstructural fibers without modification of macromolecular contents. Lastly, treatments with increasing glyceraldehyde (mimicking crosslinking conditions) and chondroitinase-ABC concentrations (mimicking glycosaminoglycan depletion) decreased diffusivities and increased magnetization transfer in cornea, whereas glyceraldehyde also increased magnetization transfer in sclera. In summary, we demonstrated the changing profiles of MRI contrast mechanisms resulting from biomechanical or biochemical modulation of the eye non-invasively. Multi-modal MRI may help evaluate the pathophysiological mechanisms in CSS and the efficacy of corneoscleral treatments.
Collapse
Affiliation(s)
- Leon C. Ho
- NeuroImaging Laboratory , University of Pittsburgh, Pittsburgh, PA, USA
- UPMC Eye Center, Ophthalmology and Visual Science Research Center, Department of Ophthalmology, School of Medicine, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong, China
| | - Ian A. Sigal
- UPMC Eye Center, Ophthalmology and Visual Science Research Center, Department of Ophthalmology, School of Medicine, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong, China
- McGowan Institute for Regenerative Medicine, University of Pittsburgh, Pittsburgh, PA, USA
- Louis J. Fox Center for Vision Restoration, University of Pittsburgh, Pittsburgh, PA, USA
| | - Ning-Jiun Jan
- UPMC Eye Center, Ophthalmology and Visual Science Research Center, Department of Ophthalmology, School of Medicine, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Bioengineering, Swanson School of Engineering, University of Pittsburgh, Pittsburgh, PA, USA
| | - Xiaoling Yang
- NeuroImaging Laboratory , University of Pittsburgh, Pittsburgh, PA, USA
- UPMC Eye Center, Ophthalmology and Visual Science Research Center, Department of Ophthalmology, School of Medicine, University of Pittsburgh, Pittsburgh, PA, USA
| | - Yolandi van der Merwe
- NeuroImaging Laboratory , University of Pittsburgh, Pittsburgh, PA, USA
- UPMC Eye Center, Ophthalmology and Visual Science Research Center, Department of Ophthalmology, School of Medicine, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Bioengineering, Swanson School of Engineering, University of Pittsburgh, Pittsburgh, PA, USA
- McGowan Institute for Regenerative Medicine, University of Pittsburgh, Pittsburgh, PA, USA
- Louis J. Fox Center for Vision Restoration, University of Pittsburgh, Pittsburgh, PA, USA
| | - Yu Yu
- Department of Chemical and Biomolecular Engineering, Hong Kong University of Science and Technology, Hong Kong, China
| | - Ying Chau
- Department of Chemical and Biomolecular Engineering, Hong Kong University of Science and Technology, Hong Kong, China
- Division of Biomedical Engineering, Hong Kong University of Science and Technology, Hong Kong, China
| | - Christopher K. Leung
- University Eye Center, Hong Kong Eye Hospital, Hong Kong, China
- Department of Ophthalmology and Visual Sciences, The Chinese University of Hong Kong, Hong Kong, China
| | - Ian P. Conner
- UPMC Eye Center, Ophthalmology and Visual Science Research Center, Department of Ophthalmology, School of Medicine, University of Pittsburgh, Pittsburgh, PA, USA
- McGowan Institute for Regenerative Medicine, University of Pittsburgh, Pittsburgh, PA, USA
- Louis J. Fox Center for Vision Restoration, University of Pittsburgh, Pittsburgh, PA, USA
| | - Tao Jin
- NeuroImaging Laboratory , University of Pittsburgh, Pittsburgh, PA, USA
| | - Ed X. Wu
- Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong, China
| | - Seong-Gi Kim
- NeuroImaging Laboratory , University of Pittsburgh, Pittsburgh, PA, USA
- Department of Bioengineering, Swanson School of Engineering, University of Pittsburgh, Pittsburgh, PA, USA
- McGowan Institute for Regenerative Medicine, University of Pittsburgh, Pittsburgh, PA, USA
- Center for the Neural Basis of Cognition, University of Pittsburgh and Carnegie Mellon University, Pittsburgh, PA, USA
- Center for Neuroscience Imaging Research, Institute for Basic Science, Suwon, Korea
- Department of Biomedical Engineering, Sungkyunkwan University, Suwon, Korea
| | - Gadi Wollstein
- UPMC Eye Center, Ophthalmology and Visual Science Research Center, Department of Ophthalmology, School of Medicine, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Bioengineering, Swanson School of Engineering, University of Pittsburgh, Pittsburgh, PA, USA
- McGowan Institute for Regenerative Medicine, University of Pittsburgh, Pittsburgh, PA, USA
- Louis J. Fox Center for Vision Restoration, University of Pittsburgh, Pittsburgh, PA, USA
| | - Joel S. Schuman
- UPMC Eye Center, Ophthalmology and Visual Science Research Center, Department of Ophthalmology, School of Medicine, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Bioengineering, Swanson School of Engineering, University of Pittsburgh, Pittsburgh, PA, USA
- McGowan Institute for Regenerative Medicine, University of Pittsburgh, Pittsburgh, PA, USA
- Center for the Neural Basis of Cognition, University of Pittsburgh and Carnegie Mellon University, Pittsburgh, PA, USA
- Clinical and Translational Science Institute, University of Pittsburgh, Pittsburgh, PA, USA
| | - Kevin C. Chan
- NeuroImaging Laboratory , University of Pittsburgh, Pittsburgh, PA, USA
- UPMC Eye Center, Ophthalmology and Visual Science Research Center, Department of Ophthalmology, School of Medicine, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Bioengineering, Swanson School of Engineering, University of Pittsburgh, Pittsburgh, PA, USA
- McGowan Institute for Regenerative Medicine, University of Pittsburgh, Pittsburgh, PA, USA
- Louis J. Fox Center for Vision Restoration, University of Pittsburgh, Pittsburgh, PA, USA
- Center for the Neural Basis of Cognition, University of Pittsburgh and Carnegie Mellon University, Pittsburgh, PA, USA
| |
Collapse
|
28
|
Improving training for sensory augmentation using the science of expertise. Neurosci Biobehav Rev 2016; 68:234-244. [PMID: 27264831 DOI: 10.1016/j.neubiorev.2016.05.026] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2015] [Revised: 05/04/2016] [Accepted: 05/23/2016] [Indexed: 11/20/2022]
Abstract
Sensory substitution and augmentation devices (SSADs) allow users to perceive information about their environment that is usually beyond their sensory capabilities. Despite an extensive history, SSADs are arguably not used to their fullest, both as assistive technology for people with sensory impairment or as research tools in the psychology and neuroscience of sensory perception. Studies of the non-use of other assistive technologies suggest one factor is the balance of benefits gained against the costs incurred. We argue that improving the learning experience would improve this balance, suggest three ways in which it can be improved by leveraging existing cognitive science findings on expertise and skill development, and acknowledge limitations and relevant concerns. We encourage the systematic evaluation of learning programs, and suggest that a more effective learning process for SSADs could reduce the barrier to uptake and allow users to reach higher levels of overall capacity.
Collapse
|