Visual rehabilitation: visual scanning, multisensory stimulation and vision restoration trainings

Advanced Visualization Engineering for Vision Disorders: A Clinically Focused Guide to Current Technology and Future Applications

Head-mounted visualization technology, often in the form of virtual, augmented, and mixed reality (VAMR), has revolutionized how visual disorders may be approached clinically. In this manuscript, we review the available literature on VAMR for visual disorders and provide a clinically oriented guide to how VAMR technology has been deployed for visual impairments. The chief areas of clinical investigation with VAMR are divided include (1) vision assessment, (2) vision simulation, and (3) vision rehabilitation. We discuss in-depth the current literature of these areas in VAMR and upcoming/future applications to combat the detrimental impact of visual impairment worldwide.

Enhancing learning outcomes through multisensory integration: A fMRI study of audio-visual training in virtual reality

The integration of information from different sensory modalities is a fundamental process that enhances perception and performance in real and virtual environments (VR). Understanding these mechanisms, especially during learning tasks that exploit novel multisensory cue combinations provides opportunities for the development of new rehabilitative interventions. This study aimed to investigate how functional brain changes support behavioural performance improvements during an audio-visual (AV) learning task. Twenty healthy participants underwent a 30 min daily VR training for four weeks. The task was an AV adaptation of a 'scanning training' paradigm that is commonly used in hemianopia rehabilitation. Functional magnetic resonance imaging (fMRI) and performance data were collected at baseline, after two and four weeks of training, and four weeks post-training. We show that behavioural performance, operationalised as mean reaction time reduction in VR, significantly improves. In separate tests in a controlled laboratory environment, we showed that the behavioural performance gains in the VR training environment transferred to a significant mean RT reduction for the trained AV voluntary task on a computer screen. Enhancements were observed in both the visual-only and AV conditions, with the latter demonstrating a faster response time supported by the presence of audio cues. The behavioural learning effect also transfers to two additional tasks that were tested: a visual search task and an involuntary visual task. Our fMRI results reveal an increase in functional activation (BOLD signal) in multisensory brain regions involved in early-stage AV processing: the thalamus, the caudal inferior parietal lobe and cerebellum. These functional changes were only observed for the trained, multisensory, task and not for unimodal visual stimulation. Functional activation changes in the thalamus were significantly correlated to behavioural performance improvements. This study demonstrates that incorporating spatial auditory cues to voluntary visual training in VR leads to augmented brain activation changes in multisensory integration, resulting in measurable performance gains across tasks. The findings highlight the potential of VR-based multisensory training as an effective method for enhancing cognitive function and as a potentially valuable tool in rehabilitative programmes.

Cross-modal exposure restores multisensory enhancement after hemianopia

Hemianopia is a common consequence of unilateral damage to visual cortex that manifests as a profound blindness in contralesional space. A noninvasive cross-modal (visual-auditory) exposure paradigm has been developed in an animal model to ameliorate this disorder. Repeated stimulation of a visual-auditory stimulus restores overt responses to visual stimuli in the blinded hemifield. It is believed to accomplish this by enhancing the visual sensitivity of circuits remaining after a lesion of visual cortex; in particular, circuits involving the multisensory neurons of the superior colliculus. Neurons in this midbrain structure are known to integrate spatiotemporally congruent visual and auditory signals to amplify their responses, which, in turn, enhances behavioral performance. Here we evaluated the relationship between the rehabilitation of hemianopia and this process of multisensory integration. Induction of hemianopia also eliminated multisensory enhancement in the blinded hemifield. Both vision and multisensory enhancement rapidly recovered with the rehabilitative cross-modal exposures. However, although both reached pre-lesion levels at similar rates, they did so with different spatial patterns. The results suggest that the capability for multisensory integration and enhancement is not a pre-requisite for visual recovery in hemianopia, and that the underlying mechanisms for recovery may be more complex than currently appreciated.

Placebo effect after visual restitution training: no eye-tracking controlled perimetric improvement after visual border stimulation in late subacute and chronic visual field defects after stroke

Introduction

A significant number of Restitution Training (RT) paradigms claim to ameliorate visual field loss after stroke by re-activating neuronal connections in the residual visual cortex due to repeated bright light-stimulation at the border of the blind and intact fields. However, the effectiveness of RT has been considered controversial both in science and clinical practice for years. The main points of the controversy are (1) the reliability of perimetric results which may be affected by compensatory eye movements and (2) heterogeneous samples consisting of patients with visual field defects and/or visuospatial neglect.

Methods

By means of our newly developed and validated Virtual Reality goggles Salzburg Visual Field Trainer (SVFT) 16 stroke patients performed RT on a regular basis for 5  months. By means of our newly developed and validated Eye Tracking Based Visual Field Analysis (EFA), we conducted a first-time full eye-movement-controlled perimetric pre-post intervention study. Additionally, patients subjectively rated the size of their intact visual field.

Results

Analysis showed that patients' mean self-assessment of their subjective visual field size indicated statistically significant improvement while, in contrast, objective eye tracking controlled perimetric results revealed no statistically significant effect.

Discussion

Bright-light detection RT at the blind-field border solely induced a placebo effect and did not lead to training-induced neuroplasticity in the visual cortex of the type needed to ameliorate the visual field size of stroke patients.

Ameliorating Hemianopia with Multisensory Training

Hemianopia (unilateral blindness), a common consequence of stroke and trauma to visual cortex, is a debilitating disorder for which there are few treatments. Research in an animal model has suggested that visual-auditory stimulation therapy, which exploits the multisensory architecture of the brain, may be effective in restoring visual sensitivity in hemianopia. It was tested in two male human patients who were hemianopic for at least 8 months following a stroke. The patients were repeatedly exposed to congruent visual-auditory stimuli within their blinded hemifield during 2 h sessions over several weeks. The results were dramatic. Both recovered the ability to detect and describe visual stimuli throughout their formerly blind field within a few weeks. They could also localize these stimuli, identify some of their features, and perceive multiple visual stimuli simultaneously in both fields. These results indicate that the multisensory therapy is a rapid and effective method for restoring visual function in hemianopia.SIGNIFICANCE STATEMENT Hemianopia (blindness on one side of space) is widely considered to be a permanent disorder. Here, we show that a simple multisensory training paradigm can ameliorate this disorder in human patients.

Innovative vision rehabilitation method for hemianopsia: Comparing pre- and post audio-luminous biofeedback training for ocular motility improving visual functions and quality of life

Background

Homonymous hemianopsia (HH) corresponds to vision loss in one hemi-field secondary to retro-chiasmal injury. Patients with HH experience difficulties in scanning and orientation in their environment. Near vision daily activities such as reading can also be impaired. There is an unmet need for standardized vision rehabilitation protocols for HH. We investigated the effectiveness of biofeedback training (BT), used for vision rehabilitation in patients with central vision loss, in individuals with HH.

Methods

In this prospective pilot pre/post study, 12 participants, with HH consecutive to brain injury, performed 5 weekly BT sessions for 20 min each under supervision using the Macular Integrity Assessment microperimeter. BT consisted of relocation of the retinal locus 1-4° toward the blind hemi-field. Outcomes measured post-BT were paracentral retinal sensitivity, visual acuity (near vision), fixation stability, contrast sensitivity, reading speed, and visual functioning questionnaire. Statistical analysis was performed using Bayesian paired t-tests.

Results

Paracentral retinal sensitivity significantly increased by 2.7 ± 0.9 dB in the treated eye in 9/11 of the participants. Significant improvements with medium-to-large effect size were observed for fixation stability (8/12 participants), contrast sensitivity (6/12 participants) and near vision visual acuity (10/12 participants). Reading speed increased by 32.5 ± 32.4 words per minute in 10/11 participants. Quality of vision scores improved significantly with large effect size for visual ability, visual information and mobility.

Conclusion

BT led to encouraging improvements in visual functions and functional vision in individuals with HH. Further confirmation with larger trials is required.

Development and 5-year Evaluation of Diagnosis-Specific Protocols for Visual Neuro-Rehabilitation in a Multicenter Inpatient Rehabilitation Network

Objective

To provide a retrospective evaluation of a new eye and vision rehabilitation care pathway in a U.S. multi-site inpatient rehabilitation network involving the occupational therapy (OT) staff and a consulting doctor of optometry (OD) specializing in vision rehabilitation.

Design

Retrospective study.

Setting

Two Inpatient Rehabilitation Facilities (IRFs) and 1 Long Term Acute Care Hospital (LTACH).

Participants

There were 2083 records reviewed (44% women, avg. age 59 years). The most common diagnoses were hemispatial neglect (19.2%), homonymous field defects (18.5%), and oculomotor cranial nerve palsies (16.7%) (N=2083).

Interventions

Clinical care was reviewed where diagnosis-specific protocols were developed and training was provided to OTs in order to reinforce OD-prescribed interventions during daily treatment sessions, including (1) third, fourth, and sixth ocular cranial nerve palsies (OCNPs) with prisms fitted for full time, postural adaptation training, and oculomotor re-education using pursuits, saccades, head-rotations, and binocular vision exercises including alternate cover and vergence; (2) homonymous hemianopia with training awareness of field loss, eccentric viewing, and fitting of Peli lens for optical field expansion; and (3) prism adaptation therapy (PAT) for left hemispatial neglect.

Main Outcome Measures

Frequency of diagnoses.

Hypothesis

Diagnoses with developed protocols were most common. Secondarily, feasibility and efficacy by anonymous OT survey.

Results

2083 vision consults were performed over 5 years. The most common diagnoses were hemispatial neglect (n=399, 19.2%), homonymous field defects (n=386, 18.5%), and OCNPs (n=347, 16.7%). None of the OTs reported the protocols were infeasible and 63% (IQR 38%-69%) reported their patients benefited from the interventions. The survey suggested prism for OCNPs helped in 42%, and Peli lens and PAT both helped in 38%.

Conclusions

Data support the feasibility of this inpatient eye and vision rehabilitation care pathway which may be used as a foundation for creating or refining similar programs elsewhere. Uniform administration of IRF-based visual neuro-rehabilitation care could provide a substrate for future clinical trials to evaluate efficacy.

Alterations in resting-state functional connectivity after brain posterior lesions reflect the functionality of the visual system in hemianopic patients

Emerging evidence suggests a role of the posterior cortices in regulating alpha oscillatory activity and organizing low-level processing in non-alpha frequency bands. Therefore, posterior brain lesions, which damage the neural circuits of the visual system, might affect functional connectivity patterns of brain rhythms. To test this hypothesis, eyes-closed resting state EEG signal was acquired from patients with hemianopia with left and right posterior lesions, patients without hemianopia with more anterior lesions and healthy controls. Left-lesioned hemianopics showed reduced intrahemispheric connectivity in the range of upper alpha only in the lesioned hemisphere, whereas right-lesioned hemianopics exhibited reduced intrahemispheric alpha connectivity in both hemispheres. In terms of network topology, these impairments were characterized by reduced local functional segregation, with no associated change in global functional integration. This suggests a crucial role of posterior cortices in promoting functional connectivity in the range of alpha. Right-lesioned hemianopics revealed also additional impairments in the theta range, with increased connectivity in this frequency band, characterized by both increased local segregated activity and decreased global integration. This indicates that lesions to right posterior cortices lead to stronger impairments in alpha connectivity and induce additional alterations in local and global low-level processing, suggesting a specialization of the right hemisphere in generating alpha oscillations and in coordinating complex interplays with lower frequency bands. Importantly, hemianopic patient's visual performance in the blind field was linked to alpha functional connectivity, corroborating the notion that alpha oscillatory patterns represent a biomarker of the integrity and the functioning of the underlying visual system.

Audio-visual stimulation for visual compensatory functions in stroke survivors with visual field defect: a systematic review

Background

Hemianopia is a complete or partial blindness in the visual fields of both eyes, commonly caused by cerebral infarction. It has been hypothesized that systematic audio-visual (AV) stimulation of the blind hemifield can improve accuracy and search times, probably due to the stimulation of bimodal representations in the superior colliculus (SC), an important multisensory structure involved in both the initiation and execution of saccades.

Methods

A narrative synthesis of the findings is presented to highlight how AV rehabilitation impacts on patients with hemianopia including visual oculomotor function, functional ability in activities of daily living, hemianopic dyslexia, visual scanning and searching tasks, maintaining of functional ability post training and the effect on brain multisensory integration by using neuroimaging.

Results

Sixteen studies were included (fourteen articles (188 participants) and two literature reviews). Results were grouped into AV training of hemianopia in adults and in children and then further grouped according to the AV task type: tasks measuring the training effects by comparing visual stimulation training to audio-visual training, localization abilities in homonymous hemianopia (HH) and AV integration in patients with HH.

Conclusion

Systematic AV training may improve the processing of visual information by recruiting subcortical pathways, and because most of the patients with visual cortex damage have an intact SC, it might be useful to use the bimodal AV training to activate retinotectal functions. Nevertheless, the underlying mechanisms supporting the reported positive effects are not currently understood. Systematic functional and/or structural imaging studies may help in understanding the underlying mechanism and inform the design of optimal training paradigms.

Supplementary Information

The online version contains supplementary material available at 10.1007/s10072-022-05926-y.

Adaptive and maladaptive brain functional network reorganization after stroke in hemianopia patients: an EEG-tracking study

OBJECTIVE

Hemianopia following occipital stroke is believed to be mainly due to local damage at or near the lesion site. Yet, MRI studies suggest functional connectivity network (FCN) reorganization also in distant brain regions. Because it is unclear if reorganization is adaptive or maladaptive, compensating for, or aggravating vision loss, we characterized FCNs electrophysiologically to explore local and global brain plasticity and correlated FCN reorganization with visual performance.

METHODS

Resting-state EEG was recorded in chronic, unilateral stroke patients and healthy age-matched controls (n=24 each). The correlation of oscillating EEG activity was calculated with the imaginary part of coherence between pairs of interested regions, and FCN graph theory metrics (degree, strength, clustering coefficient) were correlated with stimulus detection and reaction time.

RESULTS

Stroke brains showed altered FCNs in the alpha- and beta-band in numerous occipital, temporal and frontal brain structures. On a global level, FCN had a less efficient network organization while on the local level node networks reorganized especially in the intact hemisphere. Here, the occipital network was 58% more rigid (with a more "regular" network structure) while the temporal network was 32% more efficient (showing greater "small-worldness"), both of which correlated with worse or better visual processing, respectively.

CONCLUSIONS

Occipital stroke is associated with both local and global FCN reorganization, but this can be both, adaptive and maladaptive. We propose that the more "regular" FCN structure in the intact visual cortex indicates maladaptive plasticity where less processing efficacy with reduced signal/noise ratio may cause perceptual deficits in the intact visual field. In contrast, reorganization in intact temporal brain regions is presumably adaptive, possibly supporting enhanced peripheral movement perception.

Reorganization of Brain Functional Connectivity Network and Vision Restoration Following Combined tACS-tDCS Treatment After Occipital Stroke

Objective: Non-invasive brain stimulation (NIBS) is already known to improve visual field functions in patients with optic nerve damage and partially restores the organization of brain functional connectivity networks (FCNs). However, because little is known if NIBS is effective also following brain damage, we now studied the correlation between visual field recovery and FCN reorganization in patients with stroke of the central visual pathway.

Method: In a controlled, exploratory trial, 24 patients with hemianopia were randomly assigned to one of three brain stimulation groups: transcranial direct current stimulation (tDCS)/transcranial alternating current stimulation (tACS) (ACDC); sham tDCS/tACS (AC); sham tDCS/sham tACS (Sham), which were compared to age-matched controls (n = 24). Resting-state electroencephalogram (EEG) was collected at baseline, after 10 days stimulation and at 2 months follow-up. EEG recordings were analyzed for FCN measures using graph theory parameters, and FCN small worldness of the network and long pairwise coherence parameter alterations were then correlated with visual field performance.

Result: ACDC enhanced alpha-band FCN strength in the superior occipital lobe of the lesioned hemisphere at follow-up. A negative correlation (r = −0.80) was found between the intact visual field size and characteristic path length (CPL) after ACDC with a trend of decreased alpha-band centrality of the intact middle occipital cortex. ACDC also significantly decreased delta band coherence between the lesion and the intact occipital lobe, and coherence was enhanced between occipital and temporal lobe of the intact hemisphere in the low beta band. Responders showed significantly higher strength in the low alpha band at follow-up in the intact lingual and calcarine cortex and in the superior occipital region of the lesioned hemisphere.

Conclusion: While ACDC decreases delta band coherence between intact and damaged occipital brain areas indicating inhibition of low-frequency neural oscillations, ACDC increases FCN connectivity between the occipital and temporal lobe in the intact hemisphere. When taken together with the lower global clustering coefficient in responders, these findings suggest that FCN reorganization (here induced by NIBS) is adaptive in stroke. It leads to greater efficiency of neural processing, where the FCN requires fewer connections for visual processing.

Association Cortex Is Essential to Reverse Hemianopia by Multisensory Training

Hemianopia induced by unilateral visual cortex lesions can be resolved by repeatedly exposing the blinded hemifield to auditory-visual stimuli. This rehabilitative "training" paradigm depends on mechanisms of multisensory plasticity that restore the lost visual responsiveness of multisensory neurons in the ipsilesional superior colliculus (SC) so that they can once again support vision in the blinded hemifield. These changes are thought to operate via the convergent visual and auditory signals relayed to the SC from association cortex (the anterior ectosylvian sulcus [AES], in cat). The present study tested this assumption by cryogenically deactivating ipsilesional AES in hemianopic, anesthetized cats during weekly multisensory training sessions. No signs of visual recovery were evident in this condition, even after providing animals with up to twice the number of training sessions required for effective rehabilitation. Subsequent training under the same conditions, but with AES active, reversed the hemianopia within the normal timeframe. These results indicate that the corticotectal circuit that is normally engaged in SC multisensory plasticity has to be operational for the brain to use visual-auditory experience to resolve hemianopia.

Mirror therapy for unilateral neglect after stroke: A systematic review

BACKGROUND AND PURPOSE

The effect of mirror therapy for unilateral neglect after stroke currently remains uncertain.

METHODS

This systematic review investigated the effect of mirror therapy on neglect and daily living activities in patients with unilateral neglect after stroke when compared with no treatment, sham mirror therapy, or routinely applied therapies only. We performed a systematic electronic search of PubMed, Embase, Web of Science, Cochrane Central Register of Controlled Trials, China National Knowledge Infrastructure, and Wanfang Data to identify relevant randomized control trials (RCTs).

RESULTS

We included five RCTs in the data synthesis. Mirror therapy (combined or not with other treatments) was more effective in improving neglect as compared with sham mirror therapy or no treatment (combined or not with the other therapies; standard mean difference [SMD] = 1.62, 95% confidence interval [CI] = 1.03-2.21, p < 0.00001). Mirror therapy (combined or not with other therapies) was effective in improving daily living activities as compared with sham mirror therapy or no treatment (combined or not with the other therapies; SMD = 2.09, 95% CI = 0.63-3.56, p = 0.005).

CONCLUSIONS

Our results show that mirror therapy effectively improves neglect and daily living activities in patients with unilateral neglect after stroke. Future trials with high methodological quality and larger sample sizes are needed to determine the immediate and long-term effect of appropriate mirror therapy protocol for unilateral neglect.

Using the Principles of Multisensory Integration to Reverse Hemianopia

Hemianopia can be rehabilitated by an auditory-visual "training" procedure, which restores visual responsiveness in midbrain neurons indirectly compromised by the cortical lesion and reinstates vision in contralesional space. Presumably, these rehabilitative changes are induced via mechanisms of multisensory integration/plasticity. If so, the paradigm should fail if the stimulus configurations violate the spatiotemporal principles that govern these midbrain processes. To test this possibility, hemianopic cats were provided spatially or temporally noncongruent auditory-visual training. Rehabilitation failed in all cases even after approximately twice the number of training trials normally required for recovery, and even after animals learned to approach the location of the undetected visual stimulus. When training was repeated with these stimuli in spatiotemporal concordance, hemianopia was resolved. The results identify the conditions needed to engage changes in remaining neural circuits required to support vision in the absence of visual cortex, and have implications for rehabilitative strategies in human patients.

Disrupted resting-state EEG alpha-band interactions as a novel marker for the severity of visual field deficits after brain lesion

OBJECTIVE

Homonymous visual field deficits (HFVDs) are frequent following brain lesions. Current restoration treatments aim at activating areas of residual vision through numerous stimuli, but show limited effect. Recent findings suggest that spontaneous neural α-band coupling is more efficient for enabling visual perception in healthy humans than task-induced activations. Here, we evaluated whether it is also associated with the severity of HFVD.

METHODS

Ten patients with HFVDs after brain damage in the subacute to chronic stage and ten matched healthy controls underwent visual stimulation with alternating checkerboards and electroencephalography recordings of stimulation-induced power changes and of spontaneous neural interactions during rest.

RESULTS

Visual areas of the affected hemisphere showed reduced event-related power decrease in α and β frequency bands, but also reduced spontaneous α-band interactions during rest, as compared to contralesional areas and healthy controls. A multivariate stepwise regression retained the degree of disruption of spontaneous interactions, but not the reduced task-induced power changes as predictor for the severity of the visual deficit.

CONCLUSIONS

Spontaneous α-band interactions of visual areas appear as a better marker for the severity of HFVDs than task-induced activations.

SIGNIFICANCE

Treatment attempts of HFVDs should try to enhance spontaneous α-band coupling of structurally intact ipsilesional areas.

An Audiovisual 3D-Immersive Stimulation Program in Hemianopia Using a Connected Device

BACKGROUND Homonymous hemianopia is a loss of conscious vision in one hemifield, strongly affecting everyday life. Audiovisual stimulation programs improve visual perception in the blind hemifield; however, they use large equipment operated in clinical settings. Such treatments require frequent visits at the clinic, hampering the patient's adherence and compliance. In one hemianopia patient, we tested a 4-week dynamic audiovisual rehabilitation program in the stand-alone, remotely controlled, virtual-reality, head-mounted display Oculus Go and measured the effect on visual perception. CASE REPORT A 15-year-old Caucasian male was diagnosed with a right homonymous hemianopia with splitting of central fixation after a traumatic occipital contusion at age 7 months. Visual assessment showed impaired binocular contrast sensitivity and retinal sensitivity. Fixation stability and visual fields were strongly affected. After a 4-week audiovisual rehabilitation program, including 3 hours 20 minutes of stimulation, the contrast sensitivity, fixation stability, and paracentral visual perception were significantly enhanced, improving quality of life. CONCLUSIONS This pioneering work reports the use of virtual-reality in a head-mounted display to provide an audiovisual stimulation protocol for low-vision rehabilitation in a hemianopia patient. Real-time data recording and remote control of the stimulation program demonstrate that such rehabilitation treatment can be performed by the patient at home without interruption of care, decreasing the burden of disease. Beneficial effects on visual function were measured according to clinical guidelines of low-vision assessment. Improvement in visual function and quality of life challenge the prevailing belief that post-acute vision loss is both permanent and unchangeable.

Eye-tracking-based visual field analysis (EFA): a reliable and precise perimetric methodology for the assessment of visual field defects

OBJECTIVE

Several studies report evidence for training-related neuroplasticity in the visual cortex, while other studies suggest that improvements simply reflect inadequate eye fixation control during perimetric prediagnostics and postdiagnostics.

METHODS AND ANALYSIS

To improve diagnostics, a new eye-tracking-based methodology for visual field analysis (eye-tracking-based visual field analysis (EFA)) was developed. The EFA is based on static automated perimetry and additionally takes individual eye movements in real time into account and compensates for them. In the present study, an evaluation of the EFA with the help of blind spots of 58 healthy participants and the individual visual field defects of 23 clinical patients is provided. With the help of the EFA, optical coherence tomography, Goldmann perimetry and a Humphrey field analyser, these natural and acquired scotomas were diagnosed and the results were compared accordingly.

RESULTS

The EFA provides a SE of measurement of 0.38° for the right eye (OD) and 0.50° for the left eye (OS), leading to 0.44° of visual angle for both eyes (OU). Based on participants' individual results, the EFA provides disattenuated correlation (validity) of 1.00 for both OD and OS. Results from patients suffering from cortical lesions and glaucoma further indicate that the EFA is capable of diagnosing acquired scotoma validly and is applicable for clinical use.

CONCLUSION

Outcomes indicate that the EFA is highly reliable and precise in diagnosing individual shape and location of scotoma and capable of recording changes of visual field defects (after intervention) with unprecedented precision. Test duration is comparable to established instruments and due to the high customisability of the EFA, assessment duration can be shortened by adapting the diagnostic procedure to the patients' individual visual field characteristics. Therefore, the saccade-compensating methodology enables researchers and healthcare professionals to rule out eye movements as a source of inaccuracies in pre-, post-, and follow-up assessments.

Shaping the visual system: cortical and subcortical plasticity in the intact and the lesioned brain

Visual system is endowed with an incredibly complex organization composed of multiple visual pathway affording both hierarchical and parallel processing. Even if most of the visual information is conveyed by the retina to the lateral geniculate nucleus of the thalamus and then to primary visual cortex, a wealth of alternative subcortical pathways is present. This complex organization is experience dependent and retains plastic properties throughout the lifespan enabling the system with a continuous update of its functions in response to variable external needs. Changes can be induced by several factors including learning and experience but can also be promoted by the use non-invasive brain stimulation techniques. Furthermore, besides the astonishing ability of our visual system to spontaneously reorganize after injuries, we now know that the exposure to specific rehabilitative training can produce not only important functional modifications but also long-lasting changes within cortical and subcortical structures. The present review aims to update and address the current state of the art on these topics gathering studies that reported relevant modifications of visual functioning together with plastic changes within cortical and subcortical structures both in the healthy and in the lesioned visual system.

Using superior colliculus principles of multisensory integration to reverse hemianopia

The diversity of our senses conveys many advantages; it enables them to compensate for one another when needed, and the information they provide about a common event can be integrated to facilitate its processing and, ultimately, adaptive responses. These cooperative interactions are produced by multisensory neurons. A well-studied model in this context is the multisensory neuron in the output layers of the superior colliculus (SC). These neurons integrate and amplify their cross-modal (e.g., visual-auditory) inputs, thereby enhancing the physiological salience of the initiating event and the probability that it will elicit SC-mediated detection, localization, and orientation behavior. Repeated experience with the same visual-auditory stimulus can also increase the neuron's sensitivity to these individual inputs. This observation raised the possibility that such plasticity could be engaged to restore visual responsiveness when compromised. For example, unilateral lesions of visual cortex compromise the visual responsiveness of neurons in the multisensory output layers of the ipsilesional SC and produces profound contralesional blindness (hemianopia). The possibility that multisensory plasticity could restore the visual responses of these neurons, and reverse blindness, was tested in the cat model of hemianopia. Hemianopic subjects were repeatedly presented with spatiotemporally congruent visual-auditory stimulus pairs in the blinded hemifield on a daily or weekly basis. After several weeks of this multisensory exposure paradigm, visual responsiveness was restored in SC neurons and behavioral responses were elicited by visual stimuli in the previously blind hemifield. The constraints on the effectiveness of this procedure proved to be the same as those constraining SC multisensory plasticity: whereas repetitions of a congruent visual-auditory stimulus was highly effective, neither exposure to its individual component stimuli, nor to these stimuli in non-congruent configurations was effective. The restored visual responsiveness proved to be robust, highly competitive with that in the intact hemifield, and sufficient to support visual discrimination.

Reversing Hemianopia by Multisensory Training Under Anesthesia

Hemianopia is characterized by blindness in one half of the visual field and is a common consequence of stroke and unilateral injury to the visual cortex. There are few effective rehabilitative strategies that can relieve it. Using the cat as an animal model of hemianopia, we found that blindness induced by lesions targeting all contiguous areas of the visual cortex could be rapidly reversed by a non-invasive, multisensory (auditory-visual) exposure procedure even while animals were anesthetized. Surprisingly few trials were required to reinstate vision in the previously blind hemisphere. That rehabilitation was possible under anesthesia indicates that the visuomotor behaviors commonly believed to be essential are not required for this recovery, nor are factors such as attention, motivation, reward, or the various other cognitive features that are generally thought to facilitate neuro-rehabilitative therapies.

Beyond black and white: heibaika, neuroparenting, and lay neuroscience

Heibaika (Mandarin for black-and-white cards) are tools that Taiwanese parents use for infants below 3 months old. These cards are claimed to stimulate vision and enhance the brain. Although the scientific efficacy of heibaika is questionable, the wide circulation of these cards illustrates the ways some try to urge laypeople to imagine and picture the infant brain. Thus, the use of heibaika constitutes a good example of neuroparenting and neuroculture, where flourishing neuroscience transforms the parenting culture. In the present study, multiple methodologies are applied, and the emergence of heibaika is identified as a twenty-first century phenomenon popularised by online forums and postpartum care centres, among many other channels. Heibaika are contextualised in the globalisation of neuroparenting through translation since the 1990s and the rising anxiety of contemporary Taiwanese parents. Through interview analysis, parents are classified into believers, sceptics, and cautious experimenters. Their anticipations and worries are further elaborated. The paper concludes by highlighting its three major contributions: the importance of studying lay neuroscience as a way to rethink and problematise the boundary between science and culture, the enrichment of the concept of neuroparenting, and the emphasis on the dimension of globalisation and knowledge transmission.

Interhemispheric visual competition after multisensory reversal of hemianopia

Unilateral lesions of visual cortex have the secondary consequence of suppressing visual circuits in the midbrain superior colliculus (SC), collectively producing blindness in contralesional space (“hemianopia”). Recent studies have demonstrated that SC visual responses and contralesional vision can be reinstated by a non‐invasive multisensory training procedure in which spatiotemporally concordant visual‐auditory pairs are repeatedly presented within the blind hemifield. Despite this recovery of visual responsiveness, the loss of visual cortex was expected to result in permanent deficits in that hemifield, especially when visual events in both hemifields compete for attention and access to the brain's visuomotor circuitry. This was evaluated in the present study in a visual choice paradigm in which the two visual hemifields of recovered cats were simultaneously stimulated with equally valent visual targets. Surprisingly, the expected disparity was not found, and some animals even preferred stimuli presented in the previously blind hemifield. This preference persisted across multiple stimulus intensity levels and there was no indication that animals were less aware of cues in the previously blind hemifield than in its spared counterpart. Furthermore, when auditory cues were combined with visual cues, the enhanced performance they produced on a visual task was no greater in the normal than in the previously blind hemifield. These observations suggest that the multisensory rehabilitation paradigm revealed greater inherent visual information processing potential in the previously blind hemifield than was believed possible given the loss of visual cortex.

Audiovisual Rehabilitation in Hemianopia: A Model-Based Theoretical Investigation

Hemianopic patients exhibit visual detection improvement in the blind field when audiovisual stimuli are given in spatiotemporally coincidence. Beyond this “online” multisensory improvement, there is evidence of long-lasting, “offline” effects induced by audiovisual training: patients show improved visual detection and orientation after they were trained to detect and saccade toward visual targets given in spatiotemporal proximity with auditory stimuli. These effects are ascribed to the Superior Colliculus (SC), which is spared in these patients and plays a pivotal role in audiovisual integration and oculomotor behavior. Recently, we developed a neural network model of audiovisual cortico-collicular loops, including interconnected areas representing the retina, striate and extrastriate visual cortices, auditory cortex, and SC. The network simulated unilateral V1 lesion with possible spared tissue and reproduced “online” effects. Here, we extend the previous network to shed light on circuits, plastic mechanisms, and synaptic reorganization that can mediate the training effects and functionally implement visual rehabilitation. The network is enriched by the oculomotor SC-brainstem route, and Hebbian mechanisms of synaptic plasticity, and is used to test different training paradigms (audiovisual/visual stimulation in eye-movements/fixed-eyes condition) on simulated patients. Results predict different training effects and associate them to synaptic changes in specific circuits. Thanks to the SC multisensory enhancement, the audiovisual training is able to effectively strengthen the retina-SC route, which in turn can foster reinforcement of the SC-brainstem route (this occurs only in eye-movements condition) and reinforcement of the SC-extrastriate route (this occurs in presence of survived V1 tissue, regardless of eye condition). The retina-SC-brainstem circuit may mediate compensatory effects: the model assumes that reinforcement of this circuit can translate visual stimuli into short-latency saccades, possibly moving the stimuli into visual detection regions. The retina-SC-extrastriate circuit is related to restitutive effects: visual stimuli can directly elicit visual detection with no need for eye movements. Model predictions and assumptions are critically discussed in view of existing behavioral and neurophysiological data, forecasting that other oculomotor compensatory mechanisms, beyond short-latency saccades, are likely involved, and stimulating future experimental and theoretical investigations.

Pulsed Stimuli Elicit More Robust Multisensory Enhancement than Expected

Neurons in the superior colliculus (SC) integrate cross-modal inputs to generate responses that are more robust than to either input alone, and are frequently greater than their sum (superadditive enhancement). Previously, the principles of a real-time multisensory transform were identified and used to accurately predict a neuron's responses to combinations of brief flashes and noise bursts. However, environmental stimuli frequently have more complex temporal structures that elicit very different response dynamics than previously examined. The present study tested whether such stimuli (i.e., pulsed) would be treated similarly by the multisensory transform. Pulsing visual and auditory stimuli elicited responses composed of higher discharge rates that had multiple peaks temporally aligned to the stimulus pulses. Combinations pulsed cues elicited multiple peaks of superadditive enhancement within the response window. Measured over the entire response, this resulted in larger enhancements than expected given enhancements elicited by non-pulsed (“sustained”) stimuli. However, as with sustained stimuli, the dynamics of multisensory responses to pulsed stimuli were highly related to the temporal dynamics of the unisensory inputs. This suggests that the specific characteristics of the multisensory transform are not determined by the external features of the cross-modal stimulus configuration; rather the temporal structure and alignment of the unisensory inputs is the dominant driving factor in the magnitudes of the multisensory product.

Audio-visual interaction in visual motion detection: Synchrony versus Asynchrony

OBJECTIVE

Detection and identification of moving targets is of paramount importance in everyday life, even if it is not widely tested in optometric practice, mostly for technical reasons. There are clear indications in the literature that in perception of moving targets, vision and hearing interact, for example in noisy surrounds and in understanding speech. The main aim of visual perception, the ability that optometry aims to optimize, is the identification of objects, from everyday objects to letters, but also the spatial orientation of subjects in natural surrounds. To subserve this aim, corresponding visual and acoustic features from the rich spectrum of signals supplied by natural environments have to be combined.

METHODS

Here, we investigated the influence of an auditory motion stimulus on visual motion detection, both with a concrete (left/right movement) and an abstract auditory motion (increase/decrease of pitch).

RESULTS

We found that incongruent audiovisual stimuli led to significantly inferior detection compared to the visual only condition. Additionally, detection was significantly better in abstract congruent than incongruent trials. For the concrete stimuli the detection threshold was significantly better in asynchronous audiovisual conditions than in the unimodal visual condition.

CONCLUSION

We find a clear but complex pattern of partly synergistic and partly inhibitory audio-visual interactions. It seems that asynchrony plays only a positive role in audiovisual motion while incongruence mostly disturbs in simultaneous abstract configurations but not in concrete configurations. As in speech perception in hearing-impaired patients, patients suffering from visual deficits should be able to benefit from acoustic information.

From Cortical Blindness to Conscious Visual Perception: Theories on Neuronal Networks and Visual Training Strategies

Homonymous hemianopia (HH) is the most common cortical visual impairment leading to blindness in the contralateral hemifield. It is associated with many inconveniences and daily restrictions such as exploration and visual orientation difficulties. However, patients with HH can preserve the remarkable ability to unconsciously perceive visual stimuli presented in their blindfield, a phenomenon known as blindsight. Unfortunately, the nature of this captivating residual ability is still misunderstood and the rehabilitation strategies in terms of visual training have been insufficiently exploited. This article discusses type I and type II blindsight in a neuronal framework of altered global workspace, resulting from inefficient perception, attention and conscious networks. To enhance synchronization and create global availability for residual abilities to reach visual consciousness, rehabilitation tools need to stimulate subcortical extrastriate pathways through V5/MT. Multisensory bottom-up compensation combined with top-down restitution training could target pre-existing and new neuronal mechanisms to recreate a framework for potential functionality.

The normal environment delays the development of multisensory integration

Multisensory neurons in animals whose cross-modal experiences are compromised during early life fail to develop the ability to integrate information across those senses. Consequently, they lack the ability to increase the physiological salience of the events that provide the convergent cross-modal inputs. The present study demonstrates that superior colliculus (SC) neurons in animals whose visual-auditory experience is compromised early in life by noise-rearing can develop visual-auditory multisensory integration capabilities rapidly when periodically exposed to a single set of visual-auditory stimuli in a controlled laboratory paradigm. However, they remain compromised if their experiences are limited to a normal housing environment. These observations seem counterintuitive given that multisensory integrative capabilities ordinarily develop during early life in normal environments, in which a wide variety of sensory stimuli facilitate the functional organization of complex neural circuits at multiple levels of the neuraxis. However, the very richness and inherent variability of sensory stimuli in normal environments will lead to a less regular coupling of any given set of cross-modal cues than does the otherwise "impoverished" laboratory exposure paradigm. That this poses no significant problem for the neonate, but does for the adult, indicates a maturational shift in the requirements for the development of multisensory integration capabilities.

Auditory Processing After Traumatic Brain Injury

Auditory processing involves many diverse aspects of the peripheral and central nervous system. Where “simple” transformation of information ends and “signal processing” begins is difficult to say with any certainty, and the distinction between “automatic” processing and “controlled” processing is an even more philosophical question. For these reasons, the damage that occurs in one portion of the nervous system can have serious implications for many other parts of the system. For this reason, it is essential that clinicians involved in working with patients for whom any portion of the auditory system is at risk need to be in close communication with those who specialize in understanding the other parts of this delicate and interwoven system.

Non-invasive electrical brain stimulation: from acute to late-stage treatment of central nervous system damage

Non-invasive brain current stimulation (NIBS) is a promising and versatile tool for inducing neuroplasticity, protection and functional rehabilitation of damaged neuronal systems. It is technically simple, requires no surgery, and has significant beneficial effects. However, there are various technical approaches for NIBS which influence neuronal networks in significantly different ways. Transcranial direct current stimulation (tDCS), alternating current stimulation (ACS) and repetitive transcranial magnetic stimulation (rTMS) all have been applied to modulate brain activity in animal experiments under normal and pathological conditions. Also clinical trials have shown that tDCS, rTMS and ACS induce significant behavioural effects and can – depending on the parameters chosen – enhance or decrease brain excitability and influence performance and learning as well as rehabilitation and protective mechanisms. The diverse phaenomena and partially opposing effects of NIBS are not yet fully understood and mechanisms of action need to be explored further in order to select appropriate parameters for a given task, such as current type and strength, timing, distribution of current densities and electrode position. In this review, we will discuss the various parameters which need to be considered when designing a NIBS protocol and will put them into context with the envisaged applications in experimental neurobiology and medicine such as vision restoration, motor rehabilitation and cognitive enhancement.

Non-pharmacological intervention for posterior cortical atrophy

Posterior cortical atrophy (PCA) is a rare neurodegenerative condition characterized by progressive visual-perceptual deficits. Although the neurocognitive profile of PCA is a growing and relatively well-established field, non-pharmacological care remains understudied and to be widely established in clinical practice. In the present work we review the available literature on non-pharmacological approaches for PCA, such as cognitive rehabilitation including individual cognitive exercises and compensatory techniques to improve autonomy in daily life, and psycho-education aiming to inform people with PCA about the nature of their visual deficits and limits of cognitive rehabilitation. The reviewed studies represented a total of 7 patients. There is a scarcity of the number of studies, and mostly consisting of case studies. Results suggest non-pharmacological intervention to be a potentially beneficial approach for the partial compensation of deficits, improvement of daily functionality and improvement of quality of life. Clinical implications and future directions are also highlighted for the advancement of the field, in order to clarify the possible role of non-pharmacological interventions, and its extent, in PCA.

Sensory Substitution: The Spatial Updating of Auditory Scenes "Mimics" the Spatial Updating of Visual Scenes

Visual-to-auditory sensory substitution is used to convey visual information through audition, and it was initially created to compensate for blindness; it consists of software converting the visual images captured by a video-camera into the equivalent auditory images, or “soundscapes”. Here, it was used by blindfolded sighted participants to learn the spatial position of simple shapes depicted in images arranged on the floor. Very few studies have used sensory substitution to investigate spatial representation, while it has been widely used to investigate object recognition. Additionally, with sensory substitution we could study the performance of participants actively exploring the environment through audition, rather than passively localizing sound sources. Blindfolded participants egocentrically learnt the position of six images by using sensory substitution and then a judgment of relative direction task (JRD) was used to determine how this scene was represented. This task consists of imagining being in a given location, oriented in a given direction, and pointing towards the required image. Before performing the JRD task, participants explored a map that provided allocentric information about the scene. Although spatial exploration was egocentric, surprisingly we found that performance in the JRD task was better for allocentric perspectives. This suggests that the egocentric representation of the scene was updated. This result is in line with previous studies using visual and somatosensory scenes, thus supporting the notion that different sensory modalities produce equivalent spatial representation(s). Moreover, our results have practical implications to improve training methods with sensory substitution devices (SSD).