Interhemispheric visual competition after multisensory reversal of hemianopia

The brain can develop conflicting multisensory principles to guide behavior

Midbrain multisensory neurons undergo a significant postnatal transition in how they process cross-modal (e.g. visual-auditory) signals. In early stages, signals derived from common events are processed competitively; however, at later stages they are processed cooperatively such that their salience is enhanced. This transition reflects adaptation to cross-modal configurations that are consistently experienced and become informative about which correspond to common events. Tested here was the assumption that overt behaviors follow a similar maturation. Cats were reared in omnidirectional sound thereby compromising the experience needed for this developmental process. Animals were then repeatedly exposed to different configurations of visual and auditory stimuli (e.g. spatiotemporally congruent or spatially disparate) that varied on each side of space and their behavior was assessed using a detection/localization task. Animals showed enhanced performance to stimuli consistent with the experience provided: congruent stimuli elicited enhanced behaviors where spatially congruent cross-modal experience was provided, and spatially disparate stimuli elicited enhanced behaviors where spatially disparate cross-modal experience was provided. Cross-modal configurations not consistent with experience did not enhance responses. The presumptive benefit of such flexibility in the multisensory developmental process is to sensitize neural circuits (and the behaviors they control) to the features of the environment in which they will function. These experiments reveal that these processes have a high degree of flexibility, such that two (conflicting) multisensory principles can be implemented by cross-modal experience on opposite sides of space even within the same animal.

Ameliorating Hemianopia with Multisensory Training

Hemianopia (unilateral blindness), a common consequence of stroke and trauma to visual cortex, is a debilitating disorder for which there are few treatments. Research in an animal model has suggested that visual-auditory stimulation therapy, which exploits the multisensory architecture of the brain, may be effective in restoring visual sensitivity in hemianopia. It was tested in two male human patients who were hemianopic for at least 8 months following a stroke. The patients were repeatedly exposed to congruent visual-auditory stimuli within their blinded hemifield during 2 h sessions over several weeks. The results were dramatic. Both recovered the ability to detect and describe visual stimuli throughout their formerly blind field within a few weeks. They could also localize these stimuli, identify some of their features, and perceive multiple visual stimuli simultaneously in both fields. These results indicate that the multisensory therapy is a rapid and effective method for restoring visual function in hemianopia.SIGNIFICANCE STATEMENT Hemianopia (blindness on one side of space) is widely considered to be a permanent disorder. Here, we show that a simple multisensory training paradigm can ameliorate this disorder in human patients.

Noise-rearing precludes the behavioral benefits of multisensory integration

Concordant visual-auditory stimuli enhance the responses of individual superior colliculus (SC) neurons. This neuronal capacity for "multisensory integration" is not innate: it is acquired only after substantial cross-modal (e.g. auditory-visual) experience. Masking transient auditory cues by raising animals in omnidirectional sound ("noise-rearing") precludes their ability to obtain this experience and the ability of the SC to construct a normal multisensory (auditory-visual) transform. SC responses to combinations of concordant visual-auditory stimuli are depressed, rather than enhanced. The present experiments examined the behavioral consequence of this rearing condition in a simple detection/localization task. In the first experiment, the auditory component of the concordant cross-modal pair was novel, and only the visual stimulus was a target. In the second experiment, both component stimuli were targets. Noise-reared animals failed to show multisensory performance benefits in either experiment. These results reveal a close parallel between behavior and single neuron physiology in the multisensory deficits that are induced when noise disrupts early visual-auditory experience.

Association Cortex Is Essential to Reverse Hemianopia by Multisensory Training

Hemianopia induced by unilateral visual cortex lesions can be resolved by repeatedly exposing the blinded hemifield to auditory-visual stimuli. This rehabilitative "training" paradigm depends on mechanisms of multisensory plasticity that restore the lost visual responsiveness of multisensory neurons in the ipsilesional superior colliculus (SC) so that they can once again support vision in the blinded hemifield. These changes are thought to operate via the convergent visual and auditory signals relayed to the SC from association cortex (the anterior ectosylvian sulcus [AES], in cat). The present study tested this assumption by cryogenically deactivating ipsilesional AES in hemianopic, anesthetized cats during weekly multisensory training sessions. No signs of visual recovery were evident in this condition, even after providing animals with up to twice the number of training sessions required for effective rehabilitation. Subsequent training under the same conditions, but with AES active, reversed the hemianopia within the normal timeframe. These results indicate that the corticotectal circuit that is normally engaged in SC multisensory plasticity has to be operational for the brain to use visual-auditory experience to resolve hemianopia.

Stimulus value gates multisensory integration

The brain enhances its perceptual and behavioral decisions by integrating information from its multiple senses in what are believed to be optimal ways. This phenomenon of "multisensory integration" appears to be pre-conscious, effortless, and highly efficient. The present experiments examined whether experience could modify this seemingly automatic process. Cats were trained in a localization task in which congruent pairs of auditory-visual stimuli are normally integrated to enhance detection and orientation/approach performance. Consistent with the results of previous studies, animals more reliably detected and approached cross-modal pairs than their modality-specific component stimuli, regardless of whether the pairings were novel or familiar. However, when provided evidence that one of the modality-specific component stimuli had no value (it was not rewarded) animals ceased integrating it with other cues, and it lost its previous ability to enhance approach behaviors. Cross-modal pairings involving that stimulus failed to elicit enhanced responses even when the paired stimuli were congruent and mutually informative. However, the stimulus regained its ability to enhance responses when it was associated with reward. This suggests that experience can selectively block access of stimuli (i.e., filter inputs) to the multisensory computation. Because this filtering process results in the loss of useful information, its operation and behavioral consequences are not optimal. Nevertheless, the process can be of substantial value in natural environments, rich in dynamic stimuli, by using experience to minimize the impact of stimuli unlikely to be of biological significance, and reducing the complexity of the problem of matching signals across the senses.

Shaping the visual system: cortical and subcortical plasticity in the intact and the lesioned brain

Visual system is endowed with an incredibly complex organization composed of multiple visual pathway affording both hierarchical and parallel processing. Even if most of the visual information is conveyed by the retina to the lateral geniculate nucleus of the thalamus and then to primary visual cortex, a wealth of alternative subcortical pathways is present. This complex organization is experience dependent and retains plastic properties throughout the lifespan enabling the system with a continuous update of its functions in response to variable external needs. Changes can be induced by several factors including learning and experience but can also be promoted by the use non-invasive brain stimulation techniques. Furthermore, besides the astonishing ability of our visual system to spontaneously reorganize after injuries, we now know that the exposure to specific rehabilitative training can produce not only important functional modifications but also long-lasting changes within cortical and subcortical structures. The present review aims to update and address the current state of the art on these topics gathering studies that reported relevant modifications of visual functioning together with plastic changes within cortical and subcortical structures both in the healthy and in the lesioned visual system.

Using superior colliculus principles of multisensory integration to reverse hemianopia

The diversity of our senses conveys many advantages; it enables them to compensate for one another when needed, and the information they provide about a common event can be integrated to facilitate its processing and, ultimately, adaptive responses. These cooperative interactions are produced by multisensory neurons. A well-studied model in this context is the multisensory neuron in the output layers of the superior colliculus (SC). These neurons integrate and amplify their cross-modal (e.g., visual-auditory) inputs, thereby enhancing the physiological salience of the initiating event and the probability that it will elicit SC-mediated detection, localization, and orientation behavior. Repeated experience with the same visual-auditory stimulus can also increase the neuron's sensitivity to these individual inputs. This observation raised the possibility that such plasticity could be engaged to restore visual responsiveness when compromised. For example, unilateral lesions of visual cortex compromise the visual responsiveness of neurons in the multisensory output layers of the ipsilesional SC and produces profound contralesional blindness (hemianopia). The possibility that multisensory plasticity could restore the visual responses of these neurons, and reverse blindness, was tested in the cat model of hemianopia. Hemianopic subjects were repeatedly presented with spatiotemporally congruent visual-auditory stimulus pairs in the blinded hemifield on a daily or weekly basis. After several weeks of this multisensory exposure paradigm, visual responsiveness was restored in SC neurons and behavioral responses were elicited by visual stimuli in the previously blind hemifield. The constraints on the effectiveness of this procedure proved to be the same as those constraining SC multisensory plasticity: whereas repetitions of a congruent visual-auditory stimulus was highly effective, neither exposure to its individual component stimuli, nor to these stimuli in non-congruent configurations was effective. The restored visual responsiveness proved to be robust, highly competitive with that in the intact hemifield, and sufficient to support visual discrimination.

Reversing Hemianopia by Multisensory Training Under Anesthesia

Hemianopia is characterized by blindness in one half of the visual field and is a common consequence of stroke and unilateral injury to the visual cortex. There are few effective rehabilitative strategies that can relieve it. Using the cat as an animal model of hemianopia, we found that blindness induced by lesions targeting all contiguous areas of the visual cortex could be rapidly reversed by a non-invasive, multisensory (auditory-visual) exposure procedure even while animals were anesthetized. Surprisingly few trials were required to reinstate vision in the previously blind hemisphere. That rehabilitation was possible under anesthesia indicates that the visuomotor behaviors commonly believed to be essential are not required for this recovery, nor are factors such as attention, motivation, reward, or the various other cognitive features that are generally thought to facilitate neuro-rehabilitative therapies.

Interhemispheric visual competition after multisensory reversal of hemianopia

Unilateral lesions of visual cortex have the secondary consequence of suppressing visual circuits in the midbrain superior colliculus (SC), collectively producing blindness in contralesional space (“hemianopia”). Recent studies have demonstrated that SC visual responses and contralesional vision can be reinstated by a non‐invasive multisensory training procedure in which spatiotemporally concordant visual‐auditory pairs are repeatedly presented within the blind hemifield. Despite this recovery of visual responsiveness, the loss of visual cortex was expected to result in permanent deficits in that hemifield, especially when visual events in both hemifields compete for attention and access to the brain's visuomotor circuitry. This was evaluated in the present study in a visual choice paradigm in which the two visual hemifields of recovered cats were simultaneously stimulated with equally valent visual targets. Surprisingly, the expected disparity was not found, and some animals even preferred stimuli presented in the previously blind hemifield. This preference persisted across multiple stimulus intensity levels and there was no indication that animals were less aware of cues in the previously blind hemifield than in its spared counterpart. Furthermore, when auditory cues were combined with visual cues, the enhanced performance they produced on a visual task was no greater in the normal than in the previously blind hemifield. These observations suggest that the multisensory rehabilitation paradigm revealed greater inherent visual information processing potential in the previously blind hemifield than was believed possible given the loss of visual cortex.