Long-Lasting Crossmodal Cortical Reorganization Triggered by Brief Postnatal Visual Deprivation

Electrophysiological responses of audiovisual integration from infancy to adulthood

Our ability to merge information from different senses into a unified percept is a crucial perceptual process for efficient interaction with our multisensory environment. Yet, the developmental process underlying how the brain implements multisensory integration (MSI) remains poorly known. This cross-sectional study aims to characterize the developmental patterns of audiovisual events in 131 individuals aged from 3 months to 30 years. Electroencephalography (EEG) was recorded during a passive task, including simple auditory, visual, and audiovisual stimuli. In addition to examining age-related variations in MSI responses, we investigated Event-Related Potentials (ERPs) linked with auditory and visual stimulation alone. This was done to depict the typical developmental trajectory of unisensory processing from infancy to adulthood within our sample and to contextualize the maturation effects of MSI in relation to unisensory development. Comparing the neural response to audiovisual stimuli to the sum of the unisensory responses revealed signs of MSI in the ERPs, more specifically between the P2 and N2 components (P2 effect). Furthermore, adult-like MSI responses emerge relatively late in the development, around 8 years old. The automatic integration of simple audiovisual stimuli is a long developmental process that emerges during childhood and continues to mature during adolescence with ERP latencies decreasing with age.

Altered development of face recognition among infants born amid the COVID-19 pandemic

To effectively contain the spread of COVID-19, public health agencies mandated special regulations. Although they protected us from COVID-19, these restrictions have inevitably changed the environment around us. It remains unclear how these changes may have affected early cognitive development among infants born during the pandemic. Thus, this study examined how the COVID-19 restrictions have affected infants' face recognition ability, a hallmark of their cognitive capacities. Specifically, we used the familiarization and visual pair comparison paradigm to examine face recognition performance among infants aged 6 to 14 months amid the second wave of the pandemic (February to July 2021). Experiment 1 investigated the recognition of unmasked faces and found that only younger infants, but not older infants, recognized faces by showing a novelty preference. Experiment 2 examined the recognition of faces wearing masks and found that only older infants, but not younger ones, recognized faces by exhibiting a familiarity preference. These results suggest that with limited interactions during the pandemic, infants could have developed an overly specialized face processing ability that failed to recognize the faces of strangers. Moreover, infants could have obtained more information on masked faces during the pandemic and adapted to the current situation. In Expreiment 3, we further confirmed the restriction on infants' interpersonal experiences with a survey conducted both before and during the pandemic. Overall, these findings demonstrated how the pandemic altered early perceptual development and further confirmed that interpersonal experiences during infancy are critical in their cognitive development.

Neural networks associated with eye movements in congenital blindness

Recent studies have shown that during the typical resting-state, echo planar imaging (EPI) time series obtained from the eye orbit area correlate with brain regions associated with oculomotor control and lower-level visual cortex. Here, we asked whether congenitally blind (CB) shows similar patterns, suggesting a hard-wired constraint on connectivity. We find that orbital EPI signals in CB do correlate with activity in the motor cortex, but less so with activity in the visual cortex. However, the temporal patterns of this eye movement-related signal differed strongly between CB and sighted controls. Furthermore, in CB, a few participants showed uncoordinated orbital EPI signals between the two eyes, each correlated with activity in different brain networks. Our findings suggest a retained circuitry between motor cortex and eye movements in blind, but also a moderate reorganization due to the absence of visual input, and the inability of CB to control their eye movements or sense their positions.

The brain can develop conflicting multisensory principles to guide behavior

Midbrain multisensory neurons undergo a significant postnatal transition in how they process cross-modal (e.g. visual-auditory) signals. In early stages, signals derived from common events are processed competitively; however, at later stages they are processed cooperatively such that their salience is enhanced. This transition reflects adaptation to cross-modal configurations that are consistently experienced and become informative about which correspond to common events. Tested here was the assumption that overt behaviors follow a similar maturation. Cats were reared in omnidirectional sound thereby compromising the experience needed for this developmental process. Animals were then repeatedly exposed to different configurations of visual and auditory stimuli (e.g. spatiotemporally congruent or spatially disparate) that varied on each side of space and their behavior was assessed using a detection/localization task. Animals showed enhanced performance to stimuli consistent with the experience provided: congruent stimuli elicited enhanced behaviors where spatially congruent cross-modal experience was provided, and spatially disparate stimuli elicited enhanced behaviors where spatially disparate cross-modal experience was provided. Cross-modal configurations not consistent with experience did not enhance responses. The presumptive benefit of such flexibility in the multisensory developmental process is to sensitize neural circuits (and the behaviors they control) to the features of the environment in which they will function. These experiments reveal that these processes have a high degree of flexibility, such that two (conflicting) multisensory principles can be implemented by cross-modal experience on opposite sides of space even within the same animal.

Neural tracking of continuous acoustics: properties, speech-specificity and open questions

Human speech is a particularly relevant acoustic stimulus for our species, due to its role of information transmission during communication. Speech is inherently a dynamic signal, and a recent line of research focused on neural activity following the temporal structure of speech. We review findings that characterise neural dynamics in the processing of continuous acoustics and that allow us to compare these dynamics with temporal aspects in human speech. We highlight properties and constraints that both neural and speech dynamics have, suggesting that auditory neural systems are optimised to process human speech. We then discuss the speech-specificity of neural dynamics and their potential mechanistic origins and summarise open questions in the field.

Sound suppresses earliest visual cortical processing after sight recovery in congenitally blind humans

Neuroscientific research has consistently shown more extensive non-visual activity in the visual cortex of congenitally blind humans compared to sighted controls; a phenomenon known as crossmodal plasticity. Whether or not crossmodal activation of the visual cortex retracts if sight can be restored is still unknown. The present study, involving a rare group of sight-recovery individuals who were born pattern vision blind, employed visual event-related potentials to investigate persisting crossmodal modulation of the initial visual cortical processing stages. Here we report that the earliest, stimulus-driven retinotopic visual cortical activity (<100 ms) was suppressed in a spatially specific manner in sight-recovery individuals when concomitant sounds accompanied visual stimulation. In contrast, sounds did not modulate the earliest visual cortical response in two groups of typically sighted controls, nor in a third control group of sight-recovery individuals who had suffered a transient phase of later (rather than congenital) visual impairment. These results provide strong evidence for persisting crossmodal activity in the visual cortex after sight recovery following a period of congenital visual deprivation. Based on the time course of this modulation, we speculate on a role of exuberant crossmodal thalamic input which may arise during a sensitive phase of brain development.

Calibrating Vision: Concepts and Questions

The idea that visual coding and perception are shaped by experience and adjust to changes in the environment or the observer is universally recognized as a cornerstone of visual processing, yet the functions and processes mediating these calibrations remain in many ways poorly understood. In this article we review a number of facets and issues surrounding the general notion of calibration, with a focus on plasticity within the encoding and representational stages of visual processing. These include how many types of calibrations there are - and how we decide; how plasticity for encoding is intertwined with other principles of sensory coding; how it is instantiated at the level of the dynamic networks mediating vision; how it varies with development or between individuals; and the factors that may limit the form or degree of the adjustments. Our goal is to give a small glimpse of an enormous and fundamental dimension of vision, and to point to some of the unresolved questions in our understanding of how and why ongoing calibrations are a pervasive and essential element of vision.

Implications of Neural Plasticity in Retinal Prosthesis

Retinal degenerative diseases such as retinitis pigmentosa cause a progressive loss of photoreceptors that eventually prevents the affected person from perceiving visual sensations. The absence of a visual input produces a neural rewiring cascade that propagates along the visual system. This remodeling occurs first within the retina. Then, subsequent neuroplastic changes take place at higher visual centers in the brain, produced by either the abnormal neural encoding of the visual inputs delivered by the diseased retina or as the result of an adaptation to visual deprivation. While retinal implants can activate the surviving retinal neurons by delivering electric current, the unselective activation patterns of the different neural populations that exist in the retinal layers differ substantially from those in physiologic vision. Therefore, artificially induced neural patterns are being delivered to a brain that has already undergone important neural reconnections. Whether or not the modulation of this neural rewiring can improve the performance for retinal prostheses remains a critical question whose answer may be the enabler of improved functional artificial vision and more personalized neurorehabilitation strategies.

Typical resting state activity of the brain requires visual input during an early sensitive period

Sensory deprivation, following a total loss of one sensory modality e.g. vision, has been demonstrated to result in compensatory plasticity. It is yet not known to which extent neural changes, e.g. higher resting-state activity in visual areas (cross-modal plasticity) as a consequence of blindness, reverse, when sight is restored. Here, we used functional MRI to acquire blood oxygen level-dependent resting-state activity during an eyes open and an eyes closed state in congenital cataract-reversal individuals, developmental cataract-reversal individuals, congenitally permanently blind individuals and sighted controls. The amplitude of low frequency fluctuation of the blood oxygen level-dependent signal—a neural marker of spontaneous brain activity during rest—was analyzed. In accordance with previous reports, in normally sighted controls we observed an increase in amplitude of low-frequency fluctuation during rest with the eyes open compared with rest with eyes closed in visual association areas and in parietal cortex but a decrease in auditory and sensorimotor regions. In congenital cataract-reversal individuals, we found an increase of the amplitude of slow blood oxygen level-dependent fluctuations in visual cortex during rest with eyes open compared with rest with eyes closed too but this increase was larger in amplitude than in normally sighted controls. In contrast, congenital cataract-reversal individuals lagged a similar increase in parietal regions and did not show the typical decrease of amplitude of low-frequency fluctuation in auditory cortex. Congenitally blind individuals displayed an overall higher amplitude in slow blood oxygen level-dependent fluctuations in visual cortex compared with sighted individuals and compared with congenital cataract-reversal individuals in the eyes closed condition. Higher amplitude of low-frequency fluctuation in visual cortex of congenital cataract-reversal individuals than in normally sighted controls during eyes open might indicate an altered excitatory–inhibitory balance of visual neural circuits. By contrast, the lower parietal increase and the missing downregulation in auditory regions suggest a reduced influence of the visual system on multisensory and the other sensory systems after restoring sight in congenitally blind individuals. These results demonstrate a crucial dependence of visual and multisensory neural system functioning on visual experience during a sensitive phase in human brain development.

Critical Periods in Vision Revisited

For four decades, investigations of the biological basis of critical periods in the developing mammalian visual cortex were dominated by study of the consequences of altered early visual experience in cats and nonhuman primates. The neural deficits thus revealed also provided insight into the origin and neural basis of human amblyopia that in turn motivated additional studies of humans with abnormal early visual input. Recent human studies point to deficits arising from alterations in all visual cortical areas and even in nonvisual cortical regions. As the new human data accumulated in parallel with a near-complete shift toward the use of rodent animal models for the study of neural mechanisms, it is now essential to review the human data and the earlier animal data obtained from cats and monkeys to infer general conclusions and to optimize future choice of the most appropriate animal model. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Delayed Auditory Brainstem Responses (ABR) in children after sight-recovery

Studies in non-human animal models have revealed that in early development, the onset of visual input gates the critical period closure of some auditory functions. The study of rare individuals whose sight was restored after a period of congenital blindness offers the rare opportunity to assess whether early visual input is a prerequisite for the full development of auditory functions in humans as well. Here, we investigated whether a few months of delayed visual onset would affect the development of Auditory Brainstem Responses (ABRs). ABRs are widely used in the clinical practice to assess both functionality and development of the subcortical auditory pathway and, provide reliable data at the individual level. We collected Auditory Brainstem Responses from two case studies, young children (both having less than 5 years of age) who experienced a transient visual deprivation since birth due to congenital bilateral dense cataracts (BC), and who acquired sight at about two months of age. As controls, we tested 41 children (sighted controls, SC) with typical development, as well as two children who were treated (at about two months of age) for congenital monocular cataracts (MC). The SC group data served to predict, at the individual level, wave latencies of each BC and MC participant. Statistics were performed both at the single subject as well as at the group levels on latencies of main ABR waves (I, III, V and SN10). Results revealed delayed response latencies for both BC children compared with the SC group starting from the wave III. Conversely, no difference emerged between MC children and the SC group. These findings suggest that in case the onset of patterned visual input is delayed, the functional development of the subcortical auditory pathway lags behind typical developmental trajectories. Ultimately results are in favor of the presence of a crossmodal sensitive period in the human subcortical auditory system.

Brief Postnatal Visual Deprivation Triggers Long-Lasting Interactive Structural and Functional Reorganization of the Human Cortex

Patients treated for bilateral congenital cataracts provide a unique model to test the role of early visual input in shaping the development of the human cortex. Previous studies showed that brief early visual deprivation triggers long-lasting changes in the human visual cortex. However, it remains unknown if such changes interact with the development of other parts of the cortex. With high-resolution structural and resting-state fMRI images, we found changes in cortical thickness within, but not limited to, the visual cortex in adult patients, who experienced transient visual deprivation early in life as a result of congenital cataracts. Importantly, the covariation of cortical thickness across regions was also altered in the patients. The areas with altered cortical thickness in patients also showed differences in functional connectivity between patients and normally sighted controls. Together, the current findings suggest an impact of early visual deprivation on the interactive development of the human cortex.

Brief period of monocular deprivation drives changes in audiovisual temporal perception

The human brain retains a striking degree of plasticity into adulthood. Recent studies have demonstrated that a short period of altered visual experience (via monocular deprivation) can change the dynamics of binocular rivalry in favor of the deprived eye, a compensatory action thought to be mediated by an upregulation of cortical gain control mechanisms. Here, we sought to better understand the impact of monocular deprivation on multisensory abilities, specifically examining audiovisual temporal perception. Using an audiovisual simultaneity judgment task, we discovered that 90 minutes of monocular deprivation produced opposing effects on the temporal binding window depending on the eye used in the task. Thus, in those who performed the task with their deprived eye there was a narrowing of the temporal binding window, whereas in those performing the task with their nondeprived eye there was a widening of the temporal binding window. The effect was short lived, being observed only in the first 10 minutes of postdeprivation testing. These findings indicate that changes in visual experience in the adult can rapidly impact multisensory perceptual processes, a finding that has important clinical implications for those patients with adult-onset visual deprivation and for therapies founded on monocular deprivation.

Neural mechanisms of visual sensitive periods in humans

Sensitive periods in brain development are phases of enhanced susceptibility to experience. Here we discuss research from human and non-human neuroscience studies which have demonstrated a) differences in the way infants vs. adults learn; b) how the brain adapts to atypical conditions, in particular a congenital vs. a late onset blindness (sensitive periods for atypical brain development); and c) the extent to which neural systems are capable of acquiring a typical brain organization after sight restoration following a congenital vs. late phase of pattern vision deprivation (sensitive periods for typical brain development). By integrating these three lines of research, we propose neural mechanisms characteristic of sensitive periods vs. adult neuroplasticity and learning.

Mental Rotation of Digitally-Rendered Haptic Objects by the Visually-Impaired

In the event of visual impairment or blindness, information from other intact senses can be used as substitutes to retrain (and in extremis replace) visual functions. Abilities including reading, mental representation of objects and spatial navigation can be performed using tactile information. Current technologies can convey a restricted library of stimuli, either because they depend on real objects or renderings with low resolution layouts. Digital haptic technologies can overcome such limitations. The applicability of this technology was previously demonstrated in sighted participants. Here, we reasoned that visually-impaired and blind participants can create mental representations of letters presented haptically in normal and mirror-reversed form without the use of any visual information, and mentally manipulate such representations. Visually-impaired and blind volunteers were blindfolded and trained on the haptic tablet with two letters (either L and P or F and G). During testing, they haptically explored on any trial one of the four letters presented at 0°, 90°, 180°, or 270° rotation from upright and indicated if the letter was either in a normal or mirror-reversed form. Rotation angle impacted performance; greater deviation from 0° resulted in greater impairment for trained and untrained normal letters, consistent with mental rotation of these haptically-rendered objects. Performance was also generally less accurate with mirror-reversed stimuli, which was not affected by rotation angle. Our findings demonstrate, for the first time, the suitability of a digital haptic technology in the blind and visually-impaired. Classic devices remain limited in their accessibility and in the flexibility of their applications. We show that mental representations can be generated and manipulated using digital haptic technology. This technology may thus offer an innovative solution to the mitigation of impairments in the visually-impaired, and to the training of skills dependent on mental representations and their spatial manipulation.

The Detrimental Effect of Noisy Visual Input on the Visual Development of Human Infants

We followed visual development in a rare yet large sample of patients with congenital bilateral cataract for 4 years. We divided the patients into two groups: a complete deprivation group with no response to a flashlight pointing to either of their eyes and otherwise an incomplete deprivation group. All the patients received cataract surgery at age of 3 months. From 27 months onward, the complete deprivation group showed better developmental outcomes in acuity and eyeball growth than the incomplete deprivation group. Such a seemingly counterintuitive finding is consistent with research on visually deprived animals. Plasticity is better preserved in animals receiving a short period of complete visual deprivation from birth than in animals who saw diffuse light. The current finding that plasticity in visual development is better preserved in human infants with complete visual deprivation than in those who can see diffuse light but not patterned visual input has important clinical implications.

•

Infants with complete deprivation have developed better acuity than incomplete ones

•

Plasticity is better preserved in complete deprivation infants than in incomplete ones

•

Infants with complete deprivation have less myopic shift than incompletes ones

•

Early noisy input has the detrimental effect on human visual development

Language and Sensory Neural Plasticity in the Superior Temporal Cortex of the Deaf

Visual stimuli are known to activate the auditory cortex of deaf people, presenting evidence of cross-modal plasticity. However, the mechanisms underlying such plasticity are poorly understood. In this functional MRI study, we presented two types of visual stimuli, language stimuli (words, sign language, and lip-reading) and a general stimulus (checkerboard) to investigate neural reorganization in the superior temporal cortex (STC) of deaf subjects and hearing controls. We found that only in the deaf subjects, all visual stimuli activated the STC. The cross-modal activation induced by the checkerboard was mainly due to a sensory component via a feed-forward pathway from the thalamus and primary visual cortex, positively correlated with duration of deafness, indicating a consequence of pure sensory deprivation. In contrast, the STC activity evoked by language stimuli was functionally connected to both the visual cortex and the frontotemporal areas, which were highly correlated with the learning of sign language, suggesting a strong language component via a possible feedback modulation. While the sensory component exhibited specificity to features of a visual stimulus (e.g., selective to the form of words, bodies, or faces) and the language (semantic) component appeared to recruit a common frontotemporal neural network, the two components converged to the STC and caused plasticity with different multivoxel activity patterns. In summary, the present study showed plausible neural pathways for auditory reorganization and correlations of activations of the reorganized cortical areas with developmental factors and provided unique evidence towards the understanding of neural circuits involved in cross-modal plasticity.

Neuronal populations in the occipital cortex of the blind synchronize to the temporal dynamics of speech

The occipital cortex of early blind individuals (EB) activates during speech processing, challenging the notion of a hard-wired neurobiology of language. But, at what stage of speech processing do occipital regions participate in EB? Here we demonstrate that parieto-occipital regions in EB enhance their synchronization to acoustic fluctuations in human speech in the theta-range (corresponding to syllabic rate), irrespective of speech intelligibility. Crucially, enhanced synchronization to the intelligibility of speech was selectively observed in primary visual cortex in EB, suggesting that this region is at the interface between speech perception and comprehension. Moreover, EB showed overall enhanced functional connectivity between temporal and occipital cortices that are sensitive to speech intelligibility and altered directionality when compared to the sighted group. These findings suggest that the occipital cortex of the blind adopts an architecture that allows the tracking of speech material, and therefore does not fully abstract from the reorganized sensory inputs it receives.

Plasticity in the auditory system

Over the last 30 years a wide range of manipulations of auditory input and experience have been shown to result in plasticity in auditory cortical and subcortical structures. The time course of plasticity ranges from very rapid stimulus-specific adaptation to longer-term changes associated with, for example, partial hearing loss or perceptual learning. Evidence for plasticity as a consequence of these and a range of other manipulations of auditory input and/or its significance is reviewed, with an emphasis on plasticity in adults and in the auditory cortex. The nature of the changes in auditory cortex associated with attention, memory and perceptual learning depend critically on task structure, reward contingencies, and learning strategy. Most forms of auditory system plasticity are adaptive, in that they serve to optimize auditory performance, prompting attempts to harness this plasticity for therapeutic purposes. However, plasticity associated with cochlear trauma and partial hearing loss appears to be maladaptive, and has been linked to tinnitus. Three important forms of human learning-related auditory system plasticity are those associated with language development, musical training, and improvement in performance with a cochlear implant. Almost all forms of plasticity involve changes in synaptic excitatory - inhibitory balance within existing patterns of connectivity. An attractive model applicable to a number of forms of learning-related plasticity is dynamic multiplexing by individual neurons, such that learning involving a particular stimulus attribute reflects a particular subset of the diverse inputs to a given neuron being gated by top-down influences. The plasticity evidence indicates that auditory cortex is a component of complex distributed networks that integrate the representation of auditory stimuli with attention, decision and reward processes.

The normal environment delays the development of multisensory integration

Multisensory neurons in animals whose cross-modal experiences are compromised during early life fail to develop the ability to integrate information across those senses. Consequently, they lack the ability to increase the physiological salience of the events that provide the convergent cross-modal inputs. The present study demonstrates that superior colliculus (SC) neurons in animals whose visual-auditory experience is compromised early in life by noise-rearing can develop visual-auditory multisensory integration capabilities rapidly when periodically exposed to a single set of visual-auditory stimuli in a controlled laboratory paradigm. However, they remain compromised if their experiences are limited to a normal housing environment. These observations seem counterintuitive given that multisensory integrative capabilities ordinarily develop during early life in normal environments, in which a wide variety of sensory stimuli facilitate the functional organization of complex neural circuits at multiple levels of the neuraxis. However, the very richness and inherent variability of sensory stimuli in normal environments will lead to a less regular coupling of any given set of cross-modal cues than does the otherwise "impoverished" laboratory exposure paradigm. That this poses no significant problem for the neonate, but does for the adult, indicates a maturational shift in the requirements for the development of multisensory integration capabilities.

Brain circuit-gene expression relationships and neuroplasticity of multisensory cortices in blind children

Sensory deprivation reorganizes neurocircuits in the human brain. The biological basis of such neuroplastic adaptations remains elusive. In this study, we applied two complementary graph theory-based functional connectivity analyses, one to evaluate whole-brain functional connectivity relationships and the second to specifically delineate distributed network connectivity profiles downstream of primary sensory cortices, to investigate neural reorganization in blind children compared with sighted controls. We also examined the relationship between connectivity changes and neuroplasticity-related gene expression profiles in the cerebral cortex. We observed that multisensory integration areas exhibited enhanced functional connectivity in blind children and that this reorganization was spatially associated with the transcription levels of specific members of the cAMP Response Element Binding protein gene family. Using systems-level analyses, this study advances our understanding of human neuroplasticity and its genetic underpinnings following sensory deprivation.

Alterations in audiovisual simultaneity perception in amblyopia

Amblyopia is a developmental visual impairment that is increasingly recognized to affect higher-level perceptual and multisensory processes. To further investigate the audiovisual (AV) perceptual impairments associated with this condition, we characterized the temporal interval in which asynchronous auditory and visual stimuli are perceived as simultaneous 50% of the time (i.e., the AV simultaneity window). Adults with unilateral amblyopia (n = 17) and visually normal controls (n = 17) judged the simultaneity of a flash and a click presented with both eyes viewing. The signal onset asynchrony (SOA) varied from 0 ms to 450 ms for auditory-lead and visual-lead conditions. A subset of participants with amblyopia (n = 6) was tested monocularly. Compared to the control group, the auditory-lead side of the AV simultaneity window was widened by 48 ms (36%; p = 0.002), whereas that of the visual-lead side was widened by 86 ms (37%; p = 0.02). The overall mean window width was 500 ms, compared to 366 ms among controls (37% wider; p = 0.002). Among participants with amblyopia, the simultaneity window parameters were unchanged by viewing condition, but subgroup analysis revealed differential effects on the parameters by amblyopia severity, etiology, and foveal suppression status. Possible mechanisms to explain these findings include visual temporal uncertainty, interocular perceptual latency asymmetry, and disruption of normal developmental tuning of sensitivity to audiovisual asynchrony.

The Sensitive Period for Tactile Remapping Does Not Include Early Infancy

Visual input during development seems crucial in tactile spatial perception, given that late, but not congenitally, blind people are impaired when skin-based and tactile external representations are in conflict (when crossing the limbs). To test whether there is a sensitive period during which visual input is necessary, 14 children (age = 7.95) and a teenager (LM; age = 17.38) deprived of early vision by cataracts, and whose sight was restored during the first 5 months and at age 7, respectively, were tested. Tactile localization with arms crossed and uncrossed was measured. Children showed a crossing effect indistinguishable from a control group (Ns = 28, age = 8.24), whereas LM showed no crossing effect (Ns controls = 14, age = 20.78). This demonstrates a sensitive period which, critically, does not include early infancy.

Early Binocular Input Is Critical for Development of Audiovisual but Not Visuotactile Simultaneity Perception

Temporal simultaneity provides an essential cue for integrating multisensory signals into a unified perception. Early visual deprivation, in both animals and humans, leads to abnormal neural responses to audiovisual signals in subcortical and cortical areas [1-5]. Behavioral deficits in integrating complex audiovisual stimuli in humans are also observed [6, 7]. It remains unclear whether early visual deprivation affects visuotactile perception similarly to audiovisual perception and whether the consequences for either pairing differ after monocular versus binocular deprivation [8-11]. Here, we evaluated the impact of early visual deprivation on the perception of simultaneity for audiovisual and visuotactile stimuli in humans. We tested patients born with dense cataracts in one or both eyes that blocked all patterned visual input until the cataractous lenses were removed and the affected eyes fitted with compensatory contact lenses (mean duration of deprivation = 4.4 months; range = 0.3-28.8 months). Both monocularly and binocularly deprived patients demonstrated lower precision in judging audiovisual simultaneity. However, qualitatively different outcomes were observed for the two patient groups: the performance of monocularly deprived patients matched that of young children at immature stages, whereas that of binocularly deprived patients did not match any stage in typical development. Surprisingly, patients performed normally in judging visuotactile simultaneity after either monocular or binocular deprivation. Therefore, early binocular input is necessary to develop normal neural substrates for simultaneity perception of visual and auditory events but not visual and tactile events.

Cross-modal plasticity in developmental and age-related hearing loss: Clinical implications

This review explores cross-modal cortical plasticity as a result of auditory deprivation in populations with hearing loss across the age spectrum, from development to adulthood. Cross-modal plasticity refers to the phenomenon when deprivation in one sensory modality (e.g. the auditory modality as in deafness or hearing loss) results in the recruitment of cortical resources of the deprived modality by intact sensory modalities (e.g. visual or somatosensory systems). We discuss recruitment of auditory cortical resources for visual and somatosensory processing in deafness and in lesser degrees of hearing loss. We describe developmental cross-modal re-organization in the context of congenital or pre-lingual deafness in childhood and in the context of adult-onset, age-related hearing loss, with a focus on how cross-modal plasticity relates to clinical outcomes. We provide both single-subject and group-level evidence of cross-modal re-organization by the visual and somatosensory systems in bilateral, congenital deafness, single-sided deafness, adults with early-stage, mild-moderate hearing loss, and individual adult and pediatric patients exhibit excellent and average speech perception with hearing aids and cochlear implants. We discuss a framework in which changes in cortical resource allocation secondary to hearing loss results in decreased intra-modal plasticity in auditory cortex, accompanied by increased cross-modal recruitment of auditory cortices by the other sensory systems, and simultaneous compensatory activation of frontal cortices. The frontal cortices, as we will discuss, play an important role in mediating cognitive compensation in hearing loss. Given the wide range of variability in behavioral performance following audiological intervention, changes in cortical plasticity may play a valuable role in the prediction of clinical outcomes following intervention. Further, the development of new technologies and rehabilitation strategies that incorporate brain-based biomarkers may help better serve hearing impaired populations across the lifespan.

Designing sensory-substitution devices: Principles, pitfalls and potential1

An exciting possibility for compensating for loss of sensory function is to augment deficient senses by conveying missing information through an intact sense. Here we present an overview of techniques that have been developed for sensory substitution (SS) for the blind, through both touch and audition, with special emphasis on the importance of training for the use of such devices, while highlighting potential pitfalls in their design. One example of a pitfall is how conveying extra information about the environment risks sensory overload. Related to this, the limits of attentional capacity make it important to focus on key information and avoid redundancies. Also, differences in processing characteristics and bandwidth between sensory systems severely constrain the information that can be conveyed. Furthermore, perception is a continuous process and does not involve a snapshot of the environment. Design of sensory substitution devices therefore requires assessment of the nature of spatiotemporal continuity for the different senses. Basic psychophysical and neuroscientific research into representations of the environment and the most effective ways of conveying information should lead to better design of sensory substitution systems. Sensory substitution devices should emphasize usability, and should not interfere with other inter- or intramodal perceptual function. Devices should be task-focused since in many cases it may be impractical to convey too many aspects of the environment. Evidence for multisensory integration in the representation of the environment suggests that researchers should not limit themselves to a single modality in their design. Finally, we recommend active training on devices, especially since it allows for externalization, where proximal sensory stimulation is attributed to a distinct exterior object.

Early Blindness Results in Developmental Plasticity for Auditory Motion Processing within Auditory and Occipital Cortex

Early blind subjects exhibit superior abilities for processing auditory motion, which are accompanied by enhanced BOLD responses to auditory motion within hMT+ and reduced responses within right planum temporale (rPT). Here, by comparing BOLD responses to auditory motion in hMT+ and rPT within sighted controls, early blind, late blind, and sight-recovery individuals, we were able to separately examine the effects of developmental and adult visual deprivation on cortical plasticity within these two areas. We find that both the enhanced auditory motion responses in hMT+ and the reduced functionality in rPT are driven by the absence of visual experience early in life; neither loss nor recovery of vision later in life had a discernable influence on plasticity within these areas. Cortical plasticity as a result of blindness has generally be presumed to be mediated by competition across modalities within a given cortical region. The reduced functionality within rPT as a result of early visual loss implicates an additional mechanism for cross modal plasticity as a result of early blindness—competition across different cortical areas for functional role.

Neuroplasticity: Unexpected Consequences of Early Blindness

A pair of recent studies shows that congenital blindness can have significant consequences for the functioning of the visual system after sight restoration, particularly if that restoration is delayed.

Abnormal visual experience during development alters the early stages of visual-tactile integration

Visual experience during the critical periods in early postnatal life is necessary for the normal development of the visual system. Disruption of visual input during this period results in amblyopia, which is associated with reduced activation of the striate and extrastriate cortices. It is well known that visual input converges with other sensory signals and exerts a significant influence on cortical processing in multiple association areas. Recent work in healthy adults has also shown that task-relevant visual input can modulate neural excitability at very early stages of information processing in the primary somatosensory cortex. Here we used electroencephalography to investigate visual-tactile interactions in adults with abnormal binocular vision due to amblyopia and strabismus. Results showed three main findings. First, in comparison to a visually normal control group, participants with abnormal vision had a significantly lower amplitude of the P50 somatosensory event related potential (ERP) when visual and tactile stimuli were presented concurrently. Second, the amplitude of the P100 somatosensory ERP was significantly greater in participants with abnormal vision. These results indicate that task relevant visual input does not significantly influence the excitability of the primary somatosensory cortex, instead, the excitability of the secondary somatosensory cortex is increased. Third, participants with abnormal vision had a higher amplitude of the P1 visual ERP when a tactile stimulus was presented concurrently. Importantly, these results were not modulated by viewing condition, which indicates that the impact of amblyopia on crossmodal interactions is not simply related to the reduced visual acuity as it was evident when viewing with the unaffected eye and binocularly. These results indicate that the consequences of abnormal visual experience on neurophysiological processing extend beyond the primary and secondary visual areas to other modality-specific areas.

Sex-Specific Automatic Responses to Infant Cries: TMS Reveals Greater Excitability in Females than Males in Motor Evoked Potentials

Neuroimaging reveals that infant cries activate parts of the premotor cortical system. To validate this effect in a more direct way, we used event-related transcranial magnetic stimulation (TMS). Here, we investigated the presence and the time course of modulation of motor cortex excitability in young adults who listened to infant cries. Specifically, we recorded motor evoked potentials (MEPs) from the biceps brachii (BB) and interosseus dorsalis primus (ID1) muscles as produced by TMS delivered from 0 to 250 ms after sound onset in six steps of 50 ms in 10 females and 10 males. We observed an excitatory modulation of MEPs at 100 ms from the onset of infant cry specific to females and to the ID1 muscle. We regard this modulation as a response to natural cry sounds because it was attenuated to stimuli increasingly different from natural cry and absent in a separate group of females who listened to non-cry stimuli physically matched to natural infant cries. Furthermore, the 100-ms latency of this response is not compatible with a voluntary reaction to the stimulus but suggests an automatic, bottom-up audiomotor association. The brains of adult females appear to be tuned to respond to infant cries with automatic motor excitation.