Age-related multisensory enhancement in a simple audiovisual detection task

Fractality of sensations and the brain health: the theory linking neurodegenerative disorder with distortion of spatial and temporal scale-invariance and fractal complexity of the visible world

The theory that ties normal functioning and pathology of the brain and visual system with the spatial-temporal structure of the visual and other sensory stimuli is described for the first time in the present study. The deficit of fractal complexity of environmental influences can lead to the distortion of fractal complexity in the visual pathways of the brain and abnormalities of development or aging. The use of fractal light stimuli and fractal stimuli of other modalities can help to restore the functions of the brain, particularly in the elderly and in patients with neurodegenerative disorders or amblyopia. Non-linear dynamics of these physiological processes have a strong base of evidence, which is seen in the impaired fractal regulation of rhythmic activity in aged and diseased brains. From birth to old age, we live in a non-linear world, in which objects and processes with the properties of fractality and non-linearity surround us. Against this background, the evolution of man took place and all periods of life unfolded. Works of art created by man may also have fractal properties. The positive influence of music on cognitive functions is well-known. Insufficiency of sensory experience is believed to play a crucial role in the pathogenesis of amblyopia and age-dependent diseases. The brain is very plastic in its early development, and the plasticity decreases throughout life. However, several studies showed the possibility to reactivate the adult's neuroplasticity in a variety of ways. We propose that a non-linear structure of sensory information on many spatial and temporal scales is crucial to the brain health and fractal regulation of physiological rhythms. Theoretical substantiation of the author's theory is presented. Possible applications and the future research that can experimentally confirm or refute the theoretical concept are considered.

Spatial representations in older adults are not modified by action: Evidence from tool use

Theories of embodied perception hold that the visual system is calibrated by both the body schema and the action system, allowing for adaptive action-perception responses. One example of embodied perception involves the effects of tool use on distance perception, in which wielding a tool with the intention to act upon a target appears to bring that object closer. This tool-based spatial compression (i.e., tool-use effect) has been studied exclusively with younger adults, but it is unknown whether the phenomenon exists with older adults. In this study, we examined the effects of tool use on distance perception in younger and older adults in 2 experiments. In Experiment 1, younger and older adults estimated the distances of targets just beyond peripersonal space while either wielding a tool or pointing with the hand. Younger adults, but not older adults, estimated targets to be closer after reaching with a tool. In Experiment 2, younger and older adults estimated the distance to remote targets while using either a baton or a laser pointer. Younger adults displayed spatial compression with the laser pointer compared to the baton, although older adults did not. Taken together, these findings indicate a generalized absence of the tool-use effect in older adults during distance estimation, suggesting that the visuomotor system of older adults does not remap from peripersonal to extrapersonal spatial representations during tool use.

Compensating for age limits through emotional crossmodal integration

Social interactions in daily life necessitate the integration of social signals from different sensory modalities. In the aging literature, it is well established that the recognition of emotion in facial expressions declines with advancing age, and this also occurs with vocal expressions. By contrast, crossmodal integration processing in healthy aging individuals is less documented. Here, we investigated the age-related effects on emotion recognition when faces and voices were presented alone or simultaneously, allowing for crossmodal integration. In this study, 31 young adults (M = 25.8 years) and 31 older adults (M = 67.2 years) were instructed to identify several basic emotions (happiness, sadness, anger, fear, disgust) and a neutral expression, which were displayed as visual (facial expressions), auditory (non-verbal affective vocalizations) or crossmodal (simultaneous, congruent facial and vocal affective expressions) stimuli. The results showed that older adults performed slower and worse than younger adults at recognizing negative emotions from isolated faces and voices. In the crossmodal condition, although slower, older adults were as accurate as younger except for anger. Importantly, additional analyses using the "race model" demonstrate that older adults benefited to the same extent as younger adults from the combination of facial and vocal emotional stimuli. These results help explain some conflicting results in the literature and may clarify emotional abilities related to daily life that are partially spared among older adults.

Visuo-tactile interactions in the congenitally deaf: a behavioral and event-related potential study

Auditory deprivation is known to be accompanied by alterations in visual processing. Yet not much is known about tactile processing and the interplay of the intact sensory modalities in the deaf. We presented visual, tactile, and visuo-tactile stimuli to congenitally deaf and hearing individuals in a speeded detection task. Analyses of multisensory responses showed a redundant signals effect that was attributable to a coactivation mechanism in both groups, although the redundancy gain was less in the deaf. In line with these behavioral results, on a neural level, there were multisensory interactions in both groups that were again weaker in the deaf. In hearing but not deaf participants, somatosensory event-related potential N200 latencies were modulated by simultaneous visual stimulation. A comparison of unisensory responses between groups revealed larger N200 amplitudes for visual and shorter N200 latencies for tactile stimuli in the deaf. Furthermore, P300 amplitudes were also larger in the deaf. This group difference was significant for tactile and approached significance for visual targets. The differences in visual and tactile processing between deaf and hearing participants, however, were not reflected in behavior. Both the behavioral and electroencephalography (EEG) results suggest more pronounced multisensory interaction in hearing than in deaf individuals. Visuo-tactile enhancements could not be explained by perceptual deficiency, but could be partly attributable to inverse effectiveness.

Deficits in audiovisual speech perception in normal aging emerge at the level of whole-word recognition

Over the next 2 decades, a dramatic shift in the demographics of society will take place, with a rapid growth in the population of older adults. One of the most common complaints with healthy aging is a decreased ability to successfully perceive speech, particularly in noisy environments. In such noisy environments, the presence of visual speech cues (i.e., lip movements) provide striking benefits for speech perception and comprehension, but previous research suggests that older adults gain less from such audiovisual integration than their younger peers. To determine at what processing level these behavioral differences arise in healthy-aging populations, we administered a speech-in-noise task to younger and older adults. We compared the perceptual benefits of having speech information available in both the auditory and visual modalities and examined both phoneme and whole-word recognition across varying levels of signal-to-noise ratio. For whole-word recognition, older adults relative to younger adults showed greater multisensory gains at intermediate SNRs but reduced benefit at low SNRs. By contrast, at the phoneme level both younger and older adults showed approximately equivalent increases in multisensory gain as signal-to-noise ratio decreased. Collectively, the results provide important insights into both the similarities and differences in how older and younger adults integrate auditory and visual speech cues in noisy environments and help explain some of the conflicting findings in previous studies of multisensory speech perception in healthy aging. These novel findings suggest that audiovisual processing is intact at more elementary levels of speech perception in healthy-aging populations and that deficits begin to emerge only at the more complex word-recognition level of speech signals.

Visual-somatosensory integration and balance: evidence for psychophysical integrative differences in aging

Research detailing multisensory integration (MSI) processes in aging and their association with clinically relevant outcomes is virtually non-existent. To our knowledge, the relationship between MSI and balance has not been well-established in aging. Given known alterations in unisensory processing with increasing age, the aims of the current study were to determine differential behavioral patterns of MSI in aging and investigate whether MSI was significantly associated with balance and fall-risk. Seventy healthy older adults (M = 75 years; 58% female) participated in the current study. Participants were instructed to make speeded responses to visual, somatosensory, and visual-somatosensory (VS) stimuli. Based on reaction times (RTs) to all stimuli, participants were classified into one of two groups (MSI or NO MSI), depending on their MSI RT benefit. Static balance was assessed using mean unipedal stance time. Overall, results revealed that RTs to VS stimuli were significantly shorter than those elicited to constituent unisensory conditions. Further, the current experimental design afforded differential patterns of multisensory processing, with 75% of the elderly sample demonstrating multisensory enhancements. Interestingly, 25% of older adults did not demonstrate multisensory RT facilitation; a finding that was attributed to extremely fast RTs overall and specifically in response to somatosensory inputs. Individuals in the NO MSI group maintained significantly better unipedal stance times and reported less falls, compared to elders in the MSI group. This study reveals the existence of differential patterns of multisensory processing in aging, while describing the clinical translational value of MSI enhancements in predicting balance and falls risk.

The sound-induced flash illusion reveals dissociable age-related effects in multisensory integration

While aging can lead to significant declines in perceptual and cognitive function, the effects of age on multisensory integration, the process in which the brain combines information across the senses, are less clear. Recent reports suggest that older adults are susceptible to the sound-induced flash illusion (Shams et al., 2000) across a much wider range of temporal asynchronies than younger adults (Setti et al., 2011). To assess whether this cost for multisensory integration is a general phenomenon of combining asynchronous audiovisual input, we compared the time courses of two variants of the sound-induced flash illusion in young and older adults: the fission illusion, where one flash accompanied by two beeps appears as two flashes, and the fusion illusion, where two flashes accompanied by one beep appear as one flash. Twenty-five younger (18–30 years) and older (65+ years) adults were required to report whether they perceived one or two flashes, whilst ignoring irrelevant auditory beeps, in bimodal trials where auditory and visual stimuli were separated by one of six stimulus onset asynchronies (SOAs). There was a marked difference in the pattern of results for the two variants of the illusion. In conditions known to produce the fission illusion, older adults were significantly more susceptible to the illusion at longer SOAs compared to younger participants. In contrast, the performance of the younger and older groups was almost identical in conditions known to produce the fusion illusion. This surprising difference between sound-induced fission and fusion in older adults suggests dissociable age-related effects in multisensory integration, consistent with the idea that these illusions are mediated by distinct neural mechanisms.

Preservation of perceptual integration improves temporal stability of bimanual coordination in the elderly: an evidence of age-related brain plasticity

Despite the apparent age-related decline in perceptual-motor performance, recent studies suggest that the elderly people can improve their reaction time when relevant sensory information are available. However, little is known about which sensory information may improve motor behaviour itself. Using a synchronization task, the present study investigates how visual and/or auditory stimulations could increase accuracy and stability of three bimanual coordination modes produced by elderly and young adults. Neurophysiological activations are recorded with ElectroEncephaloGraphy (EEG) to explore neural mechanisms underlying behavioural effects. Results reveal that the elderly stabilize all coordination modes when auditory or audio-visual stimulations are available, compared to visual stimulation alone. This suggests that auditory stimulations are sufficient to improve temporal stability of rhythmic coordination, even more in the elderly. This behavioural effect is primarily associated with increased attentional and sensorimotor-related neural activations in the elderly but similar perceptual-related activations in elderly and young adults. This suggests that, despite a degradation of attentional and sensorimotor neural processes, perceptual integration of auditory stimulations is preserved in the elderly. These results suggest that perceptual-related brain plasticity is, at least partially, conserved in normal aging.

Deception detection, transmission, and modality in age and sex

This study is the first to create and use spontaneous (i.e., unrehearsed) pro-social lies in an ecological setting. Creation of the stimuli involved 51 older adult and 44 college student “senders” who lied “authentically” in that their lies were spontaneous in the service of protecting a research assistant. In the main study, 77 older adult and 84 college raters attempted to detect lies in the older adult and college senders in three modalities: audio, visual, and audiovisual. Raters of both age groups were best at detecting lies in the audiovisual and worst in the visual modalities. Overall, college students were better detectors than older adults. There was an age-matching effect for college students but not for older adults. Older adult males were the hardest to detect. The older the adult was the worse the ability to detect deception.

Enhanced audiovisual integration with aging in speech perception: a heightened McGurk effect in older adults

Two experiments compared young and older adults in order to examine whether aging leads to a larger dependence on visual articulatory movements in auditory-visual speech perception. These experiments examined accuracy and response time in syllable identification for auditory-visual (AV) congruent and incongruent stimuli. There were also auditory-only (AO) and visual-only (VO) presentation modes. Data were analyzed only for participants with normal hearing. It was found that the older adults were more strongly influenced by visual speech than the younger ones for acoustically identical signal-to-noise ratios (SNRs) of auditory speech (Experiment 1). This was also confirmed when the SNRs of auditory speech were calibrated for the equivalent AO accuracy between the two age groups (Experiment 2). There were no aging-related differences in VO lipreading accuracy. Combined with response time data, this enhanced visual influence for the older adults was likely to be associated with an aging-related delay in auditory processing.

Visual-somatosensory integration in aging: does stimulus location really matter?

Individuals are constantly bombarded by sensory stimuli across multiple modalities that must be integrated efficiently. Multisensory integration (MSI) is said to be governed by stimulus properties including space, time, and magnitude. While there is a paucity of research detailing MSI in aging, we have demonstrated that older adults reveal the greatest reaction time (RT) benefit when presented with simultaneous visual-somatosensory (VS) stimuli. To our knowledge, the differential RT benefit of visual and somatosensory stimuli presented within and across spatial hemifields has not been investigated in aging. Eighteen older adults (Mean = 74 years; 11 female), who were determined to be non-demented and without medical or psychiatric conditions that may affect their performance, participated in this study. Participants received eight randomly presented stimulus conditions (four unisensory and four multisensory) and were instructed to make speeded foot-pedal responses as soon as they detected any stimulation, regardless of stimulus type and location of unisensory inputs. Results from a linear mixed effect model, adjusted for speed of processing and other covariates, revealed that RTs to all multisensory pairings were significantly faster than those elicited to averaged constituent unisensory conditions (p < 0.01). Similarly, race model violation did not differ based on unisensory spatial location (p = 0.41). In summary, older adults demonstrate significant VS multisensory RT effects to stimuli both within and across spatial hemifields.

Multisensory integration mechanisms during aging

The rapid demographical shift occurring in our society implies that understanding of healthy aging and age-related diseases is one of our major future challenges. Sensory impairments have an enormous impact on our lives and are closely linked to cognitive functioning. Due to the inherent complexity of sensory perceptions, we are commonly presented with a complex multisensory stimulation and the brain integrates the information from the individual sensory channels into a unique and holistic percept. The cerebral processes involved are essential for our perception of sensory stimuli and becomes especially important during the perception of emotional content. Despite ongoing deterioration of the individual sensory systems during aging, there is evidence for an increase in, or maintenance of, multisensory integration processing in aging individuals. Within this comprehensive literature review on multisensory integration we aim to highlight basic mechanisms and potential compensatory strategies the human brain utilizes to help maintain multisensory integration capabilities during healthy aging to facilitate a broader understanding of age-related pathological conditions. Further our goal was to identify where further research is needed.

A standing posture is associated with increased susceptibility to the sound-induced flash illusion in fall-prone older adults

Recent research has provided evidence suggesting a link between inefficient processing of multisensory information and incidence of falling in older adults. Specifically, Setti et al. (Exp Brain Res 209:375-384, 2011) reported that older adults with a history of falling were more susceptible than their healthy, age-matched counterparts to the sound-induced flash illusion. Here, we investigated whether balance control in fall-prone older adults was directly associated with multisensory integration by testing susceptibility to the illusion under two postural conditions: sitting and standing. Whilst standing, fall-prone older adults had a greater body sway than the age-matched healthy older adults and their body sway increased when presented with the audio-visual illusory but not the audio-visual congruent conditions. We also found an increase in susceptibility to the sound-induced flash illusion during standing relative to sitting for fall-prone older adults only. Importantly, no performance differences were found across groups in either the unisensory or non-illusory multisensory conditions across the two postures. These results suggest an important link between multisensory integration and balance control in older adults and have important implications for understanding why some older adults are prone to falling.

Multisensory integration compensates loss of sensitivity of visual temporal order in the elderly

Here, we examined sensitivity of visual, auditory, and audiovisual temporal order in five age-groups (20 to 70 years old). We also measured multisensory integration (MSI) using a phenomenon known as "temporal ventriloquism," in which click sounds improve sensitivity of visual temporal order. Results showed that sensitivity of visual, auditory, and audiovisual temporal order declined from 50 years on. However, there was no corresponding decline in MSI as the click sounds actually compensated the loss of sensitivity of visual temporal order in the elderly. Sensitivity of audiovisual temporal order did not correlate with MSI, suggesting that well-preserved explicit judgments about cross-modal temporal order are not required for MSI to occur.

Susceptibility to a multisensory speech illusion in older persons is driven by perceptual processes

Recent studies suggest that multisensory integration is enhanced in older adults but it is not known whether this enhancement is solely driven by perceptual processes or affected by cognitive processes. Using the “McGurk illusion,” in Experiment 1 we found that audio-visual integration of incongruent audio-visual words was higher in older adults than in younger adults, although the recognition of either audio- or visual-only presented words was the same across groups. In Experiment 2 we tested recall of sentences within which an incongruent audio-visual speech word was embedded. The overall semantic meaning of the sentence was compatible with either one of the unisensory components of the target word and/or with the illusory percept. Older participants recalled more illusory audio-visual words in sentences than younger adults, however, there was no differential effect of word compatibility on recall for the two groups. Our findings suggest that the relatively high susceptibility to the audio-visual speech illusion in older participants is due more to perceptual than cognitive processing.

Multisensory integration, aging, and the sound-induced flash illusion

The present study examined age-related differences in multisensory integration and the role of attention in age-related differences in multisensory integration. The sound-induced flash illusion--the misperception of the number of visual flashes due to the simultaneous presentation of a different number of auditory beeps--was used to examine the strength of multisensory integration in older and younger observers. The effects of integration were examined when discriminating 1-3 flashes, 1-3 beeps, or 1-3 flashes presented with 1-3 beeps. Stimulus conditions were blocked according to these conditions with baseline (unisensory) performance assessed during the multisensory block. Older participants demonstrated greater multisensory integration--a greater influence of the beeps when judging the number of visual flashes--than younger observers. In a second experiment, the role of attention was assessed using a go/no-go paradigm. The results of Experiment 2 replicated those of Experiment 1. In addition, the strength of the illusion was modulated by the sensory domain of the go/no-go task, though this did not differ by age group. In the visual go/no-go task we found a decrease in the illusion, yet in the auditory go/no-go task we found an increase in the illusion. These results demonstrate that older individuals exhibit increased multisensory integration compared with younger individuals. Attention was also found to modulate the strength of the sound-induced flash illusion. However, the results also suggest that attention was not likely to be a factor in the age-related differences in multisensory integration.

Aging and audio-visual and multi-cue integration in motion

The perception of naturalistic events relies on the ability to integrate information from multiple sensory systems, an ability that may change with healthy aging. When two objects move toward and then past one another, their trajectories are perceptually ambiguous: the objects may seem to stream past one another or bounce off one another. Previous research showed that auditory or visual events that occur at the time of disks' coincidence could bias the percept toward bouncing or streaming. We exploited this malleable percept to assay age-related changes in the integration of multiple inter- and intra-modal cues. The disks' relative luminances were manipulated to produce stimuli strongly favoring either bouncing or streaming, or to produce ambiguous motion (equal luminances). A sharp sound coincident with the disks' overlap increased both groups' perception of bouncing, but did so significantly less for older subjects. An occluder's impact on motion perception varied with its duration: a long duration occluder promoted streaming in both groups; a brief occluder promoted bouncing in younger subjects, but not older ones. Control experiments demonstrated that the observed differences between younger and older subjects resulted from neither age-related changes in retinal illuminance nor age-related changes in hearing, pointing to weakened inter- and intra-modal integration with aging. These changes could contribute to previously demonstrated age-related perceptual and memory deficits.

Audio-visual detection benefits in the rat

Human psychophysical studies have described multisensory perceptual benefits such as enhanced detection rates and faster reaction times in great detail. However, the neural circuits and mechanism underlying multisensory integration remain difficult to study in the primate brain. While rodents offer the advantage of a range of experimental methodologies to study the neural basis of multisensory processing, rodent studies are still limited due to the small number of available multisensory protocols. We here demonstrate the feasibility of an audio-visual stimulus detection task for rats, in which the animals detect lateralized uni- and multi-sensory stimuli in a two-response forced choice paradigm. We show that animals reliably learn and perform this task. Reaction times were significantly faster and behavioral performance levels higher in multisensory compared to unisensory conditions. This benefit was strongest for dim visual targets, in agreement with classical patterns of multisensory integration, and was specific to task-informative sounds, while uninformative sounds speeded reaction times with little costs for detection performance. Importantly, multisensory benefits for stimulus detection and reaction times appeared at different levels of task proficiency and training experience, suggesting distinct mechanisms inducing these two multisensory benefits. Our results demonstrate behavioral multisensory enhancement in rats in analogy to behavioral patterns known from other species, such as humans. In addition, our paradigm enriches the set of behavioral tasks on which future studies can rely, for example to combine behavioral measurements with imaging or pharmacological studies in the behaving animal or to study changes of integration properties in disease models.

The effect of multisensory cues on attention in aging

The attention network test (ANT) assesses the effect of alerting and orienting cues on a visual flanker task measuring executive attention. Previous findings revealed that older adults demonstrate greater reaction times (RT) benefits when provided with visual orienting cues that offer both spatial and temporal information of an ensuing target. Given the overlap of neural substrates and networks involved in multisensory processing and cueing (i.e., alerting and orienting), an investigation of multisensory cueing effects on RT was warranted. The current study was designed to determine whether participants, both old and young, benefited from receiving multisensory alerting and orienting cues. Eighteen young (M=19.17 years; 45% female) and eighteen old (M=76.44 years; 61% female) individuals that were determined to be non-demented and without any medical or psychiatric conditions that would affect their performance were included. Results revealed main effects for the executive attention and orienting networks, but not for the alerting network. In terms of orienting, both old and young adults demonstrated significant orienting effects for auditory-somatosensory (AS), auditory-visual (AV), and visual-somatosensory (VS) cues. RT benefits of multisensory compared to unisensory orienting effects differed by cue type and age group; younger adults demonstrated greater RT benefits for AS orienting cues whereas older adults demonstrated greater RT benefits for AV orienting cues. Both groups, however, demonstrated significant RT benefits for multisensory VS orienting cues. These findings provide evidence for the facilitative effect of multisensory orienting cues, and not multisensory alerting cues, in old and young adults.

Audiovisual temporal discrimination is less efficient with aging: an event-related potential study

We investigated the crossmodal temporal discrimination deficit characterizing older adults and its event-related potential (electroencephalogram) correlates using an audiovisual temporal order judgment task. Audiovisual stimuli were presented at stimulus onset asynchronies (SOA) of 70 or 270 ms. Older were less accurate than younger adults with an SOA of 270 ms but not 70 ms. With an SOA of 270 ms only, older adults had smaller posterior P1 and frontocentral N1 amplitudes for visual stimuli in auditory-visual trials and auditory stimuli in visual-auditory trials, respectively. These results suggest a deficit in cross-sensory processing with aging reflected at the behavioural and neural level, and suggest an impairment in switching between modalities even when the inputs are separated by long temporal intervals.

Multisensory integration across the senses in young and old adults

Stimuli are processed concurrently and across multiple sensory inputs. Here we directly compared the effect of multisensory integration (MSI) on reaction time across three paired sensory inputs in eighteen young (M=19.17 years) and eighteen old (M=76.44 years) individuals. Participants were determined to be non-demented and without any medical or psychiatric conditions that would affect their performance. Participants responded to randomly presented unisensory (auditory, visual, somatosensory) stimuli and three paired sensory inputs consisting of auditory-somatosensory (AS) auditory-visual (AV) and visual-somatosensory (VS) stimuli. Results revealed that reaction time (RT) to all multisensory pairings was significantly faster than those elicited to the constituent unisensory conditions across age groups; findings that could not be accounted for by simple probability summation. Both young and old participants responded the fastest to multisensory pairings containing somatosensory input. Compared to younger adults, older adults demonstrated a significantly greater RT benefit when processing concurrent VS information. In terms of co-activation, older adults demonstrated a significant increase in the magnitude of visual-somatosensory co-activation (i.e., multisensory integration), while younger adults demonstrated a significant increase in the magnitude of auditory-visual and auditory-somatosensory co-activation. This study provides first evidence in support of the facilitative effect of pairing somatosensory with visual stimuli in older adults.

The co-occurrence of multisensory facilitation and cross-modal conflict in the human brain

Perceptual objects often comprise a visual and auditory signature that arrives simultaneously through distinct sensory channels, and cross-modal features are linked by virtue of being attributed to a specific object. Continued exposure to cross-modal events sets up expectations about what a given object most likely "sounds" like, and vice versa, thereby facilitating object detection and recognition. The binding of familiar auditory and visual signatures is referred to as semantic, multisensory integration. Whereas integration of semantically related cross-modal features is behaviorally advantageous, situations of sensory dominance of one modality at the expense of another impair performance. In the present study, magnetoencephalography recordings of semantically related cross-modal and unimodal stimuli captured the spatiotemporal patterns underlying multisensory processing at multiple stages. At early stages, 100 ms after stimulus onset, posterior parietal brain regions responded preferentially to cross-modal stimuli irrespective of task instructions or the degree of semantic relatedness between the auditory and visual components. As participants were required to classify cross-modal stimuli into semantic categories, activity in superior temporal and posterior cingulate cortices increased between 200 and 400 ms. As task instructions changed to incorporate cross-modal conflict, a process whereby auditory and visual components of cross-modal stimuli were compared to estimate their degree of congruence, multisensory processes were captured in parahippocampal, dorsomedial, and orbitofrontal cortices 100 and 400 ms after stimulus onset. Our results suggest that multisensory facilitation is associated with posterior parietal activity as early as 100 ms after stimulus onset. However, as participants are required to evaluate cross-modal stimuli based on their semantic category or their degree of congruence, multisensory processes extend in cingulate, temporal, and prefrontal cortices.

Word intelligibility and age predict visual cortex activity during word listening

The distractibility that older adults experience when listening to speech in challenging conditions has been attributed in part to reduced inhibition of irrelevant information within and across sensory systems. Whereas neuroimaging studies have shown that younger adults readily suppress visual cortex activation when listening to auditory stimuli, it is unclear the extent to which declining inhibition in older adults results in reduced suppression or compensatory engagement of other sensory cortices. The current functional magnetic resonance imaging study examined the effects of age and stimulus intelligibility in a word listening task. Across all participants, auditory cortex was engaged when listening to words. However, increasing age and declining word intelligibility had independent and spatially similar effects: both were associated with increasing engagement of visual cortex. Visual cortex activation was not explained by age-related differences in vascular reactivity but rather auditory and visual cortices were functionally connected across word listening conditions. The nature of this correlation changed with age: younger adults deactivated visual cortex when activating auditory cortex, middle-aged adults showed no relation, and older adults synchronously activated both cortices. These results suggest that age and stimulus integrity are additive modulators of crossmodal suppression and activation.

Computing an optimal time window of audiovisual integration in focused attention tasks: illustrated by studies on effect of age and prior knowledge

The concept of a "time window of integration" holds that information from different sensory modalities must not be perceived too far apart in time in order to be integrated into a multisensory perceptual event. Empirical estimates of window width differ widely, however, ranging from 40 to 600 ms depending on context and experimental paradigm. Searching for theoretical derivation of window width, Colonius and Diederich (Front Integr Neurosci 2010) developed a decision-theoretic framework using a decision rule that is based on the prior probability of a common source, the likelihood of temporal disparities between the unimodal signals, and the payoff for making right or wrong decisions. Here, this framework is extended to the focused attention task where subjects are asked to respond to signals from a target modality only. Evoking the framework of the time-window-of-integration (TWIN) model, an explicit expression for optimal window width is obtained. The approach is probed on two published focused attention studies. The first is a saccadic reaction time study assessing the efficiency with which multisensory integration varies as a function of aging. Although the window widths for young and older adults differ by nearly 200 ms, presumably due to their different peripheral processing speeds, neither of them deviates significantly from the optimal values. In the second study, head saccadic reactions times to a perfectly aligned audiovisual stimulus pair had been shown to depend on the prior probability of spatial alignment. Intriguingly, they reflected the magnitude of the time-window widths predicted by our decision-theoretic framework, i.e., a larger time window is associated with a higher prior probability.

Is inefficient multisensory processing associated with falls in older people?

Although falling is a significant problem for older persons, little is understood about its underlying causes. Spatial cognition and balance maintenance rely on the efficient integration of information across the main senses. We investigated general multisensory efficiency in older persons with a history of falls compared to age- and sensory acuity-matched controls and younger adults using a sound-induced flash illusion. Older fallers were as susceptible to the illusion as age-matched, non-fallers or younger adults at a short delay of 70 ms between the auditory and visual stimuli. Both older adult groups were more susceptible to the illusion at longer SOAs than younger adults. However, with increasing delays between the visual and auditory stimuli, older fallers did not show a decline in the frequency at which the illusion was experienced even with delays of up to 270 ms. We argue that this relatively higher susceptibility to the illusion reflects inefficient audio-visual processing in the central nervous system and has important implications for the diagnosis and rehabilitation of falling in older persons.

Aging-related changes in auditory and visual integration measured with MEG

As noted in the aging literature, processing delays often occur in the central nervous system with increasing age, which is often attributable in part to demyelination. In addition, differential slowing between sensory systems has been shown to be most discrepant between visual (up to 20ms) and auditory systems (<5ms). Therefore, we used MEG to measure the multisensory integration response in auditory association cortex in young and elderly participants to better understand the effects of aging on multisensory integration abilities. Results show a main effect for reaction times (RTs); the mean RTs of the elderly were significantly slower than the young. In addition, in the young we found significant facilitation of RTs to the multisensory stimuli relative to both unisensory stimuli, when comparing the cumulative distribution functions, which was not evident for the elderly. We also identified a significant interaction between age and condition in the superior temporal gyrus. In particular, the elderly had larger amplitude responses (∼100ms) to auditory stimuli relative to the young when auditory stimuli alone were presented, whereas the amplitude of responses to the multisensory stimuli was reduced in the elderly, relative to the young. This suppressed cortical multisensory integration response in the elderly, which corresponded with slower RTs and reduced RT facilitation effects, has not been reported previously and may be related to poor cortical integration based on timing changes in unisensory processing in the elderly.

The effects of multisensory targets on saccadic trajectory deviations: eliminating age differences

The present study had two aims. First, to determine if bimodal audio-visual targets allow for greater inhibition of visual distractors, which in turn may lead to greater saccadic trajectory deviations away from those distractors. Second, to determine if bimodal targets can reduce age differences in the ability to generate deviations away, as older adults tend to benefit more from multisensory integration than younger adults. The results show that bimodal targets produced larger deviations away than unimodal targets, but only when the distractor preceded the target, and this effect was comparable across age groups. Furthermore, in contrast to previous research, older adults in this study showed similar deviations away from distractors to those of younger adults. These findings suggest that age differences in the production of trajectory deviations away are not inevitable and that multisensory integration may be an important means for increasing top-down inhibition of irrelevant distraction.

A cognitive training intervention improves modality-specific attention in a randomized controlled trial of healthy older adults

Age-related deficits in cognitive and sensory function can result in increased distraction from background sensory stimuli. This randomized controlled trial investigated the effects of a cognitive training intervention aimed at helping healthy older adults suppress irrelevant auditory and visual stimuli. Sixty-six participants received 8 weeks of either the modality-specific attention training program or an educational lecture control program. Participants who completed the intervention program had larger improvements in modality-specific selective attention following training than controls. These improvements also correlated with reductions in bimodal integration during selective attention. Further, the intervention group showed larger improvements than the control group in non-trained domains such as processing speed and dual-task completion, demonstrating the utility of modality-specific attention training for improving cognitive function in healthy older adults.

Suppression of multisensory integration by modality-specific attention in aging

Previous research shows that modality-specific selective attention attenuates multisensory integration in healthy young adults. In addition, older adults evidence enhanced multisensory integration compared with younger adults. We hypothesized that these increases were because of changes in top-down suppression, and therefore older adults would show multisensory integration while selectively attending. Performance of older and younger adults was compared on a cued discrimination task. Older adults had greater multisensory integration than younger adults in all conditions, yet were still able to reduce integration using selective attention. This suggests that attentional processes are intact in older adults, but are unable to compensate for an overall increase in the amount of sensory processing during divided attention.