Multisensory integration in hemianopia and unilateral spatial neglect: Evidence from the sound induced flash illusion

Audiovisual integration and sensory dominance effects in older adults with subjective cognitive decline: Enhanced redundant effects and stronger fusion illusion susceptibility

INTRODUCTION

Subjective cognitive decline (SCD) refers to individuals' perceived decline in memory and/or other cognitive abilities relative to their previous level of performance. Sensory decline is one of the main manifestations of decline in older adults with SCD. The efficient integration of visual and auditory information, known as audiovisual integration, is a crucial perceptual process. This study aims to evaluate audiovisual integration in older adults with SCD.

METHODS

We adopted the audiovisual detection task, the Colavita task, and the Sound-Induced Flash Illusion (SIFI) task to evaluate the audiovisual integration by examining both redundant and illusory effects. Older adults diagnosed with SCD (N = 50, mean age = 67.8 years) and a control group of non-SCD older adults (N = 51, mean age = 66.5 years) were recruited. All participants took part in the three aforementioned experiments.

RESULTS

The outcomes showed that a redundant effect occurred in both SCD and non-SCD older adults, with SCD older adults gaining more benefits in audiovisual detection task. Moreover, an equivalent amount of the visual dominance effect was observed among both SCD and non-SCD older adults in Colavita task. In addition, older adults with SCD perceived an equal fission illusion but a bigger fusion illusion compared with non-SCD older adults in SIFI task.

CONCLUSIONS

Overall, older adults with SCD exhibit increased audiovisual redundant effects and stronger fusion illusion susceptibility compared to non-SCD older adults. Besides, visual dominance was observed in both groups via the Colavita task, with no significant difference between non-SCD and SCD older adults. These findings implied that audiovisual integration might offer a potential way for the identification of SCD.

Only visible flicker helps flutter: Tactile-visual integration breaks in the absence of visual awareness

Combining information from multiple senses enhances our perception of the world. Whether we need to be aware of all stimuli to benefit from multisensory integration, however, is still under investigation. Here, we tested whether tactile frequency perception benefits from the presence of congruent visual flicker even if the flicker is so rapid that it is perceptually fused into a steady light and therefore invisible. Our participants completed a tactile frequency discrimination task given either unisensory tactile or congruent tactile-visual stimulation. Tactile and tactile-visual test frequencies ranged from far below to far above participants' flicker fusion threshold (determined separately). For frequencies distinctively below their flicker fusion threshold, participants performed significantly better given tactile-visual stimulation than when presented with only tactile stimuli. Yet, for frequencies above their flicker fusion threshold, participants' tactile frequency perception did not profit from the presence of congruent but likely fused and thus invisible visual flicker. The results matched the predictions of an ideal-observer model in which tactile-visual integration is conditional on awareness of both stimuli. In contrast, it was impossible to reproduce the observed results with a model that assumed tactile-visual integration proceeds irrespective of stimulus awareness. In sum, we revealed that the benefits of congruent visual stimulation for tactile flutter frequency perception depend on the visibility of the visual flicker, suggesting that multisensory integration requires awareness.

Developmental changes in audiotactile event perception

The fission and fusion illusions provide measures of multisensory integration. The sound-induced tap fission illusion occurs when a tap is paired with two distractor sounds, resulting in the perception of two taps; the sound-induced tap fusion illusion occurs when two taps are paired with a single sound, resulting in the perception of a single tap. Using these illusions, we measured integration in three groups of children (9-, 11-, and 13-year-olds) and compared them with a group of adults. Based on accuracy, we derived a measure of magnitude of illusion and used a signal detection analysis to estimate perceptual discriminability and decisional criterion. All age groups showed a significant fission illusion, whereas only the three groups of children showed a significant fusion illusion. When compared with adults, the 9-year-olds showed larger fission and fusion illusions (i.e., reduced discriminability and greater bias), whereas the 11-year-olds were adult-like for fission but showed some differences for fusion: significantly worse discriminability and marginally greater magnitude and criterion. The 13-year-olds were adult-like on all measures. Based on the pattern of data, we speculate that the developmental trajectories for fission and fusion differ. We discuss these developmental results in the context of three non-mutually exclusive theoretical frameworks: sensory dominance, maximum likelihood estimation, and causal inference.

The effects of estradiol levels on crossmodal perception: a study on the sound induced flash illusion in healthy and menstrually related migraine individuals

OBJECTIVE

The sound-induced flash illusion (SIFI) is a valid paradigm to study multisensorial perception. In the "fission" SIFI, multiple flashes are perceived when observing a single flash paired with two or more beeps. SIFI is largely dependent on visual and acoustic cortex excitability; in migraine, dysfunctional cortical excitability affects SIFI perception. Since estrogen peak occurring during ovulation can increase neuronal excitability, the present study aims to verify whether cortical excitability shifts linked to the menstrual cycle could influence SIFI.

METHODS

In a comparative prospective study, we tested the effect of estrogens on crossmodal perception using the SIFI. We recruited 27 females in reproductive age, including 16 healthy and 11 menstrually related migraine females, testing their proneness to SIFI on day 14 (high estradiol) and day 27 (low estradiol) of menstrual cycle.

RESULTS

Women on day 14 reported less flashes than on day 27 (p = 0.02) in the fission illusion, suggesting a pro-excitatory effect of estradiol on visual cortex excitability during ovulation. Moreover, we confirmed that migraine women perceived less flashes (p = 0.001) than controls, independently from cycle phase. Non-migraineurs women significantly reported more flashes on day 27 than on day 14 (p = 0.04).

CONCLUSIONS

This study suggests that estradiol may influence the multisensory perception due to changes of visual cortex excitability, with high estradiol peak leading to increased visual cortical sensitivity during ovulation in non-migraineurs. Visual cortex hyperresponsiveness, here reflected by reduced SIFI, is not influenced by estradiol fluctuations in migraine women, as shown by reduced fission effects on day 14 and 27.

Differences in eccentricity for sound-induced flash illusion in four visual fields

A sound-induced flash illusion (SiFI) is a multisensory illusion dominated by auditory stimuli, in which the individual perceives that the number of visual flashes is equal to the number of auditory stimuli when visual flashes are presented along with an unequal number of auditory stimuli. Although the mechanisms underlying fission and fusion illusions have been documented, there is not yet a consensus on how they vary according to the different eccentricities. In the present study, by incorporating the classic SiFI paradigm into four different eccentricities, we aimed to investigate whether the SiFI varies under the different eccentricities. The results showed that the fission illusion varied significantly across the four eccentricities, with the perifovea (7°) and peripheral (11°) illusions being greater than the fovea and parafovea (3°) illusions. In contrast, the fusion illusion did not vary significantly across the four eccentricities. Our findings revealed that SiFI was affected by different visual fields and that there were differences between the fission and the fusion illusions. Furthermore, by examining the SiFI of eccentricity across visual fields, this study also suggests that bottom-up factors affect the SiFI.

Multisensory perception is not influenced by previous concussion history in retired rugby union players

BACKGROUND

To assess whether concussion history adversely affects multisensory integration, we compared susceptibility to the Sound-Induced Flash Illusion (SIFI) in retired professional rugby players compared to controls.

METHODS

Retired professional rugby players ((N = 58) and retired international rowers (N = 26) completed a self-report concussion history questionnaire and the SIFI task. Susceptibility to the SIFI (i.e., perceiving two flashes in response to one flash paired with two beeps) was assessed at three stimulus onset asynchronies (70 ms, 150 ms or 230 ms).Logistic mixed-effects regression modeling was implemented to evaluate how athlete grouping, previous concussion history and total number of years playing sport, impacted the susceptibility to the SIFI task. The statistical significance of a fixed effect of interest was determined by a likelihood ratio test.

RESULTS

Former rugby players had significantly more self-reported concussions than the rower group (p < 0.001). There was no impact of athlete grouping (i.e., retired professional rugby players and retired international rowers), years participation in elite sport or concussion history on performance in the SIFI.

CONCLUSION

A career in professional rugby, concussion history or number of years participating in professional rugby was not found to be predictive of performance on the SIFI task.

Individual differences in beta frequency correlate with the audio-visual fusion illusion

Presenting one flash with two beeps induces a perception of two flashes (audio-visual [AV] fission illusion), while presenting two flashes with one beep induces a perception of one flash (fusion illusion). Although previous studies showed a relationship between the frequency of the alpha rhythm (alpha cycle) and one's susceptibility to the fission illusion, the relationship between neural oscillations and the fusion illusion is unknown. Using electroencephalography, here I investigated the frequency of oscillatory signals in the pre-stimulus period and found a significant correlation between the beta rhythm and the fusion illusion; specifically, participants with a lower beta frequency showed a larger fusion illusion. These data indicate two separate time windows of AV integration in the human brain, one defined by the alpha cycle (fission) and another defined by the beta cycle (fusion).

Effects of training and using an audio-tactile sensory substitution device on speech-in-noise understanding

Understanding speech in background noise is challenging. Wearing face-masks, imposed by the COVID19-pandemics, makes it even harder. We developed a multi-sensory setup, including a sensory substitution device (SSD) that can deliver speech simultaneously through audition and as vibrations on the fingertips. The vibrations correspond to low frequencies extracted from the speech input. We trained two groups of non-native English speakers in understanding distorted speech in noise. After a short session (30-45 min) of repeating sentences, with or without concurrent matching vibrations, we showed comparable mean group improvement of 14-16 dB in Speech Reception Threshold (SRT) in two test conditions, i.e., when the participants were asked to repeat sentences only from hearing and also when matching vibrations on fingertips were present. This is a very strong effect, if one considers that a 10 dB difference corresponds to doubling of the perceived loudness. The number of sentence repetitions needed for both types of training to complete the task was comparable. Meanwhile, the mean group SNR for the audio-tactile training (14.7 ± 8.7) was significantly lower (harder) than for the auditory training (23.9 ± 11.8), which indicates a potential facilitating effect of the added vibrations. In addition, both before and after training most of the participants (70-80%) showed better performance (by mean 4-6 dB) in speech-in-noise understanding when the audio sentences were accompanied with matching vibrations. This is the same magnitude of multisensory benefit that we reported, with no training at all, in our previous study using the same experimental procedures. After training, performance in this test condition was also best in both groups (SRT ~ 2 dB). The least significant effect of both training types was found in the third test condition, i.e. when participants were repeating sentences accompanied with non-matching tactile vibrations and the performance in this condition was also poorest after training. The results indicate that both types of training may remove some level of difficulty in sound perception, which might enable a more proper use of speech inputs delivered via vibrotactile stimulation. We discuss the implications of these novel findings with respect to basic science. In particular, we show that even in adulthood, i.e. long after the classical "critical periods" of development have passed, a new pairing between a certain computation (here, speech processing) and an atypical sensory modality (here, touch) can be established and trained, and that this process can be rapid and intuitive. We further present possible applications of our training program and the SSD for auditory rehabilitation in patients with hearing (and sight) deficits, as well as healthy individuals in suboptimal acoustic situations.

Abnormal multisensory integration in relapsing–remitting multiple sclerosis

Temporal Binding Window (TBW) represents a reliable index of efficient multisensory integration process, which allows individuals to infer which sensory inputs from different modalities pertain to the same event. TBW alterations have been reported in some neurological and neuropsychiatric disorders and seem to negatively affects cognition and behavior. So far, it is still unknown whether deficits of multisensory integration, as indexed by an abnormal TBW, are present even in Multiple Sclerosis. We addressed this issue by testing 25 participants affected by relapsing–remitting Multiple Sclerosis (RRMS) and 30 age-matched healthy controls. Participants completed a simultaneity judgment task (SJ2) to assess the audio-visual TBW; two unimodal SJ2 versions were used as control tasks. Individuals with RRMS showed an enlarged audio-visual TBW (width range = from − 166 ms to + 198 ms), as compared to healthy controls (width range = − 177/ + 66 ms), thus showing an increased tendency to integrate temporally asynchronous visual and auditory stimuli. Instead, simultaneity perception of unimodal (visual or auditory) events overall did not differ from that of controls. These results provide first evidence of a selective deficit of multisensory integration in individuals affected by RRMS, besides the well-known motor and cognitive impairments. The reduced multisensory temporal acuity is likely caused by a disruption of the neural interplay between different sensory systems caused by multiple sclerosis.

New Insights Into the Anatomy, Connectivity and Clinical Implications of the Middle Longitudinal Fasciculus

The middle longitudinal fascicle (MdLF) is a long, associative white matter tract connecting the superior temporal gyrus (STG) with the parietal and occipital lobe. Previous studies show different cortical terminations, and a possible segmentation pattern of the tract. In this study, we performed a post-mortem white matter dissection of 12 human hemispheres and an in vivo deterministic fiber tracking of 24 subjects acquired from the Human Connectome Project to establish whether a constant organization of fibers exists among the MdLF subcomponents and to acquire anatomical information on each subcomponent. Moreover, two clinical cases of brain tumors impinged on MdLF territories are reported to further discuss the anatomical results in light of previously published data on the functional involvement of this bundle. The main finding is that the MdLF is consistently organized into two layers: an antero-ventral segment (aMdLF) connecting the anterior STG (including temporal pole and planum polare) and the extrastriate lateral occipital cortex, and a posterior-dorsal segment (pMdLF) connecting the posterior STG, anterior transverse temporal gyrus and planum temporale with the superior parietal lobule and lateral occipital cortex. The anatomical connectivity pattern and quantitative differences between the MdLF subcomponents along with the clinical cases reported in this paper support the role of MdLF in high-order functions related to acoustic information. We suggest that pMdLF may contribute to the learning process associated with verbal-auditory stimuli, especially on left side, while aMdLF may play a role in processing/retrieving auditory information already consolidated within the temporal lobe.

Supramodal executive control of attention: Evidence from unimodal and crossmodal dual conflict effects

Although we have demonstrated that the executive control of attention acts supramodally as shown by significant correlation between conflict effect measures in visual and auditory tasks, no direct evidence of the equivalence in the computational mechanisms governing the allocation of executive control resources within and across modalities has been found. Here, in two independent groups of 40 participants each, we examined the interaction effect of conflict processing in both unimodal (visual) and crossmodal (visual and auditory) dual-conflict paradigms (flanker conflict processing in Task 1 and then in the following Task 2) with a manipulation of the stimulus onset asynchrony (SOA). In both the unimodal and the crossmodal dual-conflict paradigms, the conflict processing of Task 1 significantly interfered with the processing of Task 2 when the SOA was short, as shown by an additive interference effect of Task 1 on Task 2 under the time constraints. These results suggest that there is a unified supramodal entity that supports conflict processing by implementing comparable mechanisms in unimodal and crossmodal scenarios.

Multisensory stimulation for the rehabilitation of unilateral spatial neglect

Unilateral spatial neglect (USN) is a neuropsychological syndrome, typically caused by lesions of the right hemisphere, whose features are the defective report of events occurring in the left (contralesional) side of space and the inability to orient and set up actions leftwards. Multisensory integration mechanisms, largely spared in USN patients, may temporally modulate spatial orienting. In this pilot study, the effects of an intensive audio-visual Multisensory Stimulation (MS) on USN were assessed, and compared with those of a treatment that ameliorates USN, Prismatic Adaptation (PA). Twenty USN stroke patients received a 2-week treatment (20 sessions, twice per day) of MS or PA. The effects of MS and PA were assessed by a set of neuropsychological clinical tests (target cancellation, line bisection, sentence reading, personal neglect, complex drawing) and the Catherine Bergego Scale for functional disability. Results showed that MS brought about an amelioration of USN deficits overall comparable to that induced by PA; personal neglect was improved only by MS, not by PA. The clinical gains of the MS treatment were not influenced by duration of disease and lesion volume, and they persisted up to one month post-treatment. In conclusion, MS represents a novel and promising rehabilitation procedure for USN.

Multisensorial Perception in Chronic Migraine and the Role of Medication Overuse

Multisensory processing can be assessed by measuring susceptibility to crossmodal illusions such as the Sound-Induced Flash Illusion (SIFI). When a single flash is accompanied by 2 or more beeps, it is perceived as multiple flashes (fission illusion); conversely, a fusion illusion is experienced when more flashes are matched with a single beep, leading to the perception of a single flash. Such illusory perceptions are associated to crossmodal changes in visual cortical excitability. Indeed, increasing occipital cortical excitability, by means of transcranial electrical currents, disrupts the SIFI (ie, fission illusion). Similarly, a reduced fission illusion was shown in patients with episodic migraine, especially during the attack, in agreement with the pathophysiological model of cortical hyperexcitability of this disease. If episodic migraine patients present with reduced SIFI especially during the attack, we hypothesize that chronic migraine (CM) patients should consistently report less illusory effects than healthy controls; drugs intake could also affect SIFI. On such a basis, we studied the proneness to SIFI in CM patients (n = 63), including 52 patients with Medication Overuse Headache (MOH), compared to 24 healthy controls. All migraine patients showed reduced fission phenomena than controls (P < .0001). Triptan MOH patients (n = 23) presented significantly less fission effects than other CM groups (P = .008). This exploratory study suggests that CM - both with and without medication overuse - is associated to a higher visual cortical responsiveness which causes deficit of multisensorial processing, as assessed by the SIFI. PERSPECTIVE: This observational study shows reduced susceptibility to the SIFI in CM, confirming and extending previous results in episodic migraine. MOH contributes to this phenomenon, especially in case of triptans.

Cathodal Occipital tDCS Is Unable to Modulate the Sound Induced Flash Illusion in Migraine

Migraine is a highly disabling disease characterized by recurrent pain. Despite an intensive effort, mechanisms of migraine pathophysiology still represent an unsolved issue. Evidence from both animal and human studies suggests that migraine is characterized by hyperresponsivity or hyperexcitability of sensory cortices, especially the visual cortex. This phenomenon, in turn, may affect multisensory processing. Indeed, migraineurs present with an abnormal, reduced, perception of the Sound-induced Flash Illusion (SiFI), a crossmodal illusion that relies on optimal integration of visual and auditory stimuli by the occipital visual cortex. Decreasing visual cortical excitability with transcranial direct current stimulation (tDCS) can increase the SiFI in healthy subjects. Moving away from these issues, we applied cathodal tDCS over the visual cortex of migraineurs, with and without aura, in order to decrease cortical excitability and thus physiologically restoring the perception of a reliable SiFI. Differently from our expectations, tDCS was unable to reliably modulate SiFI in migraine. The chronic, relatively excessive, visual cortex hyperexcitability, featuring the migraineur brain, may render tDCS ineffective for restoring multisensory processing in this disease.

On the Timing of Signals in Multisensory Integration and Crossmodal Interactions: a Scoping Review

A scoping review was undertaken to explore research investigating early interactions and integration of auditory and visual stimuli in the human brain. The focus was on methods used to study low-level multisensory temporal processing using simple stimuli in humans, and how this research has informed our understanding of multisensory perception. The study of multisensory temporal processing probes how the relative timing between signals affects perception. Several tasks, illusions, computational models, and neuroimaging techniques were identified in the literature search. Research into early audiovisual temporal processing in special populations was also reviewed. Recent research has continued to provide support for early integration of crossmodal information. These early interactions can influence higher-level factors, and vice versa. Temporal relationships between auditory and visual stimuli influence multisensory perception, and likely play a substantial role in solving the 'correspondence problem' (how the brain determines which sensory signals belong together, and which should be segregated).

Neuroscience of Virtual Reality: From Virtual Exposure to Embodied Medicine

Is virtual reality (VR) already a reality in behavioral health? To answer this question, a meta-review was conducted to assess the meta-analyses and systematic and narrative reviews published in this field in the last twenty-two months. Twenty-five different articles demonstrated the clinical potential of this technology in both the diagnosis and the treatment of mental health disorders: VR compares favorably to existing treatments in anxiety disorders, eating and weight disorders, and pain management, with long-term effects that generalize to the real world. But why is VR so effective? Here, the following answer is suggested: VR shares with the brain the same basic mechanism: embodied simulations. According to neuroscience, to regulate and control the body in the world effectively, the brain creates an embodied simulation of the body in the world used to represent and predict actions, concepts, and emotions. VR works in a similar way: the VR experience tries to predict the sensory consequences of an individual's movements, providing to him/her the same scene he/she will see in the real world. To achieve this, the VR system, like the brain, maintains a model (simulation) of the body and the space around it. If the presence in the body is the outcome of different embodied simulations, concepts are embodied simulations, and VR is an embodied technology, this suggests a new clinical approach discussed in this article: the possibility of altering the experience of the body and facilitating cognitive modeling/change by designing targeted virtual environments able to simulate both the external and the internal world/body.

Does hearing aid use affect audiovisual integration in mild hearing impairment?

There is converging evidence for altered audiovisual integration abilities in hearing-impaired individuals and those with profound hearing loss who are provided with cochlear implants, compared to normal-hearing adults. Still, little is known on the effects of hearing aid use on audiovisual integration in mild hearing loss, although this constitutes one of the most prevalent conditions in the elderly and, yet, often remains untreated in its early stages. This study investigated differences in the strength of audiovisual integration between elderly hearing aid users and those with the same degree of mild hearing loss who were not using hearing aids, the non-users, by measuring their susceptibility to the sound-induced flash illusion. We also explored the corresponding window of integration by varying the stimulus onset asynchronies. To examine general group differences that are not attributable to specific hearing aid settings but rather reflect overall changes associated with habitual hearing aid use, the group of hearing aid users was tested unaided while individually controlling for audibility. We found greater audiovisual integration together with a wider window of integration in hearing aid users compared to their age-matched untreated peers. Signal detection analyses indicate that a change in perceptual sensitivity as well as in bias may underlie the observed effects. Our results and comparisons with other studies in normal-hearing older adults suggest that both mild hearing impairment and hearing aid use seem to affect audiovisual integration, possibly in the sense that hearing aid use may reverse the effects of hearing loss on audiovisual integration. We suggest that these findings may be particularly important for auditory rehabilitation and call for a longitudinal study.

Hemispheric asymmetry: Looking for a novel signature of the modulation of spatial attention in multisensory processing

The extent to which attention modulates multisensory processing in a top-down fashion is still a subject of debate among researchers. Typically, cognitive psychologists interested in this question have manipulated the participants’ attention in terms of single/dual tasking or focal/divided attention between sensory modalities. We suggest an alternative approach, one that builds on the extensive older literature highlighting hemispheric asymmetries in the distribution of spatial attention. Specifically, spatial attention in vision, audition, and touch is typically biased preferentially toward the right hemispace, especially under conditions of high perceptual load. We review the evidence demonstrating such an attentional bias toward the right in extinction patients and healthy adults, along with the evidence of such rightward-biased attention in multisensory experimental settings. We then evaluate those studies that have demonstrated either a more pronounced multisensory effect in right than in left hemispace, or else similar effects in the two hemispaces. The results suggest that the influence of rightward-biased attention is more likely to be observed when the crossmodal signals interact at later stages of information processing and under conditions of higher perceptual load—that is, conditions under which attention is perhaps a compulsory enhancer of information processing. We therefore suggest that the spatial asymmetry in attention may provide a useful signature of top-down attentional modulation in multisensory processing.

Unilateral spatial neglect after posterior parietal damage

Unilateral spatial neglect is a disabling neurologic deficit, most frequent and severe after right-hemispheric lesions. In most patients neglect involves the left side of space, contralateral to a right-hemispheric lesion. About 50% of stroke patients exhibit neglect in the acute phase. Patients fail to orient, respond to, and report sensory events occurring in the contralateral sides of space and of the body, to explore these portions of space through movements by action effectors (eye, limbs), and to move the contralateral limbs. Neglect is a multicomponent higher-level disorder of spatial awareness, cognition, and attention. Spatial neglect may occur independently of elementary sensory and motor neurologic deficits, but it can mimic and make them more severe. Diagnostic tests include: motor exploratory target cancellation; setting the midpoint of a horizontal line (bisection), that requires the estimation of lateral extent; drawing by copy and from memory; reading, assessing neglect dyslexia; and exploring the side of the body contralateral to the lesion. Activities of daily living scales are also used. Patients are typically not aware of neglect, although they may exhibit varying degrees of awareness toward different components of the deficit. The neural correlates include lesions to the inferior parietal lobule of the posterior parietal cortex, which was long considered the unique neuropathologic correlate of neglect, to the premotor and to the dorsolateral prefrontal cortices, to the posterior superior temporal gyrus, at the temporoparietal junction, to subcortical gray nuclei (thalamus, basal ganglia), and to parietofrontal white-matter fiber tracts, such as the superior longitudinal fascicle. Damage to the inferior parietal lobule of the posterior parietal cortex is specifically associated with the mainly egocentric, perceptual, and exploratory extrapersonal, and with the personal, bodily components of neglect. Productive manifestations, such as perseveration, are not a correlate of posterior parietal cortex damage.

The neuroscience of body memory: From the self through the space to the others

Our experience of the body is not direct; rather, it is mediated by perceptual information, influenced by internal information, and recalibrated through stored implicit and explicit body representation (body memory). This paper presents an overview of the current investigations related to body memory by bringing together recent studies from neuropsychology, neuroscience, and evolutionary and cognitive psychology. To do so, in the paper, I explore the origin of representations of human body to elucidate their developmental process and, in particular, their relationship with more explicit concepts of self. First, it is suggested that our bodily experience is constructed from early development through the continuous integration of sensory and cultural data from six different representations of the body, i.e., the Sentient Body (Minimal Selfhood), the Spatial Body (Self Location), the Active Body (Agency), the Personal Body (Whole Body Ownership - Me); the Objectified Body (Objectified Self - Mine), and the Social Body (Body Satisfaction - Ideal Me). Then, it is suggested that these six representations can be combined in a coherent supramodal representation, i.e. the "body matrix", through a predictive, multisensory processing activated by central, top-down, attentional processes. From an evolutionary perspective, the main goal of the body matrix is to allow the self to protect and extend its boundaries at both the homeostatic and psychological levels. From one perspective, the self extends its boundaries (peripersonal space) through the enactment and recognition of motor schemas. From another perspective, the body matrix, by defining the boundaries of the body, also defines where the self is present, i.e., in the body that is processed by the body matrix as the most likely to be its one, and in the space surrounding it. In the paper I also introduce and discuss the concept of "embodied medicine": the use of advanced technology for altering the body matrix with the goal of improving our health and well-being.

Embodied Medicine: Mens Sana in Corpore Virtuale Sano

Progress in medical science and technology drastically improved physicians’ ability to interact with patient’s physical body. Nevertheless, medicine still addresses the human body from a Hippocratic point of view, considering the organism and its processes just as a matter of mechanics and fluids. However, the interaction between the cognitive neuroscience of bodily self-consciousness (BSC), fundamentally rooted in the integration of multisensory bodily inputs, with virtual reality (VR), haptic technologies and robotics is giving a new meaning to the classic Juvenal’s latin dictum “Mens sana in corpore sano” (a healthy mind in a healthy body). This vision provides the basis for a new research field, “Embodied Medicine”: the use of advanced technologies for altering the experience of being in a body with the goal of improving health and well-being. Up to now, most of the research efforts in the field have been focused upon how external bodily information is processed and integrated. Despite the important results, we believe that existing bodily illusions still need to be improved to enhance their capability to effectively correct pathological dysfunctions. First, they do not follow the suggestions provided by the free-energy and predictive coding approaches. More, they lacked to consider a peculiar feature of the human body, the multisensory integration of internal inputs (interoceptive, proprioceptive and vestibular) that constitute our inner body dimension. So, a future challenge is the integration of simulation/stimulation technologies also able to measure and modulate this internal/inner experience of the body. Finally, we also proposed the concept of “Sonoception” as an extension of this approach. The core idea is to exploit recent technological advances in the acoustic field to use sound and vibrations to modify the internal/inner body experience.

Introduction to the Special Issue on Individual Differences in Multisensory Perception: an Overview

The world is full of objects that can be perceived through multiple different senses to create an integrated understanding of our environment. Since each of us has different biological and psychological characteristics, different people may perceive the world in quite different ways. However, the questions of how and why our multisensory perceptions differ have not been explored in any great depth. This special issue, arising from a series of British Psychological Society-funded seminars, presents new research and opinions on the impacts of a variety of individual differences on multisensory perception. We hope that readers will enjoy this collection of eight papers on individual differences in multisensory perception arising from developmental changes, autism, Down syndrome, migraine, sensory loss and substitution, and personality.