The importance of synchrony and temporal order of visual and tactile input for illusory limb ownership experiences - an FMRI study applying virtual reality

Neuro-cognitive effects of degraded visibility on illusory body ownership

Based on visuo-tactile stimulation, the rubber hand illusion induces a sense of ownership for a dummy hand. Manipulating the visibility of the dummy hand during the stimulation influences cognitive aspects of the illusion, suggesting that the related brain activity may be influenced too. To test this, we analyzed brain activity (fMRI), subjective ratings, and skin conductance from 45 neurotypical participants undergoing a modified rubber hand illusion protocol where we manipulated the visibility (high, medium, and low) of a virtual hand, not the brush (virtual hand illusion; VHI). To further investigate the impact of visibility manipulations on VHI-related secondary effects (i.e. vicarious somatosensation), we recorded brain activity and skin conductance during a vicarious pain protocol (observation of painful stimulations of the virtual hand) that occurred after the VHI procedure. Results showed that, during both the VHI and vicarious pain periods, the activity of distinct visual, somatosensory, and motor brain regions was modulated by (i) visibility manipulations, (ii) coherence between visual and tactile stimulation, and (iii) time of visuo-tactile stimulation. Accordingly, embodiment-related subjective ratings of the perceived illusion were specifically influenced by visibility manipulations. These findings suggest that visibility modifications can impact the neural and cognitive effects of illusory body ownership, in that when visibility decreases the illusion is perceived as weaker and the brain activity in visual, motor, and somatosensory regions is overall lower. We interpret this evidence as a sign of the weight of vision on embodiment processes, in that the cortical and subjective aspects of illusory body ownership are weakened by a degradation of visual input during the induction of the illusion.

Multi-modal and bi-directional effects of a synthetic Δ9-Tetrahydrocannabinol (THC) analogue, Nabilone, on spatio-temporal binding windows: Evidence from the projected hand illusion

Abnormally widened spatial and temporal binding windows (SBW/TBWs; length of space/time whereby stimuli are considered part of the same percept) are observed in schizophrenia. TBW alterations have been associated with altered sense of agency (hereafter referred to as agency), and an associative relationship between embodiment (body ownership) and agency has been proposed. SBWs/TBWs are investigated separately, but no evidence exists of these being separate in mechanism, system or function. The underlying neural substrate of schizophrenia remains unclear. The literature claims either pro-psychotic or anti-psychotic effects of Δ9-Tetrahydrocannabinol (THC) in patients and healthy individuals, but major support for cannabis in the aetiology of schizophrenia is associative, not causal. To clarify if THC is pro- or anti-psychotic, this single-blind, placebo-controlled within-subjects cross-over study tested several hypotheses. 1) Competing hypotheses that a synthetic THC analogue, Nabilone (NAB, 1-2 mg), would alter measures of agency and embodiment in healthy volunteers (n = 32) similarly, or opposite, to that of in patients with schizophrenia. 2) That there would be significant associations between any NAB-induced alterations in individual agency and embodiment measures in the Projected Hand Illusion (PHI). 3) That there is a unitary spatio-temporal binding window (STBW). A large proportion of individuals did not experience the PHI. Multimodal and bi-directional effects of NAB on the PHI were observed. Evidence of a unitary spatio-temporal binding window (STBW) was observed. NAB widened the STBW in some but narrowed it in others as a function of space and delay. No associations were found between agency and embodiment.

Bi-directional and multi-modal effects of dexamphetamine on spatial binding windows in healthy individuals

OBJECTIVES

Stimuli that are separated by a short window of space or time, known as spatial and temporal binding windows (SBW/TBWs), may be perceived as separate. Widened TBWs are evidenced in schizophrenia, although it is unclear if the SBW is similarly affected. The current study aimed to assess if dexamphetamine (DEX) may increase SBWs in a multimodal visuo-tactile illusion, potentially validating usefulness as an experimental model for multimodal visuo-tactile hallucinations in schizophrenia, and to examine a possible association between altered binding windows (BWs) and working memory (WM) suggested by previous research.

METHODS

A placebo-controlled, double-blinded, and counter-balanced crossover design was employed. Permuted block randomisation was used for drug order. Healthy participants received DEX (0.45 mg/kg, PO, b.i.d.) or placebo (glucose powder) in capsules. The Rubber Hand Illusion (RHI) and Wechsler Adult Intelligence Scale Spatial Span was employed to determine whether DEX would alter SBWs and WM, respectively. Schizotypy was assessed with a variety of psychological scales.

RESULTS

Most participants did not experience the RHI even under normal circumstances. Bi-directional and multimodal effects of DEX on individual SBWs and schizotypy were observed, but not on WM.

CONCLUSIONS

Bidirectional multimodal effects of DEX on the RHI and SBWs were observed in individuals, although not associated with alterations in WM.

Virtual Reality During Chemotherapy Infusion: An Innovative Intervention in Holistic Nursing Practice

Patients with cancer receiving infusional chemotherapy show negative symptoms such as worry about their survival, anxiety, anguish, depression, fear, magnified perception of the passage of time, and difficulty managing boredom. Patients also suffer various side effects produced by chemotherapy such as nausea, vomiting, pain, and fatigue, which, together with psychological distress, drastically reduce their quality of life and adherence to therapy with a corresponding reduction in the probability of the individual's survival. Virtual Reality is one of the most innovative and promising digital health interventions, capable of quickly and effectively producing a positive influence on the psychosomatic axis, improving patients' quality of life during chemotherapy. Virtual Reality, through its 3-dimensional multisensory technology, isolates sensory channels from the negative external environment and enables an experience of being physically and psychologically present within virtual scenarios, in which patients can perceive sensations, emotions, cognitions, and interactions as if they really were in different surroundings. This article systematically expounds the scientific conditions necessary for effective, appropriate, and safe implementation of Virtual Reality interventions in holistic nursing practice, describing the underpinning conceptual framework, the types, technological characteristics, methods of use, duration, type of virtual content, and implementation procedure of Virtual Reality.

Cortical processes of multisensory plausibility modulation of vibrotactile perception in virtual environments in middled-aged and older adults

Digital technologies, such as virtual or augmented reality, can potentially support neurocognitive functions of the aging populations worldwide and complement existing intervention methods. However, aging-related declines in the frontal-parietal network and dopaminergic modulation which progress gradually across the later periods of the adult lifespan may affect the processing of multisensory congruence and expectancy based contextual plausibility. We assessed hemodynamic brain responses while middle-aged and old adults experienced car-riding virtual-reality scenarios where the plausibility of vibrotactile stimulations was manipulated by delivering stimulus intensities that were either congruent or incongruent with the digitalized audio-visual contexts of the respective scenarios. Relative to previous findings observed in young adults, although highly plausible vibrotactile stimulations confirming with contextual expectations also elicited higher brain hemodynamic responses in middle-aged and old adults, this effect was limited to virtual scenarios with extreme expectancy violations. Moreover, individual differences in plausibility-related frontal activity did not correlate with plausibility violation costs in the sensorimotor cortex, indicating less systematic frontal context-based sensory filtering in older ages. These findings have practical implications for advancing digital technologies to support aging societies.

Balancing the Senses: Electrophysiological Responses Reveal the Interplay between Somatosensory and Visual Processing During Body-Related Multisensory Conflict

In the study of bodily awareness, the predictive coding theory has revealed that our brain continuously modulates sensory experiences to integrate them into a unitary body representation. Indeed, during multisensory illusions (e.g., the rubber hand illusion, RHI), the synchronous stroking of the participant's concealed hand and a fake visible one creates a visuotactile conflict, generating a prediction error. Within the predictive coding framework, through sensory processing modulation, prediction errors are solved, inducing participants to feel as if touches originated from the fake hand, thus ascribing the fake hand to their own body. Here, we aimed to address sensory processing modulation under multisensory conflict, by disentangling somatosensory and visual stimuli processing that are intrinsically associated during the illusion induction. To this aim, we designed two EEG experiments, in which somatosensory- (SEPs; Experiment 1; N = 18; F = 10) and visual-evoked potentials (VEPs; Experiment 2; N = 18; F = 9) were recorded in human males and females following the RHI. Our results show that, in both experiments, ERP amplitude is significantly modulated in the illusion as compared with both control and baseline conditions, with a modality-dependent diametrical pattern showing decreased SEP amplitude and increased VEP amplitude. Importantly, both somatosensory and visual modulations occur in long-latency time windows previously associated with tactile and visual awareness, thus explaining the illusion of perceiving touch at the sight location. In conclusion, we describe a diametrical modulation of somatosensory and visual processing as the neural mechanism that allows maintaining a stable body representation, by restoring visuotactile congruency under the occurrence of multisensory conflicts.

MR-Compatible Tactile Stimulator System: Application for Individuals with Brain Injuries

Accurate perception of tactile information is essential for performing activities of daily living and learning new sensorimotor skills like writing. Deficits in perceiving tactile stimuli are associated with severity in physical disability. The mechanisms contributing to tactile deficits in individuals with brain injuries remain poorly understood in part due to insufficient assessment methods. Here, we provide a tactile stimulator system for studying the neural mechanisms contributing to tactile deficits in individuals with brain injuries during functional magnetic resonance imaging (fMRI). This tactile stimulator system consists of a pneumatically-controlled inflatable and deflatable balloon that interfaces with a digit of the hand to provide small forces. The magnitude of the applied force is delivered and controlled by modifying the air pressure in the balloon. The tactile simulator provides an 8 mm diameter tactile stimulus. The device's interface at the finger is compact, allowing it to be used with individuals who have a closed-fist posture following brain injury such as stroke or cerebral palsy. The tactile stimulator contains no metallic components and can be used in MRI research. The tactile stimulator system can repeatedly apply a force between 1 N and 2.4 N. This tactile stimulator system addresses limitations in past fMRI methodologies for assessing tactile perception by providing precise and repeatable force stimuli to a small area of the finger. Custom software automates the application of the force stimuli and permits synchronization with acquired fMRI data. This system can be used in subsequent testing to investigate deficits in sensory functioning in those with brain injuries.

Functional brain network alterations in the co-occurrence of autism spectrum disorder and attention deficit hyperactivity disorder

Autism spectrum disorder (ASD) and attention deficit hyperactivity disorder (ADHD) are two highly prevalent and commonly co-occurring neurodevelopmental disorders. The neural mechanisms underpinning the comorbidity of ASD and ADHD (ASD + ADHD) remain unclear. We focused on the topological organization and functional connectivity of brain networks in ASD + ADHD patients versus ASD patients without ADHD (ASD-only). Resting-state functional magnetic resonance imaging (rs-fMRI) data from 114 ASD and 161 typically developing (TD) individuals were obtained from the Autism Brain Imaging Data Exchange II. The ASD patients comprised 40 ASD + ADHD and 74 ASD-only individuals. We constructed functional brain networks for each group and performed graph-theory and network-based statistic (NBS) analyses. Group differences between ASD + ADHD and ASD-only were analyzed at three levels: nodal, global, and connectivity. At the nodal level, ASD + ADHD exhibited topological disorganization in the temporal and occipital regions, compared with ASD-only. At the global level, ASD + ADHD and ASD-only displayed no significant differences. At the connectivity level, the NBS analysis revealed that ASD + ADHD showed enhanced functional connectivity between the prefrontal and frontoparietal regions, as well as between the orbitofrontal and occipital regions, compared with ASD-only. The hippocampus was the shared region in aberrant functional connectivity patterns in ASD + ADHD and ASD-only compared with TD. These findings suggests that ASD + ADHD displays altered topology and functional connectivity in the brain regions that undertake social cognition, language processing, and sensory processing.

Neural correlates of an illusionary sense of agency caused by virtual reality

Sense of agency (SoA) is the sensation that self-actions lead to ensuing perceptual consequences. The prospective mechanism emphasizes that SoA arises from motor prediction and its comparison with actual action outcomes, while the reconstructive mechanism stresses that SoA emerges from retrospective causal processing about the action outcomes. Consistent with the prospective mechanism, motor planning regions were identified by neuroimaging studies using the temporal binding (TB) effect, a behavioral measure often linked to implicit SoA. Yet, TB also occurs during passive observation of another's action, lending support to the reconstructive mechanism, but its neural correlates remain unexplored. Here, we employed virtual reality (VR) to modulate such observation-based SoA and examined it with functional magnetic resonance imaging (fMRI). After manipulating an avatar hand in VR, participants passively observed an avatar's "action" and showed a significant increase in TB. The binding effect was associated with the right angular gyrus and inferior parietal lobule, which are critical nodes for inferential and agency processing. These results suggest that the experience of controlling an avatar may potentiate inferential processing within the right inferior parietal cortex and give rise to the illusionary SoA without voluntary action.

The Potential and Challenges of Virtual Reality as an Adjunctive Treatment of Depression Patients

Virtual reality (VR) is a promising supplemental or alternative approach for treating depression. Focusing on the unique affordances of VR, such as immersive therapeutic settings and uniform treatment delivery, this study explores both the current applications and future potential of VR technology in treating and assessing depression. VR provides users with an "immersive" and "presence" experience through multisensory stimulation. VR is an emerging paradigm in healthcare, particularly in psychiatric treatment, and presents compelling possibilities for its role in therapeutic interventions by facilitating realistic and controlled environments for both clinicians and patients. VR technology offers promising advancements in augmenting traditional cognitive-behavioral therapy (CBT) methods for treating depression, with applications in psychoeducation, behavioral activation, and cognitive restructuring. Various VR assessment techniques including biomarkers and machine learning have been discussed in this study. Although the field remains experimental, the immersive nature of VR holds the potential for more personalized and accurate therapeutic interventions and assessments. Further research is required for definitive conclusions.

Sensorimotor Uncertainty of Immersive Virtual Reality Environments for People in Pain: Scoping Review

INTRODUCTION

Decision making and action execution both rely on sensory information, and their primary objective is to minimise uncertainty. Virtual reality (VR) introduces uncertainty due to the imprecision of perceptual information. The concept of "sensorimotor uncertainty" is a pivotal element in the interplay between perception and action within the VR environment. The role of immersive VR in the four stages of motor behaviour decision making in people with pain has been previously discussed. These four processing levels are the basis to understand the uncertainty that a patient experiences when using VR: sensory information, current state, transition rules, and the outcome obtained.

METHODS

This review examines the different types of uncertainty that a patient may experience when they are immersed in a virtual reality environment in a context of pain. Randomised clinical trials, a secondary analysis of randomised clinical trials, and pilot randomised clinical trials related to the scope of Sensorimotor Uncertainty in Immersive Virtual Reality were included after searching.

RESULTS

Fifty studies were included in this review. They were divided into four categories regarding the type of uncertainty the intervention created and the stage of the decision-making model.

CONCLUSIONS

Immersive virtual reality makes it possible to alter sensorimotor uncertainty, but studies of higher methodological quality are needed on this topic, as well as an exploration into the patient profile for pain management using immersive VR.

From rubber hands to neuroprosthetics: Neural correlates of embodiment

Our interaction with the world rests on the knowledge that we are a body in space and time, which can interact with the environment. This awareness is usually referred to as sense of embodiment. For the good part of the past 30 years, the rubber hand illusion (RHI) has been a prime tool to study embodiment in healthy and people with a variety of clinical conditions. In this paper, we provide a critical overview of this research with a focus on the RHI paradigm as a tool to study prothesis embodiment in individuals with amputation. The RHI relies on well-documented multisensory integration mechanisms based on sensory precision, where parietal areas are involved in resolving the visuo-tactile conflict, and premotor areas in updating the conscious bodily representation. This mechanism may be transferable to prosthesis ownership in amputees. We discuss how these results might transfer to technological development of sensorised prostheses, which in turn might progress the acceptability by users.

How the body remembers: Examining the default mode and sensorimotor networks during moral injury autobiographical memory retrieval in PTSD

Neural representations of sensory percepts and motor responses constitute key elements of autobiographical memory. However, these representations may remain as unintegrated sensory and motor fragments in traumatic memory, thus contributing toward re-experiencing and reliving symptoms in trauma-related conditions such as post-traumatic stress disorder (PTSD). Here, we investigated the sensorimotor network (SMN) and posterior default mode network (pDMN) using a group independent component analysis (ICA) by examining their functional connectivity during a script-driven memory retrieval paradigm of (potentially) morally injurious events in individuals with PTSD and healthy controls. Moral injury (MI), where an individual acts or fails to act in a morally aligned manner, is examined given its inherent ties to disrupted motor planning and thus sensorimotor mechanisms. Our findings revealed significant differences in functional network connectivity across the SMN and pDMN during MI retrieval in participants with PTSD (n = 65) as compared to healthy controls (n = 25). No such significant group-wise differences emerged during retrieval of a neutral memory. PTSD-related alterations included hyperconnectivity between the SMN and pDMN, enhanced within-network connectivity of the SMN with premotor areas, and increased recruitment of the supramarginal gyrus into both the SMN and the pDMN during MI retrieval. In parallel with these neuroimaging findings, a positive correlation was found between PTSD severity and subjective re-experiencing intensity ratings after MI retrieval. These results suggest a neural basis for traumatic re-experiencing, where reliving and/or re-enacting a past morally injurious event in the form of sensory and motor fragments occurs in place of retrieving a complete, past-contextualized narrative as put forth by Brewin and colleagues (1996) and Conway and Pleydell-Pearce (2000). These findings have implications for bottom-up treatments targeting directly the sensory and motoric elements of traumatic experiences.

Altered Resting-State functional connectivity in the anterior and posterior hippocampus in Post-traumatic stress disorder: The central role of the anterior hippocampus

BACKGROUND

Post-traumatic stress disorder can be viewed as a memory disorder, with trauma-related flashbacks being a core symptom. Given the central role of the hippocampus in autobiographical memory, surprisingly, there is mixed evidence concerning altered hippocampal functional connectivity in PTSD. We shed light on this discrepancy by considering the distinct roles of the anterior versus posterior hippocampus and examine how this distinction may map onto whole-brain resting-state functional connectivity patterns among those with and without PTSD.

METHODS

We first assessed whole-brain between-group differences in the functional connectivity profiles of the anterior and posterior hippocampus within a publicly available data set of resting-state fMRI data from 31 male Vietnam war veterans diagnosed with PTSD (mean age = 67.6 years, sd = 2.3) and 29 age-matched combat-exposed male controls (age = 69.1 years, sd = 3.5). Next, the connectivity patterns of each subject within the PTSD group were correlated with their PTSD symptom scores. Finally, the between-group differences in whole-brain functional connectivity profiles discovered for the anterior and posterior hippocampal seeds were used to prescribe post-hoc ROIs, which were then used to perform ROI-to-ROI functional connectivity and graph-theoretic analyses.

RESULTS

The PTSD group showed increased functional connectivity of the anterior hippocampus with affective brain regions (anterior/posterior insula, orbitofrontal cortex, temporal pole) and decreased functional connectivity of the anterior/posterior hippocampus with regions involved in processing bodily self-consciousness (supramarginal gyrus). Notably, decreased anterior hippocampus connectivity with the posterior cingulate cortex/precuneus was associated with increased PTSD symptom severity. The left anterior hippocampus also emerged as a central locus of abnormal functional connectivity, with graph-theoretic measures suggestive of a more central hub-like role for this region in those with PTSD compared to trauma-exposed controls.

CONCLUSIONS

Our results highlight that the anterior hippocampus plays a critical role in the neurocircuitry underlying PTSD and underscore the importance of the differential roles of hippocampal sub-regions in serving as biomarkers of PTSD. Future studies should investigate whether the differential patterns of functional connectivity stemming from hippocampal sub-regions is observed in PTSD populations other than older war veterans.

Supramodal Representation of the Sense of Body Ownership in the Human Parieto-Premotor and Extrastriate Cortices

The sense of body ownership, defined as the sensation that one's body belongs to oneself, is a fundamental component of bodily self-consciousness. Several studies have shown the importance of multisensory integration for the emergence of the sense of body ownership, together with the involvement of the parieto-premotor and extrastriate cortices in bodily awareness. However, whether the sense of body ownership elicited by different sources of signal, especially visuotactile and visuomotor inputs, is represented by common neural patterns remains to be elucidated. We used functional magnetic resonance imaging (fMRI) to investigate the existence of neural correlates of the sense of body ownership independent of the sensory modalities. Participants received tactile stimulation or executed finger movements while given synchronous and asynchronous visual feedback of their hand. We used multivoxel patterns analysis (MVPA) to decode the synchronous and asynchronous conditions with cross-classification between two modalities: the classifier was first trained in the visuotactile sessions and then tested in the visuomotor sessions, and vice versa. Regions of interest (ROIs)-based and searchlight analyses revealed significant above-chance cross-classification accuracies in the bilateral intraparietal sulcus (IPS), the bilateral ventral premotor cortex (PMv), and the left extrastriate body area (EBA). Moreover, we observed a significant positive correlation between the cross-classification accuracy in the left PMv and the difference in subjective ratings of the sense of body ownership between the synchronous and asynchronous conditions. Our findings revealed the neural representations of the sense of body ownership in the IPS, PMv, and EBA that is invariant to the sensory modalities.

A multi-dimensional framework for prosthetic embodiment: a perspective for translational research

The concept of embodiment has gained widespread popularity within prosthetics research. Embodiment has been claimed to be an indicator of the efficacy of sensory feedback and control strategies. Moreover, it has even been claimed to be necessary for prosthesis acceptance, albeit unfoundedly. Despite the popularity of the term, an actual consensus on how prosthetic embodiment should be used in an experimental framework has yet to be reached. The lack of consensus is in part due to terminological ambiguity and the lack of an exact definition of prosthetic embodiment itself. In a review published parallel to this article, we summarized the definitions of embodiment used in prosthetics literature and concluded that treating prosthetic embodiment as a combination of ownership and agency allows for embodiment to be quantified, and thus useful in translational research. Here, we review the potential mechanisms that give rise to ownership and agency considering temporal, spatial, and anatomical constraints. We then use this to propose a multi-dimensional framework where prosthetic embodiment arises within a spectrum dependent on the integration of volition and multi-sensory information as demanded by the degree of interaction with the environment. This framework allows for the different experimental paradigms on sensory feedback and prosthetic control to be placed in a common perspective. By considering that embodiment lays along a spectrum tied to the interactions with the environment, one can conclude that the embodiment of prosthetic devices should be assessed while operating in environments as close to daily life as possible for it to become relevant.

Causal Inference of Body Ownership in the Posterior Parietal Cortex

How do we come to sense that a hand in view belongs to our own body or not? Previous studies have suggested that the integration of vision and somatosensation in the frontoparietal areas plays a critical role in the sense of body ownership (i.e., the multisensory perception of limbs and body parts as our own). However, little is known about how these areas implement the multisensory integration process at the computational level and whether activity predicts illusion elicitation in individual participants on a trial-by-trial basis. To address these questions, we used functional magnetic resonance imaging and a rubber hand illusion-detection task and fitted the registered neural responses to a Bayesian causal inference model of body ownership. Thirty healthy human participants (male and female) performed 12 s trials with varying degrees of asynchronously delivered visual and tactile stimuli of a rubber hand (in view) and a (hidden) real hand. After the 12 s period, participants had to judge whether the rubber hand felt like their own. As hypothesized, activity in the premotor and posterior parietal cortices was related to illusion elicitation at the level of individual participants and trials. Importantly, activity in the posterior parietal cortex fit the predicted probability of illusion emergence of the Bayesian causal inference model based on each participant's behavioral response profile. Our findings suggest an important role for the posterior parietal cortex in implementing Bayesian causal inference of body ownership and reveal how trial-by-trial variations in neural signatures of multisensory integration relate to the elicitation of the rubber hand illusion.SIGNIFICANCE STATEMENT How does the brain create a coherent perceptual experience of one's own body based on information from the different senses? We examined how the likelihood of eliciting a classical bodily illusion that depends on vision and touch-the rubber hand illusion-is related to neural activity measured by functional magnetic resonance imaging. We found that trial-by-trial variations in the neural signal in the posterior parietal cortex, a well known center for sensory integration, fitted a statistical function that describes how likely it is that the brain infers that a rubber hand is one's own given the available visual and tactile evidence. Thus, probabilistic analysis of sensory information in the parietal lobe underlies our unitary sense of bodily self.

The rubber hand illusion is accompanied by a distributed reduction of alpha and beta power in the EEG

Previous studies have reported correlates of bodily self-illusions such as the rubber hand in signatures of rhythmic brain activity. However, individual studies focused on specific variations of the rubber hand paradigm, used different experimental setups to induce this, or used different control conditions to isolate the neurophysiological signatures related to the illusory state, leaving the specificity of the reported illusion-signatures unclear. We here quantified correlates of the rubber hand illusion in EEG-derived oscillatory brain activity and asked two questions: which of the observed correlates are robust to the precise nature of the control conditions used as contrast for the illusory state, and whether such correlates emerge directly around the subjective illusion onset. To address these questions, we relied on two experimental configurations to induce the illusion, on different non-illusion conditions to isolate neurophysiological signatures of the illusory state, and we implemented an analysis directly focusing on the immediate moment of the illusion onset. Our results reveal a widespread suppression of alpha and beta-band activity associated with the illusory state in general, whereby the reduction of beta power prevailed around the immediate illusion onset. These results confirm previous reports of a suppression of alpha and beta rhythms during body illusions, but also highlight the difficulties to directly pinpoint the precise neurophysiological correlates of the illusory state.

Embodiment Comfort Levels During Motor Imagery Training Combined With Immersive Virtual Reality in a Spinal Cord Injury Patient

Brain-machine interfaces combining visual, auditory, and tactile feedback have been previously used to generate embodiment experiences during spinal cord injury (SCI) rehabilitation. It is not known if adding temperature to these modalities can result in discomfort with embodiment experiences. Here, comfort levels with the embodiment experiences were investigated in an intervention that required a chronic pain SCI patient to generate lower limb motor imagery commands in an immersive environment combining visual (virtual reality -VR), auditory, tactile, and thermal feedback. Assessments were made pre-/ post-, throughout the intervention (Weeks 0-5), and at 7 weeks follow up. Overall, high levels of embodiment in the adapted three-domain scale of embodiment were found throughout the sessions. No significant adverse effects of VR were reported. Although sessions induced only a modest reduction in pain levels, an overall reduction occurred in all pain scales (Faces, Intensity, and Verbal) at follow up. A high degree of comfort in the comfort scale for the thermal-tactile sleeve, in both the thermal and tactile feedback components of the sleeve was reported. This study supports the feasibility of combining multimodal stimulation involving visual (VR), auditory, tactile, and thermal feedback to generate embodiment experiences in neurorehabilitation programs.

Neural correlates of disturbance in the sense of agency in schizophrenia: An fMRI study using the 'enfacement' paradigm

An altered sense of self-awareness and agency has been proposed to underlie symptoms of schizophrenia. In this study, we used the enfacement illusion paradigm - in which perception of another person's face leads to changes in perception of one's own peri-personal space - to examine the brain correlates of the sense of agency and its potential disruption in schizophrenia. Thirty-three schizophrenic patients and 27 healthy controls underwent fMRI scanning during performance of a task designed to elicit the enfacement illusion. Activations were examined using whole-brain analysis and also in an a priori identified region of interest (ROI) in the temporoparietal junction (TPJ), a region that has been described as involved in self/other differentiation and sense of agency. Both groups showed a pattern of cortical activation involving the pre and postcentral cortex, Rolandic operculum, insula, parietal, temporal and occipital cortex bilaterally as well as TPJ (but only right-side in patients). Examination of the TPJ ROI revealed significantly reduced activation on the left in the patients that was associated with poorer insight. The findings suggest brain functional abnormality in schizophrenia related to the formation or maintenance of processes related to self and/or agency. Decreased function in the TPJ may have a role in the impaired insight seen in patients with the disorder.

Enhanced processing of aversive stimuli on embodied artificial limbs by the human amygdala

Body perception has been extensively investigated, with one particular focus being the integration of vision and touch within a neuronal body representation. Previous studies have implicated a distributed network comprising the extrastriate body area (EBA), posterior parietal cortex (PPC) and ventral premotor cortex (PMv) during illusory self-attribution of a rubber hand. Here, we set up an fMRI paradigm in virtual reality (VR) to study whether and how the self-attribution of (artificial) body parts is altered if these body parts are somehow threatened. Participants (N = 30) saw a spider (aversive stimulus) or a toy-car (neutral stimulus) moving along a 3D-rendered virtual forearm positioned like their real forearm, while tactile stimulation was applied on the real arm in the same (congruent) or opposite (incongruent) direction. We found that the PPC was more activated during congruent stimulation; higher visual areas and the anterior insula (aIns) showed increased activation during aversive stimulus presentation; and the amygdala was more strongly activated for aversive stimuli when there was stronger multisensory integration of body-related information (interaction of aversiveness and congruency). Together, these findings suggest an enhanced processing of aversive stimuli within the amygdala when they represent a bodily threat.

Intrinsic neural activity predisposes susceptibility to a body illusion

Susceptibility to the rubber hand illusion (RHI) varies. To date, however, there is no consensus explanation of this variability. Previous studies, focused on the role of multisensory integration, have searched for neural correlates of the illusion. But those studies have failed to identify a sufficient set of functionally specific neural correlates. Because some evidence suggests that frontal α power is one means of tracking neural instantiations of self, we hypothesized that the higher the frontal α power during the eyes-closed resting state, the more stable the self. As a corollary, we infer that the more stable the self, the less susceptible are participants to a blurring of boundaries—to feeling that the rubber hand belongs to them. Indeed, we found that frontal α amplitude oscillations negatively correlate with susceptibility. Moreover, since lower frequencies often modulate higher frequencies, we explored the possibility that this might be the case for the RHI. Indeed, some evidence suggests that high frontal α power observed in low-RHI participants is modulated by δ frequency oscillations. We conclude that while neural correlates of multisensory integration might be necessary for the RHI, sufficient explanation involves variable intrinsic neural activity that modulates how the brain responds to incompatible sensory stimuli.

Predicting vasovagal reactions to a virtual blood donation using facial image analysis

Background

People with needle fear experience not only anxiety and stress but also vasovagal reactions (VVR), including nausea, dizziness, sweating, pallor changes, or even fainting. However, the mechanism behind needle fear and the VVR response are not yet well understood. The aim of our study was to explore whether fluctuations in facial temperature in several facial regions are related to the level of experienced vasovagal reactions, in a simulated blood donation.

Study design and methods

We recruited 45 students at Tilburg University and filmed them throughout a virtual blood donation procedure using an Infrared Thermal Imaging (ITI) camera. Participants reported their fear of needles and level of experienced vasovagal reactions. ITI data pre‐processing was completed on each video frame by detecting facial landmarks and image alignment before extracting the mean temperature from the six regions of interest.

Results

Temperatures of the chin and left and right cheek areas increased during the virtual blood donation. Mixed‐effects linear regression showed a significant association between self‐reported vasovagal reactions and temperature fluctuations in the area below the nose.

Discussion

Our results suggest that the area below the nose may be an interesting target for measuring vasovagal reactions using video imaging techniques. This is the first in a line of studies, which assess whether it is possible to automatically detect levels of fear and vasovagal reactions using facial imaging, from which the development of e‐health solutions and interventions can benefit.

Multivariate Analysis of Evoked Responses during the Rubber Hand Illusion Suggests a Temporal Parcellation into Manipulation and Illusion-Specific Correlates

The neurophysiological processes reflecting body illusions such as the rubber hand remain debated. Previous studies investigating the neural responses evoked by the illusion-inducing stimulation have provided diverging reports as to when these responses reflect the illusory state of the artificial limb becoming embodied. One reason for these diverging reports may be that different studies contrasted different experimental conditions to isolate potential correlates of the illusion, but individual contrasts may reflect multiple facets of the adopted experimental paradigm and not just the illusory state. To resolve these controversies, we recorded EEG responses in human participants and combined multivariate (cross-)classification with multiple Illusion and non-Illusion conditions. These conditions were designed to probe for markers of the illusory state that generalize across the spatial arrangements of limbs or the specific nature of the control object (a rubber hand or participant’s real hand), hence which are independent of the precise experimental conditions used as contrast for the illusion. Our results reveal a parcellation of evoked responses into a temporal sequence of events. Around 125 and 275 ms following stimulus onset, the neurophysiological signals reliably differentiate the illusory state from non-Illusion epochs. These results consolidate previous work by demonstrating multiple neurophysiological correlates of the rubber hand illusion and illustrate how multivariate approaches can help pinpointing those that are independent of the precise experimental configuration used to induce the illusion.

The body-ownership is unconsciously distorted in the brain: An event-related potential study of rubber hand illusion

Many studies have reported that bottom-up multisensory integration of visual, tactile, and proprioceptive information can distort our sense of body-ownership, producing rubber hand illusion (RHI). There is less evidence about when and how the body-ownership is distorted in the brain during RHI. To examine whether this illusion effect occurs preattentively at an early stage of processing, we monitored the visual mismatch negativity (vMMN) component (the index of automatic deviant detection) and N2 (the index for conflict monitoring). Participants first performed an RHI elicitation task in a synchronous or asynchronous setting and then finished a passive visual oddball task in which the deviant stimuli were unrelated to the explicit task. A significant interaction between Deviancy (deviant hand vs. standard hand) and Group (synchronous vs. asynchronous) was found. The asynchronous group showed clear mismatch effects in both vMMN and N2, while the synchronous group had such effect only in N2. The results indicate that after the elicitation of RHI bottom-up integration could be retrieved at the early stage of sensory processing before top-down processing, providing evidence for the priority of the bottom-up processes after the generation of RHI and revealing the mechanism of how the body-ownership is unconsciously distorted in the brain.

Cognitive Models of Limb Embodiment in Structurally Varying Bodies: A Theoretical Perspective

Using the seminal rubber hand illusion and related paradigms, the last two decades unveiled the multisensory mechanisms underlying the sense of limb embodiment, that is, the cognitive integration of an artificial limb into one's body representation. Since also individuals with amputations can be induced to embody an artificial limb by multimodal sensory stimulation, it can be assumed that the involved computational mechanisms are universal and independent of the perceiver's physical integrity. This is anything but trivial, since experimentally induced embodiment has been related to the embodiment of prostheses in limb amputees, representing a crucial rehabilitative goal with clinical implications. However, until now there is no unified theoretical framework to explain limb embodiment in structurally varying bodies. In the present work, we suggest extensions of the existing Bayesian models on limb embodiment in normally-limbed persons in order to apply them to the specific situation in limb amputees lacking the limb as physical effector. We propose that adjusted weighting of included parameters of a unified modeling framework, rather than qualitatively different model structures for normally-limbed and amputated individuals, is capable of explaining embodiment in structurally varying bodies. Differences in the spatial representation of the close environment (peripersonal space) and the limb (phantom limb awareness) as well as sensorimotor learning processes associated with limb loss and the use of prostheses might be crucial modulators for embodiment of artificial limbs in individuals with limb amputation. We will discuss implications of our extended Bayesian model for basic research and clinical contexts.

Virtual Hand Illusion in younger and older adults

Introduction

Embodiment involves experiencing ownership over our body and localizing it in space and is informed by multiple senses (visual, proprioceptive and tactile). Evidence suggests that embodiment and multisensory integration may change with older age. The Virtual Hand Illusion (VHI) has been used to investigate multisensory contributions to embodiment, but has never been evaluated in older adults. Spatio-temporal factors unique to virtual environments may differentially affect the embodied perceptions of older and younger adults.

Methods

Twenty-one younger (18–35 years) and 19 older (65+ years) adults completed the VHI paradigm. Body localization was measured at baseline and again, with subjective ownership ratings, following synchronous and asynchronous visual-tactile interactions.

Results

Higher ownership ratings were observed in the synchronous relative to the asynchronous condition, but no effects on localization/drift were found. No age differences were observed. Localization accuracy was biased in both age groups when the virtual hand was aligned with the real hand, indicating a visual mislocalization of the virtual hand.

Conclusions

No age-related differences in the VHI were observed. Mislocalization of the hand in VR occurred for both groups, even when congruent and aligned; however, tactile feedback reduced localization biases. Our results expand the current understanding of age-related changes in multisensory embodiment within virtual environments.

Region-of-interest analysis approaches in neuroimaging studies of body ownership: An activation likelihood estimation meta-analysis

How do we feel that we own our body? By manipulating the integration of multisensory signals and creating the illusory experience of owning external body parts and entire bodies, researchers have investigated the neurofunctional correlates of body ownership. Recent attempts to synthesize the neuroimaging literature of body ownership through meta-analysis have shown partly inconsistent results. A large proportion of functional magnetic resonance imaging (fMRI) findings on body ownership include analyses based on regions of interest (ROIs). This approach can produce inflated findings when results are synthesized in meta-analyses. We conducted a systematic search of the fMRI literature of ownership of body parts and entire bodies. Three activation likelihood estimation (ALE) meta-analyses were conducted, testing the impact of including ROI-based findings. When both whole-brain and ROI-based results were included, frontal and posterior parietal multisensory areas were associated with body ownership. When only ROI-based results were included, larger areas of the frontal and posterior parietal cortices and the middle occipital gyrus were associated with body ownership. A whole-brain meta-analysis, excluding ROI-based results, found no significant convergence of activation across the brain. These findings highlight the difficulty of quantitatively synthesizing a neuroimaging field where a large part of the literature is based on findings from ROI-based analyses. We discuss these findings in the light of current practices within this field of research and highlight current problems of meta-analytic approaches of body ownership. We recommend the sharing of unthresholded data as a means to facilitate future meta-analyses of the neuroimaging literature of body ownership.

Diametrical modulation of tactile and visual perceptual thresholds during the rubber hand illusion: a predictive coding account

During the rubber hand illusion (RHI), the synchronous stroking of the participants' concealed hand and a visible rubber hand induces a conflict among visuo-tactile inputs, leading healthy subjects to perceive the illusion of being touched on the rubber hand, as if it were part of their body. The predictive coding theory suggests that the RHI emerges to settle the conflict, attenuating somatosensory inputs in favour of visual ones, which "capture" tactile sensations. Here, we employed the psychophysical measure of perceptual threshold to measure a behavioural correlate of the somatosensory and visual modulations, to better understand the mechanisms underpinning the illusion. Before and after the RHI, participants underwent a tactile (Experiment 1) and a visual (Experiment 2) task, wherein they had to detect stimuli slightly above the perceptual threshold. According to the predictive coding framework, we found a significant decrease of tactile detection (i.e. increased tactile perceptual threshold) and a significant increase of visual detection (i.e.  decreased visual perceptual threshold), suggesting a diametrical modulation of somatosensory and visual perceptual processes. These findings provide evidence of how our system plastically adapts to uncertainty, attributing different weights to sensory inputs to restore a coherent representation of the own body.

Predicting Post-Stroke Somatosensory Function from Resting-State Functional Connectivity: A Feasibility Study

Accumulating evidence shows that brain functional deficits may be impacted by damage to remote brain regions. Recent advances in neuroimaging suggest that stroke impairment can be better predicted based on disruption to brain networks rather than from lesion locations or volumes only. Our aim was to explore the feasibility of predicting post-stroke somatosensory function from brain functional connectivity through the application of machine learning techniques. Somatosensory impairment was measured using the Tactile Discrimination Test. Functional connectivity was employed to model the global brain function. Behavioral measures and MRI were collected at the same timepoint. Two machine learning models (linear regression and support vector regression) were chosen to predict somatosensory impairment from disrupted networks. Along with two feature pools (i.e., low-order and high-order functional connectivity, or low-order functional connectivity only) engineered, four predictive models were built and evaluated in the present study. Forty-three chronic stroke survivors participated this study. Results showed that the regression model employing both low-order and high-order functional connectivity can predict outcomes based on correlation coefficient of r = 0.54 (p = 0.0002). A machine learning predictive approach, involving high- and low-order modelling, is feasible for the prediction of residual somatosensory function in stroke patients using functional brain networks.

The Development of a Flexible Bodily Representation: Behavioral Outcomes and Brain Oscillatory Activity During the Rubber Hand Illusion in Preterm and Full-Term School-Age Children

During childhood, the body undergoes rapid changes suggesting the need to constantly update body representation based on the integration of multisensory signals. Sensory experiences in critical periods of early development may have a significant impact on the neurobiological mechanisms underpinning the development of the sense of one’s own body. Specifically, preterm children are at risk for sensory processing difficulties, which may lead to specific vulnerability in binding together sensory information in order to modulate the representation of the bodily self. The present study aims to investigate the malleability of body ownership in preterm (N = 21) and full-term (N = 19) school-age children, as reflected by sensitivity to the Rubber Hand Illusion. The results revealed that multisensory processes underlying the ability to identify a rubber hand as being part of one’s own body are already established in childhood, as indicated by a higher subjective feeling of embodiment over the rubber hand during synchronous visual-tactile stimulation. Notably, the effect of visual-tactile synchrony was related to the suppression of the alpha band oscillations over frontal, central, and parietal scalp regions, possibly indicating a greater activation of somatosensory and associative areas underpinning the illusory body ownership. Moreover, an interaction effect between visual-tactile condition and group emerged, suggesting that preterm children showed a greater suppression of alpha oscillatory activity during the illusion. This result together with lower scores of subjective embodiment over the rubber hand reported by preterm children indicate that preterm birth may affect the development of the flexible representation of the body. These findings provide an essential contribution to better understand the processes of identification and differentiation of the bodily self from the external environment, in both full-term and preterm children, paving the way for a multisensory and embodied approach to the investigation of social and cognitive development.

Contribution of interaction force to the sense of hand ownership and the sense of hand agency

When performing willed actions, we have the unified and coherent experience of owning and controlling our body. Body ownership is believed to emerge from the integration of coherent multisensory signals, while agency is believed to emerge from the coherence between predicted and perceived outcomes of actions. As a consequence, body ownership and agency can both be modulated by multisensory conflicts. The contribution of active movement generation to ownership and agency has not been parametrically explored. Here, we investigated the contribution of interaction force between the agent and the environment to the sense of hand ownership (SO) and the sense of hand agency (SA). By combining robotics and virtual reality, we manipulated the sensorimotor and visual information during immersive scenarios to induce and quantify altered states of SO and SA. First, we demonstrated that SO and SA could be successfully manipulated by our experimental paradigms. Second, we showed that interaction force strongly contributes to SA, but to a lesser extent to SO. Finally, we showed that SO and SA interact beyond their common multisensory basis. Our results, based on two independent studies, provide a direct link between sensorimotor interactions and subjective body experience and demonstrate a new dissociation between SO and SA.

Illusory Body Ownership Affects the Cortical Response to Vicarious Somatosensation

Fundamental human feelings such as body ownership (“this” body is “my” body) and vicariousness (first-person-like experience of events occurring to others) are based on multisensory integration. Behavioral links between body ownership and vicariousness have been shown, but the neural underpinnings remain largely unexplored. To fill this gap, we investigated the neural effects of altered body ownership on vicarious somatosensation. While recording functional brain imaging data, first, we altered participants’ body ownership by robotically delivering tactile stimulations (“tactile” stroking) in synchrony or not with videos of a virtual hand being brushed (“visual” stroking). Then, we manipulated vicarious somatosensation by showing videos of the virtual hand being touched by a syringe’s plunger (touch) or needle (pain). Only after the alteration of body ownership (synchronous visuo-tactile stroking) and specifically during late epochs of vicarious somatosensation, vicarious pain was associated with lower activation in premotor and anterior cingulate cortices with respect to vicarious touch. At the methodological level, the present study highlights the importance of the neural response’s temporal evolution. At the theoretical level, it shows that the higher-level (cognitive) impact of a lower-level (sensory) body-related processing (visuo-tactile) is not limited to body ownership but also extends to other psychological body-related domains, such as vicarious somatosensation.

Promoting neuroplasticity and neuropsychological functioning in frailty through an app-based sensorimotor training: study protocol for a randomized trial

BACKGROUND

Frailty is characterized by an age-related decline in multiple physiological systems, leading to a high vulnerability to stressors, adverse health outcomes, and low quality of life. Neuroscientific models of pathological aging emphasize the loss of sensorimotor stimulation and reduced neuromodulatory capacities as core processes in age-related cognitive and bodily decline, which may be associated with maladaptive plastic changes in the brain. We plan to increase sensorimotor stimulation in frail persons through a newly developed app-based training program and link the training trials to biological and psychological correlates of age-associated vulnerability and health indices.

METHODS

We will conduct a randomized trial, applying an app-based sensorimotor home training (N = 30) in people suffering from frailty. An app-based relaxation training will serve as an active control condition (N = 30). Both interventions will last for 90 days each. The sensorimotor training includes unimodal and multimodal sensory discrimination tasks in the visual, auditory, and tactile domain, as well as sensorimotor precision tasks. The tasks will be implemented using an adaptive training algorithm and enriched with motivational components embedded in a virtual training environment. We expect a pre-post reduction of frailty status and associated functional decline related to refinement of representational maps within the sensorimotor system and improved sensorimotor function such as extremity function. Secondary analyses will study the influence of BDNF genotype as moderating variable. Additional outcomes will include measures of perceptual and cognitive functioning, quality of life as well as BDNF serum levels. Measurements will take place before training (baseline), after 60 days (assessment 1), and at the end of the training after 90 days (assessment 2).

DISCUSSION

In our randomized trial, we aim to characterize a multidimensional concept of frailty and to target maladaptive behaviors and neuroplasticity using an app-based sensorimotor training. This type of intervention might provide further knowledge and new possibilities for preventing decline and preserving function in older adults.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03666039 . Registered 11 September 2018 - Retrospectively registered. Protocol version: Version 4 revised (issue date: 19 May 2021).

Virtual Reality for Neurorehabilitation and Cognitive Enhancement

Our access to computer-generated worlds changes the way we feel, how we think, and how we solve problems. In this review, we explore the utility of different types of virtual reality, immersive or non-immersive, for providing controllable, safe environments that enable individual training, neurorehabilitation, or even replacement of lost functions. The neurobiological effects of virtual reality on neuronal plasticity have been shown to result in increased cortical gray matter volumes, higher concentration of electroencephalographic beta-waves, and enhanced cognitive performance. Clinical application of virtual reality is aided by innovative brain–computer interfaces, which allow direct tapping into the electric activity generated by different brain cortical areas for precise voluntary control of connected robotic devices. Virtual reality is also valuable to healthy individuals as a narrative medium for redesigning their individual stories in an integrative process of self-improvement and personal development. Future upgrades of virtual reality-based technologies promise to help humans transcend the limitations of their biological bodies and augment their capacity to mold physical reality to better meet the needs of a globalized world.

Prosthesis embodiment and attenuation of prosthetic touch in upper limb amputees - A proof-of-concept study

Sensory attenuation of self-touch, that is, the perceptual reduction of self-generated tactile stimuli, is considered a neurocognitive basis for self-other distinction. However, whether this effect can also be found in upper limb amputees using a prosthesis is unknown. Thirteen participants were asked to touch their foot sole with a) their intact hand (self-touch), b) their prosthesis (prosthesis-touch), or c) let it be touched by another person (other-touch). Intensity of touch was assessed with a questionnaire. In addition, prosthesis embodiment was assessed in nine participants. Self-touch as well as prosthesis-touch was characterized by significant perceptual attenuation compared to other-touch, while self- and prosthesis-touch did not differ. The more embodied the prosthesis was, the more similar was its elicited touch perception to actual self-touch. These findings - although preliminary - suggest that perceptually embodied prostheses can be represented as an actual limb by the users' sensorimotor system.

Building the bodily self-awareness: Evidence for the convergence between interoceptive and exteroceptive information in a multilevel kernel density analysis study

Exteroceptive and interoceptive signals shape and sustain the bodily self-awareness. The existence of a set of brain areas, supporting the integration of information coming from the inside and the outside of the body in building the sense of bodily self-awareness has been postulated, yet the evidence remains limited, a matter of discussion never assessed quantitatively. With the aim of unrevealing where in the brain interoceptive and exteroceptive signals may converge, we performed a meta-analysis on imaging studies of the sense of body ownership, modulated by external visuotactile stimulation, and studies on interoception, which involves the self-awareness for internal bodily sensations. Using a multilevel kernel density analysis, we found that processing of stimuli of the two domains converges primarily in the supramarginal gyrus bilaterally. Furthermore, we found a right-lateralized set of areas, including the precentral and postcentral, and superior temporal gyri. We discuss these results and propose this set of areas as ideal candidates to match multiple body-related signals contributing to the creation of a multidimensional representation of the bodily self.

Cortical Regions Encoding Hardness Perception Modulated by Visual Information Identified by Functional Magnetic Resonance Imaging With Multivoxel Pattern Analysis

Recent studies have revealed that hardness perception is determined by visual information along with the haptic input. This study investigated the cortical regions involved in hardness perception modulated by visual information using functional magnetic resonance imaging (fMRI) and multivoxel pattern analysis (MVPA). Twenty-two healthy participants were enrolled. They were required to place their left and right hands at the front and back, respectively, of a mirror attached to a platform placed above them while lying in a magnetic resonance scanner. In conditions SFT, MED, and HRD, one of three polyurethane foam pads of varying hardness (soft, medium, and hard, respectively) was presented to the left hand in a given trial, while only the medium pad was presented to the right hand in all trials. MED was defined as the control condition, because the visual and haptic information was congruent. During the scan, the participants were required to push the pad with the both hands while observing the reflection of the left hand and estimate the hardness of the pad perceived by the right (hidden) hand based on magnitude estimation. Behavioral results showed that the perceived hardness was significantly biased toward softer or harder in >73% of the trials in conditions SFT and HRD; we designated these trials as visually modulated (SFTvm and HRDvm, respectively). The accuracy map was calculated individually for each of the pair-wise comparisons of (SFTvm vs. MED), (HRDvm vs. MED), and (SFTvm vs. HRDvm) by a searchlight MVPA, and the cortical regions encoding the perceived hardness with visual modulation were identified by conjunction of the three accuracy maps in group analysis. The cluster was observed in the right sensory motor cortex, left anterior intraparietal sulcus (aIPS), bilateral parietal operculum (PO), and occipito-temporal cortex (OTC). Together with previous findings on such cortical regions, we conclude that the visual information of finger movements processed in the OTC may be integrated with haptic input in the left aIPS, and the subjective hardness perceived by the right hand with visual modulation may be processed in the cortical network between the left PO and aIPS.

Increased neural connectivity between the hypothalamus and cortical resting-state functional networks in chronic migraine

OBJECTIVE

The findings of resting-state functional MRI studies have suggested that abnormal functional integration between interconnected cortical networks characterises the brain of patients with migraine. The aim of this study was to investigate the functional connectivity between the hypothalamus, brainstem, considered as the migraine generator, and the following areas/networks that are reportedly involved in the pathophysiology of migraine: default mode network (DMN), executive control network, dorsal attention system, and primary and dorsoventral visual networks.

METHODS

Twenty patients with chronic migraine (CM) without medication overuse and 20 healthy controls (HCs) were prospectively recruited. All study participants underwent 3-T MRI scans using a 7.5-min resting-state protocol. Using a seed-based approach, we performed a ROI-to-ROI analysis selecting the hypothalamus as the seed.

RESULTS

Compared to HCs, patients with CM showed significantly increased neural connectivity between the hypothalamus and brain areas belonging to the DMN and dorsal visual network. We did not detect any connectivity abnormalities between the hypothalamus and the brainstem. The correlation analysis showed that the severity of the migraine headache was positively correlated with the connectivity strength of the hypothalamus and negatively with the connectivity strength of the medial prefrontal cortex, which belongs to the DMN.

CONCLUSION

These data provide evidence for hypothalamic involvement in large-scale reorganisation at the functional-network level in CM and in proportion with the perceived severity of the migraine pain.

Tablet-based sensorimotor home-training system for amnestic mild cognitive impairments in the elderly: design of a randomised clinical trial

INTRODUCTION

Dementia (particularly Alzheimer's disease, AD) is a major cause of impaired cognitive functions in the elderly. Amnestic mild cognitive impairment (aMCI) is a prodromal stage of AD, if substantiated by Alzheimer biomarkers. A neuroscientific model of pathological ageing emphasises the loss of brain plasticity, sensorimotor capacities and subsequent cognitive decline. A mechanistic treatment targeting dysfunctional plastic changes associated with ageing should be efficacious in delaying AD. In this trial, we aim to evaluate the effectiveness of a newly developed sensorimotor training, delivered at home, combined with personalised reinforcement, on the progression of aMCI-related cognitive impairments.

METHODS AND ANALYSIS

In a randomised trial, we will compare two aMCI groups (30 subjects each), randomly allocated to a sensorimotor or a cognitive control training. Both trainings consist of an adaptive algorithm, and will last 3 months each. We hypothesise that both trainings will have positive effects on cognitive function with the sensorimotor training being superior compared with the control training based on its improvement in basic perceptual skills underlying memory encoding and retrieval. The primary outcome is episodic memory function, improved hippocampal function during memory tasks will be a secondary outcome. As further exploratory outcomes, we expect improved segregation in sensory and motor maps, better sensory discrimination only in the sensorimotor training and reduced transition to dementia (examined after completion of this study). We expect the experimental training to be evaluated more positively by the users compared with the cognitive training, resulting in reduced rates of discontinuation.

ETHICS AND DISSEMINATION

The Ethics Committee of the Medical Faculty Mannheim, Heidelberg University, approved the study (2015-543N-MA), which adheres to the Declaration of Helsinki. The results will be published in a peer-reviewed journal. Access to raw data is available on request.

TRIAL REGISTRATION NUMBER

DRKS00012748.

Activity of the inferior parietal cortex is modulated by visual feedback delay in the robot hand illusion

The robot hand illusion (RoHI) is the perception of self-ownership and self-agency of a virtual (robot) hand that moves consistently with one's own. The phenomenon shows that self-attribution can be established via temporal integration of visual and movement information. Our previous study showed that participants felt significantly greater RoHI (sense of self-ownership and sense of self-agency) when visuomotor temporal discrepancies were less than 200 ms. A weaker RoHI effect (sense of self-agency only) was observed when temporal discrepancies were between 300 and 500 ms. Here, we used functional near-infrared spectroscopy (fNIRS) to investigate brain activity associated with the RoHI under different visual feedback delays (100 ms, 400 ms, 700 ms). We found that the angular and supramarginal gyri exhibited significant activation in the 100-ms feedback condition. ANOVA indicated a significant difference between the 100-ms condition and the other conditions (p < 0.01). These results demonstrate that activity in the posterior parietal cortex was modulated by the delay between the motor command and the visual feedback of the virtual hand movements. Thus, we propose that the inferior parietal cortex is essential for integrating motor and visual information to distinguish one's own body from others.

Visual network alterations in brain functional connectivity in chronic low back pain: A resting state functional connectivity and machine learning study

Chronic low back pain (cLBP) is associated with widespread functional and structural changes in the brain. This study aims to investigate the resting state functional connectivity (rsFC) changes of visual networks in cLBP patients and the feasibility of distinguishing cLBP patients from healthy controls using machine learning methods. cLBP (n = 90) and control individuals (n = 74) were enrolled and underwent resting-state BOLD fMRI scans. Primary, dorsal, and ventral visual networks derived from independent component analysis were used as regions of interest to compare resting state functional connectivity changes between the cLBP patients and healthy controls. We then applied a support vector machine classifier to distinguish the cLBP patients and control individuals. These results were further verified in a new cohort of subjects. We found that the functional connectivity between the primary visual network and the somatosensory/motor areas were significantly enhanced in cLBP patients. The rsFC between the primary visual network and S1 was negatively associated with duration of cLBP. In addition, we found that the rsFC of the visual network could achieve a classification accuracy of 79.3% in distinguishing cLBP patients from HCs, and these results were further validated in an independent cohort of subjects (accuracy = 66.7%). Our results demonstrate significant changes in the rsFC of the visual networks in cLBP patients. We speculate these alterations may represent an adaptation/self-adjustment mechanism and cross-model interaction between the visual, somatosensory, motor, attention, and salient networks in response to cLBP. Elucidating the role of the visual networks in cLBP may shed light on the pathophysiology and development of the disorder.

•

We investigated rsFC changes of visual networks in cLBP patients.

•

rsFC of the primary visual network with S1 and M1 increased in cLBP patients.

•

rsFC of the visual networks can differentiate cLBP patients from controls (with 79.3% accuracy).

•

Classification results can be validated in an independent cohort (with 66.7% accuracy).

Robotic hand illusion with tactile feedback: Unravelling the relative contribution of visuotactile and visuomotor input to the representation of body parts in space

The rubber hand illusion describes a phenomenon in which participants experience a rubber hand as being part of their body by the synchronous application of visuotactile stimulation to the real and the artificial limb. In the recently introduced robotic hand illusion (RobHI), a robotic hand is incorporated into one’s body representation due to the integration of synchronous visuomotor information. However, there are no setups so far that combine visuotactile and visuomotor feedback, which is expected to unravel mechanisms that cannot be detected in experimental designs applying this information in isolation. We developed a robotic hand, controlled by a sensor glove and equipped with pressure sensors, and varied systematically and separately the synchrony for motor feedback (MF) and tactile feedback (TF). In Experiment 1, we implemented a ball-grasping task and assessed the perceived proprioceptive drift of one’s own hand as a behavioral measure of the spatial calibration of body coordinates as well as explicit embodiment experiences by a questionnaire. Results revealed significant main effects of both MF and TF for proprioceptive drift data, but we only observed main effects for MF on perceived embodiment. Furthermore, for the proprioceptive drift we found that synchronous feedback in one factor compensates for asynchronous feedback in the other. In Experiment 2, including a new sample of naïve participants, we further explored this finding by adding unimodal conditions, in which we manipulated the presence or absence of MF and/or TF. These findings replicated the results from Experiment 1 and we further found evidence for a supper-additive multisensory effect on spatial body representation caused by the presence of both factors. Results on conscious body perception were less consistent across both experiments. The findings indicate that sensory and motor input equally contribute to the representation of spatial body coordinates which for their part are subject to multisensory enhancing effects. The results outline the potential of human-in-the-loop approaches and might have important implications for clinical applications such as for the future design of robotic prostheses.

A Literature Overview of Virtual Reality (VR) in Treatment of Psychiatric Disorders: Recent Advances and Limitations

In this paper, we conduct a literature survey on various virtual reality (VR) treatments in psychiatry. We collected 36 studies that used VR to provide clinical trials or therapies for patients with psychiatric disorders. In order to gain a better understanding of the management of pain and stress, we first investigate VR applications for patients to alleviate pain and stress during immersive activities in a virtual environment. VR exposure therapies are particularly effective for anxiety, provoking realistic reactions to feared stimuli. On top of that, exposure therapies with simulated images are beneficial for patients with psychiatric disorders such as phobia and posttraumatic stress disorder (PTSD). Moreover, VR environments have shown the possibility of changing depression, cognition, even social functions. We review empirical evidence from VR-based treatments on psychiatric illnesses such as dementia, mild cognitive impairment (MCI), schizophrenia and autism. Through cognitive training and social skill training, rehabilitation through VR therapies helps patients to improve their quality of life. Recent advances in VR technology also demonstrate potential abilities to address cognitive and functional impairments in dementia. In terms of the different types of VR systems, we discuss the feasibility of the technology within different stages of dementia as well as the methodological limitations. Although there is room for improvement, its widespread adoption in psychiatry is yet to occur due to technical drawbacks such as motion sickness and dry eyes, as well as user issues such as preoccupation and addiction. However, it is worth mentioning that VR systems relatively easily deliver virtual environments with well-controlled sensory stimuli. In the future, VR systems may become an innovative clinical tool for patients with specific psychiatric symptoms.

Effects of prolonged exposure to feedback delay on the qualitative subjective experience of virtual reality

When interacting with virtual environments, feedback delays between making a movement and seeing the visual consequences of that movement are detrimental for the subjective quality of the VR experience. Here we used standard measures of subjective experiences such as ownership, agency and presence to investigate whether prolonged exposure to the delay, and thus the possibility to adapt to it, leads to the recovery of the qualitative experience of VR. Participants performed a target-tracking task in a Virtual Reality environment. We measured the participants’ tracking performance in terms of spatial and temporal errors with respect to the target in both No-Delay and Delay conditions. Additionally, participants rated their sense of “ownership” of holding a virtual tool, agency and presence on each trial using sliding scales. These single trial ratings were compared to the results of the more traditional questionnaires for ownership and agency and presence for both No-Delay and Delay conditions. We found that the participants’ sliding scales ratings corresponded very well to the scores obtained from the traditional questionnaires. Moreover, not only did participants behaviourally adapt to the delay, their ratings of ownership and agency significantly improved with prolonged exposure to the delay. Together the results suggest a tight link between the ability to perform a behavioural task and the subjective ratings of ownership and agency in virtual reality.

Effect of Visual Information on Active Touch During Mirror Visual Feedback

Several studies have demonstrated that observation of a dummy or mirror-reflected hand being stroked or moving at the same time as the hidden hand evokes a feeling that the dummy hand is one’s own, such as the rubber hand illusion (RHI) and mirror visual feedback (MVF). Under these conditions, participants also report sensing the tactile stimulation applied to the fake hands, suggesting that tactile perception is modulated by visual information during the RHI and MVF. Previous studies have utilized passive stimulation conditions; however, active touch is more common in real-world settings. Therefore, we investigated whether active touch is also modulated by visual information during an MVF scenario. Twenty-three participants (13 men and 10 women; mean age ± SD: 21.6 ± 2.0 years) were required to touch a polyurethane pad with both hands synchronously, and estimate the hardness of the pad while observing the mirror reflection. When participants observed the mirror reflection of the other hand pushing a softer or harder pad, perceived hardness estimates were significantly biased toward softer or harder, respectively, even though the physical hardness of the pad remained constant. Furthermore, perceived hardness exhibited a strong correlation with finger displacement of the mirrored, but not hidden, hand. The modulatory effects on perceived hardness diminished when participants touched the pad with both hands asynchronously or with their eyes closed. Moreover, participants experienced ownership of the mirrored hand when they touched the pad with both hands synchronously but not asynchronously. These results indicate that hardness estimates were modulated by observation of the mirrored hand during synchronous touch conditions. The present study demonstrates that, similar to passive touch, active touch is also modulated by visual input.

Relieving phantom limb pain with multimodal sensory-motor training

OBJECTIVE

The causes for the disabling condition of phantom limb pain (PLP), affecting 85% of amputees, are so far unknown, with few effective treatments available. Sensory feedback based strategies to normalize the motor commands to control the phantom limb offer important targets for new effective treatments as the correlation between phantom limb motor control and sensory feedback from the motor intention has been identified as a possible mechanism for PLP development.

APPROACH

Ten upper-limb amputees, suffering from chronic PLP, underwent 16 days of intensive training on phantom-limb movement control. Visual and tactile feedback, driven by muscular activity at the stump, was provided with the aim of reducing PLP intensity.

MAIN RESULTS

A 32.1% reduction of PLP intensity was obtained at the follow-up (6 weeks after the end of the training, with an initial 21.6% reduction immediately at the end of the training) reaching clinical effectiveness for chronic pain reduction. Multimodal sensory-motor training on phantom-limb movements with visual and tactile feedback is a new method for PLP reduction.

SIGNIFICANCE

The study results revealed a substantial reduction in phantom limb pain intensity, obtained with a new training protocol focused on improving phantom limb motor output using visual and tactile feedback from the stump muscular activity executed to move the phantom limb.

Deep Brain Stimulation for Parkinson's disease changes perception in the Rubber Hand Illusion

Parkinson’s disease (PD) alters cortico-basal ganglia-thalamic circuitry and susceptibility to an illusion of bodily awareness, the Rubber Hand Illusion (RHI). Bodily awareness is thought to result from multisensory integration in a predominantly cortical network; the role of subcortical connections is unknown. We studied the effect of modulating cortico-subcortical circuitry on multisensory integration for bodily awareness in 24 PD patients treated with subthalamic nucleus (STN) deep brain stimulation (DBS), in comparison to 21 healthy volunteers, using the RHI experiment. Typically, synchronous visuo-tactile cues induce a false perception of touch on the rubber hand as if it were the subject’s hand, whereas asynchronous visuo-tactile cues do not. However, we found that in the asynchronous condition, patients in the off-stimulation state did not reject the RHI as strongly as healthy controls; patients’ rejection of the RHI strengthened when STN-DBS was switched on, although it remained weaker than that of controls. Patients in the off-stimulation state also misjudged the position of their hand, indicating it to be closer to the rubber hand than controls. However, STN-DBS did not affect proprioceptive judgements or subsequent arm movements altered by the perceptual effects of the illusion. Our findings support the idea that the STN and subcortical connections have a key role in multisensory integration for bodily awareness. Decision-making in multisensory bodily illusions is discussed.