Ownership and Agency of an Independent Supernumerary Hand Induced by an Imitation Brain-Computer Interface

Toward the Development of User-Centered Neurointegrated Lower Limb Prostheses

The last few years witnessed radical improvements in lower-limb prostheses. Researchers have presented innovative solutions to overcome the limits of the first generation of prostheses, refining specific aspects which could be implemented in future prostheses designs. Each aspect of lower-limb prostheses has been upgraded, but despite these advances, a number of deficiencies remain and the most capable limb prostheses fall far short of the capabilities of the healthy limb. This article describes the current state of prosthesis technology; identifies a number of deficiencies across the spectrum of lower limb prosthetic components with respect to users' needs; and discusses research opportunities in design and control that would substantially improve functionality concerning each deficiency. In doing so, the authors present a roadmap of patients related issues that should be addressed in order to fulfill the vision of a next-generation, neurally-integrated, highly-functional lower limb prosthesis.

Skin temperature changes in response to body ownership modulation vary according to the side of stimulation

A growing body of research has shown that a unilateral alteration in the sense of limb ownership is associated with the cooling of a limb's temperature. However, the recent emergence of contradictory results calls into question the existence of a relationship between this physiological reaction and the sense of body ownership. In the light of evidence that the malleability of the sense of hand ownership differs based on the preferential motor use of the hand to which the illusion is applied, one might observe the same lateralised pattern in the skin temperature cooling. In particular, if skin temperature change is a signature of body ownership, we expected a stronger illusion and reduction in skin temperature when altering ownership alteration of the left hand compared to the right hand in dextral individuals. To test this hypothesis, we selectively perturbated body ownership of the left or right hand in 24 healthy participants in different experimental sessions using the Mirror-Box Illusion (MBI) paradigm. Participants were asked to tap synchronously or asynchronously at a constant rhythm with their left and right index fingers against two parallel mirrors while looking at their reflected right/left hand. Skin temperature was measured before and after each MBI application, and explicit judgments of ownership and proprioceptive drift were collected. The results showed a consistent cooling of the hand's temperature only when the illusion was performed on the left hand. Proprioceptive drift exhibited the same pattern. In contrast, the explicit judgment of ownership of the reflected hand was similar across the two hands. These data provide evidence in favor of a specific laterality effect of the physiological response to an induced alteration of body part ownership. Moreover, they highlight the possibility of a direct link between proprioception and skin temperature.

"Mine Works Better": Examining the Influence of Embodiment in Virtual Reality on the Sense of Agency During a Binary Motor Imagery Task With a Brain-Computer Interface

Motor imagery-based brain-computer interfaces (MI-BCI) have been proposed as a means for stroke rehabilitation, which combined with virtual reality allows for introducing game-based interactions into rehabilitation. However, the control of the MI-BCI may be difficult to obtain and users may face poor performance which frustrates them and potentially affects their motivation to use the technology. Decreases in motivation could be reduced by increasing the users' sense of agency over the system. The aim of this study was to understand whether embodiment (ownership) of a hand depicted in virtual reality can enhance the sense of agency to reduce frustration in an MI-BCI task. Twenty-two healthy participants participated in a within-subject study where their sense of agency was compared in two different embodiment experiences: 1) avatar hand (with body), or 2) abstract blocks. Both representations closed with a similar motion for spatial congruency and popped a balloon as a result. The hand/blocks were controlled through an online MI-BCI. Each condition consisted of 30 trials of MI-activation of the avatar hand/blocks. After each condition a questionnaire probed the participants' sense of agency, ownership, and frustration. Afterwards, a semi-structured interview was performed where the participants elaborated on their ratings. Both conditions supported similar levels of MI-BCI performance. A significant correlation between ownership and agency was observed (r = 0.47, p = 0.001). As intended, the avatar hand yielded much higher ownership than the blocks. When controlling for performance, ownership increased sense of agency. In conclusion, designers of BCI-based rehabilitation applications can draw on anthropomorphic avatars for the visual mapping of the trained limb to improve ownership. While not While not reducing frustration ownership can improve perceived agency given sufficient BCI performance. In future studies the findings should be validated in stroke patients since they may perceive agency and ownership differently than able-bodied users.

Concurrent control of a brain-computer interface and natural overt movements

OBJECTIVE

A primary control signal in brain-computer interfaces (BCIs) have been cortical signals related to movement. However, in cases where natural motor function remains, BCI control signals may interfere with other possibly simultaneous activity for useful ongoing movement. We sought to determine if the brain could learn to control both a BCI and concurrent overt movement execution in such cases.

APPROACH

We designed experiments where BCI and overt movements must be used concurrently and in coordination to achieve a 2D centre out control. Power in the 70-90 Hz band of human electrocorticography (ECoG) signals, was used to generate BCI control commands for vertical movement of the cursor. These signals were deliberately recorded from the same human cortical site that produced the strongest movement related activity associated with the concurrent overt finger movements required for the horizontal movement of the cursor.

MAIN RESULTS

We demonstrate that three subjects were able to perform the concurrent BCI task, controlling BCI and natural movements simultaneously and to a large extent independently. We conclude that the brain is capable of dissociating the original control signal dependency on movement, producing specific BCI control signals in the presence of motor related responses from the ongoing overt behaviour with which the BCI signal was initially correlated.

SIGNIFICANCE

We demonstrate a novel human brain-computer interface (BCI) which can be used to control movement concurrently and in coordination with movements of the natural limbs. This demonstrates the dissociation of cortical activity from the behaviour with which it was originally associated despite the ongoing behaviour and shows the feasibility of achieving simultaneous BCI control of devices with natural movements.

Judging the position of the artificial hand induces a "visual" drift towards the real one during the rubber hand illusion

When subjects look at a rubber hand being brush-stroked synchronously with their own hidden hand, they might feel a sense of ownership over the rubber hand. The perceived mislocalization of the own hand towards the rubber hand (proprioceptive drift) would reflect an implicit marker of this illusion occurring through the dominance of vision over proprioception. This account, however, contrasts with principles of multisensory integration whereby percepts result from a "statistical sum" of different sensory afferents. In this case, the most-known proprioceptive drift should be mirrored by complementary visual drift of the rubber hand in the opposite direction. We investigated this issue by designing two experiments in which subjects were not only requested to localize their own hand but also the rubber hand and further explored the subjective feeling of the illusion. In both experiments, we demonstrated a (visual) drift in the opposite direction of the proprioceptive drift, suggesting that both hands converge toward each other. This might suggest that the spatial representations of the two hands are integrated in a common percept placed in between them, contradicting previous accounts of substitution of the real hand by the rubber hand.

Revisiting the link between body and agency: visual movement congruency enhances intentional binding but is not body-specific

Embodiment and agency are key aspects of how we perceive ourselves that have typically been associated with independent mechanisms. Recent work, however, has suggested that these mechanisms are related. The sense of agency arises from recognising a causal influence on the external world. This influence is typically realised through bodily movements and thus the perception of the bodily self could also be crucial for agency. We investigated whether a key index of agency - intentional binding - was modulated by body-specific information. Participants judged the interval between pressing a button and a subsequent tone. We used virtual reality to manipulate two aspects of movement feedback. First, form: participants viewed a virtual hand or sphere. Second, movement congruency: the viewed object moved congruently or incongruently with the participant's hidden hand. Both factors, form and movement congruency, significantly influenced embodiment. However, only movement congruency influenced intentional binding. Binding was increased for congruent compared to incongruent movement feedback irrespective of form. This shows that the comparison between viewed and performed movements provides an important cue for agency, whereas body-specific visual form does not. We suggest that embodiment and agency mechanisms both depend on comparisons across sensorimotor signals but that they are influenced by distinct factors.