The dominant limb preferentially stabilizes posture in a bimanual task with physical coupling

Humans are endowed with an ability to skillfully handle objects, like when holding a jar with the nondominant hand while opening the lid with the dominant hand. Dynamic dominance, a prevailing theory in handedness research, proposes that the nondominant hand is specialized for postural stability, which would explain why right-handed people hold the jar steady using the left hand. However, the underlying specialization of the nondominant hand has only been tested unimanually, or in a bimanual task where the two hands had different functions. Using a dedicated dual-wrist robotic interface, we tested the dynamic dominance hypothesis in a bimanual task where both hands carry out the same function. We examined how left- and right-handed subjects held onto a vibrating virtual object using their wrists, which were physically coupled by the object. Muscular activity of the wrist flexors and extensors revealed a preference for cocontracting the dominant hand during both holding and transport of the object, which suggests proficiency in the dominant hand for stabilization, contradicting the dynamic dominance hypothesis. While the reliance on the dominant hand was partially explained by its greater strength, the Edinburgh inventory was a better predictor of the difference in the cocontraction between the dominant and nondominant hands. When provided with redundancy to stabilize the task, the dominant hand preferentially cocontracts to absorb perturbing forces.NEW & NOTEWORTHY We found that subjects prefer to stabilize a bimanually held object by cocontracting their dominant limb, contradicting the established view that the nondominant limb is specialized toward stabilization.

The Influence of Posture, Applied Force and Perturbation Direction on Hip Joint Viscoelasticity

Limb viscoelasticity is a critical neuromechanical factor used to regulate the interaction with the environment. It plays a key role in modelling human sensorimotor control, and can be used to assess the condition of healthy and neurologically affected individuals. This paper reports the estimation of hip joint viscoelasticity during voluntary force control using a novel device that applies a leg displacement without constraining the hip joint. The influence of hip angle, applied limb force and perturbation direction on the stiffness and viscosity values was studied in ten subjects. No difference was detected in the hip joint stiffness between the dominant and non-dominant legs, but a small dependency was observed on the perturbation direction. Both hip stiffness and viscosity increased monotonically with the applied force magnitude, with posture being observed to have a slight influence. These results are in line with previous measurements carried out on upper limbs, and can be used as a baseline for lower limb movement simulation and further neuromechanical investigations.

Identification of the best strategy to command variable stiffness using electromyographic signals

OBJECTIVE

In the last decades, many EMG-controlled robotic devices were developed. Since stiffness control may be required to perform skillful interactions, different groups developed devices whose stiffness is real-time controlled based on EMG signal samples collected from the operator. However, this control strategy may be fatiguing. In this study, we proposed and experimentally validated a novel stiffness control strategy, based on the average muscle co-contraction estimated from EMG samples collected in the previous 1 or 2 s.

APPROACH

Nine subjects performed a tracking task with their right wrist in five different sessions. In four sessions a haptic device (Hi-5) applied a sinusoidal perturbing torque. In Baseline session, co-contraction reduced the effect of the perturbation only by stiffening the wrist. In contrast, during aided sessions the perturbation amplitude was also reduced (mimicking the effect of additional stiffening provided by EMG-driven robotic device) either proportionally to the co-contraction exerted by the subject sample-by-sample (Proportional), or according to the average co-contraction exerted in the previous 1 s (Integral 1s), or 2 s (Integral 2s). Task error, metabolic cost during the tracking task, perceived fatigue, and the median EMG frequency calculated during a sub-maximal isometric torque generation tasks that alternated with the tracking were compared across sessions.

MAIN RESULTS

Positive effects of the reduction of the perturbation provided by co-contraction estimation was identified in all the investigated variables. Integral 1s session showed lower metabolic cost with respect to the Proportional session, and lower perceived fatigue with respect to both the Proportional and the Integral 2s sessions.

SIGNIFICANCE

This study's results showed that controlling the stiffness of an EMG-driven robotic device proportionally to the operator's co-contraction, averaged in the previous 1 s, represents the best control strategy because it required less metabolic cost and led to a lower perceived fatigue.

The effect of skill level matching in dyadic interaction on learning of a tracing task

Dyadic interaction between humans has gained great research interest in the last years. The effects of factors that influence the interaction, as e.g. roles or skill level matching, are still not well understood. In this paper, we further investigated the effect of skill level matching between partners on learning of a visuo-motor task. Understanding the effect of skill level matching is crucial for applications in collaborative rehabilitation. Fifteen healthy participants were asked to trace a path while being subjected to a visuo-motor rotation (Novice). The Novices were paired with a partner, forming one of the three Dyad Types: a) haptic connection to another Novice, b) haptic connection to an Expert (no visuo-motor rotation), or c) no haptic. The intervention consisted of a Familiarization phase, followed by a Training phase, in which the Novices were learning the task in the respective Dyad Type, and a Test phase in which the learning was assessed (haptic connection removed, if any). Results suggest that learning of the task with a haptic connection to an Expert was least beneficial. However, during the Training phase the dyads comprising an Expert clearly outperformed the dyads with matched skill levels. The results point towards the same direction as previous findings in literature and can be explained by current motor-learning theories. Future work needs to corroborate these preliminary results.

For Motion Assistance Humans Prefer to Rely on a Robot Rather Than on an Unpredictable Human

Objective: The last decades have seen a surge of robots for physical training and work assistance. How to best control these interfaces is unknown, although arguably the interaction should be similar to human movement assistance. Methods: We compare the behaviour and assessment of subjects tracking a moving target with assistance from (i) trajectory guidance (as typically used in robots for physical training), (ii) a human partner, and (iii) the reactive robot partner of Takagi et al. Results: Trajectory guidance was recognised as robotic, while the robot partner was felt as human-like. However, trajectory guidance was preferred to assistance from a human partner, which was recognised as less predictable. The robot partner also was felt to be more predictable and helpful than a human partner, and was preferred. Conclusions: While subjects like to rely on predictable interaction, such as in trajectory guidance, the control reactivity of the robot partner is essential for perceiving an interaction as human-like.

Prediction of Gait Freezing in Parkinsonian Patients: A Binary Classification Augmented With Time Series Prediction

This paper presents a novel technique to predict freezing of gait in advanced stage Parkinsonian patients using movement data from wearable sensors. A two-class approach is presented which consists of autoregressive predictive models to project the feature time series, followed by machine learning based classifiers to discriminate freezing from nonfreezing based on the predicted features. To implement and validate our technique a set of time domain and frequency domain features were extracted from the 3D acceleration data, which was then analyzed using information theoretic and feature selection approaches to determine the most discriminative features. Predictive models were trained to predict the features from their past values, then fed into binary classifiers based on support vector machines and probabilistic neural networks which were rigorously cross validated. We compared the results of this approach with a three-class classification approach proposed in previous literature, in which a pre-freezing class was introduced and the problem of prediction of the gait freezing incident was reduced to solving a three-class classification problem. The two-class approach resulted in a sensitivity of 93±4%, specificity of 91±6%, with an expected prediction horizon of 1.72 s. Our subject-specific gait freezing prediction algorithm outperformed existing algorithms, yields consistent results across different subjects and is robust against the choice of classifier, with slight variations in the selected features. In addition, we analyzed the merits and limitations of different families of features to predict gait freezing.

Influence of visual-coupling on bimanual coordination in unilateral spastic cerebral palsy

Controlling two objects simultaneously during a bimanual task is a cognitively demanding process; both hands need to be temporally and spatially coordinated to achieve the shared task goal. Children with unilateral spastic cerebral palsy (USCP) exhibit severe sensory and motor impairments to one side of their body that make the process of coordinating bimanual movements particularly exhausting. Prior studies have shown that performing visually-coupled task could reduce cognitive interference associated with performing 'two tasks at once' in an uncoupled bimanual task. For children with USCP, who also present with cognitive delay, performing this type of task may allow them to process and plan their movement faster. We tested this hypothesis by examining the grip force control of 7 children with USCP during unimanual and visually-coupled bimanual tasks. Results demonstrated that despite the visual coupling, the bimanual coordination of these children remained impaired. However, there may be a potential benefit of visually-coupled task in encouraging both hands to initiate in concert. The implication of the study for children with USCP is discussed.

optimizing self-exercise scheduling in motor stroke using Challenge Point Framework theory

An important challenge for technology-assisted self-led rehabilitation is how to automate appropriate schedules of exercise that are responsive to patients' needs, and optimal for learning. While random scheduling has been found to be superior for long-term learning relative to fixed scheduling (Contextual Interference), this method is limited by not adequately accounting for task difficulty, or skill acquisition during training. One method that combines contextual interference with adaptation of the challenge to the skill-level of the player is Challenge Point Framework (CPF) theory. In this pilot study we test whether self-led motor training based upon CPF scheduling achieves faster learning than deterministic, fixed scheduling. Training was implemented in a mobile gaming device adapted for arm disability, allowing for grip and wrist exercises. We tested 11 healthy volunteers and 12 hemiplegic stroke patients in a single-blinded no crossover controlled randomized trial. Results suggest that patients training with CPF-based adaption performed better than those training with fixed conditions. This was not seen for healthy volunteers whose performance was close to ceiling. Further data collection is required to determine the significance of the results.

Augmented manipulation ability in humans with six-fingered hands

Neurotechnology attempts to develop supernumerary limbs, but can the human brain deal with the complexity to control an extra limb and yield advantages from it? Here, we analyzed the neuromechanics and manipulation abilities of two polydactyly subjects who each possess six fingers on their hands. Anatomical MRI of the supernumerary finger (SF) revealed that it is actuated by extra muscles and nerves, and fMRI identified a distinct cortical representation of the SF. In both subjects, the SF was able to move independently from the other fingers. Polydactyly subjects were able to coordinate the SF with their other fingers for more complex movements than five fingered subjects, and so carry out with only one hand tasks normally requiring two hands. These results demonstrate that a body with significantly more degrees-of-freedom can be controlled by the human nervous system without causing motor deficits or impairments and can instead provide superior manipulation abilities.

Individuals physically interacting in a group rapidly coordinate their movement by estimating the collective goal

How can a human collective coordinate, for example to move a banquet table, when each person is influenced by the inertia of others who may be inferior at the task? We hypothesized that large groups cannot coordinate through touch alone, accruing to a zero-sum scenario where individuals inferior at the task hinder superior ones. We tested this hypothesis by examining how dyads, triads and tetrads, whose right hands were physically coupled together, followed a common moving target. Surprisingly, superior individuals followed the target accurately even when coupled to an inferior group, and the interaction benefits increased with the group size. A computational model shows that these benefits arose as each individual uses their respective interaction force to infer the collective’s target and enhance their movement planning, which permitted coordination in seconds independent of the collective’s size. By estimating the collective’s movement goal, its individuals make physical interaction beneficial, swift and scalable.

Bimanual coordination during a physically coupled task in unilateral spastic cerebral palsy children

Background

Single object bimanual manipulation, or physically-coupled bimanual tasks, are ubiquitous in daily lives. However, the predominant focus of previous studies has been on uncoupled bimanual actions, where the two hands act independently to manipulate two disconnected objects. In this paper, we explore interlimb coordination among children with unilateral spastic cerebral palsy (USCP), by investigating upper limb motor control during a single object bimanual lifting task.

Methods

15 children with USCP and 17 typically developing (TD) children performed a simple single-object bimanual lifting task. The object was an instrumented cube that can record the contact force on each of its faces alongside estimating its trajectory during a prescribed two-handed lifting motion. The subject’s performance was measured in terms of the duration of individual phases, linearity and monotonicity of the grasp-to-load force synergy, interlimb force asymmetry, and movement smoothness.

Results

Similar to their TD counterparts, USCP subjects were able to produce a linear grasp-to-load force synergy. However, they demonstrated difficulties in producing monotonic forces and generating smooth movements. No impairment of anticipatory control was observed within the USCP subjects. However, our analysis showed that the USCP subjects shifted the weight of the cube onto their more-abled side, potentially to minimise the load on the impaired side, which suggests a developed strategy of compensating for inter-limb asymmetries, such as muscle strength.

Conclusion

Bimanual interaction with a single mutual object has the potential to facilitate anticipation and sequencing of force control in USCP children unlike previous studies which showed deficits during uncoupled bimanual actions. We suggest that this difference could be partly due to the provision of adequate cutaneous and kinaesthetic information gathered from the dynamic exchange of forces between the two hands, mediated through the physical coupling.

A novel sensor design for accurate measurement of facial somatosensation in pre-term infants

Facial somatosensory feedback is critical for breastfeeding in the first days of life. However, its development has never been investigated in humans. Here we develop a new interface to measure facial somatosensation in newborn infants. The novel system allows to measure neuronal responses to touching the face of the subject by synchronously recording scalp electroencephalography (EEG) and the force applied by the experimenter. This is based on a dedicated force transducer that can be worn on the finger underneath a clinical nitrile glove and linked to a commercial EEG acquisition system. The calibrated device measures the pressure applied by the investigator when tapping the skin concurrently with the resulting brain response. With this system, we were able to demonstrate that taps of 192 mN (mean) reliably elicited facial somatosensory responses in 7 pre-term infants. These responses had a time course similar to those following limbs stimulation, but more lateral topographical distribution consistent with body representations in primary somatosensory areas. The method introduced can therefore be used to reliably measure facial somatosensory responses in vulnerable infants.

Somatotopic Mapping of the Developing Sensorimotor Cortex in the Preterm Human Brain

In the mature mammalian brain, the primary somatosensory and motor cortices are known to be spatially organized such that neural activity relating to specific body parts can be somatopically mapped onto an anatomical "homunculus". This organization creates an internal body representation which is fundamental for precise motor control, spatial awareness and social interaction. Although it is unknown when this organization develops in humans, animal studies suggest that it may emerge even before the time of normal birth. We therefore characterized the somatotopic organization of the primary sensorimotor cortices using functional MRI and a set of custom-made robotic tools in 35 healthy preterm infants aged from 31 + 6 to 36 + 3 weeks postmenstrual age. Functional responses induced by somatosensory stimulation of the wrists, ankles, and mouth had a distinct spatial organization as seen in the characteristic mature homunculus map. In comparison to the ankle, activation related to wrist stimulation was significantly larger and more commonly involved additional areas including the supplementary motor area and ipsilateral sensorimotor cortex. These results are in keeping with early intrinsic determination of a somatotopic map within the primary sensorimotor cortices. This may explain why acquired brain injury in this region during the preterm period cannot be compensated for by cortical reorganization and therefore can lead to long-lasting motor and sensory impairment.

Sensory integration of apparent motion speed and vibration magnitude

Tactile apparent motion can display directional information in an intuitive way. It can for example be used to give directions to visually impaired individuals, or for waypoint navigation while cycling on busy streets, when vision or audition should not be loaded further. However, although humans can detect very short tactile patterns, discriminating between similar motion speeds has been shown to be difficult. Here we develop and investigate a method where the speed of tactile apparent motion around the user's wrist is coupled with vibration magnitude. This redundant coupling is used to produce tactile patterns from slow&weak to fast&strong. We compared the just noticeable difference (JND) of the coupled and the individual variables. The results show that the perception of the coupled variable can be characterised by JND smaller than JNDs of the individual variables. This allowed us to create short tactile pattens (tactons) for display of direction and speed, which can be distinguished significantly better than tactons based on motion alone. Additionally, most subjects were also able to identify the coupled-variable tactons better than the magnitude-based tactons.

Haptic communication between humans is tuned by the hard or soft mechanics of interaction

To move a hard table together, humans may coordinate by following the dominant partner's motion [1-4], but this strategy is unsuitable for a soft mattress where the perceived forces are small. How do partners readily coordinate in such differing interaction dynamics? To address this, we investigated how pairs tracked a target using flexion-extension of their wrists, which were coupled by a hard, medium or soft virtual elastic band. Tracking performance monotonically increased with a stiffer band for the worse partner, who had higher tracking error, at the cost of the skilled partner's muscular effort. This suggests that the worse partner followed the skilled one's lead, but simulations show that the results are better explained by a model where partners share movement goals through the forces, whilst the coupling dynamics determine the capacity of communicable information. This model elucidates the versatile mechanism by which humans can coordinate during both hard and soft physical interactions to ensure maximum performance with minimal effort.

Is EMG a Viable Alternative to BCI for Detecting Movement Intention in Severe Stroke?

OBJECTIVE

In light of the shortcomings of current restorative brain-computer interfaces (BCI), this study investigated the possibility of using EMG to detect hand/wrist extension movement intention to trigger robot-assisted training in individuals without residual movements.

METHODS

We compared movement intention detection using an EMG detector with a sensorimotor rhythm based EEG-BCI using only ipsilesional activity. This was carried out on data of 30 severely affected chronic stroke patients from a randomized control trial using an EEG-BCI for robot-assisted training.

RESULTS

The results indicate the feasibility of using EMG to detect movement intention in this severely handicapped population; probability of detecting EMG when patients attempted to move was higher (p 0.001) than at rest. Interestingly, 22 out of 30 (or 73%) patients had sufficiently strong EMG in their finger/wrist extensors. Furthermore, in patients with detectable EMG, there was poor agreement between the EEG and EMG intent detectors, which indicates that these modalities may detect different processes.

CONCLUSION

A substantial segment of severely affected stroke patients may benefit from EMG-based assisted therapy. When compared to EEG, a surface EMG interface requires less preparation time, which is easier to don/doff, and is more compact in size.

SIGNIFICANCE

This study shows that a large proportion of severely affected stroke patients have residual EMG, which yields a direct and practical way to trigger robot-assisted training.

Balancing the playing field: collaborative gaming for physical training

Background

Multiplayer video games promoting exercise-based rehabilitation may facilitate motor learning, by increasing motivation through social interaction. However, a major design challenge is to enable meaningful inter-subject interaction, whilst allowing for significant skill differences between players. We present a novel motor-training paradigm that allows real-time collaboration and performance enhancement, across a wide range of inter-subject skill mismatches, including disabled vs. able-bodied partnerships.

Methods

A virtual task consisting of a dynamic ball on a beam, is controlled at each end using independent digital force-sensing handgrips. Interaction is mediated through simulated physical coupling and locally-redundant control. Game performance was measured in 16 healthy-healthy and 16 patient-expert dyads, where patients were hemiparetic stroke survivors using their impaired arm. Dual-player was compared to single-player performance, in terms of score, target tracking, stability, effort and smoothness; and questionnaires probing user-experience and engagement.

Results

Performance of less-able subjects (as ranked from single-player ability) was enhanced by dual-player mode, by an amount proportionate to the partnership’s mismatch. The more abled partners’ performances decreased by a similar amount. Such zero-sum interactions were observed for both healthy-healthy and patient-expert interactions. Dual-player was preferred by the majority of players independent of baseline ability and subject group; healthy subjects also felt more challenged, and patients more skilled.

Conclusion

This is the first demonstration of implicit skill balancing in a truly collaborative virtual training task leading to heightened engagement, across both healthy subjects and stroke patients.

Electronic supplementary material

The online version of this article (doi:10.1186/s12984-017-0319-x) contains supplementary material, which is available to authorized users.

Anticipatory detection of turning in humans for intuitive control of robotic mobility assistance

Many wearable lower-limb robots for walking assistance have been developed in recent years. However, it remains unclear how they can be commanded in an intuitive and efficient way by their user. In particular, providing robotic assistance to neurologically impaired individuals in turning remains a significant challenge. The control should be safe to the users and their environment, yet yield sufficient performance and enable natural human-machine interaction. Here, we propose using the head and trunk anticipatory behaviour in order to detect the intention to turn in a natural, non-intrusive way, and use it for triggering turning movement in a robot for walking assistance. We therefore study head and trunk orientation during locomotion of healthy adults, and investigate upper body anticipatory behaviour during turning. The collected walking and turning kinematics data are clustered using the k-means algorithm and cross-validation tests and k-nearest neighbours method are used to evaluate the performance of turning detection during locomotion. Tests with seven subjects exhibited accurate turning detection. Head anticipated turning by more than 400-500 ms in average across all subjects. Overall, the proposed method detected turning 300 ms after its initiation and 1230 ms before the turning movement was completed. Using head anticipatory behaviour enabled to detect turning faster by about 100 ms, compared to turning detection using only pelvis orientation measurements. Finally, it was demonstrated that the proposed turning detection can improve the quality of human-robot interaction by improving the control accuracy and transparency.

A simple tool to measure spasticity in spinal cord injury subjects

This work presents a wearable device and the algorithms for quantitative modelling of joint spasticity and its application in a pilot group of subjects with different levels of spinal cord injury. The device comprises light-weight instrumented handles to measure the interaction force between the subject and the physical therapist performing the tests, EMG sensors and inertial measurement units to measure muscle activity and joint kinematics. Experimental tests included the passive movement of different body segments, where the spasticity was expected, at different velocities. Tonic stretch reflex thresholds and their velocity modulation factor are computed, as a quantitative index of spasticity, by using the kinematics data at the onset of spasm detected through thresholding the EMG data. This technique was applied to two spinal cord injury subjects. The proposed method allowed the analysis of spasticity at muscle and joint levels. The obtained results are in line with the expert diagnosis and qualitative spasticity characterisation on each individual.

Positioning the endoscope in laparoscopic surgery by foot: Influential factors on surgeons' performance in virtual trainer

We have investigated how surgeons can use the foot to position a laparoscopic endoscope, a task that normally requires an extra assistant. Surgeons need to train in order to exploit the possibilities offered by this new technique and safely manipulate the endoscope together with the hands movements. A realistic abdominal cavity has been developed as training simulator to investigate this multi-arm manipulation. In this virtual environment, the surgeon's biological hands are modelled as laparoscopic graspers while the viewpoint is controlled by the dominant foot. 23 surgeons and medical students performed single-handed and bimanual manipulation in this environment. The results show that residents had superior performance compared to both medical students and more experienced surgeons, suggesting that residency is an ideal period for this training. Performing the single-handed task improves the performance in the bimanual task, whereas the converse was not true.

Validity of a sensor-based table-top platform to measure upper limb function

Objective measurement is an essential part of the assessment process in neurological dysfunction such as stroke. However, current clinical scores are insensitive and based on subjective observation from experts. Technology provides an opportunity for enhanced accuracy and specificity of objective measurement. This study describes the use of an interactive force-sensitive table-top platform for the assessment of reach in post-stroke patients, admitted as part of a three week intensive upper limb training programme. Objective measures from the reachable workspace were extracted and included normalised reach distance, normalised reached speed and reach dragging. The data was compared to standardised Fugl-Meyer (FM) clinical scores, recorded at admission (FMPRE) and discharge (FMPOST). Results indicate strong relationships between the three objective measures and subjective FM scores, with significant Spearman correlations found in all cases (|ρ| > 0.5, p < 0.05). The results highlight the validity for a sensor-based table-top system to provide a simple, flexible, and objective platform for assessment of impaired upper limb motor function.

Taxonomy based analysis of force exchanges during object grasping and manipulation

The flexibility of the human hand in object manipulation is essential for daily life activities, but remains relatively little explored with quantitative methods. On the one hand, recent taxonomies describe qualitatively the classes of hand postures for object grasping and manipulation. On the other hand, the quantitative analysis of hand function has been generally restricted to precision grip (with thumb and index opposition) during lifting tasks. The aim of the present study is to fill the gap between these two kinds of descriptions, by investigating quantitatively the forces exerted by the hand on an instrumented object in a set of representative manipulation tasks. The object was a parallelepiped object able to measure the force exerted on the six faces and its acceleration. The grasping force was estimated from the lateral force and the unloading force from the bottom force. The protocol included eleven tasks with complementary constraints inspired by recent taxonomies: four tasks corresponding to lifting and holding the object with different grasp configurations, and seven to manipulating the object (rotation around each of its axis and translation). The grasping and unloading forces and object rotations were measured during the five phases of the actions: unloading, lifting, holding or manipulation, preparation to deposit, and deposit. The results confirm the tight regulation between grasping and unloading forces during lifting, and extend this to the deposit phase. In addition, they provide a precise description of the regulation of force exchanges during various manipulation tasks spanning representative actions of daily life. The timing of manipulation showed both sequential and overlapping organization of the different sub-actions, and micro-errors could be detected. This phenomenological study confirms the feasibility of using an instrumented object to investigate complex manipulative behavior in humans. This protocol will be used in the future to investigate upper-limb dexterity in patients with sensory-motor impairments.