Chronic Multi-Electrode Electromyography in Snakes

Knowledge about body motion kinematics and underlying muscle contraction dynamics usually derives from electromyographic (EMG) recordings. However, acquisition of such signals in snakes is challenging because electrodes either attached to or implanted beneath the skin may unintentionally be removed by force or friction caused from undulatory motion, thus severely impeding chronic EMG recordings. Here, we present a reliable method for stable subdermal implantation of up to eight bipolar electrodes above the target muscles. The mechanical stability of the inserted electrodes and the overnight coverage of the snake body with a “sleeping bag” ensured the recording of reliable and robust chronic EMG activity. The utility of the technique was verified by daily acquisition of high signal-to-noise activity from all target sites over four consecutive days during stimulus-evoked postural reactions in Amazon tree boas and Western diamondback rattlesnakes. The successful demonstration of the chronic recording suggests that this technique can improve acute experiments by enabling the collection of larger data sets from single individuals.

An Adaptive Mechatronic Exoskeleton for Force-Controlled Finger Rehabilitation

This paper presents a novel mechatronic exoskeleton architecture for finger rehabilitation. The system consists of an underactuated kinematic structure that enables the exoskeleton to act as an adaptive finger stimulator. The exoskeleton has sensors for motion detection and control. The proposed architecture offers three main advantages. First, the exoskeleton enables accurate quantification of subject-specific finger dynamics. The configuration of the exoskeleton can be fully reconstructed using measurements from three angular position sensors placed on the kinematic structure. In addition, the actuation force acting on the exoskeleton is recorded. Thus, the range of motion (ROM) and the force and torque trajectories of each finger joint can be determined. Second, the adaptive kinematic structure allows the patient to perform various functional tasks. The force control of the exoskeleton acts like a safeguard and limits the maximum possible joint torques during finger movement. Last, the system is compact, lightweight and does not require extensive peripherals. Due to its safety features, it is easy to use in the home. Applicability was tested in three healthy subjects.

SnakeStrike: A Low-Cost Open-Source High-Speed Multi-Camera Motion Capture System

Current neuroethological experiments require sophisticated technologies to precisely quantify the behavior of animals. In many studies, solutions for video recording and subsequent tracking of animal behavior form a major bottleneck. Three-dimensional (3D) tracking systems have been available for a few years but are usually very expensive and rarely include very high-speed cameras; access to these systems for research is limited. Additionally, establishing custom-built software is often time consuming – especially for researchers without high-performance programming and computer vision expertise. Here, we present an open-source software framework that allows researchers to utilize low-cost high-speed cameras in their research for a fraction of the cost of commercial systems. This software handles the recording of synchronized high-speed video from multiple cameras, the offline 3D reconstruction of that video, and a viewer for the triangulated data, all functions previously also available as separate applications. It supports researchers with a performance-optimized suite of functions that encompass the entirety of data collection and decreases processing time for high-speed 3D position tracking on a variety of animals, including snakes. Motion capture in snakes can be particularly demanding since a strike can be as short as 50 ms, literally twice as fast as the blink of an eye. This is too fast for faithful recording by most commercial tracking systems and therefore represents a challenging test to our software for quantification of animal behavior. Therefore, we conducted a case study investigating snake strike speed to showcase the use and integration of the software in an existing experimental setup.

SynEM, automated synapse detection for connectomics

Nerve tissue contains a high density of chemical synapses, about 1 per µm3 in the mammalian cerebral cortex. Thus, even for small blocks of nerve tissue, dense connectomic mapping requires the identification of millions to billions of synapses. While the focus of connectomic data analysis has been on neurite reconstruction, synapse detection becomes limiting when datasets grow in size and dense mapping is required. Here, we report SynEM, a method for automated detection of synapses from conventionally en-bloc stained 3D electron microscopy image stacks. The approach is based on a segmentation of the image data and focuses on classifying borders between neuronal processes as synaptic or non-synaptic. SynEM yields 97% precision and recall in binary cortical connectomes with no user interaction. It scales to large volumes of cortical neuropil, plausibly even whole-brain datasets. SynEM removes the burden of manual synapse annotation for large densely mapped connectomes.

Key Insights into Hand Biomechanics: Human Grip Stiffness Can Be Decoupled from Force by Cocontraction and Predicted from Electromyography

We investigate the relation between grip force and grip stiffness for the human hand with and without voluntary cocontraction. Apart from gaining biomechanical insight, this issue is particularly relevant for variable-stiffness robotic systems, which can independently control the two parameters, but for which no clear methods exist to design or efficiently exploit them. Subjects were asked in one task to produce different levels of force, and stiffness was measured. As expected, this task reveals a linear coupling between force and stiffness. In a second task, subjects were then asked to additionally decouple stiffness from force at these force levels by using cocontraction. We measured the electromyogram from relevant groups of muscles and analyzed the possibility to predict stiffness and force. Optical tracking was used for avoiding wrist movements. We found that subjects were able to decouple grip stiffness from force when using cocontraction on average by about 20% of the maximum measured stiffness over all force levels, while this ability increased with the applied force. This result contradicts the force-stiffness behavior of most variable-stiffness actuators. Moreover, we found the thumb to be on average twice as stiff as the index finger and discovered that intrinsic hand muscles predominate our prediction of stiffness, but not of force. EMG activity and grip force allowed to explain 72 ± 12% of the measured variance in stiffness by simple linear regression, while only 33 ± 18% variance in force. Conclusively the high signal-to-noise ratio and the high correlation to stiffness of these muscles allow for a robust and reliable regression of stiffness, which can be used to continuously teleoperate compliance of modern robotic hands.

Connecting Artificial Brains to Robots in a Comprehensive Simulation Framework: The Neurorobotics Platform

Combined efforts in the fields of neuroscience, computer science, and biology allowed to design biologically realistic models of the brain based on spiking neural networks. For a proper validation of these models, an embodiment in a dynamic and rich sensory environment, where the model is exposed to a realistic sensory-motor task, is needed. Due to the complexity of these brain models that, at the current stage, cannot deal with real-time constraints, it is not possible to embed them into a real-world task. Rather, the embodiment has to be simulated as well. While adequate tools exist to simulate either complex neural networks or robots and their environments, there is so far no tool that allows to easily establish a communication between brain and body models. The Neurorobotics Platform is a new web-based environment that aims to fill this gap by offering scientists and technology developers a software infrastructure allowing them to connect brain models to detailed simulations of robot bodies and environments and to use the resulting neurorobotic systems for in silico experimentation. In order to simplify the workflow and reduce the level of the required programming skills, the platform provides editors for the specification of experimental sequences and conditions, environments, robots, and brain-body connectors. In addition to that, a variety of existing robots and environments are provided. This work presents the architecture of the first release of the Neurorobotics Platform developed in subproject 10 "Neurorobotics" of the Human Brain Project (HBP). At the current state, the Neurorobotics Platform allows researchers to design and run basic experiments in neurorobotics using simulated robots and simulated environments linked to simplified versions of brain models. We illustrate the capabilities of the platform with three example experiments: a Braitenberg task implemented on a mobile robot, a sensory-motor learning task based on a robotic controller, and a visual tracking embedding a retina model on the iCub humanoid robot. These use-cases allow to assess the applicability of the Neurorobotics Platform for robotic tasks as well as in neuroscientific experiments.

Evaluation of joint type modelling in the human hand

This short communication presents preliminary results from an extensive investigation of joint modelling for the human hand. We use finger and hand movement data recorded from both hands of 110 subjects using passive reflective markers on the skin. Furthermore, we use data which was recorded from a single Thiel-fixated cadaver hand using also passive reflective markers but fixed to the bone. Our data clearly demonstrate that, for wrist and finger joints, hinge joint models are sufficiently accurate to describe their movement in Cartesian space.

Task dependency of grip stiffness--a study of human grip force and grip stiffness dependency during two different tasks with same grip forces

It is widely known that the pinch-grip forces of the human hand are linearly related to the weight of the grasped object. Less is known about the relationship between grip force and grip stiffness. We set out to determine variations to these dependencies in different tasks with and without visual feedback. In two different settings, subjects were asked to (a) grasp and hold a stiffness-measuring manipulandum with a predefined grip force, differing from experiment to experiment, or (b) grasp and hold this manipulandum of which we varied the weight between trials in a more natural task. Both situations led to grip forces in comparable ranges. As the measured grip stiffness is the result of muscle and tendon properties, and since muscle/tendon stiffness increases more-or-less linearly as a function of muscle force, we found, as might be predicted, a linear relationship between grip force and grip stiffness. However, the measured stiffness ranges and the increase of stiffness with grip force varied significantly between the two tasks. Furthermore, we found a strong correlation between regression slope and mean stiffness for the force task which we ascribe to a force stiffness curve going through the origin. Based on a biomechanical model, we attributed the difference between both tasks to changes in wrist configuration, rather than to changes in cocontraction. In a new set of experiments where we prevent the wrist from moving by fixing it and resting it on a pedestal, we found subjects exhibiting similar stiffness/force characteristics in both tasks.

Evidence of muscle synergies during human grasping

Motor synergies have been investigated since the 1980s as a simplifying representation of motor control by the nervous system. This way of representing finger positional data is in particular useful to represent the kinematics of the human hand. Whereas, so far, the focus has been on kinematic synergies, that is common patterns in the motion of the hand and fingers, we hereby also investigate their force aspects, evaluated through surface electromyography (sEMG). We especially show that force-related motor synergies exist, i.e. that muscle activation during grasping, as described by the sEMG signal, can be grouped synergistically; that these synergies are largely comparable to one another across human subjects notwithstanding the disturbances and inaccuracies typical of sEMG; and that they are physiologically feasible representations of muscular activity during grasping. Potential applications of this work include force control of mechanical hands, especially when many degrees of freedom must be simultaneously controlled.

Relation between object properties and EMG during reaching to grasp

In order to stably grasp an object with an artificial hand, a priori knowledge of the object's properties is a major advantage, especially to ensure subsequent manipulation of the object held by the hand. This is also true for hand prostheses: pre-shaping of the hand while approaching the object, similar to able-bodied, allows the wearer for a much faster and more intuitive way of handling and grasping an object. For hand prostheses, it would be advantageous to obtain this information about object properties from a surface electromyography (sEMG) signal, which is already present and used to control the active prosthetic hand. We describe experiments in which human subjects grasp different objects at different positions while their muscular activity is recorded through eight sEMG electrodes placed on the forearm. Results show that sEMG data, gathered before the hand is in contact with the object, can be used to obtain relevant information on object properties such as size and weight.

Human hand modelling: kinematics, dynamics, applications

An overview of mathematical modelling of the human hand is given. We consider hand models from a specific background: rather than studying hands for surgical or similar goals, we target at providing a set of tools with which human grasping and manipulation capabilities can be studied, and hand functionality can be described. We do this by investigating the human hand at various levels: (1) at the level of kinematics, focussing on the movement of the bones of the hand, not taking corresponding forces into account; (2) at the musculotendon structure, i.e. by looking at the part of the hand generating the forces and thus inducing the motion; and (3) at the combination of the two, resulting in hand dynamics as well as the underlying neurocontrol. Our purpose is to not only provide the reader with an overview of current human hand modelling approaches but also to fill the gaps with recent results and data, thus allowing for an encompassing picture.

Robotics of human movements

The construction of robotic systems that can move the way humans do, with respect to agility, stability and precision, is a necessary prerequisite for the successful integration of robotic systems in human environments. We explain human-centered views on robotics, based on the three basic ingredients (1) actuation; (2) sensing; and (3) control, and formulate detailed examples thereof.

Surface EMG in advanced hand prosthetics

One of the major problems when dealing with highly dexterous, active hand prostheses is their control by the patient wearing them. With the advances in mechatronics, building prosthetic hands with multiple active degrees of freedom is realisable, but actively controlling the position and especially the exerted force of each finger cannot yet be done naturally. This paper deals with advanced robotic hand control via surface electromyography. Building upon recent results, we show that machine learning, together with a simple downsampling algorithm, can be effectively used to control on-line, in real time, finger position as well as finger force of a highly dexterous robotic hand. The system determines the type of grasp a human subject is willing to use, and the required amount of force involved, with a high degree of accuracy. This represents a remarkable improvement with respect to the state-of-the-art of feed-forward control of dexterous mechanical hands, and opens up a scenario in which amputees will be able to control hand prostheses in a much finer way than it has so far been possible.