Feeling the beat: a smart hand exoskeleton for learning to play musical instruments

Design and Verification of Piano Playing Assisted Hand Exoskeleton Robot

Finger technique is a crucial aspect of piano learning, and hand exoskeleton mechanisms effectively assist novice piano players in maintaining correct finger technique consistently. Addressing current issues with exoskeleton robots, such as the inability to provide continuous correction of finger technique and their considerable weight, a novel hand exoskeleton robot has been developed to enhance finger technique through continuous correction and reduced weight. Initial data are gathered using finger joint angle sensors to analyze movements during piano playing, focusing on the trajectory and angular velocity of key strikes. This analysis informs the design of a 6-bar double-closed-loop mechanism with an end equivalent sliding pair, using analytical methods to establish the relationship between motor extension and input rod rotation. Simulation studies assess the exoskeleton's motion space and dynamics, confirming its capability to meet structural and functional demands for accurate key striking. Prototype testing validates the exoskeleton's ability to maintain correct finger positioning and mimic natural strike speeds, thus improving playing technique while ensuring comfort and safety.

High-Performance Four-Channel Tactile Sensor for Measuring the Magnitude and Orientation of Forces

Flexible sensors have gained popularity in recent years. This study proposes a novel structure of a resistive four-channel tactile sensor capable of distinguishing the magnitude and direction of normal forces acting on its sensing surface. The sensor uses EcoflexTM00-30 as the substrate and EGaIn alloy as the conductive filler, featuring four mutually perpendicular and curved channels to enhance the sensor's dynamic responsiveness. Experiments and simulations show that the sensor has a large dynamic range (31.25-100 mΩ), high precision (deviation of repeated pressing below 0.1%), linearity (R2 above 0.97), fast response/recovery time (0.2 s/0.15 s), and robust stability (with fluctuations below 0.9%). This work uses an underactuated robotic hand equipped with a four-channel tactile sensor to grasp various objects. The sensor data collected effectively predicts the shapes of the objects grasped. Furthermore, the four-channel tactile sensor proposed in this work may be employed in smart wearables, medical diagnostics, and other industries.

Biohybrid Robotic Hand to Investigate Tactile Encoding and Sensorimotor Integration

For people who have experienced a spinal cord injury or an amputation, the recovery of sensation and motor control could be incomplete despite noteworthy advances with invasive neural interfaces. Our objective is to explore the feasibility of a novel biohybrid robotic hand model to investigate aspects of tactile sensation and sensorimotor integration with a pre-clinical research platform. Our new biohybrid model couples an artificial hand with biological neural networks (BNN) cultured in a multichannel microelectrode array (MEA). We decoded neural activity to control a finger of the artificial hand that was outfitted with a tactile sensor. The fingertip sensations were encoded into rapidly adapting (RA) or slowly adapting (SA) mechanoreceptor firing patterns that were used to electrically stimulate the BNN. We classified the coherence between afferent and efferent electrodes in the MEA with a convolutional neural network (CNN) using a transfer learning approach. The BNN exhibited the capacity for functional specialization with the RA and SA patterns, represented by significantly different robotic behavior of the biohybrid hand with respect to the tactile encoding method. Furthermore, the CNN was able to distinguish between RA and SA encoding methods with 97.84% ± 0.65% accuracy when the BNN was provided tactile feedback, averaged across three days in vitro (DIV). This novel biohybrid research platform demonstrates that BNNs are sensitive to tactile encoding methods and can integrate robotic tactile sensations with the motor control of an artificial hand. This opens the possibility of using biohybrid research platforms in the future to study aspects of neural interfaces with minimal human risk.

Research on Robot Screwing Skill Method Based on Demonstration Learning

A robot screwing skill learning framework based on teaching-learning is proposed to improve the generalization ability of robots for different scenarios and objects, combined with the experience of a human operation. This framework includes task-based teaching, learning, and summarization. We teach a robot to twist and gather the operation's trajectories, define the obstacles with potential functions, and counter the twisting of the robot using a skill-learning-based dynamic movement primitive (DMP) and Gaussian mixture model-Gaussian mixture regression (GMM-GMR). The hole-finding and screwing stages of the process are modeled. In order to verify the effectiveness of the robot tightening skill learning model and its adaptability to different tightening scenarios, obstacle avoidance trends and tightening experiments were conducted. Obstacle avoidance and tightening experiments were conducted on the robot tightening platform for bolts, plastic bottle caps, and faucets. The robot successfully avoided obstacles and completed the twisting task, verifying the effectiveness of the robot tightening skill learning model and its adaptability to different tightening scenarios.

A New Method to Evaluate Pressure Distribution Using a 3D-Printed C2-C3 Cervical Spine Model with an Embedded Sensor Array

Cervical degenerative disc diseases such as myelopathy and radiculopathy often require conventional treatments like artificial cervical disc replacement or anterior cervical discectomy and fusion (ACDF). When designing a medical device, like the stand-alone cage, there are many design inputs to consider. However, the precise biomechanics of the force between the vertebrae and implanted devices under certain conditions require further investigation. In this study, a new method was developed to evaluate the pressure between the vertebrae and implanted devices by embedding a sensor array into a 3D-printed C2-C3 cervical spine. The 3D-printed cervical spine model was subjected to a range of axial loads while under flexion, extension, bending and compression conditions. Cables were used for the application of a preload and a robotic arm was used to recreate the natural spine motions (flexion, extension, and bending). To verify and predict the total pressure between the vertebrae and the implanted devices, a 3D finite element (FE) numerical mathematical model was developed. A preload was represented by applying 22 N of force on each of the anterior tubercles for the C2 vertebra. The results of this study suggest that the sensor is useful in identifying static pressure. The pressure with the robot arm was verified from the FE results under all conditions. This study indicates that the sensor array has promising potential to reduce the trial and error with implants for various surgical procedures, including multi-level artificial cervical disk replacement and ACDF, which may help clinicians to reduce pain, suffering, and costly follow-up procedures.