A teleoperated control approach for anthropomorphic manipulator using magneto-inertial sensors

Tele-Impedance control of a virtual avatar based on EMG and M-IMU sensors: a proof-of-concept

The broad spread of cooperative robots into many application domains has resulted in a demand for intuitive and effective solutions for teleoperated control. A relevant role in teleoperation has been assumed by impedance controllers, that allow the increase of stability and accuracy during interaction. This paper aims to test a teleoperation method based on an impedance controller, namely tele-impedance control, that is usable in unstructured environments since it relies only on wearable sensors. The proposed solution maps the joint stiffness and position of the human user, computed through six EMG and two M-IMU sensors, into the remote system to be teleoperated. We developed a 2-DoFs virtual task involving virtual physical interactions to compare the performance of our solution with the one of a traditional position-based controller. The study has been conducted on five healthy participants, who experienced both controllers in two different sessions. The tele-impedance approach has proved to be less physically demanding and more intuitive than the position-based one. Experimental data also allow us to investigate the strategy employed by the volunteers in the case of remote interactions, while using the two controllers. Of note, even though with the position controller the variation of subject impedance has no effect on the virtual arm, participants still tend to regulate both impedance and position of their own arm.

Sensor Fusion-Based Anthropomorphic Control of a Robotic Arm

The main goal of this research is to develop a highly advanced anthropomorphic control system utilizing multiple sensor technologies to achieve precise control of a robotic arm. Combining Kinect and IMU sensors, together with a data glove, we aim to create a multimodal sensor system for capturing rich information of human upper body movements. Specifically, the four angles of upper limb joints are collected using the Kinect sensor and IMU sensor. In order to improve the accuracy and stability of motion tracking, we use the Kalman filter method to fuse the Kinect and IMU data. In addition, we introduce data glove technology to collect the angle information of the wrist and fingers in seven different directions. The integration and fusion of multiple sensors provides us with full control over the robotic arm, giving it flexibility with 11 degrees of freedom. We successfully achieved a variety of anthropomorphic movements, including shoulder flexion, abduction, rotation, elbow flexion, and fine movements of the wrist and fingers. Most importantly, our experimental results demonstrate that the anthropomorphic control system we developed is highly accurate, real-time, and operable. In summary, the contribution of this study lies in the creation of a multimodal sensor system capable of capturing and precisely controlling human upper limb movements, which provides a solid foundation for the future development of anthropomorphic control technologies. This technology has a wide range of application prospects and can be used for rehabilitation in the medical field, robot collaboration in industrial automation, and immersive experience in virtual reality environments.

Tele-Impedance Control Approach Using Wearable Sensors

Tele-operational tasks often suffer from instability issues and limited reliability during unpredictable interactions. We propose a real-time control law reproducing the impedance and kinematic behaviour of a subject's arm (shoulder and elbow) on a remote avatar in a 2-DoF task. The human arm impedance and kinematics are estimated respectively from EMG and M-IMU data and then mapped into the avatar arm through an impedance control. Contrary to literature methods, our portable tele-impedance controller relies only on wearable sensors and enables an easy use in unstructured environments. The good performance (R²> 0.7) of the muscle model used to map on the robot the human stiffness of five healthy subjects indicates the possibility of applying the proposed algorithm for a tele-impedance control.

Specifying Inputs for the Computational Structure of a Surgical System via Optical Method and DLT Algorithm Based on In Vitro Experiments on Cardiovascular Tissue in Minimally Invasive and Robotic Surgery

With the application of four optical CMOS sensors, it was possible to capture the trajectory of an endoscopic tool during an in vitro surgical experiment on a cardiovascular preparation. This was due to the possibility of obtaining a path when a reflective marker was attached. In the work, APAS (Ariel Performance Analysis System) software and DLT (direct linear transformation) algorithm were used. This made it possible to acquire kinematic inputs to the computational model of dynamics, which enabled, regardless of the type of surgical robot structure, derivation of the analogous motion of an endoscopic effector due to the mathematical transformation of the trajectory to joints coordinates. Experiments were carried out with the participation of a practiced cardiac surgeon employing classic endoscopic instruments and robot surgical systems. The results indicated by the experiment showed that the inverse task of kinematics of position for the surgical robot with RCM (remote center of motion) structure was solved. The achieved results from the experiment were used as inputs for deriving a numerical dynamics model of surgical robot during transient states that was obtained by applying the finite element method and by driving dynamics moments acquired through the block diagrams method using a steering system with DC (direct current) motor and PID (proportional–integral–derivative) controller. The results section illustrates the course of kinematic values of endoscopic tools which were employed to apply numerical models as inputs, the course of the driving torque of the model of the surgical robot that enabled the selection of the drive system and the strength values, stresses and displacements according to von Mises hypothesis in its structure during the analysis of transient states that made it possible to establish the strength safety of the surgical robot. For the conducted experiments, the accuracy was ±2 [mm]. In the paper, the employment of optical CMOS sensors in surgical robotics and endoscopy is discussed. The paper concludes that the usage of optical sensors for determining inputs for numerical models of dynamics of surgical robots provides the basis for setting the course of physical quantities that appear in their real object structure, in manners close to reality.