Towards Model-Free Tool Dynamic Identification and Calibration Using Multi-Layer Neural Network

Design of motor cable artificial muscle (MC-AM) with tendon sheath–pulley system (TSPS) for musculoskeletal robot

In an unstructured environment, the arm can perform complicated tasks with rapidity, flexibility, and robustness. It is difficult to configure multiple artificial muscles similar to an arm in the compact space of a robotic arm. When muscle tension is transferred, mechanisms like tendon-sheath/tendon-pulley may be installed in a compact space to develop musculoskeletal robots that are closer to the arm. However, handling variable frictional nonlinearity and elastic cable deformation is necessary for transmission stability. In this study, the modular artificial muscle system (MAMS), including motor cable artificial muscle and tendon sheath–pulley system (TSPS), that can be installed remotely and transmit muscle tension in narrow paths, is designed. The feed-forward multi-layer neural network (FF-MNN) approach is utilized to discuss the relationship between the measurable input tension of TSPS and the unmeasurable output tension and cable elongation. Subsequently, the lightweight musculoskeletal arm (LM-Arm) is built to verify the validity of MAMS. Through trials, the experiments of MAMS after friction compensating and the LM-Arm’s end-point 3D trajectory tracking are investigated. The results show that average errors of the active and passive muscles tension are 3.87 N and 3.51 N, respectively, under conditions of larger load and higher contraction velocity. The average muscle length error of trajectory tracking is 0.00078 m (0.72%). The suggested MAMS may successfully build a musculoskeletal robot that has similar flexibility and morphology to the arm. It can also be utilized to power various pieces of machinery, such as rescue robot, invasive surgical robots, dexterous hands, and wearable exoskeletons.

A feedforward compensation approach for cable-driven musculoskeletal systems

This paper presents a feedforward compensation approach for musculoskeletal systems (MSs). Compared with traditional rigid robots, human arms have the advantages of flexibility and safety in operation in unstructured environments. However, the influence of external unknown disturbances, inner friction effects, and dynamic uncertainties of the MS makes it difficult to model and practically apply. In order to reduce the inner friction effects of the hardware platform and the over-relaxation/tension of the cable-pull drive, a feedforward friction compensation method for the cable-pulled artificial muscle unit is proposed. The method analyzes the friction causes of the hardware structure and establishes a mapping network relationship between the joint variables and the muscle force error in the muscle space. The experimental results show that the method can effectively improve the control accuracy and reduce the artificial muscle over-relaxation/tension instability.

Flexible Electronic Skin for Monitoring of Grasping State During Robotic Manipulation

Electronic skin for robotic tactile sensing has been studied extensively over the past years, yet practical applications of electronic skin for the grasping state monitoring during robotic manipulation are still limited. In this study, we present the fabrication and implementation of electronic skin sensor arrays for the detection of unstable grasping. The piezoresistive sensor arrays have the advantages of facile fabrication, fast response, and high reliability. With the tactile data from the sensor array, we propose two quantitative indicators, correlation coefficient and wavelet coefficient, to identify grasping with variable forces and slippage. Those two indicators reflect both time and frequency domain characteristics in the contact forces from the sensor array and can be obtained without large amount of calculation. We demonstrate the utility of this method under various conditions, the results indicate grasping with variable forces, and slippage can be distinguished by this method. The flexible sensor arrays are adopted for tactile sensing on a bionic hand, and the effectiveness of this method in detecting various grasping states has been verified. The electronic skin sensor array and the grasping state monitoring method are promising for applications in robotic dexterous manipulation.

Transfer of learned dynamics between different surgical robots and operative configurations

PURPOSE

Using the da Vinci Research Kit (dVRK), we propose and experimentally demonstrate transfer learning (Xfer) of dynamics between different configurations and robots distributed around the world. This can extend recent research using neural networks to estimate the dynamics of the patient side manipulator (PSM) to provide accurate external end-effector force estimation, by adapting it to different robots and instruments, and in different configurations, with additional forces applied on the instruments as they pass through the trocar.

METHODS

The goal of the learned models is to predict internal joint torques during robot motion. First, exhaustive training is performed during free-space (FS) motion, using several configurations to include gravity effects. Second, to adapt to different setups, a limited amount of training data is collected and then the neural network is updated through Xfer.

RESULTS

Xfer can adapt a FS network trained on one robot, in one configuration, with a particular instrument, to provide comparable joint torque estimation for a different robot, in a different configuration, using a different instrument, and inserted through a trocar. The robustness of this approach is demonstrated with multiple PSMs (sampled from the dVRK community), instruments, configurations and trocar ports.

CONCLUSION

Xfer provides significant improvements in prediction errors without the need for complete training from scratch and is robust over a wide range of robots, kinematic configurations, surgical instruments, and patient-specific setups.

Intelligent Calibration of a Heavy-Duty Mechanical Arm in Coal Mine

Accurate positioning of an airborne heavy-duty mechanical arm in coal mine, such as a roof bolter, is important for the efficiency and safety of coal mining. Its positioning accuracy is affected not only by geometric errors but also by nongeometric errors such as link and joint compliance. In this paper, a novel calibration method based on error limited genetic algorithm (ELGA) and regularized extreme learning machine (RELM) is proposed to improve the positioning accuracy of a roof bolter. To achieve the improvement, the ELGA is firstly implemented to identify the geometric parameters of the roof bolter’s kinematics model. Then, the residual positioning errors caused by nongeometric facts are compensated with the regularized extreme learning machine (RELM) network. Experiments were carried out to validate the proposed calibration method. The experimental results show that the root mean square error (RMSE) and the mean absolute error (MAE) between the actual mast end position and the nominal mast end position are reduced by more than 78.23%. It also shows the maximum absolute error (MAXE) between the actual mast end position and the nominal mast end position is reduced by more than 58.72% in the three directions of Cartesian coordinate system.

Adaptive Robust Force Position Control for Flexible Active Prosthetic Knee Using Gait Trajectory

Active prosthetic knees (APKs) are widely used in the past decades. However, it is still challenging to make them more natural and controllable because: (1) most existing APKs that use rigid actuators have difficulty obtaining more natural walking; and (2) traditional finite-state impedance control has difficulty adjusting parameters for different motions and users. In this paper, a flexible APK with a compact variable stiffness actuator (VSA) is designed for obtaining more flexible bionic characteristics. The VSA joint is implemented by two motors of different sizes, which connect the knee angle and the joint stiffness. Considering the complexity of prothetic lower limb control due to unknown APK dynamics, as well as strong coupling between biological joints and prosthetic joints, an adaptive robust force/position control method is designed for generating a desired gait trajectory of the prosthesis. It can operate without the explicit model of the system dynamics and multiple tuning parameters of different gaits. The proposed model-free scheme utilizes the time-delay estimation technique, sliding mode control, and fuzzy neural network to realize finite-time convergence and gait trajectory tracking. The virtual prototype of APK was established in ADAMS as a testing platform and compared with two traditional time-delay control schemes. Some demonstrations are illustrated, which show that the proposed method has superior tracking characteristics and stronger robustness under uncertain disturbances within the trajectory error in ± 0 . 5 degrees. The VSA joint can reduce energy consumption by adjusting stiffness appropriately. Furthermore, the feasibility of this method was verified in a human–machine hybrid control model.

CAPTCHA Image Generation: Two-Step Style-Transfer Learning in Deep Neural Networks

Mobile devices such as sensors are used to connect to the Internet and provide services to users. Web services are vulnerable to automated attacks, which can restrict mobile devices from accessing websites. To prevent such automated attacks, CAPTCHAs are widely used as a security solution. However, when a high level of distortion has been applied to a CAPTCHA to make it resistant to automated attacks, the CAPTCHA becomes difficult for a human to recognize. In this work, we propose a method for generating a CAPTCHA image that will resist recognition by machines while maintaining its recognizability to humans. The method utilizes the style transfer method, and creates a new image, called a style-plugged-CAPTCHA image, by incorporating the styles of other images while keeping the content of the original CAPTCHA. In our experiment, we used the TensorFlow machine learning library and six CAPTCHA datasets in use on actual websites. The experimental results show that the proposed scheme reduces the rate of recognition by the DeCAPTCHA system to 3.5% and 3.2% using one style image and two style images, respectively, while maintaining recognizability by humans.

Neural Approximation Enhanced Predictive Tracking Control of a Novel Designed Four-Wheeled Rollator

In the past few decades, the research of assistant mobile rollators for the elderly has attracted more and more investigation attention. In order to satisfy the needs of older people or disabled patients, this paper develops a neural approximation based predictive tracking control scheme to improve and support the handicapped through the novel four-wheeled rollator. Firstly, considering the industrial product theory, a novel Kano-TRIZ-QFD engineering design approach is presented to optimize the mechanical structure combined with humanistic care. At the same time, in order to achieve a stable trajectory tracking control for the assistant rollator system, a neural approximation enhanced predictive tracking control is discussed. Finally, autonomous tracking mobility of the presented control scheme has received sufficient advantage performance in position and heading angle variations under the external uncertainties. As the market for the medical device of the elderly rollators continues to progress, the method discussed in this article will attract more investigation and industry concerns.

A Fast and Robust Deep Convolutional Neural Networks for Complex Human Activity Recognition Using Smartphone

As a significant role in healthcare and sports applications, human activity recognition (HAR) techniques are capable of monitoring humans' daily behavior. It has spurred the demand for intelligent sensors and has been giving rise to the explosive growth of wearable and mobile devices. They provide the most availability of human activity data (big data). Powerful algorithms are required to analyze these heterogeneous and high-dimension streaming data efficiently. This paper proposes a novel fast and robust deep convolutional neural network structure (FR-DCNN) for human activity recognition (HAR) using a smartphone. It enhances the effectiveness and extends the information of the collected raw data from the inertial measurement unit (IMU) sensors by integrating a series of signal processing algorithms and a signal selection module. It enables a fast computational method for building the DCNN classifier by adding a data compression module. Experimental results on the sampled 12 complex activities dataset show that the proposed FR-DCNN model is the best method for fast computation and high accuracy recognition. The FR-DCNN model only needs 0.0029 s to predict activity in an online way with 95.27% accuracy. Meanwhile, it only takes 88 s (average) to establish the DCNN classifier on the compressed dataset with less precision loss 94.18%.