Research on motion pattern recognition of exoskeleton robot based on multimodal machine learning model

MFBP-UNet: A Network for Pear Leaf Disease Segmentation in Natural Agricultural Environments

The accurate prevention and control of pear tree diseases, especially the precise segmentation of leaf diseases, poses a serious challenge to fruit farmers globally. Given the possibility of disease areas being minute with ambiguous boundaries, accurate segmentation becomes difficult. In this study, we propose a pear leaf disease segmentation model named MFBP-UNet. It is based on the UNet network architecture and integrates a Multi-scale Feature Extraction (MFE) module and a Tokenized Multilayer Perceptron (BATok-MLP) module with dynamic sparse attention. The MFE enhances the extraction of detail and semantic features, while the BATok-MLP successfully fuses regional and global attention, striking an effective balance in the extraction capabilities of both global and local information. Additionally, we pioneered the use of a diffusion model for data augmentation. By integrating and analyzing different augmentation methods, we further improved the model's training accuracy and robustness. Experimental results reveal that, compared to other segmentation networks, MFBP-UNet shows a significant improvement across all performance metrics. Specifically, MFBP-UNet achieves scores of 86.15%, 93.53%, 90.89%, and 0.922 on MIoU, MP, MPA, and Dice metrics, marking respective improvements of 5.75%, 5.79%, 1.08%, and 0.074 over the UNet model. These results demonstrate the MFBP-UNet model's superior performance and generalization capabilities in pear leaf disease segmentation and its inherent potential to address analogous challenges in natural environment segmentation tasks.

Review of adaptive control for stroke lower limb exoskeleton rehabilitation robot based on motion intention recognition

Stroke is a significant cause of disability worldwide, and stroke survivors often experience severe motor impairments. Lower limb rehabilitation exoskeleton robots provide support and balance for stroke survivors and assist them in performing rehabilitation training tasks, which can effectively improve their quality of life during the later stages of stroke recovery. Lower limb rehabilitation exoskeleton robots have become a hot topic in rehabilitation therapy research. This review introduces traditional rehabilitation assessment methods, explores the possibility of lower limb exoskeleton robots combining sensors and electrophysiological signals to assess stroke survivors' rehabilitation objectively, summarizes standard human-robot coupling models of lower limb rehabilitation exoskeleton robots in recent years, and critically introduces adaptive control models based on motion intent recognition for lower limb exoskeleton robots. This provides new design ideas for the future combination of lower limb rehabilitation exoskeleton robots with rehabilitation assessment, motion assistance, rehabilitation treatment, and adaptive control, making the rehabilitation assessment process more objective and addressing the shortage of rehabilitation therapists to some extent. Finally, the article discusses the current limitations of adaptive control of lower limb rehabilitation exoskeleton robots for stroke survivors and proposes new research directions.

Human Motion Pattern Recognition and Feature Extraction: An Approach Using Multi-Information Fusion

An exoskeleton is a kind of intelligent wearable device with bioelectronics and biomechanics. To realize its effective assistance to the human body, an exoskeleton needs to recognize the real time movement pattern of the human body in order to make corresponding movements at the right time. However, it is of great difficulty for an exoskeleton to fully identify human motion patterns, which are mainly manifested as incomplete acquisition of lower limb motion information, poor feature extraction ability, and complicated steps. Aiming at the above consideration, the motion mechanisms of human lower limbs have been analyzed in this paper, and a set of wearable bioelectronics devices are introduced based on an electromyography (EMG) sensor and inertial measurement unit (IMU), which help to obtain biological and kinematic information of the lower limb. Then, the Dual Stream convolutional neural network (CNN)-ReliefF was presented to extract features from the fusion sensors’ data, which were input into four different classifiers to obtain the recognition accuracy of human motion patterns. Compared with a single sensor (EMG or IMU) and single stream CNN or manual designed feature extraction methods, the feature extraction based on Dual Stream CNN-ReliefF shows better performance in terms of visualization performance and recognition accuracy. This method was used to extract features from EMG and IMU data of six subjects and input these features into four different classifiers. The motion pattern recognition accuracy of each subject under the four classifiers is above 97%, with the highest average recognition accuracy reaching 99.12%. It can be concluded that the wearable bioelectronics device and Dual Stream CNN-ReliefF feature extraction method proposed in this paper enhanced an exoskeleton’s ability to capture human movement patterns, thus providing optimal assistance to the human body at the appropriate time. Therefore, it can provide a novel approach for improving the human-machine interaction of exoskeletons.

FB-EEGNet: A fusion neural network across multi-stimulus for SSVEP target detection

BACKGROUND

Steady-state visual evoked potential (SSVEP) is a prevalent paradigm of brain-computer interface (BCI). Recently, deep neural networks (DNNs) have been employed for SSVEP target recognition. However, current DNN models can not fully extract information from SSVEP harmonic components, and ignore the influence of non-target stimuli.

NEW METHOD

To employ information of multiple sub-bands and non-target stimulus data, we propose a DNN model for SSVEP target detection, i.e., FB-EEGNet, which fuses features of multiple neural networks. Additionally, we design a multi-label for each sample and optimize the parameters of FB-EEGNet across multi-stimulus to incorporate the information from non-target stimuli.

RESULTS

Under the subject-specific condition, FB-EEGNet achieves the average classification accuracies (information transfer rate (ITR)) of 76.75 % (50.70 bits/min) and 89.14 % (70.45 bits/min) in a time widow of 0.7 s under the public 12-target dataset and our experimental 9-target dataset, respectively. Under the cross-subject condition, FB-EEGNet achieved mean accuracies (ITRs) of 81.72 % (67.99 bits/min) and 92.15 % (76.12 bits/min) on the public and experimental datasets in a time window of 1 s, respectively.

COMPARISON WITH EXISTING METHODS

FB-EEGNet shows superior performance than CCNN, EEGNet, CCA and FBCCA both for subject-dependent and subject-independent SSVEP target recognition.

CONCLUSION

FB-EEGNet can effectively extract information from multiple sub-bands and cross-stimulus targets, providing a promising way for extracting deep features in SSVEP using neural networks.

Visual Analysis of College Sports Performance Based on Multimodal Knowledge Graph Optimization Neural Network

In this paper, through data analysis of multimodal knowledge graph optimized neural network and visual analysis of college students’ sports performance, we use huge graph, a graph database supporting distributed storage, to store domain knowledge in the form of the knowledge graph, use Spring Boot to build a server-side framework, use Vue framework combined with vis.js to visualize relational network graphs, and design and implement a knowledge-oriented. This paper proposes a visual analytics system based on the theory of visual analytics. Based on the idea of visual analytics, this paper presents a visual analytics framework combining predictive models. This framework combines the automated analysis capability of predictive models with interactive visualization as a new idea to explore the visual analysis of student behavior and performance changes. Using relevant predictive algorithms in machine learning, corresponding models are built to refine the importance of features for visual analysis and correlate behavioral data with achievement data. In this process, multiple prediction algorithms are used to build prediction models. The model effects are analyzed and compared to select the optimal model for use in the visual analytics framework. The graphical analytic view is integrated. EduRedar, an optical analytical system for sports data based on the performance prediction model, is designed and implemented to support multidimensional and multiangle data analysis and visualize the changes in college students’ sports and performance based on accurate campus exercise data.

Research on Sports Health Care Information System Based on Computer Deep Learning Algorithm

There are various problems in diagnosing and treating tumor diseases in significant hospitals. The content includes misjudgement and over-surgery issues. For example, the judgment of pulmonary nodules mainly relies on artificial experience, and most of the artificial experience is too radical. This paper is mainly based on the extensive medical data of significant hospitals, extracts the diagnosis and treatment data and digital images of similar cases from the extensive database, classifies them through the deep learning of the computer, and then proposes the control mechanism and the solution of the doctor's misjudgement and excessive medical treatment. This method mainly relies on the CT and MRI digital images of various types of tumor diseases accumulated in the history of major hospitals. Based on the preliminary judgment of each diagnosis and treatment and the results of surgical and pathological examinations, the accumulation of various types of digital images from the history is used. The features are analysed and extracted, the model is built, and finally, a predictive analysis system for this type of tumor is obtained, which can predict the benign and malignant cases of currently occurring cases and avoid the limitations and instability of artificial experience greatest extent. It is proved by experiments and combined with Spearman to remove redundancy. The redundancy removal method SVM_RFE is used for dimensionality reduction. The method can timely correct the misjudgement of the doctor's experience and effectively reduce the instability of the manual, which provides a solution for solving the contradiction between doctors and patients and improving the scientific of diagnosis and treatment.

Military Applications of Machine Learning: A Bibliometric Perspective

The military environment generates a large amount of data of great importance, which makes necessary the use of machine learning for its processing. Its ability to learn and predict possible scenarios by analyzing the huge volume of information generated provides automatic learning and decision support. This paper aims to present a model of a machine learning architecture applied to a military organization, carried out and supported by a bibliometric study applied to an architecture model of a nonmilitary organization. For this purpose, a bibliometric analysis up to the year 2021 was carried out, making a strategic diagram and interpreting the results. The information used has been extracted from one of the main databases widely accepted by the scientific community, ISI WoS. No direct military sources were used. This work is divided into five parts: the study of previous research related to machine learning in the military world; the explanation of our research methodology using the SciMat, Excel and VosViewer tools; the use of this methodology based on data mining, preprocessing, cluster normalization, a strategic diagram and the analysis of its results to investigate machine learning in the military context; based on these results, a conceptual architecture of the practical use of ML in the military context is drawn up; and, finally, we present the conclusions, where we will see the most important areas and the latest advances in machine learning applied, in this case, to a military environment, to analyze a large set of data, providing utility, machine learning and decision support.

Machine Learning Techniques for Increasing Efficiency of the Robot’s Sensor and Control Information Processing

Real-time systems are widely used in industry, including technological process control systems, industrial automation systems, SCADA systems, testing, and measuring equipment, and robotics. The efficiency of executing an intelligent robot’s mission in many cases depends on the properties of the robot’s sensor and control systems in providing the trajectory planning, recognition of the manipulated objects, adaptation of the desired clamping force of the gripper, obstacle avoidance, and so on. This paper provides an analysis of the approaches and methods for real-time sensor and control information processing with the application of machine learning, as well as successful cases of machine learning application in the synthesis of a robot’s sensor and control systems. Among the robotic systems under investigation are (a) adaptive robots with slip displacement sensors and fuzzy logic implementation for sensor data processing, (b) magnetically controlled mobile robots for moving on inclined and ceiling surfaces with neuro-fuzzy observers and neuro controllers, and (c) robots that are functioning in unknown environments with the prediction of the control system state using statistical learning theory. All obtained results concern the main elements of the two-component robotic system with the mobile robot and adaptive manipulation robot on a fixed base for executing complex missions in non-stationary or uncertain conditions. The design and software implementation stage involves the creation of a structural diagram and description of the selected technologies, training a neural network for recognition and classification of geometric objects, and software implementation of control system components. The Swift programming language is used for the control system design and the CreateML framework is used for creating a neural network. Among the main results are: (a) expanding the capabilities of the intelligent control system by increasing the number of classes for recognition from three (cube, cylinder, and sphere) to five (cube, cylinder, sphere, pyramid, and cone); (b) increasing the validation accuracy (to 100%) for recognition of five different classes using CreateML (YOLOv2 architecture); (c) increasing the training accuracy (to 98.02%) and testing accuracy (to 98.0%) for recognition of five different classes using Torch library (ResNet34 architecture) in less time and number of epochs compared with Create ML (YOLOv2 architecture); (d) increasing the training accuracy (to 99.75%) and testing accuracy (to 99.2%) for recognition of five different classes using Torch library (ResNet34 architecture) and fine-tuning technology; and (e) analyzing the effect of dataset size impact on recognition accuracy with ResNet34 architecture and fine-tuning technology. The results can help to choose efficient (a) design approaches for control robotic devices, (b) machine-learning methods for performing pattern recognition and classification, and (c) computer technologies for designing control systems and simulating robotic devices.

Wireless Multi-sensor Physio-Motion Measurement and Synchronization System and Method for HRI Research

There is a strong demand for acquisition, processing and understanding of a variety of physiological and behavioral signals from the measurements in human-robot interface (HRI). However, multiple data streams from these measurements bring considerable challenges for their synchronizations, either for offline analysis or for online HRI applications, especially when the sensors are wirelessly connected, without synchronization mechanisms, such as a network-time-protocol. In this paper, we presented a full wireless multi-modality sensor system comprising biopotential measurements such as EEG, EMG and inertial parameter data of articulated body-limb motions. In the paper, we propose two methods to synchronize and calibrate the transmission latencies from different wireless channels. The first method employs the traditional artificial electrical timing signal. The other one employs the force-acceleration relationship governed by Newton's Second Law to facilitate reconstruction of the sample-to-sample alignment between the two wireless sensors. The measured latencies are investigated and the result show that they could be determined consistently and accurately by the devised techniques.