Intelligent Detection of Steel Defects Based on Improved Split Attention Networks

Quality-Related Process Monitoring and Diagnosis of Hot-Rolled Strip Based on Weighted Statistical Feature KPLS

Rolling is the main process in steel production. There are some problems in the rolling process, such as insufficient ability of abnormal detection and evaluation, low accuracy of process monitoring, and fault diagnosis. To improve the accuracy of quality-related fault diagnosis, this paper proposes a quality-related process monitoring and diagnosis method for hot-rolled strip based on weighted statistical feature KPLS. Firstly, the process-monitoring and diagnosis model of strip thickness and quality based on the KPLS method is introduced. Then, considering that the KPLS diagnosis method ignores the contribution of process variables to quality, it is easy to misjudge the root cause of quality in the diagnosis process. Based on the rolling mechanism model, the influence weight of strip thickness is constructed. By weighing the statistical data features, a quality diagnosis framework of series structure data fusion is constructed. Finally, the method is applied to the 1580 mm hot-rolling process for industrial verification. The verification results show that the proposed method has higher diagnostic accuracy than PLS, KPLS, and other methods. The results show that the diagnostic model based on weighted statistical feature KPLS has a diagnostic accuracy of more than 96% for strip thickness and quality-related faults.

A siamese network-based approach for vehicle pose estimation

We propose a deep learning-based vehicle pose estimation method based on a monocular camera called FPN PoseEstimateNet. The FPN PoseEstimateNet consists of a feature extractor and a pose calculate network. The feature extractor is based on Siamese network and a feature pyramid network (FPN) is adopted to deal with feature scales. Through the feature extractor, a correlation matrix between the input images is obtained for feature matching. With the time interval as the label, the feature extractor can be trained independently of the pose calculate network. On the basis of the correlation matrix and the standard matrix, the vehicle pose changes can be predicted by the pose calculate network. Results show that the network runs at a speed of 6 FPS, and the parameter size is 101.6 M. In different sequences, the angle error is within 8.26° and the maximum translation error is within 31.55 m.

Real-Time Target Detection Method Based on Lightweight Convolutional Neural Network

The continuous development of deep learning improves target detection technology day by day. The current research focuses on improving the accuracy of target detection technology, resulting in the target detection model being too large. The number of parameters and detection speed of the target detection model are very important for the practical application of target detection technology in embedded systems. This article proposed a real-time target detection method based on a lightweight convolutional neural network to reduce the number of model parameters and improve the detection speed. In this article, the depthwise separable residual module is constructed by combining depthwise separable convolution and non–bottleneck-free residual module, and the depthwise separable residual module and depthwise separable convolution structure are used to replace the VGG backbone network in the SSD network for feature extraction of the target detection model to reduce parameter quantity and improve detection speed. At the same time, the convolution kernels of 1 × 3 and 3 × 1 are used to replace the standard convolution of 3 × 3 by adding the convolution kernels of 1 × 3 and 3 × 1, respectively, to obtain multiple detection feature graphs corresponding to SSD, and the real-time target detection model based on a lightweight convolutional neural network is established by integrating the information of multiple detection feature graphs. This article used the self-built target detection dataset in complex scenes for comparative experiments; the experimental results verify the effectiveness and superiority of the proposed method. The model is tested on video to verify the real-time performance of the model, and the model is deployed on the Android platform to verify the scalability of the model.

FRCNet: Feature Refining and Context-Guided Network for Efficient Polyp Segmentation

Colorectal cancer, also known as rectal cancer, is one of the most common forms of cancer, and it can be completely cured with early diagnosis. The most effective and objective method of screening and diagnosis is colonoscopy. Polyp segmentation plays a crucial role in the diagnosis and treatment of diseases related to the digestive system, providing doctors with detailed auxiliary boundary information during clinical analysis. To this end, we propose a novel light-weight feature refining and context-guided network (FRCNet) for real-time polyp segmentation. In this method, we first employed the enhanced context-calibrated module to extract the most discriminative features by developing long-range spatial dependence through a context-calibrated operation. This operation is helpful to alleviate the interference of background noise and effectively distinguish the target polyps from the background. Furthermore, we designed the progressive context-aware fusion module to dynamically capture multi-scale polyps by collecting multi-range context information. Finally, the multi-scale pyramid aggregation module was used to learn more representative features, and these features were fused to refine the segmented results. Extensive experiments on the Kvasir, ClinicDB, ColonDB, ETIS, and Endoscene datasets demonstrated the effectiveness of the proposed model. Specifically, FRCNet achieves an mIoU of 84.9% and mDice score of 91.5% on the Kvasir dataset with a model size of only 0.78 M parameters, outperforming state-of-the-art methods. Models and codes are available at the footnote.¹

Flaw Detection in White Porcelain Wine Bottles Based on Improved YOLOv4 Algorithm

Aiming at the problems of low detection accuracy and slow detection speed in white porcelain wine bottle flaw detection, an improved flaw detection algorithm based on YOLOv4 was proposed. By adding Coordinate Attention to the backbone feature extraction network, the extracting ability of white porcelain bottle flaw features was improved. Deformable convolution is added to locate flaws more accurately, so as to improve the detection accuracy of flaws by the model. Efficient Intersection over Union was used to replace Complete Intersection over Union in YOLOv4 to improve the loss function and improve the model detection speed and accuracy. Experimental results on the surface flaw data set of white porcelain wine bottles show that the proposed algorithm can effectively detect white porcelain wine bottle flaws, the mean Average Precision of the model can reach 92.56%, and the detection speed can reach 37.17 frames/s.

Vanishing Point Detection Method Based on Constrained Classification for Checkpoints on Urban Roads

To solve the problems of computational complexity and inaccuracy in classical vanishing point detection algorithms, such as the cascaded Hough transform, a vanishing point detection method based on constrained classification is proposed. First, the short line data are filtered to avoid interference in straight line detection, and then, the line segment is screened and classified by hierarchical clustering according to the image characteristics of the line segment and the variation pattern of angle similarity. Subsequently, Three types of straight line segments with the most significant angle differences are acquired. To prevent the optimization algorithm from getting stuck in the “wrong” local optimum neighborhood or failing to locate the global optimum, a set of constraints are set to further restrict the search. Afterward, the classified line segments are projected into a finite rhombic space, which are then quantified. The point with the maximum vote is eventually identified as the vanishing point. Experimental results show that the proposed method not only greatly reduces the computational complexity of vanishing points but also largely improves the accuracy of vanishing point detection.

Depth Estimation Using Feature Pyramid U-Net and Polarized Self-Attention for Road Scenes

Studies have shown that the observed image texture details and semantic information are of great significance for the depth estimation on the road scenes. However, there are ambiguities and inaccuracies in the boundary information of observed objects in previous methods. For this reason, we hope to design a new depth estimation method that can obtain higher accuracy and more accurate boundary information of the detected object. Based on polarized self-attention (PSA) and feature pyramid U-net, we proposed a new self-supervised monocular depth estimation model to extract more accurate texture details and semantic information. Firstly, we add a PSA module at the end of the depth encoder and pose encoder so that the network can extract more accurate semantic information. Then, based on the U-net, we put the multi-scale image obtained by the object detection module FPN (Feature Pyramid network) directly into the decoder. It can guide the model to learn semantic information, thus enhancing the boundary of the image. We evaluated our method on KITTI 2015 datasets and Make3D datasets, and our model achieved better results than previous studies. In order to verify the generalization of the model, we have done monocular, stereo, monocular plus stereo experiments. The experimental results show that our model has achieved better results in several main evaluation indexes and clearer boundary information. In order to compare different forms of PSA mechanism, we did ablation experiments. Compared with no PSA module, after adding the PSA module, better results in evaluating indicators were achieved. We also found that our model is better in monocular training than stereo training and monocular plus stereo training.

Surface Defect Segmentation Algorithm of Steel Plate Based on Geometric Median Filter Pruning

Problems such as redundancy of detection model parameters make it difficult to apply to factory embedded device applications. This paper focuses on the analysis of different existing deep learning model compression algorithms and proposes a model pruning algorithm based on geometric median filtering for structured pruning and compression of defect segmentation detection networks on the basis of structured pruning. Through experimental comparisons and optimizations, the proposed optimization algorithm can greatly reduce the network parameters and computational effort to achieve effective pruning of the defect detection algorithm for steel plate surfaces.

Path Planning Optimization of Intelligent Vehicle Based on Improved Genetic and Ant Colony Hybrid Algorithm

Intelligent vehicles were widely used in logistics handling, agriculture, medical service, industrial production, and other industries, but they were often not smooth enough in planning the path, and the number of turns was large, resulting in high energy consumption. Aiming at the unsmooth path planning problem of four-wheel intelligent vehicle path planning algorithm, this article proposed an improved genetic and ant colony hybrid algorithm, and the physical model of intelligent vehicle was established. This article first improved ant colony optimization algorithm about heuristic function with the adaptive change of evaporation factor. Then, it improved the genetic algorithm on fitness function, adaptive adjustment of crossover factor, and mutation factor. Last, this article proposed the improved hybrid algorithm with the addition of a deletion operator, adoption of an elite retention strategy, and addition of suboptimal solutions obtained from the improved ant colony algorithm to improved genetic algorithm to obtain optimized new populations. The simulation environment for this article is windows 10, the processor is Intel Core i5-5257U, the running memory is 4GB, the compilation environment is MATLAB2018b, the number of ant samples is 50, the maximum number of iterations is 100, the initial population size of the genetic algorithm is 200, and the maximum number of iterations is 50. Simulation and physical experiments show that the improved hybrid algorithm is effective. Compared with the traditional hybrid algorithm, the improved hybrid algorithm reduced by 46% in the average number of iterations and 75% in the average number of turns in a simple grid. The improved hybrid algorithm reduced by 47% in the average number of iterations and 21% in the average number of turns in a complex grid. The improved hybrid algorithm works better to reduce the number of turns in simple maps.

Self-Supervised Monocular Depth Estimation Based on Channel Attention

Scene structure and local details are important factors in producing high-quality depth estimations so as to solve fuzzy artifacts in depth prediction results. We propose a new network structure that combines two channel attention modules in a deep prediction network. The structure perception module (spm) uses a frequency channel attention network. We use frequencies from different perspectives to analyze the channel representation as a compression process. This enhances the perception of the scene structure and obtains more feature information. The detail emphasis module (dem) adopts the global attention mechanism. It improves the performance of deep neural networks by reducing irrelevant information and magnifying global interactive representations. Emphasizing important details effectively fuses features at different scales to achieve more accurate and clearer depth predictions. Experiments show that our network produces clearer depth estimations, and our accuracy rate on the KITTI benchmark has improved from 98.1% to 98.3% in the δ < 1.253 metric.

Multi-Objective Optimization Design of Ladle Refractory Lining Based on Genetic Algorithm

Genetic algorithm is widely used in multi-objective mechanical structure optimization. In this paper, a genetic algorithm-based optimization method for ladle refractory lining structure is proposed. First, the parametric finite element model of the new ladle refractory lining is established by using ANSYS Workbench software. The refractory lining is mainly composed of insulating layer, permanent layer and working layer. Secondly, a mathematical model for multi-objective optimization is established to reveal the functional relationship between the maximum equivalent force on the ladle lining, the maximum temperature on the ladle shell, the total mass of the ladle and the structural parameters of the ladle refractory lining. Genetic algorithm translates the optimization process of ladle refractory lining into natural evolution and selection. The optimization results show that, compared with the unoptimized ladle refractory lining structure (insulation layer thickness of 0 mm, permanent layer thickness of 81 mm, and working layer thickness of 152 mm), the refractory lining with insulation layer thickness of 8.02 mm, permanent layer thickness of 76.20 mm, and working layer thickness of 148.61 mm has the best thermal insulation performance and longer service life within the variation of ladle refractory lining structure parameters. Finally, the results of the optimization are verified and analyzed in this paper. The study found that by optimizing the design of the ladle refractory lining, the maximum equivalent force on the ladle lining, the maximum temperature on the ladle shell and the ladle mass were reduced. The thermal insulation performance and the lightweight performance of the ladle are improved, which is very important for improving the service life of the ladle.

Improved Multi-Stream Convolutional Block Attention Module for sEMG-Based Gesture Recognition

As a key technology for the non-invasive human-machine interface that has received much attention in the industry and academia, surface EMG (sEMG) signals display great potential and advantages in the field of human-machine collaboration. Currently, gesture recognition based on sEMG signals suffers from inadequate feature extraction, difficulty in distinguishing similar gestures, and low accuracy of multi-gesture recognition. To solve these problems a new sEMG gesture recognition network called Multi-stream Convolutional Block Attention Module-Gate Recurrent Unit (MCBAM-GRU) is proposed, which is based on sEMG signals. The network is a multi-stream attention network formed by embedding a GRU module based on CBAM. Fusing sEMG and ACC signals further improves the accuracy of gesture action recognition. The experimental results show that the proposed method obtains excellent performance on dataset collected in this paper with the recognition accuracies of 94.1%, achieving advanced performance with accuracy of 89.7% on the Ninapro DB1 dataset. The system has high accuracy in classifying 52 kinds of different gestures, and the delay is less than 300 ms, showing excellent performance in terms of real-time human-computer interaction and flexibility of manipulator control.

Multi-Scale Feature Fusion Convolutional Neural Network for Indoor Small Target Detection

The development of object detection technology makes it possible for robots to interact with people and the environment, but the changeable application scenarios make the detection accuracy of small and medium objects in the practical application of object detection technology low. In this paper, based on multi-scale feature fusion of indoor small target detection method, using the device to collect different indoor images with angle, light, and shade conditions, and use the image enhancement technology to set up and amplify a date set, with indoor scenarios and the SSD algorithm in target detection layer and its adjacent features fusion. The Faster R-CNN, YOLOv5, SSD, and SSD target detection models based on multi-scale feature fusion were trained on an indoor scene data set based on transfer learning. The experimental results show that multi-scale feature fusion can improve the detection accuracy of all kinds of objects, especially for objects with a relatively small scale. In addition, although the detection speed of the improved SSD algorithm decreases, it is faster than the Faster R-CNN, which better achieves the balance between target detection accuracy and speed.

A Tandem Robotic Arm Inverse Kinematic Solution Based on an Improved Particle Swarm Algorithm

The analysis of robot inverse kinematic solutions is the basis of robot control and path planning, and is of great importance for research. Due to the limitations of the analytical and geometric methods, intelligent algorithms are more advantageous because they can obtain approximate solutions directly from the robot’s positive kinematic equations, saving a large number of computational steps. Particle Swarm Algorithm (PSO), as one of the intelligent algorithms, is widely used due to its simple principle and excellent performance. In this paper, we propose an improved particle swarm algorithm for robot inverse kinematics solving. Since the setting of weights affects the global and local search ability of the algorithm, this paper proposes an adaptive weight adjustment strategy for improving the search ability. Considering the running time of the algorithm, this paper proposes a condition setting based on the limit joints, and introduces the position coefficient k in the velocity factor. Meanwhile, an exponential product form modeling method (POE) based on spinor theory is chosen. Compared with the traditional DH modeling method, the spinor approach describes the motion of a rigid body as a whole and avoids the singularities that arise when described by a local coordinate system. In order to illustrate the advantages of the algorithm in terms of accuracy, time, convergence and adaptability, three experiments were conducted with a general six-degree-of-freedom industrial robotic arm, a PUMA560 robotic arm and a seven-degree-of-freedom robotic arm as the research objects. In all three experiments, the parameters of the robot arm, the range of joint angles, and the initial attitude and position of the end-effector of the robot arm are given, and the attitude and position of the impact point of the end-effector are set to verify whether the joint angles found by the algorithm can reach the specified positions. In Experiments 2 and 3, the algorithm proposed in this paper is compared with the traditional particle swarm algorithm (PSO) and quantum particle swarm algorithm (QPSO) in terms of position and direction solving accuracy, operation time, and algorithm convergence. The results show that compared with the other two algorithms, the algorithm proposed in this paper can ensure higher position accuracy and orientation accuracy of the robotic arm end-effector. the position error of the algorithm proposed in this paper is 0 and the maximum orientation error is 1.29 × 10–8. while the minimum position error of the other two algorithms is −1.64 × 10–5 and the minimum orientation error is −4.03 × 10–6. In terms of operation time, the proposed algorithm in this paper has shorter operation time compared with the other two algorithms. In the last two experiments, the computing time of the proposed algorithm is 0.31851 and 0.30004s respectively, while the shortest computing time of the other two algorithms is 0.33359 and 0.30521s respectively. In terms of algorithm convergence, the proposed algorithm can achieve faster and more stable convergence than the other two algorithms. After changing the experimental subjects, the proposed algorithm still maintains its advantages in terms of accuracy, time and convergence, which indicates that the proposed algorithm is more applicable and has certain potential in solving the multi-arm inverse kinematics solution. This paper provides a new way of thinking for solving the multi-arm inverse kinematics solution problem.

Low-Illumination Image Enhancement Algorithm Based on Improved Multi-Scale Retinex and ABC Algorithm Optimization

In order to solve the problems of poor image quality, loss of detail information and excessive brightness enhancement during image enhancement in low light environment, we propose a low-light image enhancement algorithm based on improved multi-scale Retinex and Artificial Bee Colony (ABC) algorithm optimization in this paper. First of all, the algorithm makes two copies of the original image, afterwards, the irradiation component of the original image is obtained by used the structure extraction from texture via relative total variation for the first image, and combines it with the multi-scale Retinex algorithm to obtain the reflection component of the original image, which are simultaneously enhanced using histogram equalization, bilateral gamma function correction and bilateral filtering. In the next part, the second image is enhanced by histogram equalization and edge-preserving with Weighted Guided Image Filtering (WGIF). Finally, the weight-optimized image fusion is performed by ABC algorithm. The mean values of Information Entropy (IE), Average Gradient (AG) and Standard Deviation (SD) of the enhanced images are respectively 7.7878, 7.5560 and 67.0154, and the improvement compared to original image is respectively 2.4916, 5.8599 and 52.7553. The results of experiment show that the algorithm proposed in this paper improves the light loss problem in the image enhancement process, enhances the image sharpness, highlights the image details, restores the color of the image, and also reduces image noise with good edge preservation which enables a better visual perception of the image.

Recognition and Detection of Wide Field Bionic Compound Eye Target Based on Cloud Service Network

In this paper, a multidisciplinary cross-fusion of bionics, robotics, computer vision, and cloud service networks was used as a research platform to study wide-field bionic compound eye target recognition and detection from multiple perspectives. The current research status of wide-field bionic compound-eye target recognition and detection was analyzed, and improvement directions were proposed. The surface microlens array arrangement was designed, and the spaced surface bionic compound eye design principle cloud service network model was established for the adopted spaced-type circumferential hierarchical microlens array arrangement. In order to realize the target localization of the compound eye system, the content of each step of the localization scheme was discussed in detail. The distribution of virtual spherical targets was designed by using the subdivision of the positive icosahedron to ensure the uniformity of the targets. The spot image was pre-processed to achieve spot segmentation. The energy symmetry-based spot center localization algorithm was explored and its localization effect was verified. A suitable spatial interpolation method was selected to establish the mapping relationship between target angle and spot coordinates. An experimental platform of wide-field bionic compound eye target recognition and detection system was acquired. A super-resolution reconstruction algorithm combining pixel rearrangement and an improved iterative inverse projection method was used for image processing. The model was trained and evaluated in terms of detection accuracy, leakage rate, time overhead, and other evaluation indexes, and the test results showed that the cloud service network-based wide-field bionic compound eye target recognition and detection performs well in terms of detection accuracy and leakage rate. Compared with the traditional algorithm, the correct rate of the algorithm was increased by 21.72%. Through the research of this paper, the wide-field bionic compound eye target recognition and detection and cloud service network were organically provide more technical support for the design of wide-field bionic compound eye target recognition and detection system.

Automatic Measurement of Endometrial Thickness From Transvaginal Ultrasound Images

Purpose: Endometrial thickness is one of the most important indicators in endometrial disease screening and diagnosis. Herein, we propose a method for automated measurement of endometrial thickness from transvaginal ultrasound images.

Methods: Accurate automated measurement of endometrial thickness relies on endometrium segmentation from transvaginal ultrasound images that usually have ambiguous boundaries and heterogeneous textures. Therefore, a two-step method was developed for automated measurement of endometrial thickness. First, a semantic segmentation method was developed based on deep learning, to segment the endometrium from 2D transvaginal ultrasound images. Second, we estimated endometrial thickness from the segmented results, using a largest inscribed circle searching method. Overall, 8,119 images (size: 852 × 1136 pixels) from 467 cases were used to train and validate the proposed method.

Results: We achieved an average Dice coefficient of 0.82 for endometrium segmentation using a validation dataset of 1,059 images from 71 cases. With validation using 3,210 images from 214 cases, 89.3% of endometrial thickness errors were within the clinically accepted range of ±2 mm.

Conclusion: Endometrial thickness can be automatically and accurately estimated from transvaginal ultrasound images for clinical screening and diagnosis.

Pursuit and Evasion Strategy of a Differential Game Based on Deep Reinforcement Learning

Since the emergence of deep neural network (DNN), it has achieved excellent performance in various research areas. As the combination of DNN and reinforcement learning, deep reinforcement learning (DRL) becomes a new paradigm for solving differential game problems. In this study, we build up a reinforcement learning environment and apply relevant DRL methods to a specific bio-inspired differential game problem: the dog sheep game. The dog sheep game environment is set on a circle where the dog chases down the sheep attempting to escape. According to some presuppositions, we are able to acquire the kinematic pursuit and evasion strategy. Next, this study implements the value-based deep Q network (DQN) model and the deep deterministic policy gradient (DDPG) model to the dog sheep game, attempting to endow the sheep the ability to escape successfully. To enhance the performance of the DQN model, this study brought up the reward mechanism with a time-out strategy and the game environment with an attenuation mechanism of the steering angle of sheep. These modifications effectively increase the probability of escape for the sheep. Furthermore, the DDPG model is adopted due to its continuous action space. Results show the modifications of the DQN model effectively increase the escape probabilities to the same level as the DDPG model. When it comes to the learning ability under various environment difficulties, the refined DQN and the DDPG models have bigger performance enhancement over the naive evasion model in harsh environments than in loose environments.

Time Optimal Trajectory Planing Based on Improved Sparrow Search Algorithm

Complete trajectory planning includes path planning, inverse solution solving and trajectory optimization. In this paper, a highly smooth and time-saving approach to trajectory planning is obtained by improving the kinematic and optimization algorithms for the time-optimal trajectory planning problem. By partitioning the joint space, the paper obtains an inverse solution calculation based on the partitioning of the joint space, saving 40% of the inverse kinematics solution time. This means that a large number of computational resources can be saved in trajectory planning. In addition, an improved sparrow search algorithm (SSA) is proposed to complete the solution of the time-optimal trajectory. A Tent chaotic mapping was used to optimize the way of generating initial populations. The algorithm was further improved by combining it with an adaptive step factor. The experiments demonstrated the performance of the improved SSA. The robot’s trajectory is further optimized in time by an improved sparrow search algorithm. Experimental results show that the method can improve convergence speed and global search capability and ensure smooth trajectories.

Photoelastic Stress Field Recovery Using Deep Convolutional Neural Network

Recent work has shown that deep convolutional neural network is capable of solving inverse problems in computational imaging, and recovering the stress field of the loaded object from the photoelastic fringe pattern can also be regarded as an inverse problem solving process. However, the formation of the fringe pattern is affected by the geometry of the specimen and experimental configuration. When the loaded object produces complex fringe distribution, the traditional stress analysis methods still face difficulty in unwrapping. In this study, a deep convolutional neural network based on the encoder–decoder structure is proposed, which can accurately decode stress distribution information from complex photoelastic fringe images generated under different experimental configurations. The proposed method is validated on a synthetic dataset, and the quality of stress distribution images generated by the network model is evaluated using mean squared error (MSE), structural similarity index measure (SSIM), peak signal-to-noise ratio (PSNR), and other evaluation indexes. The results show that the proposed stress recovery network can achieve an average performance of more than 0.99 on the SSIM.

Attitude Stabilization Control of Autonomous Underwater Vehicle Based on Decoupling Algorithm and PSO-ADRC

Autonomous Underwater Vehicle are widely used in industries, such as marine resource exploitation and fish farming, but they are often subject to a large amount of interference which cause poor control stability, while performing their tasks. A decoupling control algorithm is proposed and A single control volume–single attitude angle model is constructed for the problem of severe coupling in the control system of attitude of six degrees of freedom Autonomous Underwater Vehicle. Aiming at the problem of complex Active Disturbance Rejection Control (ADRC) adjustment relying on manual experience, the PSO-ADRC algorithm is proposed to realize the automatic adjustment of its parameters, which improves the anti-interference ability and control accuracy of Autonomous Underwater Vehicle in dynamic environment. The anti-interference ability and control accuracy of the method were verified through experiments.

Adaptive Door Opening Control Algorithm of Bio-Inspired Mobile Manipulator Based on Synchronous Sensing

At present, the research of robot door opening method is basically realized by identifying the door handle through the synchronous sensing system on the premise that the bio-inspired mobile manipulator is located in front of the door. An adaptive door opening strategy of a bio-inspired mobile manipulator based on a synchronous sensing system is proposed. Firstly, the random delay distribution in clock synchronization technology is analyzed in detail, and its distribution is verified on the experimental platform of adjacent nodes. Based on the Gaussian distribution of random delay, the relative frequency offset and relative phase offset of adjacent nodes are calculated. The clock synchronization of network cable sensor nodes is realized. Secondly, based on the information data of synchronous sensing system, this article realizes target detection and tracking based on depth network. In addition, based on the sliding mode control theory, the dynamic model of the nonholonomic bio-inspired mobile manipulator is applied. Finally, a robust adaptive sliding mode control method for nonlinear systems with input gain uncertainty and unmatched uncertainty is proposed by combining adaptive backstepping with sliding mode control. By adding sliding mode control in the last step of adaptive backstepping, the uncertainty of the system is compensated, and the system trajectory is maintained on the specified sliding mode manifold. The tracking control and stability control of the nonholonomic bio-inspired mobile manipulator are simulated. The experimental and simulation results show that the control method proposed in this article is effective and feasible.

Genetic Algorithm-Based Trajectory Optimization for Digital Twin Robots

Mobile robots have an important role in material handling in manufacturing and can be used for a variety of automated tasks. The accuracy of the robot's moving trajectory has become a key issue affecting its work efficiency. This paper presents a method for optimizing the trajectory of the mobile robot based on the digital twin of the robot. The digital twin of the mobile robot is created by Unity, and the trajectory of the mobile robot is trained in the virtual environment and applied to the physical space. The simulation training in the virtual environment provides schemes for the actual movement of the robot. Based on the actual movement data returned by the physical robot, the preset trajectory of the virtual robot is dynamically adjusted, which in turn enables the correction of the movement trajectory of the physical robot. The contribution of this work is the use of genetic algorithms for path planning of robots, which enables trajectory optimization of mobile robots by reducing the error in the movement trajectory of physical robots through the interaction of virtual and real data. It provides a method to map learning in the virtual domain to the physical robot.