Twin-S: a digital twin for skull base surgery

PURPOSE

Digital twins are virtual replicas of real-world objects and processes, and they have potential applications in the field of surgical procedures, such as enhancing situational awareness. We introduce Twin-S, a digital twin framework designed specifically for skull base surgeries.

METHODS

Twin-S is a novel framework that combines high-precision optical tracking and real-time simulation, making it possible to integrate it into image-guided interventions. To guarantee accurate representation, Twin-S employs calibration routines to ensure that the virtual model precisely reflects all real-world processes. Twin-S models and tracks key elements of skull base surgery, including surgical tools, patient anatomy, and surgical cameras. Importantly, Twin-S mirrors real-world drilling and updates the virtual model at frame rate of 28.

RESULTS

Our evaluation of Twin-S demonstrates its accuracy, with an average error of 1.39 mm during the drilling process. Our study also highlights the benefits of Twin-S, such as its ability to provide augmented surgical views derived from the continuously updated virtual model, thus offering additional situational awareness to the surgeon.

CONCLUSION

We present Twin-S, a digital twin environment for skull base surgery. Twin-S captures the real-world surgical progresses and updates the virtual model in real time through the use of modern tracking technologies. Future research that integrates vision-based techniques could further increase the accuracy of Twin-S.

Medical Surgical Video Recognition and Retrieval Based on Novel Unified Approximation

Video retrieval recognition is a linear characterized action constituted by many frame similarity-based videos. This medical video recognition and classification can be a great extent in medical research, such as Endoscopic, radiological, pathological, and applied health informatics. General Video Retrieval Recognition (GVRR) cannot address a problem with recognition alone. GVRR can be solving the Multi-Input-Multi-Output (MIMO) interface mixed video retrieval system. To generalize the conventional video retrieval interface like Multi-user MIMO, WiMAX MIMO, single-user MIMO, several types of research made excused. In fine-tuning existing video retrieval, this research gives the authentic procedure for a frame-based cognitive operation called Secure Approximation and sTability Based Secure Video Retrieval recognition (SAT-SR) recognition proposed. In this research article, the process of recognition has three processes generalized by the video retrieval system. Initially, the virtual dissection and connection weights of input video were established using the mathematical and numerical analysis of interpolation estimation. Secondly, the interpolation approximation and activation function were figured out using the Open Mcrypt Stimulus (oMs) for video security fragments. Similarly, systematic investigations are accomplished for approximation error computation. The result for this widely circulated utilization of three processes on the video retrieval recognition prevents the occurrence of the cybercrime abuse of stored video registers. The proposed technique was used to identify the virtual dissection, interpolation, and activation function for decoding the videos. Using this information, the abusers identified cybercrime rate might be reduced considerably.

A Piezoelectric Tactile Sensor for Tissue Stiffness Detection with Arbitrary Contact Angle

In this paper, a piezoelectric tactile sensor for detecting tissue stiffness in robot-assisted minimally invasive surgery (RMIS) is proposed. It can detect the stiffness not only when the probe is normal to the tissue surface, but also when there is a contact angle between the probe and normal direction. It solves the problem that existing sensors can only detect in the normal direction to ensure accuracy when the degree of freedom (DOF) of surgical instruments is limited. The proposed senor can distinguish samples with different stiffness and recognize lump from normal tissue effectively when the contact angle varies within [0°, 45°]. These are achieved by establishing a new detection model and sensor optimization. It deduces the influence of contact angle on stiffness detection by sensor parameters design and optimization. The detection performance of the sensor is confirmed by simulation and experiment. Five samples with different stiffness (including lump and normal samples with close stiffness) are used. Through blind recognition test in simulation, the recognition rate is 100% when the contact angle is randomly selected within 30°, 94.1% within 45°, which is 38.7% higher than the unoptimized sensor. Through blind classification test and automatic k-means clustering in experiment, the correct rate is 92% when the contact angle is randomly selected within 45°. We can get the proposed sensor can easily recognize samples with different stiffness with high accuracy which has broad application prospects in the medical field.

Conditioned haptic perception for 3D localization of nodules in soft tissue palpation with a variable stiffness probe

This paper provides a solution for fast haptic information gain during soft tissue palpation using a Variable Lever Mechanism (VLM) probe. More specifically, we investigate the impact of stiffness variation of the probe to condition likelihood functions of the kinesthetic force and tactile sensors measurements during a palpation task for two sweeping directions. Using knowledge obtained from past probing trials or Finite Element (FE) simulations, we implemented this likelihood conditioning in an autonomous palpation control strategy. Based on a recursive Bayesian inferencing framework, this new control strategy adapts the sweeping direction and the stiffness of the probe to detect abnormal stiff inclusions in soft tissues. This original control strategy for compliant palpation probes shows a sub-millimeter accuracy for the 3D localization of the nodules in a soft tissue phantom as well as a 100% reliability detecting the existence of nodules in a soft phantom.