A Biomechanics-Aware Robot-Assisted Steerable Drilling Framework for Minimally Invasive Spinal Fixation Procedures

In this paper, we propose a novel biomechanics-aware robot-assisted steerable drilling framework with the goal of addressing common complications of spinal fixation procedures occurring due to the rigidity of drilling instruments and implants. This framework is composed of two main unique modules to design a robotic system including (i) a Patient-Specific Biomechanics-aware Trajectory Selection Module used to analyze the stress and strain distribution along an implanted pedicle screw in a generic drilling trajectory (linear and/or curved) and obtain an optimal trajectory; and (ii) a complementary semi-autonomous robotic drilling module that consists of a novel Concentric Tube Steerable Drilling Robot (CT-SDR) integrated with a seven degree-of-freedom robotic manipulator. This semi-autonomous robot-assisted steerable drilling system follows a multi-step drilling procedure to accurately and reliably execute the optimal hybrid drilling trajectory (HDT) obtained by the Trajectory Selection Module. Performance of the proposed framework has been thoroughly analyzed on simulated bone materials by drilling various trajectories obtained from the finite element-based Selection Module using Quantitative Computed Tomography (QCT) scans of a real patient's vertebra.

Automatic planning and geometric analysis of the drilling path in core decompression surgery for osteonecrosis of the femoral head

BACKGROUND AND OBJECTIVE

Core decompression surgery is an effective treatment method for patients with pre-collapse osteonecrosis of the femoral head (ONFH). The treatment relies on accurately predrilling the wire into the necrotic lesion. However, the surgical planning of this drilling path remains unclear. This paper aims to develop a framework to automatically plan the drilling path and analyze its geometric parameters.

METHODOLOGY

The proposed system consists of two stages. The first stage is to detect the key points. Besides the entry point and target point for the drilling path, the center of the femoral head (FH) and the boundary points of the necrotic lesion are also detected for the subsequent geometric analysis. In the second stage, the geometric parameters of the drilling path are analyzed, including the size of the necrotic lesion, the length from the entry point to the target point, the relative location between the FH center and the necrosis center, and the angular range of the drilling path in the anterior-posterior (AP) direction and superior-inferior (SI) direction.

RESULTS

All of the drilling paths designed by the proposed system were considered successful, starting from the proximal subtrochanteric region, terminating at the center of the necrotic lesion, and remaining within the femoral neck. The relative coordinates of the centers of the femoral head and necrotic lesion were (-0.89,5.14,2.63) mm for the left femurs and (1.55,5.92,2.63) mm for the right femurs, on average. The angular range of the drilling path was 39.99±29.58 degrees in the SI direction and 46.18±40.73 degrees in the AP direction.

CONCLUSION

This study develops a framework that allows for automatic planning and geometric analysis of the drilling path in core decompression surgery. The target point of the drilling path primarily resides in the lateral-anterior-superior region relative to the femoral head center. Surgeons and researchers can benefit from our unified framework while still maintaining the flexibility to adapt to variations in surgical cases.

A Concentric Tube Steerable Drilling Robot for Minimally Invasive Spinal Fixation of Osteoporotic Vertebrae

Spinal fixation with rigid pedicle screws have shown to be an effective treatment for many patients. However, this surgical option has been proved to be insufficient and will eventually fail for patients experiencing osteoporosis. This failure is mainly attributed to the lack of dexterity in the existing rigid drilling instruments and the complex anatomy of vertebrae, forcing surgeons to implant rigid pedicle screws within the osteoporotic regions of anatomy. To address this problem, in this article, we present the design, fabrication, and evaluation of a unique flexible yet structurally strong concentric tube steerable drilling robot (CT-SDR). The CT-SDR is capable of drilling smooth and accurate curved trajectories through hard tissues without experiencing buckling and failure; thus enabling the use of novel flexible pedicle screws for the next generation of spinal fixation procedures. Particularly, by decoupling the control of bending and insertion degrees of freedom (DoF) of the CT-SDR, we present a robotic system that (i) is intuitive to steer as it does not require an on-the-fly control algorithm for the bending DoF, and (ii) is able to address the contradictory requirements of structural stiffness and dexterity of a flexible robot interacting with the hard tissue. The robust and repeatable performance of the proposed CT-SDR have been experimentally evaluated by conducting various drilling procedures on simulated bone materials and animal bone samples. Experimental results indicate drilling times as low as 35 seconds for curved trajectories with 41 mm length and remarkable steering accuracy with a maximum 2% deviation error.

Platform for investigating continuum manipulator behavior in orthopedics

PURPOSE

The use of robotic continuum manipulators has been proposed to facilitate less-invasive orthopedic surgical procedures. While tools and strategies have been developed, critical challenges such as system control and intra-operative guidance are under-addressed. Simulation tools can help solve these challenges, but several gaps limit their utility for orthopedic surgical systems, particularly those with continuum manipulators. Herein, a simulation platform which addresses these gaps is presented as a tool to better understand and solve challenges for minimally invasive orthopedic procedures.

METHODS

An open-source surgical simulation software package was developed in which a continuum manipulator can interact with any volume model such as to drill bone volumes segmented from a 3D computed tomography (CT) image. Paired simulated X-ray images of the scene can also be generated. As compared to previous works, tool-anatomy interactions use a physics-based approach which leads to more stable behavior and wider procedure applicability. A new method for representing low-level volumetric drilling behavior is also introduced to capture material variability within bone as well as patient-specific properties from a CT.

RESULTS

Similar interaction between a continuum manipulator and phantom bone was also demonstrated between a simulated manipulator and volumetric obstacle models. High-level material- and tool-driven behavior was shown to emerge directly from the improved low-level interactions, rather than by need of manual programming.

CONCLUSION

This platform is a promising tool for developing and investigating control algorithms for tasks such as curved drilling. The generation of simulated X-ray images that correspond to the scene is useful for developing and validating image guidance models. The improvements to volumetric drilling offer users the ability to better tune behavior for specific tools and procedures and enable research to improve surgical simulation model fidelity. This platform will be used to develop and test control algorithms for image-guided curved drilling procedures in the femur.

Design and Fabrication of a Fiber Bragg Grating Shape Sensor for Shape Reconstruction of a Continuum Manipulator

Continuum dexterous manipulators (CDMs) are suitable for performing tasks in a constrained environment due to their high dexterity and maneuverability. Despite the inherent advantages of CDMs in minimally invasive surgery, real-time control of CDMs' shape during nonconstant curvature bending is still challenging. This study presents a novel approach for the design and fabrication of a large deflection fiber Bragg grating (FBG) shape sensor embedded within the lumens inside the walls of a CDM with a large instrument channel. The shape sensor consisted of two fibers, each with three FBG nodes. A shape-sensing model was introduced to reconstruct the centerline of the CDM based on FBG wavelengths. Different experiments, including shape sensor tests and CDM shape reconstruction tests, were conducted to assess the overall accuracy of the shape-sensing. The FBG sensor evaluation results revealed the linear curvature-wavelength relationship with the large curvature detection of 0.045 mm and a high wavelength shift of up to 5.50 nm at a 90° bending angle in both the bending directions. The CDM's shape reconstruction experiments in a free environment demonstrated the shape-tracking accuracy of 0.216 ± 0.126 mm for positive/negative deflections. Also, the CDM shape reconstruction error for three cases of bending with obstacles was observed to be 0.436 ± 0.370 mm for the proximal case, 0.485 ± 0.418 mm for the middle case, and 0.312 ± 0.261 mm for the distal case. This study indicates the adequate performance of the FBG sensor and the effectiveness of the model for tracking the shape of the large-deflection CDM with nonconstant-curvature bending for minimally invasive orthopedic applications.

Tsetse fly inspired steerable bone drill-a proof of concept

The fixation strength of pedicle screws could be increased by fixating along the much stronger cortical bone layer, which is not possible with the current rigid and straight bone drills. Inspired by the tsetse fly, a single-plane steerable bone drill was developed. The drill has a flexible transmission using two stacked leaf springs such that the drill is flexible in one plane and can drill along the cortical bone layer utilizing wall guidance. A proof-of-principle experiment was performed which showed that the Tsetse Drill was able to successfully drill through 5, 10 and 15 PCF cancellous bone phantom which has similar mechanical properties to severe osteoporotic, osteoporotic and healthy cancellous bone. Furthermore, the Tsetse Drill was able to successfully steer and drill along the cortical wall utilizing wall guidance for an insertion angle of 5°, 10° and 15°. The experiments conclude that the tsetse fly-inspired drilling method is successful and even allows the drilling along the cortical bone layer. The Tsetse Drill can create curved tunnels utilizing wall guidance which could increase the fixation strength of bone anchors and limit the risk of cortical breach and damage to surrounding anatomy.

Design of Proposed Software System for Prediction of Iliosacral Screw Placement for Iliosacral Joint Injuries Based on X-ray and CT Images

One of the crucial tasks for the planning of surgery of the iliosacral joint is placing an iliosacral screw with the goal of fixing broken parts of the pelvis. Tracking of proper screw trajectory is usually done in the preoperative phase by the acquisition of X-ray images under different angles, which guide the surgeons to perform surgery. This approach is standardly complicated due to the investigation of 2D X-ray images not showing spatial perspective. Therefore, in this pilot study, we propose complex software tools which are aimed at making a simulation model of reconstructed CT (DDR) images with a virtual iliosacral screw to guide the surgery process. This pilot study presents the testing for two clinical cases to reveal the initial performance and usability of this software in clinical conditions. This model is consequently used for a multiregional registration with reference intraoperative X-ray images to select the slide from the 3D dataset which best fits with reference X-ray. The proposed software solution utilizes input CT slices of the pelvis area to create a segmentation model of individual bone components. Consequently, a model of an iliosacral screw is inserted into this model. In the next step, we propose the software CT2DDR which makes DDR projections with the iliosacral screw. In the last step, we propose a multimodal registration procedure, which performs registration of a selected number of slices with reference X-ray, and based on the Structural Similarity Index (SSIM) and index of correlation, the procedure finds the best match of DDR with X-ray images. In this pilot study, we also provide a comparative analysis of the computational costs of the multimodal registration upon various numbers of DDR slices to show the complex software performance. The proposed complex model has versatile usage for modeling and surgery planning of the pelvis area in fractures of iliosacral joints.

Synthetic data accelerates the development of generalizable learning-based algorithms for X-ray image analysis

Artificial intelligence (AI) now enables automated interpretation of medical images. However, AI's potential use for interventional image analysis remains largely untapped. This is because the post hoc analysis of data collected during live procedures has fundamental and practical limitations, including ethical considerations, expense, scalability, data integrity and a lack of ground truth. Here we demonstrate that creating realistic simulated images from human models is a viable alternative and complement to large-scale in situ data collection. We show that training AI image analysis models on realistically synthesized data, combined with contemporary domain generalization techniques, results in machine learning models that on real data perform comparably to models trained on a precisely matched real data training set. We find that our model transfer paradigm for X-ray image analysis, which we refer to as SyntheX, can even outperform real-data-trained models due to the effectiveness of training on a larger dataset. SyntheX provides an opportunity to markedly accelerate the conception, design and evaluation of X-ray-based intelligent systems. In addition, SyntheX provides the opportunity to test novel instrumentation, design complementary surgical approaches, and envision novel techniques that improve outcomes, save time or mitigate human error, free from the ethical and practical considerations of live human data collection.

Review of Enhanced Handheld Surgical Drills

The handheld drill has been used as a conventional surgical tool for centuries. Alongside the recent successes of surgical robots, the development of new and enhanced medical drills has improved surgeon ability without requiring the high cost and consuming setup times that plague medical robot systems. This work provides an overview of enhanced handheld surgical drill research focusing on systems that include some form of image guidance and do not require additional hardware that physically supports or guides drilling. Drilling is reviewed by main contribution divided into audio-, visual-, or hardware-enhanced drills. A vision for future work to enhance handheld drilling systems is also discussed.

Influence of Antagonistic Tensions on Distributed Friction Forces of Multisegment Tendon-Driven Continuum Manipulators With Irregular Geometry

In this paper, we thoroughly analyze the effect of single-tendon and antagonistic tendons actuation on tension loss of multi-segment tendon-driven continuum manipulators (TD-CMs) with irregular geometry. To this end, we propose a generic analytical modeling approach and iterative algorithm that can solve the unknown correlation between distributed friction force, tendons' tension transmission loss, and planar deformation behavior of TD-CMs during tendons' pulling and releasing phases. The proposed generic model solely relies on known input tendons' tensions and does not require a priori knowledge of the manipulator's shape and/or other experimental conditions. To investigate the influence of actuation type on tension loss and deformation behavior of TD-CMs, we fabricated two different TD-CMs and performed various simulation and experimental studies with single-tendon and antagonistic tensions actuations. The obtained results indicate the importance of considering the effect of distributed friction force and actuation type on tension(s) loss of multi-segment TD-CMs. Moreover, it clearly demonstrates the efficacy and accuracy of the proposed model in providing insights and understanding of tension transmission process in various types of actuations in multi-segment TD-CMs with irregular geometry.

Computer-aided automatic planning and biomechanical analysis of a novel arc screw for pelvic fracture internal fixation

BACKGROUND AND OBJECTIVE

The sacroiliac joint screw is a common fixation method for pelvic posterior ring fractures. The complex anatomical structure around the pelvis makes it impossible to find a suitable fixed path, which increases the difficulty of surgical operation. In this paper, we propose an automatic planning algorithm based on a computer-aided internal arc fixation channel for pelvic fractures for the first time.

METHODS

A channel generation algorithm based on seed derived points was designed, and the optimal channel was selected by scoring rules based on 3D erode algorithm for the generated channel. The biomechanical properties of the internal arc fixation screw and traditional internal straight fixation screw in three postures were compared using biomechanical finite element analysis.

RESULTS

The proposed algorithm verified the existence of a more adaptable internal arc fixation channel and can quantitatively plan a relatively optimal constant-curvature internal arc fixation channel in pelvises of ten adults. Significantly high stresses concentrated around the interaction region between the screws and bone may increase the risk of bone fractures and screw loosening in the long term. The experimental results show that the internal arc fixation screw has better strain and deformation performance than the internal straight fixation screw.

CONCLUSIONS

A novel arc internal fixation method for pelvic fractures was proposed to improve the safety and stability of screw fixation of pelvic fracture. The nonparametric test proved that the sacroiliac dislocation model repaired by internal arc fixation screw was significantly different from that repaired by internal straight fixation screw. The computer-aided automatic planning algorithm provides the possibility of robot-assisted pelvic fracture fixation.

A Dexterous Robotic System for Autonomous Debridement of Osteolytic Bone Lesions in Confined Spaces: Human Cadaver Studies

This article presents a dexterous robotic system for autonomous debridement of osteolytic bone lesions in confined spaces. The proposed system is distinguished from the state-of-the-art orthopedics systems because it combines a rigid-link robot with a continuum manipulator (CM) that enhances reach in difficult-to-access spaces often encountered in surgery. The CM is equipped with flexible debriding instruments and fiber Bragg grating sensors. The surgeon plans on the patient's preoperative computed tomography and the robotic system performs the task autonomously under the surgeon's supervision. An optimization-based controller generates control commands on the fly to execute the task while satisfying physical and safety constraints. The system design and controller are discussed and extensive simulation, phantom and human cadaver experiments are carried out to evaluate the performance, workspace, and dexterity in confined spaces. Mean and standard deviation of target placement are 0.5 and 0.18 mm, and the robotic system covers 91% of the workspace behind an acetabular implant in treatment of hip osteolysis, compared to the 54% that is achieved by conventional rigid tools.

A Handheld Steerable Surgical Drill With a Novel Miniaturized Articulated Joint Module for Dexterous Confined-Space Bone Work

OBJECTIVE

Steerable surgical drills have the potential to minimize intraoperative tissue damage to patients. However, due to their large shaft diameters, large bend radii, and small bend angles, existing steerable drills are unsuitable for dexterous operations in confined spaces. This article presents a handheld steerable drill with a 4.5-mm miniaturized tip, capable of abruptly bending up to 65.

METHODS

To achieve a small tip diameter and a large bend angle, we propose a novel articulated joint module composed of a tendon-driven geared rolling joint and a double universal joint for steering the drill shaft and transmitting drilling torques, respectively. We integrate this joint module with a customized compact actuation unit into a handheld device. The integrated handheld steerable drill is slim and lightweight, supporting burdenless, single-handed grips and easy integration into existing surgical procedures.

RESULTS

Experiments and analysis showed the proposed steerable drill has high distal dexterity and is capable to remove target tissues dexterously through a small passage/incision with minimized collateral damage.

CONCLUSION

The results suggest the potential of the proposed miniaturized articulated drill for dexterous bone work in confined spaces.

SIGNIFICANCE

By enhancing distal dexterity and reach for surgeons when dealing with hard bony tissues, the proposed device can potentially minimize surgical invasiveness and thus collateral tissue damage to patients for a better clinical outcome.

Fluoroscopic Navigation for a Surgical Robotic System Including a Continuum Manipulator

We present an image-based navigation solution for a surgical robotic system with a Continuum Manipulator (CM). Our navigation system uses only fluoroscopic images from a mobile C-arm to estimate the CM shape and pose with respect to the bone anatomy. The CM pose and shape estimation is achieved using image intensity-based 2D/3D registration. A learning-based framework is used to automatically detect the CM in X-ray images, identifying landmark features that are used to initialize and regularize image registration. We also propose a modified hand-eye calibration method that numerically optimizes the hand-eye matrix during image registration. The proposed navigation system for CM positioning was tested in simulation and cadaveric studies. In simulation, the proposed registration achieved a mean error of 1.10±0.72 mm between the CM tip and a target entry point on the femur. In cadaveric experiments, the mean CM tip position error was 2.86±0.80 mm after registration and repositioning of the CM. The results suggest that our proposed fluoroscopic navigation is feasible to guide the CM in orthopedic applications.

An Active Steering Hand-held Robotic System for Minimally Invasive Orthopaedic Surgery Using a Continuum Manipulator

This paper presents the development and experimental evaluation of an active steering hand-held robotic system for milling and curved drilling in minimally invasive orthopaedic interventions. The system comprises a cable-driven continuum dexterous manipulator (CDM), an actuation unit with a handpiece, and a flexible, rotary cutting tool. Compared to conventional rigid drills, the proposed system enhances dexterity and reach in confined spaces in surgery, while providing direct control to the surgeon with sufficient stability while cutting/milling hard tissue. Of note, for cases that require precise motion, the system is able to be mounted on a positioning robot for additional controllability. A proportional-derivative (PD) controller for regulating drive cable tension is proposed for the stable steering of the CDM during cutting operations. The robotic system is characterized and tested with various tool rotational speeds and cable tensions, demonstrating successful cutting of three-dimensional and curvilinear tool paths in simulated cancellous bone and bone phantom. Material removal rates (MRRs) of up to 571 mm3/s are achieved for stable cutting, demonstrating great improvement over previous related works.

Beyond Constant Curvature: A New Mechanics Model for Unidirectional Notched-Tube Continuum Wrists

This paper presents a new mechanics model for unidirectional notched-tube continuum wrists, a class of mechanisms frequently used to implement distal steering in needle-sized surgical robotic instruments. Existing kinematic models available for these devices are based on the simplifying assumption that, during actuation, all the notches undergo the same amount of deflection, so that the shape of a wrist can be approximated by an arc of constant curvature. This approach is analytically attractive, but, as we show in this paper, it can sometimes fail to provide good tracking accuracy. In this article, we provide a new model that relaxes the assumption above, and we report experimental evidence showing its superior accuracy. We model wrist deflection using Castigliano's second theorem, with the addition of a capstan friction term that accounts for frictional losses on the actuation tendon. Because notched-tube wrists are typically made of Nickel-Titanium (Nitinol), which has nonlinear stress-strain characteristics, we use a technique to obtain a local linearized approximation of the material modulus, suitable for use in the deflection model. The result of our modeling is a system of nonlinear equations that can be solved numerically to predict the wrist configuration based on the applied actuation force. Experimental results on physical specimens show that this improved model provides a more accurate estimate of wrist kinematics than prior models assuming constant curvature bending.

Data-Driven Shape Sensing of a Surgical Continuum Manipulator Using an Uncalibrated Fiber Bragg Grating Sensor

This article proposes a data-driven learning-based approach for shape sensing and Distal-end Position Estimation (DPE) of a surgical Continuum Manipulator (CM) in constrained environments using Fiber Bragg Grating (FBG) sensors. The proposed approach uses only the sensory data from an unmodeled uncalibrated sensor embedded in the CM to estimate the shape and DPE. It serves as an alternate to the conventional mechanics-based sensor-model-dependent approach which relies on several sensor and CM geometrical assumptions. Unlike the conventional approach where the shape is reconstructed from proximal to distal end of the device, we propose a reversed approach where the distal-end position is estimated first and given this information, shape is then reconstructed from distal to proximal end. The proposed methodology yields more accurate DPE by avoiding accumulation of integration errors in conventional approaches. We study three data-driven models, namely a linear regression model, a Deep Neural Network (DNN), and a Temporal Neural Network (TNN) and compare DPE and shape reconstruction results. Additionally, we test both approaches (data-driven and model-dependent) against internal and external disturbances to the CM and its environment such as incorporation of flexible medical instruments into the CM and contacts with obstacles in taskspace. Using the data-driven (DNN) and model-dependent approaches, the following max absolute errors are observed for DPE: 0.78 mm and 2.45 mm in free bending motion, 0.11 mm and 3.20 mm with flexible instruments, and 1.22 mm and 3.19 mm with taskspace obstacles, indicating superior performance of the proposed data-driven approach compared to the conventional approaches.

A Surgical Robotic System for Treatment of Pelvic Osteolysis Using an FBG-Equipped Continuum Manipulator and Flexible Instruments

This paper presents the development and experimental evaluation of a redundant robotic system for the less-invasive treatment of osteolysis (bone degradation) behind the acetabular implant during total hip replacement revision surgery. The system comprises a rigid-link positioning robot and a Continuum Dexterous Manipulator (CDM) equipped with highly flexible debriding tools and a Fiber Bragg Grating (FBG)-based sensor. The robot and the continuum manipulator are controlled concurrently via an optimization-based framework using the Tip Position Estimation (TPE) from the FBG sensor as feedback. Performance of the system is evaluated on a setup that consists of an acetabular cup and saw-bone phantom simulating the bone behind the cup. Experiments consist of performing the surgical procedure on the simulated phantom setup. CDM TPE using FBGs, target location placement, cutting performance, and the concurrent control algorithm capability in achieving the desired tasks are evaluated. Mean and standard deviation of the CDM TPE from the FBG sensor and the robotic system are 0.50 mm, and 0.18 mm, respectively. Using the developed surgical system, accurate positioning and successful cutting of desired straight-line and curvilinear paths on saw-bone phantoms behind the cup with different densities are demonstrated. Compared to the conventional rigid tools, the workspace reach behind the acetabular cup is 2.47 times greater when using the developed robotic system.

Design, implementation, and control of a deformable manipulator robot based on a compliant spine

This article presents the conception, the numerical modeling, and the control of a dexterous, deformable manipulator bio-inspired by the skeletal spine found in vertebrate animals. Through the implementation of this new manipulator, we show a methodology based on numerical models and simulations, that goes from design to control of continuum and soft robots. The manipulator is modeled using a finite element method (FEM), using a set of beam elements that reproduce the lattice structure of the robot. The model is computed and inverted in real-time using optimization methods. A closed-loop control strategy is implemented to account for the disparities between the model and the robot. This control strategy allows for accurate positioning, not only of the tip of the manipulator, but also the positioning of selected middle points along its backbone. In a scenario where the robot is piloted by a human operator, the command of the robot is enhanced by a haptic loop that renders the boundaries of its task space as well as the contact with its environment. The experimental validation of the model and control strategies is also presented in the form of an inspection task use case.

SCADE: Simultaneous Sensor Calibration and Deformation Estimation of FBG-Equipped Unmodeled Continuum Manipulators

In this article, we present a novel stochastic algorithm called simultaneous sensor calibration and deformation estimation (SCADE) to address the problem of modeling deformation behavior of a generic continuum manipulator (CM) in free and obstructed environments. In SCADE, using a novel mathematical formulation, we introduce a priori model-independent filtering algorithm to fuse the continuous and inaccurate measurements of an embedded sensor (e.g., magnetic or piezoelectric sensors) with an intermittent but accurate data of an external imaging system (e.g., optical trackers or cameras). The main motivation of this article is the crucial need of obtaining an accurate shape/position estimation of a CM utilized in a surgical intervention. In these robotic procedures, the CM is typically equipped with an embedded sensing unit (ESU) while an external imaging modality (e.g., ultrasound or a fluoroscopy machine) is also available in the surgical site. The results of two different set of prior experiments in free and obstructed environments were used to evaluate the efficacy of SCADE algorithm. The experiments were performed with a CM specifically designed for orthopaedic interventions equipped with an inaccurate Fiber Bragg Grating (FBG) ESU and overhead camera. The results demonstrated the successful performance of the SCADE algorithm in simultaneous estimation of unknown deformation behavior of the utilized unmodeled CM together with realizing the time-varying drift of the poor-calibrated FBG sensing unit. Moreover, the results showed the phenomenal out-performance of the SCADE algorithm in estimation of the CM's tip position as compared to FBG-based position estimations.

Inroads Toward Robot-Assisted Internal Fixation of Bone Fractures Using a Bendable Medical Screw and the Curved Drilling Technique

Internal fixation is a common orthopedic procedure in which a rigid screw is used to fix fragments of a fractured bone together and expedite the healing process. However, the rigidity of the screw, geometry of the fractured anatomy (e.g. femur and pelvis), and patient's age can cause an array of complications during screw placement, such as improper fracture healing due to misalignment of the bone fragments, lengthy procedure time and subsequently high radiation exposure. To address these issues, we propose a minimally invasive robot-assisted procedure comprising of a continuum robot, called ortho-snake, together with a novel bendable medical screw (BMS) for fixating the fractures. We describe the implementation of a curved drilling technique and focus on the design, manufacturing, and evaluation of a novel BMS, which can passively morph into the drilled curved tunnels with various curvatures. We evaluate the performance and efficacy of the proposed BMS using both finite element simulations as well as experiments conducted on synthetic bone samples.

Surgical drilling of curved holes in bone - a patent review

INTRODUCTION

Conventional surgical drills are rigid straight instruments used to make holes in bones. They lack the ability to follow a curved pathway, making them impractical for several surgical procedures. For this reason, there is a continuous need for improved devices for surgical drilling of curved holes.

AREAS COVERED

This review provides a comprehensive overview and classification of the patent literature of surgical drills able to produce a curved hole. The goal is to identify the fundamental mechanical designs of the drills. The medical section of the Web of Science Derwent Innovation Index was scanned combining keywords for both steering and drilling. Overall, 41 unique patents were reviewed and categorized.

EXPERT OPINION

Drills were subdivided in four groups based on the capability of either drilling a single curved path or a multi-curved path and on their ability to adjust the path after insertion of the drill into the bone. We found patents describing instrument designs for all these four groups. The insight in the drilling capabilities and in the mechanical designs described in the patents may serve as a source of inspiration for the design of novel surgical drills and the development of new surgical procedures.

Interactive Flying Frustums (IFFs): spatially aware surgical data visualization

PURPOSE

As the trend toward minimally invasive and percutaneous interventions continues, the importance of appropriate surgical data visualization becomes more evident. Ineffective interventional data display techniques that yield poor ergonomics that hinder hand-eye coordination, and therefore promote frustration which can compromise on-task performance up to adverse outcome. A very common example of ineffective visualization is monitors attached to the base of mobile C-arm X-ray systems.

METHODS

We present a spatially and imaging geometry-aware paradigm for visualization of fluoroscopic images using Interactive Flying Frustums (IFFs) in a mixed reality environment. We exploit the fact that the C-arm imaging geometry can be modeled as a pinhole camera giving rise to an 11-degree-of-freedom view frustum on which the X-ray image can be translated while remaining valid. Visualizing IFFs to the surgeon in an augmented reality environment intuitively unites the virtual 2D X-ray image plane and the real 3D patient anatomy. To achieve this visualization, the surgeon and C-arm are tracked relative to the same coordinate frame using image-based localization and mapping, with the augmented reality environment being delivered to the surgeon via a state-of-the-art optical see-through head-mounted display.

RESULTS

The root-mean-squared error of C-arm source tracking after hand-eye calibration was determined as [Formula: see text] and [Formula: see text] in rotation and translation, respectively. Finally, we demonstrated the application of spatially aware data visualization for internal fixation of pelvic fractures and percutaneous vertebroplasty.

CONCLUSION

Our spatially aware approach to transmission image visualization effectively unites patient anatomy with X-ray images by enabling spatial image manipulation that abides image formation. Our proof-of-principle findings indicate potential applications for surgical tasks that mostly rely on orientational information such as placing the acetabular component in total hip arthroplasty, making us confident that the proposed augmented reality concept can pave the way for improving surgical performance and visuo-motor coordination in fluoroscopy-guided surgery.

On the Use of a Continuum Manipulator and a Bendable Medical Screw for Minimally Invasive Interventions in Orthopedic Surgery

Accurate placement and stable fixation are the main goals of internal fixation of bone fractures using the traditional medical screws. These goals are necessary to expedite and avoid improper fracture healing due to misalignment of the bone fragments. However, the rigidity of the screw, geometry of the fractured anatomy (e.g., femur and pelvis), and osteoporosis may cause an array of complications. To address these challenges, we propose the use of a continuum manipulator and a bendable medical screw (BMS) to drill curved tunnels and fixate the bone fragments. This novel approach provides the clinicians with a degree of freedom in selecting the drilling entry point as well as the navigation of drill in complex anatomical and osteoporotic bones. This technique can also facilitate the treatment of osteonecrosis and augmentation of the hip to prevent osteoporotic fractures. In this paper: 1) we evaluated the performance of the curved drilling technique on human cadaveric specimens by making several curved tunnels with different curvatures and 2) we also demonstrated the feasibility of internal fixation using the BMS versus a rigid straight screw by performing finite element simulation of fracture fixation in an osteoporotic femur.

Automatic intraoperative stitching of nonoverlapping cone-beam CT acquisitions

PURPOSE

Cone-beam computed tomography (CBCT) is one of the primary imaging modalities in radiation therapy, dentistry, and orthopedic interventions. While CBCT provides crucial intraoperative information, it is bounded by a limited imaging volume, resulting in reduced effectiveness. This paper introduces an approach allowing real-time intraoperative stitching of overlapping and nonoverlapping CBCT volumes to enable 3D measurements on large anatomical structures.

METHODS

A CBCT-capable mobile C-arm is augmented with a red-green-blue-depth (RGBD) camera. An offline cocalibration of the two imaging modalities results in coregistered video, infrared, and x-ray views of the surgical scene. Then, automatic stitching of multiple small, nonoverlapping CBCT volumes is possible by recovering the relative motion of the C-arm with respect to the patient based on the camera observations. We propose three methods to recover the relative pose: RGB-based tracking of visual markers that are placed near the surgical site, RGBD-based simultaneous localization and mapping (SLAM) of the surgical scene which incorporates both color and depth information for pose estimation, and surface tracking of the patient using only depth data provided by the RGBD sensor.

RESULTS

On an animal cadaver, we show stitching errors as low as 0.33, 0.91, and 1.72 mm when the visual marker, RGBD SLAM, and surface data are used for tracking, respectively.

CONCLUSIONS

The proposed method overcomes one of the major limitations of CBCT C-arm systems by integrating vision-based tracking and expanding the imaging volume without any intraoperative use of calibration grids or external tracking systems. We believe this solution to be most appropriate for 3D intraoperative verification of several orthopedic procedures.

Numerical study of temperature effects on the poro-viscoelastic behavior of articular cartilage

This paper presents a new approach to study the effects of temperature on the poro- elastic and viscoelastic behavior of articular cartilage. Biphasic solid-fluid mixture theory is applied to study the poro-mechanical behavior of articular cartilage in a fully saturated state. The balance of linear momentum, mass, and energy are considered to describe deformation of the solid skeleton, pore fluid pressure, and temperature distribution in the mixture. The mechanical model assumes both linear elastic and viscoelastic isotropic materials, infinitesimal strain theory, and a time-dependent response. The influence of temperature on the mixture behavior is modeled through temperature dependent mass density and volumetric thermal strain. The fluid flow through the porous medium is described by the Darcy's law. The stress-strain relation for time-dependent viscoelastic deformation in the solid skeleton is described using the generalized Maxwell model. A verification example is presented to illustrate accuracy and efficiency of the developed finite element model. The influence of temperature is studied through examining the behavior of articular cartilage for confined and unconfined boundary conditions. Furthermore, articular cartilage under partial loading condition is modeled to investigate the deformation, pore fluid pressure, and temperature dissipation processes. The results suggest significant impacts of temperature on both poro- elastic and viscoelastic behavior of articular cartilage.

A Robotic Flexible Drill and Its Navigation System for Total Hip Arthroplasty

This paper presents a robotic flexible drill and its navigation system for total hip arthroplasty (THA). The new robotic system provides an unprecedented and unique capability to perform curved femoral milling under the guidance of a multimodality navigation system. The robotic system consists of three components. Firstly, a flexible drill manipulator comprises multiple rigid segments that act as a sheath to a flexible shaft with a drill/burr attached to the end. The second part of the robotic system is a hybrid tracking system that consists of an optical tracking system and a position tracking system. Optical tracking units are used to track the surgical objects and tools outside the drilling area, while a rotary encoder placed at each joint of the sheath is synchronized to provide the position information for the flexible manipulator with its virtual object. Finally, the flexible drill is integrated into a computer-aided navigation system. The navigation system provides real time guidance to a surgeon during the procedure. The flexible drill system is then able to implement THA by bone milling. The final section of this paper is an evaluation of the flexible and steerable drill and its navigation system for femoral bone milling in sawbones.

Development and Experimental Evaluation of Concurrent Control of a Robotic Arm and Continuum Manipulator for Osteolytic Lesion Treatment

This paper presents the development and evaluation of concurrent control of a robotic system for less-invasive treatment of osteolytic lesions behind an acetabular implant. This system implements safety constraints including a remote center of motion (RCM), virtual walls, and joint limits while operating through the screw holes of the acetabular implant. The formulated linear constrained optimization problem ensures these constraints are satisfied while maintaining precise control of the tip of a Continuum Dexterous Manipulator (CDM) attached to a positioning robot. Experiments evaluated the performance of the tip control method within an acetabular cup. The controller reliably reached a series of goal points with a mean error of 0.42 mm and a worst-case error of straying 1.0 mm from our path.