Needle tip localization using stylet vibration

Robust tip localization under continuous spatial and temporal constraints during 2D ultrasound-guided needle puncture

PURPOSE

During ultrasound-guided (US-guided) needle puncture for minimally invasive procedures, automated needle tip localization can help clinicians capture small tips in US images easily and precisely, providing them with obvious tip indicators on the screen and bringing them more confidence during the procedures. However, automated needle tip localization in US images is challenging due to serious interferences arising from all kinds of echoes.

METHODS

We propose a method that localizes needle tips under continuous spatial and temporal constraints in the real-time US frame stream. A temporal constraint is firstly acquired by detecting translational tip motion in motion-enhanced US images with a deep learning-based (DL-based) detector. A spatial constraint and candidate tip locations are obtained by detecting needle shafts and tips in the raw grayscale B-mode images with another DL-based detector. To provide continuous constraints, estimated tip velocity from acquired temporal constraint is used to predict tip locations in frames where no temporal or spatial constraint is detected. Finally, tip coordinates are precisely localized among candidate tips under the spatial and temporal constraints.

RESULTS

Experimental results evaluated on 1121 US images from porcine organ punctures, and 895 images from human thyroid punctures demonstrate that the proposed method is effective and efficient, surpassing existing methods. On porcine organ data, a 97.2% recall rate and a 91.9% precision rate on tip detection and 0.88 ± 0.70 mm root-mean-square error (RMSE) on tip localization were achieved. On the human thyroid data, which was not involved in the training, 86.5% recall, 84.3% precision and 0.92 ± 0.78 mm RMSE were achieved separately. The running speed of 14.5 frames per second was achieved only using a CPU.

CONCLUSION

The proposed method provides a more reliable solution for automated needle tip localization during US-guided needle puncture, being more robust to interferences. Fast running speed leads to its practicability in the real-time US stream.

A power Doppler ultrasound method for improving intraoperative tip localization for visually obstructed needles in interstitial prostate brachytherapy

PURPOSE

High-dose-rate (HDR) interstitial brachytherapy (BT) is a common treatment technique for localized intermediate to high-risk prostate cancer. Transrectal ultrasound (US) imaging is typically used for guiding needle insertion, including localization of the needle tip which is critical for treatment planning. However, image artifacts can limit needle tip visibility in standard brightness (B)-mode US, potentially leading to dose delivery that deviates from the planned dose. To improve intraoperative tip visualization in visually obstructed needles, we propose a power Doppler (PD) US method which utilizes a novel wireless mechanical oscillator, validated in phantom experiments and clinical HDR-BT cases as part of a feasibility clinical trial.

METHODS

Our wireless oscillator contains a DC motor housed in a 3D printed case and is powered by rechargeable battery allowing the device to be operated by one person with no additional equipment required in the operating room. The oscillator end-piece features a cylindrical shape designed for BT applications to fit on top of the commonly used cylindrical needle mandrins. Phantom validation was completed using tissue-equivalent agar phantoms with the clinical US system and both plastic and metal needles. Our PD method was tested using a needle implant pattern matching a standard HDR-BT procedure as well as an implant pattern designed to maximize needle shadowing artifacts. Needle tip localization accuracy was assessed using the clinical method based on ideal reference needles as well as a comparison to computed tomography (CT) as a gold standard. Clinical validation was completed in five patients who underwent standard HDR-BT as part of a feasibility clinical trial. Needle tips positions were identified using B-mode US and PD US with perturbation from our wireless oscillator.

RESULTS

Absolute mean ± standard deviation tip error for B-mode alone, PD alone, and B-mode combined with PD was respectively: 0.3 ± 0.3 mm, 0.6 ± 0.5 mm, and 0.4 ± 0.2 mm for the mock HDR-BT needle implant; 0.8 ± 1.7 mm, 0.4 ± 0.6 mm, and 0.3 ± 0.5 mm for the explicit shadowing implant with plastic needles; and 0.5 ± 0.2 mm, 0.5 ± 0.3 mm, and 0.6 ± 0.2 mm for the explicit shadowing implant with metal needles. The total mean absolute tip error for all five patients in the feasibility clinical trial was 0.9 ± 0.7 mm using B-mode US alone and 0.8 ± 0.5 mm when including PD US, with increased benefit observed for needles classified as visually obstructed.

CONCLUSIONS

Our proposed PD needle tip localization method is easy to implement and requires no modifications or additions to the standard clinical equipment or workflow. We have demonstrated decreased tip localization error and variation for visually obstructed needles in both phantom and clinical cases, including providing the ability to visualize needles previously not visible using B-mode US alone. This method has the potential to improve needle visualization in challenging cases without burdening the clinical workflow, potentially improving treatment accuracy in HDR-BT and more broadly in any minimally invasive needle-based procedure.

Intraoperative Needle Tip Tracking with an Integrated Fibre-Optic Ultrasound Sensor

Ultrasound is an essential tool for guidance of many minimally-invasive surgical and interventional procedures, where accurate placement of the interventional device is critical to avoid adverse events. Needle insertion procedures for anaesthesia, fetal medicine and tumour biopsy are commonly ultrasound-guided, and misplacement of the needle may lead to complications such as nerve damage, organ injury or pregnancy loss. Clear visibility of the needle tip is therefore critical, but visibility is often precluded by tissue heterogeneities or specular reflections from the needle shaft. This paper presents the in vitro and ex vivo accuracy of a new, real-time, ultrasound needle tip tracking system for guidance of fetal interventions. A fibre-optic, Fabry-Pérot interferometer hydrophone is integrated into an intraoperative needle and used to localise the needle tip within a handheld ultrasound field. While previous, related work has been based on research ultrasound systems with bespoke transmission sequences, the new system-developed under the ISO 13485 Medical Devices quality standard-operates as an adjunct to a commercial ultrasound imaging system and therefore provides the image quality expected in the clinic, superimposing a cross-hair onto the ultrasound image at the needle tip position. Tracking accuracy was determined by translating the needle tip to 356 known positions in the ultrasound field of view in a tank of water, and by comparison to manual labelling of the the position of the needle in B-mode US images during an insertion into an ex vivo phantom. In water, the mean distance between tracked and true positions was 0.7 ± 0.4 mm with a mean repeatability of 0.3 ± 0.2 mm. In the tissue phantom, the mean distance between tracked and labelled positions was 1.1 ± 0.7 mm. Tracking performance was found to be independent of needle angle. The study demonstrates the performance and clinical compatibility of ultrasound needle tracking, an essential step towards a first-in-human study.

Scrubbing needles: a simple and costless technique to improve needle tip visibility during US-guided liver interventions

AIMS

To evaluate the echogenicity of a commercially available needle, modified on the tip, by comparing two groups of patients undergoing to percutaneous biliary drainage.

METHODS

In this retrospective analysis 16 percutaneous transhepatic biliary drainage (PTBD) procedures performed on 16 oncologic patients were evaluated. Patients were randomly divided into two groups of eight subjects each; in the first group, a standard needle was adopted (group A); in the second group, the needle was manually modified to create a rough surface (group B), by scrubbing the tip with an 11 scalpel blade for 150 s all around its surface. To objectively quantify US needle tip visibility, the contrast-to-noise ratio (CNR) was calculated analyzing B-mode images by positioning region of interests in correspondence of needle tip and liver parenchyma.

RESULTS

Needle tip echogenicity was significantly higher in group B where the needle tip was modified compared to control group A (p value = 0.014). CNR, considered to objectively evaluate differences among needle tip echogenicity, was significantly higher in group B with respect to control group A (p value = 0.018).

CONCLUSIONS

The proposed method, scrubbing a 22 gauge commercially available needle tip with a scalpel blade, represents an effective technique to improve needle visibility during US-guided punctures of the liver.

Enhancement of needle visualization and localization in ultrasound

PURPOSE

This scoping review covers needle visualization and localization techniques in ultrasound, where localization-based approaches mostly aim to compute the needle shaft (and tip) location while potentially enhancing its visibility too.

METHODS

A literature review is conducted on the state-of-the-art techniques, which could be divided into five categories: (1) signal and image processing-based techniques to augment the needle, (2) modifications to the needle and insertion to help with needle-transducer alignment and visibility, (3) changes to ultrasound image formation, (4) motion-based analysis and (5) machine learning.

RESULTS

Advantages, limitations and challenges of representative examples in each of the categories are discussed. Evaluation techniques performed in ex vivo, phantom and in vivo studies are discussed and summarized.

CONCLUSION

Greatest limitation of the majority of the literature is that they rely on original visibility of the needle in the static image. Need for additional/improved apparatus is the greatest limitation toward clinical utility in practice.

SIGNIFICANCE

Ultrasound-guided needle placement is performed in many clinical applications, including biopsies, treatment injections and anesthesia. Despite the wide range and long history of this technique, an ongoing challenge is needle visibility in ultrasound. A robust technique to enhance ultrasonic needle visibility, especially for steeply inserted hand-held needles, and while maintaining clinical utility requirements is needed.

Sonographic visibility of cannulas using convex ultrasound transducers

The key for safe ultrasound (US)-guided punctures is a good visibility of the cannula. When using convex transducers for deep punctures, the incident angle between US beam and cannula varies along the cannula leading to a complex visibility pattern. Here, we present a method to systematically investigate the visibility throughout the US image. For this, different objective criteria were defined and applied to measurement series with varying puncture angles and depths of the cannula. It is shown that the visibility not only depends on the puncture angle but also on the location of the cannula in the US image when using convex transducers. In some image regions, an unexpected good visibility was observed even for steep puncture angles. The systematic evaluation of the cannula visibility is of fundamental interest to sensitise physicians to the handling of convex transducers and to evaluate new techniques for further improvement.

A Methodical Quantification of Needle Visibility and Echogenicity in Ultrasound Images

During ultrasound-guided percutaneous interventions, needle localization can be a challenge. To increase needle visibility, enhancements of both the imaging methods and the needle surface properties have been investigated. However, a methodical approach to compare potential solutions is currently unavailable. The work described here involves automated image acquisition, analysis and reporting techniques to collect large amounts of data efficiently, delineate relevant factors and communicate effects. Data processing included filtering, line fitting and image intensity analysis steps. Foreground and background image samples were used to compute a contrast-to-noise ratio or a signal ratio. The approach was evaluated in a comparative study of commercially available and custom-made needles. Varied parameters included needle material, diameter and surface roughness. The shafts with kerfed patterns and the trocar and chiba tips performed best. The approach enabled an intuitive polar depiction of needle visibility in ultrasound images for a large range of insertion angles.

Looking beyond the imaging plane: 3D needle tracking with a linear array ultrasound probe

Ultrasound is well suited for guiding many minimally invasive procedures, but its use is often precluded by the poor visibility of medical devices. When devices are not visible, they can damage critical structures, with life-threatening complications. Here, we developed the first ultrasound probe that comprises both focused and unfocused transducer elements to provide both 2D B-mode ultrasound imaging and 3D ultrasonic needle tracking. A fibre-optic hydrophone was integrated into a needle to receive Golay-coded transmissions from the probe and these data were processed to obtain tracking images of the needle tip. The measured tracking accuracy in water was better than 0.4 mm in all dimensions. To demonstrate the clinical potential of this system, insertions were performed into the spine and the uterine cavity, in swine and pregnant ovine models in vivo. In both models, the SNR ranged from 13 to 38 at depths of 22 to 38 mm, at out-of-plane distances of 1 to 15 mm, and at insertion angles of 33 to 42 degrees relative to the probe surface normal. This novel ultrasound imaging/tracking probe has strong potential to improve procedural outcomes by providing 3D needle tip locations that are co-registered to ultrasound images, while maintaining compatibility with current clinical workflow.

Modelling and characterisation of a ultrasound-actuated needle for improved visibility in ultrasound-guided regional anaesthesia and tissue biopsy

Clear needle visualisation is recognised as an unmet need for ultrasound guided percutaneous needle procedures including regional anaesthesia and tissue biopsy. With inadequate needle visibility, these procedures may result in serious complications or a failed operation. This paper reports analysis of the modal behaviour of a previously proposed ultrasound-actuated needle configuration, which may overcome this problem by improving needle visibility in colour Doppler imaging. It uses a piezoelectric transducer to actuate longitudinal resonant modes in needles (outer diameter 0.8-1.2mm, length>65mm). The factors that affect the needle's vibration mode are identified, including the needle length, the transducer's resonance frequency and the gripping position. Their effects are investigated using finite element modelling, with the conclusions validated experimentally. The actuated needle was inserted into porcine tissue up to 30mm depth and its visibility was observed under colour Doppler imaging. The piezoelectric transducer is able to generate longitudinal vibration with peak-to-peak amplitude up to 4μm at the needle tip with an actuating voltage of 20Vpp. Actuated in longitudinal vibration modes (distal mode at 27.6kHz and transducer mode at 42.2kHz) with a drive amplitude of 12-14Vpp, a 120mm needle is delineated as a coloured line in colour Doppler images, with both needle tip and shaft visualised. The improved needle visibility is maintained while the needle is advanced into the tissue, thus allowing tracking of the needle position in real time. Moreover, the needle tip is highlighted by strong coloured artefacts around the actuated needle generated by its flexural vibration. A limitation of the technique is that the transducer mode requires needles of specific lengths so that the needle's resonance frequency matches the transducer. This may restrict the choice of needle lengths in clinical applications.

Transvaginal Ultrasound-Guided Biopsy of Deep Pelvic Masses: How We Do It

The purpose of this review is to discuss the rationale and indications for transvaginal ultrasound-guided biopsy. Transvaginal ultrasound-guided biopsy can be a helpful tool for diagnosis and treatment planning in the evaluation of pelvic masses, particularly when the anatomy precludes a transabdominal or posterior transgluteal percutaneous biopsy approach. A step-by-step summary of the technique with preprocedure and postprocedure considerations is included.

Needle Trajectory and Tip Localization in Real-Time 3-D Ultrasound Using a Moving Stylus

Described here is a novel approach to needle localization in 3-D ultrasound based on automatic detection of small changes in appearance on movement of the needle stylus. By stylus oscillation, including its full insertion into the cannula to the tip, the image processing techniques can localize the needle trajectory and the tip in the 3-D ultrasound volume. The 3-D needle localization task is reduced to two 2-D localizations using orthogonal projections. To evaluate our method, we tested it on three different ex vivo tissue types, and the preliminary results indicated that the method accuracy lies within clinical acceptance, with average error ranges of 0.9°-1.4° in needle trajectory and 0.8-1.1 mm in needle tip. Results also indicate that method performance is independent of the echogenicity of the tissue. This technique is a safe way of producing ultrasonic intensity changes and appears to introduce negligible risk to the patient, as the outer cannula remains fixed.

3-D ultrasound-guided robotic needle steering in biological tissue

Robotic needle steering systems have the potential to greatly improve medical interventions, but they require new methods for medical image guidance. Three-dimensional (3-D) ultrasound is a widely available, low-cost imaging modality that may be used to provide real-time feedback to needle steering robots. Unfortunately, the poor visibility of steerable needles in standard grayscale ultrasound makes automatic segmentation of the needles impractical. A new imaging approach is proposed, in which high-frequency vibration of a steerable needle makes it visible in ultrasound Doppler images. Experiments demonstrate that segmentation from this Doppler data is accurate to within 1-2 mm. An image-guided control algorithm that incorporates the segmentation data as feedback is also described. In experimental tests in ex vivo bovine liver tissue, a robotic needle steering system implementing this control scheme was able to consistently steer a needle tip to a simulated target with an average error of 1.57 mm. Implementation of 3-D ultrasound-guided needle steering in biological tissue represents a significant step toward the clinical application of robotic needle steering.

Robotic assistance for ultrasound-guided prostate brachytherapy

We present a robotically assisted prostate brachytherapy system and test results in training phantoms and Phase-I clinical trials. The system consists of a transrectal ultrasound (TRUS) and a spatially co-registered robot, fully integrated with an FDA-approved commercial treatment planning system. The salient feature of the system is a small parallel robot affixed to the mounting posts of the template. The robot replaces the template interchangeably, using the same coordinate system. Established clinical hardware, workflow and calibration remain intact. In all phantom experiments, we recorded the first insertion attempt without adjustment. All clinically relevant locations in the prostate were reached. Non-parallel needle trajectories were achieved. The pre-insertion transverse and rotational errors (measured with a Polaris optical tracker relative to the template's coordinate frame) were 0.25 mm (STD=0.17 mm) and 0.75 degrees (STD=0.37 degrees). In phantoms, needle tip placement errors measured in TRUS were 1.04 mm (STD=0.50mm). A Phase-I clinical feasibility and safety trial has been successfully completed with the system. We encountered needle tip positioning errors of a magnitude greater than 4mm in only 2 of 179 robotically guided needles, in contrast to manual template guidance where errors of this magnitude are much more common. Further clinical trials are necessary to determine whether the apparent benefits of the robotic assistant will lead to improvements in clinical efficacy and outcomes.