1
|
Niu K, Sluiter V, Lan B, Homminga J, Sprengers A, Verdonschot N. A Method to Track 3D Knee Kinematics by Multi-Channel 3D-Tracked A-Mode Ultrasound. SENSORS (BASEL, SWITZERLAND) 2024; 24:2439. [PMID: 38676056 PMCID: PMC11053743 DOI: 10.3390/s24082439] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/07/2024] [Revised: 04/05/2024] [Accepted: 04/10/2024] [Indexed: 04/28/2024]
Abstract
This paper introduces a method for measuring 3D tibiofemoral kinematics using a multi-channel A-mode ultrasound system under dynamic conditions. The proposed system consists of a multi-channel A-mode ultrasound system integrated with a conventional motion capture system (i.e., optical tracking system). This approach allows for the non-invasive and non-radiative quantification of the tibiofemoral joint's six degrees of freedom (DOF). We demonstrated the feasibility and accuracy of this method in the cadaveric experiment. The knee joint's motions were mimicked by manually manipulating the leg through multiple motion cycles from flexion to extension. To measure it, six custom ultrasound holders, equipped with a total of 30 A-mode ultrasound transducers and 18 optical markers, were mounted on various anatomical regions of the lower extremity of the specimen. During experiments, 3D-tracked intra-cortical bone pins were inserted into the femur and tibia to measure the ground truth of tibiofemoral kinematics. The results were compared with the tibiofemoral kinematics derived from the proposed ultrasound system. The results showed an average rotational error of 1.51 ± 1.13° and a translational error of 3.14 ± 1.72 mm for the ultrasound-derived kinematics, compared to the ground truth. In conclusion, this multi-channel A-mode ultrasound system demonstrated a great potential of effectively measuring tibiofemoral kinematics during dynamic motions. Its improved accuracy, nature of non-invasiveness, and lack of radiation exposure make this method a promising alternative to incorporate into gait analysis and prosthetic kinematic measurements later.
Collapse
Affiliation(s)
- Kenan Niu
- Robotics and Mechatronics Group, Faculty of Electrical Engineering, Mathematics and Computer Science (EEMCS), University of Twente, P.O. Box 217, 7500 AE Enschede, The Netherlands;
| | - Victor Sluiter
- Department of Biomechanical Engineering, University of Twente, 7521 HK Enschede, The Netherlands (J.H.)
| | - Bangyu Lan
- Robotics and Mechatronics Group, Faculty of Electrical Engineering, Mathematics and Computer Science (EEMCS), University of Twente, P.O. Box 217, 7500 AE Enschede, The Netherlands;
| | - Jasper Homminga
- Department of Biomechanical Engineering, University of Twente, 7521 HK Enschede, The Netherlands (J.H.)
| | - André Sprengers
- Orthopaedic Research Lab, Radboud University Medical Center, P.O. Box 9101, 6500 HB Nijmegen, The Netherlands
| | - Nico Verdonschot
- Department of Biomechanical Engineering, University of Twente, 7521 HK Enschede, The Netherlands (J.H.)
- Orthopaedic Research Lab, Radboud University Medical Center, P.O. Box 9101, 6500 HB Nijmegen, The Netherlands
| |
Collapse
|
2
|
Lu W, Chen J, Wang Y, Chang W, Wang Y, Chen C, Dong L, Liang P, Kong D. Coplanarity Constrained Ultrasound Probe Calibration Based on N-Wire Phantom. ULTRASOUND IN MEDICINE & BIOLOGY 2023; 49:2316-2324. [PMID: 37541788 DOI: 10.1016/j.ultrasmedbio.2023.05.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/27/2023] [Revised: 05/15/2023] [Accepted: 05/26/2023] [Indexed: 08/06/2023]
Abstract
OBJECTIVE N-wire phantom-based ultrasound probe calibration has been used widely in many freehand tracked ultrasound imaging systems. The calibration matrix is obtained by registering the coplanar point cloud in ultrasound space and non-coplanar point cloud in tracking sensor space based on the least squares method. This method is sensitive to outliers and loses the coplanar information of the fiducial points. In this article, we describe a coplanarity-constrained calibration algorithm focusing on these issues. METHODS We verified that the out-of-plane error along the oblique wire in the N-wire phantom followed a normal distribution and used it to remove the experimental outliers and fit the plane with the Levenberg-Marquardt algorithm. Then, we projected the points to the plane along the oblique wire. Coplanarity-constrained point cloud registration was used to calculate the transformation matrix. RESULTS Compared with the other two commonly used methods, our method had the best calibration precision and achieved 25% and 36% improvement of the mean calibration accuracy than the closed-form solution and in-plane error method respectively at depth 16. Experiments at different depths revealed that our algorithm had better performance in our setup. CONCLUSION Our proposed coplanarity-constrained calibration algorithm achieved significant improvement in both precision and accuracy compared with existing algorithms with the same N-wire phantom. It is expected that calibration accuracy will improve when the algorithm is applied to all other N-wire phantom-based calibration procedures.
Collapse
Affiliation(s)
- Wenliang Lu
- School of Mathematical Sciences, Zhejiang University, Hangzhou, China
| | - Jiye Chen
- Fifth Medical Center, Chinese PLA General Hospital, Beijing, China; Chinese PLA Medical School, Beijing, China
| | - Yuan Wang
- School of Mathematical Sciences, Zhejiang University, Hangzhou, China
| | - Wanru Chang
- School of Mathematical Sciences, Zhejiang University, Hangzhou, China
| | - Yun Wang
- School of Mathematical Sciences, Zhejiang University, Hangzhou, China
| | | | - Linan Dong
- Department of Interventional Ultrasound, First Medical Center, Chinese PLA General Hospital, Beijing, China
| | - Ping Liang
- Fifth Medical Center, Chinese PLA General Hospital, Beijing, China; Chinese PLA Medical School, Beijing, China
| | - Dexing Kong
- School of Mathematical Sciences, Zhejiang University, Hangzhou, China.
| |
Collapse
|
3
|
Hiep MAJ, Heerink WJ, Groen HC, Ruers TJM. Feasibility of tracked ultrasound registration for pelvic-abdominal tumor navigation: a patient study. Int J Comput Assist Radiol Surg 2023; 18:1725-1734. [PMID: 37227572 DOI: 10.1007/s11548-023-02937-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2023] [Accepted: 04/24/2023] [Indexed: 05/26/2023]
Abstract
PURPOSE Surgical navigation techniques can guide surgeons in localizing pelvic-abdominal malignancies. For abdominal navigation, accurate patient registration is crucial and is generally performed using an intra-operative cone-beam CT (CBCT). However, this method causes 15-min surgical preparation workflow interruption and radiation exposure, and more importantly, it cannot be repeated during surgery to compensate for large patient movement. As an alternative, the accuracy and feasibility of tracked ultrasound (US) registration are assessed in this patient study. METHODS Patients scheduled for surgical navigation during laparotomy of pelvic-abdominal malignancies were prospectively included. In the operating room, two percutaneous tracked US scans of the pelvic bone were acquired: one in supine and one in Trendelenburg patient position. Postoperatively, the bone surface was semiautomatically segmented from US images and registered to the bone surface on the preoperative CT scan. The US registration accuracy was computed using the CBCT registration as a reference and acquisition times were compared. Additionally, both US measurements were compared to quantify the registration error caused by patient movement into Trendelenburg. RESULTS In total, 18 patients were included and analyzed. US registration resulted in a mean surface registration error of 1.2 ± 0.2 mm and a mean target registration error of 3.3 ± 1.4 mm. US acquisitions were 4 × faster than the CBCT scans (two-sample t-test P < 0.05) and could even be performed during standard patient preparation before skin incision. Patient repositioning in Trendelenburg caused a mean target registration error of 7.7 ± 3.3 mm, mainly in cranial direction. CONCLUSION US registration based on the pelvic bone is accurate, fast and feasible for surgical navigation. Further optimization of the bone segmentation algorithm will allow for real-time registration in the clinical workflow. In the end, this would allow intra-operative US registration to correct for large patient movement. TRIAL REGISTRATION This study is registered in ClinicalTrials.gov (NCT05637359).
Collapse
Affiliation(s)
- M A J Hiep
- Department of Surgical Oncology, Netherlands Cancer Institute, 1066 CX, Amsterdam, The Netherlands.
| | - W J Heerink
- Department of Surgical Oncology, Netherlands Cancer Institute, 1066 CX, Amsterdam, The Netherlands
| | - H C Groen
- Department of Surgical Oncology, Netherlands Cancer Institute, 1066 CX, Amsterdam, The Netherlands
| | - T J M Ruers
- Department of Surgical Oncology, Netherlands Cancer Institute, 1066 CX, Amsterdam, The Netherlands
- Faculty of Science and Technology (TNW), Nanobiophysics Group (NBP), University of Twente, 7500 AE, Enschede, The Netherlands
| |
Collapse
|
4
|
Wu C, Fu T, Chen X, Xiao J, Ai D, Fan J, Lin Y, Song H, Yang J. Automatic spatial calibration of freehand ultrasound probe with a multilayer N-wire phantom. ULTRASONICS 2023; 128:106862. [PMID: 36240539 DOI: 10.1016/j.ultras.2022.106862] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/01/2021] [Revised: 08/25/2022] [Accepted: 10/03/2022] [Indexed: 06/16/2023]
Abstract
The classic N-wire phantom has been widely used in the calibration of freehand ultrasound probes. One of the main challenges of the phantom is accurately identifying N-fiducials in ultrasound images, especially with multiple N-wire structures. In this study, a method using a multilayer N-wire phantom for the automatic spatial calibration of ultrasound images is proposed. All dots in the ultrasound image are segmented, scored, and classified according to the unique geometric features of the multilayer N-wire phantom. A recognition method for identifying N-fiducials from the dots is proposed for calibrating the spatial transformation of the ultrasound probe. At depths of 9, 11, 13, and 15 cm, the reconstruction error of 50 points is 1.24 ± 0.16, 1.09 ± 0.06, 0.95 ± 0.08, 1.02 ± 0.05 mm, respectively. The reconstruction mockup test shows that the distance accuracy is 1.11 ± 0.82 mm at a depth of 15 cm.
Collapse
Affiliation(s)
- Chan Wu
- Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
| | - Tianyu Fu
- School of Medical Technology, Beijing Institute of Technology, Beijing 100081, China.
| | - Xinyu Chen
- Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
| | - Jian Xiao
- Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
| | - Danni Ai
- Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
| | - Jingfan Fan
- Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
| | - Yucong Lin
- School of Medical Technology, Beijing Institute of Technology, Beijing 100081, China.
| | - Hong Song
- School of Computer Science and Technology, Beijing Institute of Technology, Beijing 100081, China
| | - Jian Yang
- Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
| |
Collapse
|
5
|
Mikaeili M, Bilge HŞ. Trajectory estimation of ultrasound images based on convolutional neural network. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103965] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
6
|
Chen F, Xu P, Xie Y, Zhang D, Liao H, Zhao Z. Annotation-guided encoder-decoder network for bone extraction in ultrasound-assisted orthopedic surgery. Comput Biol Med 2022; 148:105813. [PMID: 35849949 DOI: 10.1016/j.compbiomed.2022.105813] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2022] [Revised: 06/05/2022] [Accepted: 07/03/2022] [Indexed: 11/03/2022]
Abstract
The patients and surgeons are usually exposed in massive ionizing radiation during fluoroscopy-based navigation orthopedic surgery. Comparatively, ultrasound-assisted orthopedic surgery could not only decrease the risk of radiation but also provide rich navigation information. However, due to the artifacts in ultrasound images, the extraction of bone structure from ultrasound sequences can be a particularly difficult task, which leads to some major challenges in ultrasound-assisted orthopedic navigation. In this paper, we propose an annotation-guided encoder-decoder network (AGN) to extract bone structure from the radiation-free ultrasound sequences. Specifically, the variability of the ultrasound probe's pose leads to the change of the ultrasound frame during the acquisition of ultrasound sequences. Therefore, a feature alignment module deployed in the AGN model is used to achieve reliable matching across ultrasound frames. Moreover, inspired by the interactive ultrasound analysis, where user annotated foreground information can help target extraction, our AGN model incorporates the annotation information obtained by Siamese networks. Experimental results validated that the AGN model not only produced better bone surface extraction than state-of-the-art methods (IOU: 0.92 versus. 0.88), but also achieved almost real-time extraction with the speed about 15 frames per second. In addition, the acquired bone surface further provided radiation-free 3D intraoperative bone structure for the intuitive navigation of orthopedic surgery.
Collapse
Affiliation(s)
- Fang Chen
- Department of Computer Science and Engineering, Nanjing University of Aeronautics and Astronautics, MIIT Key Laboratory of Pattern Analysis and Machine Intelligence, China.
| | - Peng Xu
- Children's Hospital of Nanjing Medical University, Nanjing, 21106, China.
| | - Yanting Xie
- Department of Computer Science and Engineering, Nanjing University of Aeronautics and Astronautics, MIIT Key Laboratory of Pattern Analysis and Machine Intelligence, China
| | - Daoqiang Zhang
- Department of Computer Science and Engineering, Nanjing University of Aeronautics and Astronautics, MIIT Key Laboratory of Pattern Analysis and Machine Intelligence, China
| | - Hongen Liao
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, China
| | - Zhe Zhao
- Department of Orthopaedics, Beijing Tsinghua Changgung Hospital, Tsinghua University, China
| |
Collapse
|
7
|
Tang S, Yang X, Shajudeen P, Sears C, Taraballi F, Weiner B, Tasciotti E, Dollahon D, Park H, Righetti R. A CNN-based method to reconstruct 3-D spine surfaces from US images in vivo. Med Image Anal 2021; 74:102221. [PMID: 34520960 DOI: 10.1016/j.media.2021.102221] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2020] [Revised: 08/26/2021] [Accepted: 08/27/2021] [Indexed: 01/12/2023]
Abstract
Three-dimensional (3-D) reconstruction of the spine surface is of strong clinical relevance for the diagnosis and prognosis of spine disorders and intra-operative image guidance. In this paper, we report a new technique to reconstruct lumbar spine surfaces in 3-D from non-invasive ultrasound (US) images acquired in free-hand mode. US images randomly sampled from in vivo scans of 9 rabbits were used to train a U-net convolutional neural network (CNN). More specifically, a late fusion (LF)-based U-net trained jointly on B-mode and shadow-enhanced B-mode images was generated by fusing two individual U-nets and expanding the set of trainable parameters to around twice the capacity of a basic U-net. This U-net was then applied to predict spine surface labels in in vivo images obtained from another rabbit, which were then used for 3-D spine surface reconstruction. The underlying pose of the transducer during the scan was estimated by registering stacks of US images to a geometrical model derived from corresponding CT data and used to align detected surface points. Final performance of the reconstruction method was assessed by computing the mean absolute error (MAE) between pairs of spine surface points detected from US and CT and by counting the total number of surface points detected from US. Comparison was made between the LF-based U-net and a previously developed phase symmetry (PS)-based method. Using the LF-based U-net, the averaged number of US surface points across the lumbar region increased by 21.61% and MAE reduced by 26.28% relative to the PS-based method. The overall MAE (in mm) was 0.24±0.29. Based on these results, we conclude that: 1) the proposed U-net can detect the spine posterior arch with low MAE and large number of US surface points and 2) the newly proposed reconstruction framework may complement and, under certain circumstances, be used without the aid of an external tracking system in intra-operative spine applications.
Collapse
Affiliation(s)
- Songyuan Tang
- Department of Electrical and Computer Engineering, Texas A&M University, College Station, TX 77843, USA
| | - Xu Yang
- Department of Electrical and Computer Engineering, Texas A&M University, College Station, TX 77843, USA
| | - Peer Shajudeen
- Department of Electrical and Computer Engineering, Texas A&M University, College Station, TX 77843, USA
| | - Candice Sears
- Houston Methodist Hospital, Department of Orthopedics and Sports Medicine, Center for Musculoskeletal Regeneration, Houston 77030, USA
| | - Francesca Taraballi
- Houston Methodist Hospital, Department of Orthopedics and Sports Medicine, Center for Musculoskeletal Regeneration, Houston 77030, USA
| | - Bradley Weiner
- Houston Methodist Hospital, Department of Orthopedics and Sports Medicine, Center for Musculoskeletal Regeneration, Houston 77030, USA
| | - Ennio Tasciotti
- Houston Methodist Hospital, Department of Orthopedics and Sports Medicine, Center for Musculoskeletal Regeneration, Houston 77030, USA
| | - Devon Dollahon
- Department of Electrical and Computer Engineering, Texas A&M University, College Station, TX 77843, USA
| | - Hangue Park
- Department of Electrical and Computer Engineering, Texas A&M University, College Station, TX 77843, USA
| | - Raffaella Righetti
- Department of Electrical and Computer Engineering, Texas A&M University, College Station, TX 77843, USA.
| |
Collapse
|
8
|
Identification of ultrasound imaging markers to quantify long bone regeneration in a segmental tibial defect sheep model in vivo. Sci Rep 2020; 10:13646. [PMID: 32788593 PMCID: PMC7423946 DOI: 10.1038/s41598-020-70426-y] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2020] [Accepted: 07/27/2020] [Indexed: 12/11/2022] Open
Abstract
The healing of large bone defects has been investigated for decades due to its complexity and clinical relevance. Ultrasound (US) methods have shown promise in monitoring bone healing, but no quantitative method to assess regenerated bone morphology in US images has been presented yet. In this study, we investigate new US morphometric parameters to quantify bone regeneration in vivo. A segmental tibial defect was surgically created and stabilized in a sheep animal model. US and computed tomography (CT) imaging data were collected two months post-surgery. New bone was assessed, reconstructed and quantified from the US and CT data using 3 morphometric parameters: the new-bone bulk (NBB), new-bone surface (NBS) and new-bone contact (NBC). The distance (mm) between surface reconstructions from repeated US was \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$0.49\pm 0.30$$\end{document}0.49±0.30 and from US and CT was \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$0.89\pm 0.49$$\end{document}0.89±0.49. In the mid-shaft of the defected tibia, US measurements of NBB, NBS and NBC were significantly higher than the corresponding CT measurements (\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$p < 0.001$$\end{document}p<0.001). Based on our results, we conclude that US may complement CT to reconstruct and quantify bone regrowth, especially in its early stages.
Collapse
|
9
|
Gueziri HE, Santaguida C, Collins DL. The state-of-the-art in ultrasound-guided spine interventions. Med Image Anal 2020; 65:101769. [PMID: 32668375 DOI: 10.1016/j.media.2020.101769] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2019] [Revised: 06/23/2020] [Accepted: 06/25/2020] [Indexed: 02/07/2023]
Abstract
During the last two decades, intra-operative ultrasound (iUS) imaging has been employed for various surgical procedures of the spine, including spinal fusion and needle injections. Accurate and efficient registration of pre-operative computed tomography or magnetic resonance images with iUS images are key elements in the success of iUS-based spine navigation. While widely investigated in research, iUS-based spine navigation has not yet been established in the clinic. This is due to several factors including the lack of a standard methodology for the assessment of accuracy, robustness, reliability, and usability of the registration method. To address these issues, we present a systematic review of the state-of-the-art techniques for iUS-guided registration in spinal image-guided surgery (IGS). The review follows a new taxonomy based on the four steps involved in the surgical workflow that include pre-processing, registration initialization, estimation of the required patient to image transformation, and a visualization process. We provide a detailed analysis of the measurements in terms of accuracy, robustness, reliability, and usability that need to be met during the evaluation of a spinal IGS framework. Although this review is focused on spinal navigation, we expect similar evaluation criteria to be relevant for other IGS applications.
Collapse
Affiliation(s)
- Houssem-Eddine Gueziri
- McConnell Brain Imaging Center, Montreal Neurological Institute and Hospital, Montreal (QC), Canada; McGill University, Montreal (QC), Canada.
| | - Carlo Santaguida
- Department of Neurology and Neurosurgery, McGill University Health Center, Montreal (QC), Canada
| | - D Louis Collins
- McConnell Brain Imaging Center, Montreal Neurological Institute and Hospital, Montreal (QC), Canada; McGill University, Montreal (QC), Canada
| |
Collapse
|
10
|
De Silva T, Uneri A, Zhang X, Ketcha M, Han R, Sheth N, Martin A, Vogt S, Kleinszig G, Belzberg A, Sciubba DM, Siewerdsen JH. Real-time, image-based slice-to-volume registration for ultrasound-guided spinal intervention. Phys Med Biol 2018; 63:215016. [PMID: 30372418 DOI: 10.1088/1361-6560/aae761] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
Abstract
Real-time fusion of magnetic resonance (MR) and ultrasound (US) images could facilitate safe and accurate needle placement in spinal interventions. We develop an entirely image-based registration method (independent of or complementary to surgical trackers) that includes an efficient US probe pose initialization algorithm. The registration enables the simultaneous display of 2D ultrasound image slices relative to 3D pre-procedure MR images for navigation. A dictionary-based 3D-2D pose initialization algorithm was developed in which likely probe positions are predefined in a dictionary with feature encoding by Haar wavelet filters. Feature vectors representing the 2D US image are computed by scaling and translating multiple Haar basis filters to capture scale, location, and relative intensity patterns of distinct anatomical features. Following pose initialization, fast 3D-2D registration was performed by optimizing normalized cross-correlation between intra- and pre-procedure images using Powell's method. Experiments were performed using a lumbar puncture phantom and a fresh cadaver specimen presenting realistic image quality in spinal US imaging. Accuracy was quantified by comparing registration transforms to ground truth motion imparted by a computer-controlled motion system and calculating target registration error (TRE) in anatomical landmarks. Initialization using a 315-length feature vector yielded median translation accuracy of 2.7 mm (3.4 mm interquartile range, IQR) in the phantom and 2.1 mm (2.5 mm IQR) in the cadaver. By comparison, storing the entire image set in the dictionary and optimizing correlation yielded a comparable median accuracy of 2.1 mm (2.8 mm IQR) in the phantom and 2.9 mm (3.5 mm IQR) in the cadaver. However, the dictionary-based method reduced memory requirements by 47× compared to storing the entire image set. The overall 3D error after registration measured using 3D landmarks was 3.2 mm (1.8 mm IQR) mm in the phantom and 3.0 mm (2.3 mm IQR) mm in the cadaver. The system was implemented in a 3D Slicer interface to facilitate translation to clinical studies. Haar feature based initialization provided accuracy and robustness at a level that was sufficient for real-time registration using an entirely image-based method for ultrasound navigation. Such an approach could improve the accuracy and safety of spinal interventions in broad utilization, since it is entirely software-based and can operate free from the cost and workflow requirements of surgical trackers.
Collapse
Affiliation(s)
- T De Silva
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD 21205, United States of America
| | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
11
|
Abstract
Ultrasound is a real-time, non-radiation-based imaging modality with an ability to acquire two-dimensional (2D) and three-dimensional (3D) data. Due to these capabilities, research has been carried out in order to incorporate it as an intraoperative imaging modality for various orthopedic surgery procedures. However, high levels of noise, different imaging artifacts, and bone surfaces appearing blurred with several mm in thickness have prohibited the widespread use of ultrasound as a standard of care imaging modality in orthopedics. In this chapter, we provided a detailed overview of numerous applications of 3D ultrasound in the domain of orthopedic surgery. Specifically, we discuss the advantages and disadvantages of methods proposed for segmentation and enhancement of bone ultrasound data and the successful application of these methods in clinical domain. Finally, a number of challenges are identified which need to be overcome in order for ultrasound to become a preferred imaging modality in orthopedics.
Collapse
|
12
|
Tümer N, Kok AC, Vos FM, Streekstra GJ, Askeland C, Tuijthof GJM, Zadpoor AA. Three-Dimensional Registration of Freehand-Tracked Ultrasound to CT Images of the Talocrural Joint. SENSORS (BASEL, SWITZERLAND) 2018; 18:E2375. [PMID: 30037099 PMCID: PMC6068753 DOI: 10.3390/s18072375] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/06/2018] [Revised: 07/09/2018] [Accepted: 07/19/2018] [Indexed: 12/11/2022]
Abstract
A rigid surface⁻volume registration scheme is presented in this study to register computed tomography (CT) and free-hand tracked ultrasound (US) images of the talocrural joint. Prior to registration, bone surfaces expected to be visible in US are extracted from the CT volume and bone contours in 2D US data are enhanced based on monogenic signal representation of 2D US images. A 3D monogenic signal data is reconstructed from the 2D data using the position of the US probe recorded with an optical tracking system. When registering the surface extracted from the CT scan to the monogenic signal feature volume, six transformation parameters are estimated so as to optimize the sum of monogenic signal features over the transformed surface. The robustness of the registration algorithm was tested on a dataset collected from 12 cadaveric ankles. The proposed method was used in a clinical case study to investigate the potential of US imaging for pre-operative planning of arthroscopic access to talar (osteo)chondral defects (OCDs). The results suggest that registrations with a registration error of 2 mm and less is achievable, and US has the potential to be used in assessment of an OCD' arthroscopic accessibility, given the fact that 51% of the talar surface could be visualized.
Collapse
Affiliation(s)
- Nazlı Tümer
- Department of Biomechanical Engineering, Delft University of Technology (TU Delft), Mekelweg 2, 2628 CD Delft, The Netherlands.
| | - Aimee C Kok
- Orthopaedic Research Center Amsterdam, Academic Medical Centre (AMC), Meibergdreef 9, 1105 AZ Amsterdam, The Netherlands.
| | - Frans M Vos
- Department of Imaging Science and Technology, Quantitative Imaging Group, Delft University of Technology (TU Delft), Lorentzweg 1, 2628 CJ Delft, The Netherlands.
- Department of Radiology, Academic Medical Centre (AMC), Meibergdreef 9, 1105 AZ Amsterdam, The Netherlands.
| | - Geert J Streekstra
- Department of Radiology, Academic Medical Centre (AMC), Meibergdreef 9, 1105 AZ Amsterdam, The Netherlands.
| | | | - Gabrielle J M Tuijthof
- Orthopaedic Research Center Amsterdam, Academic Medical Centre (AMC), Meibergdreef 9, 1105 AZ Amsterdam, The Netherlands.
- Zuyd University of Applied Sciences, Research Centre Smart Devices, Nieuw Eyckholt 300, 6419 DJ Heerlen, The Netherlands.
| | - Amir A Zadpoor
- Department of Biomechanical Engineering, Delft University of Technology (TU Delft), Mekelweg 2, 2628 CD Delft, The Netherlands.
| |
Collapse
|
13
|
Pandey P, Guy P, Hodgson AJ, Abugharbieh R. Fast and automatic bone segmentation and registration of 3D ultrasound to CT for the full pelvic anatomy: a comparative study. Int J Comput Assist Radiol Surg 2018; 13:1515-1524. [PMID: 29804181 DOI: 10.1007/s11548-018-1788-5] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2018] [Accepted: 05/09/2018] [Indexed: 12/15/2022]
Abstract
PURPOSE Ultrasound (US) is a safer alternative to X-rays for bone imaging, and its popularity for orthopedic surgical navigation is growing. Routine use of intraoperative US for navigation requires fast, accurate and automatic alignment of tracked US to preoperative computed tomography (CT) patient models. Our group previously investigated image segmentation and registration to align untracked US to CT of only the partial pelvic anatomy. In this paper, we extend this to study the performance of these previously published techniques over the full pelvis in a tracked framework, to characterize their suitability in more realistic scenarios, along with an additional simplified segmentation method and similarity metric for registration. METHOD We evaluated phase symmetry segmentation, and Gaussian mixture model (GMM) and coherent point drift (CPD) registration methods on a pelvic phantom augmented with human soft tissue images. Additionally, we proposed and evaluated a simplified 3D bone segmentation algorithm we call Shadow-Peak (SP), which uses acoustic shadowing and peak intensities to detect bone surfaces. We paired this with a registration pipeline that optimizes the normalized cross-correlation (NCC) between distance maps of the segmented US-CT images. RESULTS SP segmentation combined with the proposed NCC registration successfully aligned tracked US volumes to the preoperative CT model in all trials, in contrast to the other techniques. SP with NCC achieved a median target registration error (TRE) of 2.44 mm (maximum 4.06 mm), when imaging all three anterior pelvic structures, and a mean runtime of 27.3 s. SP segmentation with CPD registration was the next most accurate combination: median TRE of 3.19 mm (maximum 6.07 mm), though a much faster runtime of 4.2 s. CONCLUSION We demonstrate an accurate, automatic image processing pipeline for intraoperative alignment of US-CT over the full pelvis and compare its performance with the state-of-the-art methods. The proposed methods are amenable to clinical implementation due to their high accuracy on realistic data and acceptably low runtimes.
Collapse
Affiliation(s)
- Prashant Pandey
- Department of Electrical and Computer Engineering, University of British Columbia, Vancouver, Canada.
| | - Pierre Guy
- Department of Orthopaedics, University of British Columbia, Vancouver, Canada
| | - Antony J Hodgson
- Department of Mechanical Engineering, University of British Columbia, Vancouver, Canada
| | - Rafeef Abugharbieh
- Department of Electrical and Computer Engineering, University of British Columbia, Vancouver, Canada
| |
Collapse
|
14
|
Niu K, Homminga J, Sluiter V, Sprengers A, Verdonschot N. Measuring relative positions and orientations of the tibia with respect to the femur using one-channel 3D-tracked A-mode ultrasound tracking system: A cadaveric study. Med Eng Phys 2018; 57:61-68. [PMID: 29759948 DOI: 10.1016/j.medengphy.2018.04.015] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2017] [Revised: 04/11/2018] [Accepted: 04/30/2018] [Indexed: 11/18/2022]
Abstract
The purpose of this study is to investigate the technical feasibility of measuring relative positions and orientations of the tibia with respect to the femur in an in-vitro experiment by using a 3D-tracked A-mode ultrasound system and to determine its accuracy of angular and translational measurements. As A-mode ultrasound is capable of detecting bone surface through soft tissue in a non-invasive manner, the combination of a single A-mode ultrasound transducer with an optical motion tracking system provides the possibility for digitizing the 3D locations of bony points at different anatomical regions on the thigh and the shank. After measuring bony points over a large area of both the femur and tibia, the bone models of the femur and tibia that were segmented from CT or MRI images were registered to the corresponding bony points. Then the relative position of the tibia with respect to the femur could be obtained and the angular and translational components could also be measured. A cadaveric experiment was conducted to assess its accuracy compared to the reference measurement obtained by optical markers fixed to intra-cortical bone pins placed in the femur and tibia. The results showed that the ultrasound system could achieve 0.49 ± 0.83°, 0.85 ± 1.86° and 1.85 ± 2.78° (mean ± standard deviation) errors for Flexion-Extension, Adduction-Abduction and External-Internal rotations, respectively, and -2.22 ± 3.62 mm, -2.80 ± 2.35 mm and -1.44 ± 2.90 mm errors for Anterior-Posterior, Proximal-Distal and Lateral-Medial translations, respectively. It was concluded that this technique is feasible and facilitates the integration of arrays of A-mode ultrasound transducers with an optical motion tracking system for non-invasive dynamic tibiofemoral kinematics measurement.
Collapse
Affiliation(s)
- Kenan Niu
- Laboratory of Biomechanical Engineering, Faculty of Engineering Technology, MIRA Institute, University of Twente, Drienerlolaan 5, 7522 NB Enschede, The Netherlands.
| | - Jasper Homminga
- Laboratory of Biomechanical Engineering, Faculty of Engineering Technology, MIRA Institute, University of Twente, Drienerlolaan 5, 7522 NB Enschede, The Netherlands
| | - Victor Sluiter
- Laboratory of Biomechanical Engineering, Faculty of Engineering Technology, MIRA Institute, University of Twente, Drienerlolaan 5, 7522 NB Enschede, The Netherlands
| | - André Sprengers
- Orthopaedic Research Lab, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Nico Verdonschot
- Laboratory of Biomechanical Engineering, Faculty of Engineering Technology, MIRA Institute, University of Twente, Drienerlolaan 5, 7522 NB Enschede, The Netherlands; Orthopaedic Research Lab, Radboud University Medical Center, Nijmegen, The Netherlands
| |
Collapse
|
15
|
Yang X, Tang S, Tasciotti E, Righetti R. Bone surface enhancement in ultrasound images using a new Doppler-based acquisition/processing method. Phys Med Biol 2018; 63:025035. [PMID: 29339568 DOI: 10.1088/1361-6560/aa9c5e] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
Abstract
Ultrasound (US) imaging has long been considered as a potential aid in orthopedic surgeries. US technologies are safe, portable and do not use radiations. This would make them a desirable tool for real-time assessment of fractures and to monitor fracture healing. However, image quality of US imaging methods in bone applications is limited by speckle, attenuation, shadow, multiple reflections and other imaging artifacts. While bone surfaces typically appear in US images as somewhat 'brighter' than soft tissue, they are often not easily distinguishable from the surrounding tissue. Therefore, US imaging methods aimed at segmenting bone surfaces need enhancement in image contrast prior to segmentation to improve the quality of the detected bone surface. In this paper, we present a novel acquisition/processing technique for bone surface enhancement in US images. Inspired by elastography and Doppler imaging methods, this technique takes advantage of the difference between the mechanical and acoustic properties of bones and those of soft tissues to make the bone surface more easily distinguishable in US images. The objective of this technique is to facilitate US-based bone segmentation methods and improve the accuracy of their outcomes. The newly proposed technique is tested both in in vitro and in vivo experiments. The results of these preliminary experiments suggest that the use of the proposed technique has the potential to significantly enhance the detectability of bone surfaces in noisy ultrasound images.
Collapse
Affiliation(s)
- Xu Yang
- Department of Electrical and Computer Engineering, Texas A&M University, College Station, TX 77843, United States of America
| | | | | | | |
Collapse
|
16
|
Toews M, Wells WM. Phantomless Auto-Calibration and Online Calibration Assessment for a Tracked Freehand 2-D Ultrasound Probe. IEEE TRANSACTIONS ON MEDICAL IMAGING 2018; 37:262-272. [PMID: 28910761 PMCID: PMC5808952 DOI: 10.1109/tmi.2017.2750978] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
This paper presents a method for automatically calibrating and assessing the calibration quality of an externally tracked 2-D ultrasound (US) probe by scanning arbitrary, natural tissues, as opposed a specialized calibration phantom as is the typical practice. A generative topic model quantifies the posterior probability of calibration parameters conditioned on local 2-D image features arising from a generic underlying substrate. Auto-calibration is achieved by identifying the maximum a-posteriori image-to-probe transform, and calibration quality is assessed online in terms of the posterior probability of the current image-to-probe transform. Both are closely linked to the 3-D point reconstruction error (PRE) in aligning feature observations arising from the same underlying physical structure in different US images. The method is of practical importance in that it operates simply by scanning arbitrary textured echogenic structures, e.g., in-vivo tissues in the context of the US-guided procedures, without requiring specialized calibration procedures or equipment. Observed data take the form of local scale-invariant features that can be extracted and fit to the model in near real-time. Experiments demonstrate the method on a public data set of in vivo human brain scans of 14 unique subjects acquired in the context of neurosurgery. Online calibration assessment can be performed at approximately 3 Hz for the US images of pixels. Auto-calibration achieves an internal mean PRE of 1.2 mm and a discrepancy of [2 mm, 6 mm] in comparison to the calibration via a standard phantom-based method.
Collapse
|
17
|
Park S, Jang J, Kim J, Kim YS, Kim C. Real-time Triple-modal Photoacoustic, Ultrasound, and Magnetic Resonance Fusion Imaging of Humans. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:1912-1921. [PMID: 28436857 DOI: 10.1109/tmi.2017.2696038] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/12/2023]
Abstract
Imaging that fuses multiple modes has become a useful tool for diagnosis and therapeutic monitoring. As a next step, real-time fusion imaging has attracted interest as for a tool to guide surgery. One widespread fusion imaging technique in surgery combines real-time ultrasound (US) imaging and pre-acquired magnetic resonance (MR) imaging. However, US imaging visualizes only structural information with relatively low contrast. Here, we present a photoacoustic (PA), US, and MR fusion imaging system which integrates a clinical PA and US imaging system with an optical tracking-based navigation sub-system. Through co-registration of pre-acquired MR and real-time PA/US images, overlaid PA, US, and MR images can be concurrently displayed in real time. We successfully acquired fusion images from a phantom and a blood vessel in a human forearm. This fusion imaging can complementarily delineate the morphological and vascular structure of tissues with good contrast and sensitivity, has a well-established user interface, and can be flexibly integrated with clinical environments. As a novel fusion imaging, the proposed triple-mode imaging can provide comprehensive image guidance in real time, and can potentially assist various surgeries.
Collapse
|
18
|
Abstract
Due to its real-time, non-radiation based three-dimensional (3D) imaging capabilities, ultrasound (US) has been incorporated into various orthopedic procedures. However, imaging artifacts, low signal-to-noise ratio (SNR) and bone boundaries appearing several mm in thickness make the analysis of US data difficult. This paper provides a review about the state-of-the-art bone segmentation and enhancement methods developed for two-dimensional (2D) and 3D US data. First, an overview for the appearance of bone surface response in B-mode data is presented. Then, classification of the proposed techniques in terms of the image information being used is provided. Specifically, the focus is given on segmentation and enhancement of B-mode US data. The review is concluded by discussing future directions of research and additional challenges which need to be overcome in order to make this imaging modality more successful in orthopedics.
Collapse
Affiliation(s)
- Ilker Hacihaliloglu
- Department of Biomedical Engineering, Rutgers University, NJ, USA
- Department of Radiology, Rutgers University Robert Wood Johnson Medical School, NJ, USA
| |
Collapse
|
19
|
Hacihaliloglu I. Enhancement of bone shadow region using local phase-based ultrasound transmission maps. Int J Comput Assist Radiol Surg 2017; 12:951-960. [PMID: 28285340 DOI: 10.1007/s11548-017-1556-y] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2017] [Accepted: 03/06/2017] [Indexed: 11/26/2022]
Abstract
PURPOSE Ultrasound is increasingly being employed in different orthopedic procedures as an imaging modality for real-time guidance. Nevertheless, low signal-to-noise-ratio and different imaging artifacts continue to hamper the success of ultrasound-based procedures. Bone shadow region is an important feature indicating the presence of bone/tissue interface in the acquired ultrasound data. Enhancement and automatic detection of this region could improve the sensitivity of ultrasound for imaging bone and result in improved guidance for various orthopedic procedures. METHODS In this work, a method is introduced for the enhancement of bone shadow regions from B-mode ultrasound data. The method is based on the combination of three different image phase features: local phase tensor, local weighted mean phase angle, and local phase energy. The combined local phase image features are used as an input to an [Formula: see text] norm-based contextual regularization method which emphasizes uncertainty in the shadow regions. The enhanced bone shadow images are automatically segmented and compared against expert segmentation. RESULTS Qualitative and quantitative validation was performed on 100 in vivo US scans obtained from five subjects by scanning femur and vertebrae bones. Validation against expert segmentation achieved a mean dice similarity coefficient of 0.88. CONCLUSIONS The encouraging results obtained in this initial study suggest that the proposed method is promising enough for further evaluation. The calculated bone shadow maps could be incorporated into different ultrasound bone segmentation and registration approaches as an additional feature.
Collapse
Affiliation(s)
- Ilker Hacihaliloglu
- Department of Biomedical Engineering, Rutgers University, Piscataway, NJ, USA.
- Department of Radiology, Rutgers University Robert Wood Johnson Medical School, New Brunswick, NJ, USA.
| |
Collapse
|
20
|
Hussain MA, Hodgson AJ, Abugharbieh R. Strain-Initialized Robust Bone Surface Detection in 3-D Ultrasound. ULTRASOUND IN MEDICINE & BIOLOGY 2017; 43:648-661. [PMID: 28017462 DOI: 10.1016/j.ultrasmedbio.2016.11.003] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/13/2016] [Revised: 10/21/2016] [Accepted: 11/02/2016] [Indexed: 06/06/2023]
Abstract
Three-dimensional ultrasound has been increasingly considered as a safe radiation-free alternative to radiation-based fluoroscopic imaging for surgical guidance during computer-assisted orthopedic interventions, but because ultrasound images contain significant artifacts, it is challenging to automatically extract bone surfaces from these images. We propose an effective way to extract 3-D bone surfaces using a surface growing approach that is seeded from 2-D bone contours. The initial 2-D bone contours are estimated from a combination of ultrasound strain images and envelope power images. Novel features of the proposed method include: (i) improvement of a previously reported 2-D strain imaging-based bone segmentation method by incorporation of a depth-dependent cumulative power of the envelope into the elastographic data; (ii) incorporation of an echo decorrelation measure-based weight to fuse the strain and envelope maps; (iii) use of local statistics of the bone surface candidate points to detect the presence of any bone discontinuity; and (iv) an extension of our 2-D bone contour into a 3-D bone surface by use of an effective surface growing approach. Our new method produced average improvements in the mean absolute error of 18% and 23%, respectively, on 2-D and 3-D experimental phantom data, compared with those of two state-of-the-art bone segmentation methods. Validation on 2-D and 3-D clinical in vivo data also reveals, respectively, an average improvement in the mean absolute fitting error of 55% and an 18-fold improvement in the computation time.
Collapse
Affiliation(s)
- Mohammad Arafat Hussain
- Department of Electrical and Computer Engineering, University of British Columbia, Vancouver, British Columbia, Canada.
| | - Antony J Hodgson
- Department of Mechanical Engineering, University of British Columbia, Vancouver, British Columbia, Canada
| | - Rafeef Abugharbieh
- Department of Electrical and Computer Engineering, University of British Columbia, Vancouver, British Columbia, Canada
| |
Collapse
|
21
|
A computer-aided tracking and motion analysis with ultrasound (CAT & MAUS) system for the description of hip joint kinematics. Int J Comput Assist Radiol Surg 2016; 11:1965-1977. [DOI: 10.1007/s11548-016-1443-y] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2016] [Accepted: 06/06/2016] [Indexed: 10/21/2022]
|
22
|
Chan HL, Wang HL, Fowlkes JB, Giannobile WV, Kripfgans OD. Non-ionizing real-time ultrasonography in implant and oral surgery: A feasibility study. Clin Oral Implants Res 2016; 28:341-347. [PMID: 26992276 DOI: 10.1111/clr.12805] [Citation(s) in RCA: 53] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/24/2016] [Indexed: 01/17/2023]
Abstract
PURPOSE Ultrasound imaging has potential to complement radiographic imaging modalities in implant and oral surgery given that it is non-ionizing and provides instantaneous images of anatomical structures. For application in oral and dental imaging, its qualities are dependent on its ability to accurately capture these complex structures. Therefore, the aim of this feasibility study was to investigate ultrasound to image soft tissue, hard tissue surface topography and specific vital structures. MATERIAL AND METHODS A clinical ultrasound scanner, paired with two 14-MHz transducers of different sizes (one for extraoral and the other for intraoral scans), was used to scan the following structures on a fresh cadaver: (i) the facial bone surface and soft tissue of maxillary anterior teeth, (ii) the greater palatine foramen; (iii) the mental foramen and (iv) the lingual nerve. Multiple measurements relevant to these structures were made on the ultrasound images and compared to those on cone-beam computed tomography (CBCT) scans and/or direct measurements. RESULTS Ultrasound imaging could delineate hard tissue surfaces, including enamel, root dentin and bone as well as soft tissue with high resolution (110 μm wavelength). The greater palatine foramen, mental foramen and lingual nerve were clearly shown in ultrasound images. Merging ultrasound and CBCT images demonstrated overall spatial accuracy of ultrasound images, which was corroborated by data gathered from direct measurements. CONCLUSION For the first time, this study provides proof-of-concept evidence that ultrasound can be a real-time and non-invasive alternative for the evaluation of oral and dental anatomical structures relevant for implant and oral surgery.
Collapse
Affiliation(s)
- Hsun-Liang Chan
- Department of Periodontics and Oral Medicine, University of Michigan School of Dentistry, Ann Arbor, MI, USA
| | - Hom-Lay Wang
- Department of Periodontics and Oral Medicine, University of Michigan School of Dentistry, Ann Arbor, MI, USA
| | - Jeffery Brian Fowlkes
- Department of Radiology, University of Michigan Medical School, Ann Arbor, MI, USA.,Department of Biomedical Engineering, College of Engineering, University of Michigan, Ann Arbor, MI, USA
| | - William V Giannobile
- Department of Periodontics and Oral Medicine, University of Michigan School of Dentistry, Ann Arbor, MI, USA.,Department of Biomedical Engineering, College of Engineering, University of Michigan, Ann Arbor, MI, USA
| | - Oliver D Kripfgans
- Department of Radiology, University of Michigan Medical School, Ann Arbor, MI, USA
| |
Collapse
|
23
|
Xiao Y, Yan CXB, Drouin S, De Nigris D, Kochanowska A, Collins DL. User-friendly freehand ultrasound calibration using Lego bricks and automatic registration. Int J Comput Assist Radiol Surg 2016; 11:1703-11. [PMID: 26984553 DOI: 10.1007/s11548-016-1368-5] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2015] [Accepted: 02/26/2016] [Indexed: 11/24/2022]
Abstract
PURPOSE As an inexpensive, noninvasive, and portable clinical imaging modality, ultrasound (US) has been widely employed in many interventional procedures for monitoring potential tissue deformation, surgical tool placement, and locating surgical targets. The application requires the spatial mapping between 2D US images and 3D coordinates of the patient. Although positions of the devices (i.e., ultrasound transducer) and the patient can be easily recorded by a motion tracking system, the spatial relationship between the US image and the tracker attached to the US transducer needs to be estimated through an US calibration procedure. Previously, various calibration techniques have been proposed, where a spatial transformation is computed to match the coordinates of corresponding features in a physical phantom and those seen in the US scans. However, most of these methods are difficult to use for novel users. METHODS We proposed an ultrasound calibration method by constructing a phantom from simple Lego bricks and applying an automated multi-slice 2D-3D registration scheme without volumetric reconstruction. The method was validated for its calibration accuracy and reproducibility. RESULTS Our method yields a calibration accuracy of [Formula: see text] mm and a calibration reproducibility of 1.29 mm. CONCLUSION We have proposed a robust, inexpensive, and easy-to-use ultrasound calibration method.
Collapse
Affiliation(s)
- Yiming Xiao
- McConnell Brain Imaging Center, Montreal Neurological Institute and Hospital, 3801 University Street, Montreal, Quebec, Canada, H3A 2B4.
| | - Charles Xiao Bo Yan
- Department of Radiology, McGill University Health Centre, Montreal, Quebec, Canada
| | - Simon Drouin
- McConnell Brain Imaging Center, Montreal Neurological Institute and Hospital, 3801 University Street, Montreal, Quebec, Canada, H3A 2B4
| | | | - Anna Kochanowska
- McConnell Brain Imaging Center, Montreal Neurological Institute and Hospital, 3801 University Street, Montreal, Quebec, Canada, H3A 2B4
| | - D Louis Collins
- McConnell Brain Imaging Center, Montreal Neurological Institute and Hospital, 3801 University Street, Montreal, Quebec, Canada, H3A 2B4
| |
Collapse
|
24
|
State of the Art of Ultrasound-Based Registration in Computer Assisted Orthopedic Interventions. COMPUTATIONAL RADIOLOGY FOR ORTHOPAEDIC INTERVENTIONS 2016. [DOI: 10.1007/978-3-319-23482-3_14] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/07/2023]
|
25
|
Minimally invasive registration for computer-assisted orthopedic surgery: combining tracked ultrasound and bone surface points via the P-IMLOP algorithm. Int J Comput Assist Radiol Surg 2015; 10:761-71. [PMID: 25895079 DOI: 10.1007/s11548-015-1188-z] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2015] [Accepted: 03/20/2015] [Indexed: 10/23/2022]
Abstract
PURPOSE We present a registration method for computer-assisted total hip replacement (THR) surgery, which we demonstrate to improve the state of the art by both reducing the invasiveness of current methods and increasing registration accuracy. A critical element of computer-guided procedures is the determination of the spatial correspondence between the patient and a computational model of patient anatomy. The current method for establishing this correspondence in robot-assisted THR is to register points intraoperatively sampled by a tracked pointer from the exposed proximal femur and, via auxiliary incisions, from the distal femur. METHODS In this paper, we demonstrate a noninvasive technique for sampling points on the distal femur using tracked B-mode ultrasound imaging and present a new algorithm for registering these data called Projected Iterative Most-Likely Oriented Point (P-IMLOP). Points and normal orientations of the distal bone surface are segmented from ultrasound images and registered to the patient model along with points sampled from the exposed proximal femur via a tracked pointer. RESULTS The proposed approach is evaluated using a bone- and tissue-mimicking leg phantom constructed to enable accurate assessment of experimental registration accuracy with respect to a CT-image-based model of the phantom. These experiments demonstrate that localization of the femur shaft is greatly improved by tracked ultrasound. The experiments further demonstrate that, for ultrasound-based data, the P-IMLOP algorithm significantly improves registration accuracy compared to the standard ICP algorithm. CONCLUSION Registration via tracked ultrasound and the P-IMLOP algorithm has high potential to reduce the invasiveness and improve the registration accuracy of computer-assisted orthopedic procedures.
Collapse
|
26
|
Automatic bone detection and soft tissue aware ultrasound-CT registration for computer-aided orthopedic surgery. Int J Comput Assist Radiol Surg 2015; 10:971-9. [PMID: 25895084 DOI: 10.1007/s11548-015-1208-z] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2015] [Accepted: 04/03/2015] [Indexed: 10/23/2022]
Abstract
PURPOSE The transfer of preoperative CT data into the tracking system coordinates within an operating room is of high interest for computer-aided orthopedic surgery. In this work, we introduce a solution for intra-operative ultrasound-CT registration of bones. METHODS We have developed methods for fully automatic real-time bone detection in ultrasound images and global automatic registration to CT. The bone detection algorithm uses a novel bone-specific feature descriptor and was thoroughly evaluated on both in-vivo and ex-vivo data. A global optimization strategy aligns the bone surface, followed by a soft tissue aware intensity-based registration to provide higher local registration accuracy. RESULTS We evaluated the system on femur, tibia and fibula anatomy in a cadaver study with human legs, where magnetically tracked bone markers were implanted to yield ground truth information. An overall median system error of 3.7 mm was achieved on 11 datasets. CONCLUSION Global and fully automatic registration of bones aquired with ultrasound to CT is feasible, with bone detection and tracking operating in real time for immediate feedback to the surgeon.
Collapse
|
27
|
Hacihaliloglu I, Rasoulian A, Rohling RN, Abolmaesumi P. Local phase tensor features for 3-D ultrasound to statistical shape+pose spine model registration. IEEE TRANSACTIONS ON MEDICAL IMAGING 2014; 33:2167-2179. [PMID: 24988590 DOI: 10.1109/tmi.2014.2332571] [Citation(s) in RCA: 32] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
Most conventional spine interventions are performed under X-ray fluoroscopy guidance. In recent years, there has been a growing interest to develop nonionizing imaging alternatives to guide these procedures. Ultrasound guidance has emerged as a leading alternative. However, a challenging problem is automatic identification of the spinal anatomy in ultrasound data. In this paper, we propose a local phase-based bone feature enhancement technique that can robustly identify the spine surface in ultrasound images. The local phase information is obtained using a gradient energy tensor filter. This information is used to construct local phase tensors in ultrasound images, which highlight the spine surface. We show that our proposed approach results in a more distinct enhancement of the bone surfaces compared to recently proposed techniques based on monogenic scale-space filters and logarithmic Gabor filters. We also demonstrate that registration accuracy of a statistical shape+pose model of the spine to 3-D ultrasound images can be significantly improved, using the proposed method, compared to those obtained using monogenic scale-space filters and logarithmic Gabor filters.
Collapse
|
28
|
Jang T, Lee K. A novel registration method for computer-assisted total knee arthroplasty using a patient-specific registration guide. Surg Innov 2013; 21:80-9. [PMID: 24145692 DOI: 10.1177/1553350613505917] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Total knee arthroplasty (TKA) is a surgical method for replacing a degenerated or diseased knee joint that can no longer perform daily functions with an artificial knee implant. In TKA, the artificial knee implant should be inserted such that it aligns well with the mechanical axis of the leg. Thus, precise bone cutting is essential. To improve TKA outcomes, a registration process is performed to locate the predetermined bone cutting area by calculating the position and posture of the femur and tibia. In this article, we propose a patient-specific registration guide that is able to significantly reduce registration time and effort without loss of accuracy. Furthermore, the patient-specific registration guide can be implemented with real-time registration, allowing continuous surgical information to be provided without the insertion of any tracking devices. The precision and accuracy of the proposed registration guide were confirmed through animal tests with a digitizer, stereo camera, and linear motion generator. The error of our registration method, including measurement and guide attachment errors, reached a maximum of 0.321 mm for one pair of cow legs.
Collapse
Affiliation(s)
- Taeho Jang
- 1Seoul National University, Seoul, South Korea
| | | |
Collapse
|
29
|
Beitzel J, Ahmadi SA, Karamalis A, Wein W, Navab N. Ultrasound bone detection using patient-specific CT prior. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2013; 2012:2664-7. [PMID: 23366473 DOI: 10.1109/embc.2012.6346512] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Registration of pre-operative CT datasets to intra-operative 3D freehand ultrasound has been of high interest for computer assisted orthopedic surgery. Feature-based registration relies on an accurate detection of the bone surface in the B-mode ultrasound images. In this work we present a fully automatic bone detection approach for US. The pre-operative CT is utilized to create a patient-specific bone model for our joint detection-registration framework. The model provides a geometric constraint for accurate and robust detection. Simultaneously to the detection, our method yields a close estimate of the rigid transformation from US to CT, which can be used as an initialization for further refinement through sophisticated intensity-/feature-based registration methods. We evaluated our approach on datasets of the human femur acquired in a cadaver study and demonstrate a mean bone detection error of below 0.4 mm.
Collapse
Affiliation(s)
- Julian Beitzel
- Technische Universität München in Munich, Germany. fbeitzel at in.tum.de
| | | | | | | | | |
Collapse
|
30
|
Rodriguez y Baena F, Hawke T, Jakopec M. A bounded iterative closest point method for minimally invasive registration of the femur. Proc Inst Mech Eng H 2013; 227:1135-44. [PMID: 23959859 DOI: 10.1177/0954411913500948] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
This article describes a novel method for image-based, minimally invasive registration of the femur, for application to computer-assisted unicompartmental knee arthroplasty. The method is adapted from the well-known iterative closest point algorithm. By utilising an estimate of the hip centre on both the preoperative model and intraoperative patient anatomy, the proposed 'bounded' iterative closest point algorithm robustly produces accurate varus-valgus and anterior-posterior femoral alignment with minimal distal access requirements. Similar to the original iterative closest point implementation, the bounded iterative closest point algorithm converges monotonically to the closest minimum, and the presented case includes a common method for global minimum identification. The bounded iterative closest point method has shown to have exceptional resistance to noise during feature acquisition through simulations and in vitro plastic bone trials, where its performance is compared to a standard form of the iterative closest point algorithm.
Collapse
|
31
|
Karamalis A, Wein W, Klein T, Navab N. Ultrasound confidence maps using random walks. Med Image Anal 2012; 16:1101-12. [PMID: 22906822 DOI: 10.1016/j.media.2012.07.005] [Citation(s) in RCA: 63] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2011] [Revised: 07/19/2012] [Accepted: 07/20/2012] [Indexed: 10/28/2022]
Abstract
Advances in ultrasound system development have led to a substantial improvement of image quality and to an increased use of ultrasound in clinical practice. Nevertheless, ultrasound attenuation and shadowing artifacts cannot be entirely avoided and continue to challenge medical image computing algorithms. We introduce a method for estimating a per-pixel confidence in the information depicted by ultrasound images, referred to as an ultrasound confidence map, which emphasizes uncertainty in attenuated and/or shadow regions. Our main novelty is the modeling of the confidence estimation problem within a random walks framework by taking into account ultrasound specific constraints. The solution to the random walks equilibrium problem is global and takes the entire image content into account. As a result, our method is applicable to a variety of ultrasound image acquisition setups. We demonstrate the applicability of our confidence maps for ultrasound shadow detection, 3D freehand ultrasound reconstruction, and multi-modal image registration.
Collapse
Affiliation(s)
- Athanasios Karamalis
- Computer Aided Medical Procedures (CAMP), Technische Universität München, München, Germany.
| | | | | | | |
Collapse
|
32
|
Ultrasound-CT registration of vertebrae without reconstruction. Int J Comput Assist Radiol Surg 2012; 7:901-9. [DOI: 10.1007/s11548-012-0771-9] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2012] [Accepted: 05/31/2012] [Indexed: 10/28/2022]
|
33
|
Rasoulian A, Abolmaesumi P, Mousavi P. Feature-based multibody rigid registration of CT and ultrasound images of lumbar spine. Med Phys 2012; 39:3154-66. [DOI: 10.1118/1.4711753] [Citation(s) in RCA: 27] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
|
34
|
Kuiran Chen T, Heffter T, Lasso A, Pinter C, Abolmaesumi P, Burdette EC, Fichtinger G. Automated intraoperative calibration for prostate cancer brachytherapy. Med Phys 2012; 38:6285-99. [PMID: 22047394 DOI: 10.1118/1.3651690] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
PURPOSE Prostate cancer brachytherapy relies on an accurate spatial registration between the implant needles and the TRUS image, called "calibration". The authors propose a new device and a fast, automatic method to calibrate the brachytherapy system in the operating room, with instant error feedback. METHODS A device was CAD-designed and precision-engineered, which mechanically couples a calibration phantom with an exact replica of the standard brachytherapy template. From real-time TRUS images acquired from the calibration device and processed by the calibration system, the coordinate transformation between the brachytherapy template and the TRUS images was computed automatically. The system instantly generated a report of the target reconstruction accuracy based on the current calibration outcome. RESULTS Four types of validation tests were conducted. First, 50 independent, real-time calibration trials yielded an average of 0.57 ± 0.13 mm line reconstruction error (LRE) relative to ground truth. Second, the averaged LRE was 0.37 ± 0.25 mm relative to ground truth in tests with six different commercial TRUS scanners operating at similar imaging settings. Furthermore, testing with five different commercial stepper systems yielded an average of 0.29 ± 0.16 mm LRE relative to ground truth. Finally, the system achieved an average of 0.56 ± 0.27 mm target registration error (TRE) relative to ground truth in needle insertion tests through the template in a water tank. CONCLUSIONS The proposed automatic, intraoperative calibration system for prostate cancer brachytherapy has achieved high accuracy, precision, and robustness.
Collapse
|
35
|
Hacihaliloglu I, Abugharbieh R, Hodgson AJ, Rohling RN, Guy P. Automatic bone localization and fracture detection from volumetric ultrasound images using 3-D local phase features. ULTRASOUND IN MEDICINE & BIOLOGY 2012; 38:128-144. [PMID: 22104523 DOI: 10.1016/j.ultrasmedbio.2011.10.009] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/13/2011] [Revised: 09/05/2011] [Accepted: 10/13/2011] [Indexed: 05/31/2023]
Abstract
This article presents a novel method for bone segmentation from three-dimensional (3-D) ultrasound images that derives intensity-invariant 3-D local image phase measures that are then employed for extracting ridge-like features similar to those that occur at soft tissue/bone interfaces. The main contributions in this article include: (1) the extension of our previously proposed phase-symmetry-based bone surface extraction from two-dimensional (2-D) to 3-D images using 3-D Log-Gabor filters; (2) the design of a new framework for accuracy evaluation based on using computed tomography as a gold standard that allows the assessment of surface localization accuracy across the entire 3-D surface; (3) the quantitative validation of accuracy of our 3-D phase-processing approach on both intact and fractured bone surfaces using phantoms and ex vivo 3-D ultrasound scans; and (4) the qualitative validation obtained by scanning emergency room patients with distal radius and pelvis fractures. We show a 41% improvement in surface localization error over the previous 2-D phase symmetry method. The results demonstrate clearly visible segmentations of bone surfaces with a localization accuracy of <0.6 mm and mean errors in estimating fracture displacements below 0.6 mm. The results show that the proposed method is successful even for situations when the bone surface response is weak due to shadowing from muscle and fascia interfaces above the bone, which is a situation where the 2-D method fails.
Collapse
Affiliation(s)
- Ilker Hacihaliloglu
- Department of Electrical and Computer Engineering, University of British Columbia, Vancouver, BC, Canada
| | | | | | | | | |
Collapse
|
36
|
Yan CXB, Goulet B, Chen SJS, Tampieri D, Collins DL. Validation of automated ultrasound-CT registration of vertebrae. Int J Comput Assist Radiol Surg 2011; 7:601-10. [DOI: 10.1007/s11548-011-0666-1] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2011] [Accepted: 11/08/2011] [Indexed: 10/15/2022]
|
37
|
Melvaer EL, Mørken K, Samset E. A motion constrained cross-wire phantom for tracked 2D ultrasound calibration. Int J Comput Assist Radiol Surg 2011; 7:611-20. [PMID: 22009307 DOI: 10.1007/s11548-011-0661-6] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2010] [Accepted: 10/04/2011] [Indexed: 10/16/2022]
Abstract
PURPOSE Ultrasound-guided 3D interventions require calibration to relate real-time 2D images with the position and orientation of the ultrasound probe. Capturing several images of a single fixed point from different viewpoints is a simple and commonly used approach, but it is cumbersome and tedious. A new phantom for calibration was designed, built and tested to simplify this process. METHODS A mechanical phantom that restricts the motion of the ultrasound probe was designed such that the ultrasound image always captures a designated fixed point. Software was implemented which computes calibration parameters. Although the software provides no scientific novelty, it is required to demonstrate the proof of concept and to assess the accuracy and precision of the calibration phantom. The software also illustrates how the phantom enables the fixed point to be located automatically, both in tracker device coordinates and in image pixel coordinates. RESULTS The phantom was used to capture several hundred images of a single fixed point in less than 1 min, with different probe positions and orientations around the fixed point and with the single fixed point located in different parts of the ultrasound image. It would not be feasible to capture the same number of images by manual alignment of the probe with the fixed point. CONCLUSION Images for single fixed point calibration can be captured easily and quickly with a new calibration phantom. Since a larger number of images can be used to compute the required parameters, the calibration robustness is increased.
Collapse
Affiliation(s)
- Eivind Lyche Melvaer
- Centre of Mathematics for Applications, University of Oslo, P.O. Box 1053, Blindern, 0316, Oslo, Norway.
| | | | | |
Collapse
|
38
|
Schumann S, Nolte LP, Zheng G. Compensation of sound speed deviations in 3-D B-mode ultrasound for intraoperative determination of the anterior pelvic plane. ACTA ACUST UNITED AC 2011; 16:88-97. [PMID: 21984516 DOI: 10.1109/titb.2011.2170844] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
An accurate determination of the pelvic orientation is inevitable for the correct cup prosthesis placement of navigated total hip arthroplasties. Conventionally, this step is accomplished by percutaneous palpation of anatomic landmarks. Sterility issues and an increased landmark localization error for obese patients lead to the application of B-mode ultrasound imaging in the field of computer-assisted orthopedic surgery. Many approaches have been proposed in the literature to replace the percutaneous digitization by 3-D B-mode ultrasound imaging. However, the correct depth localization of the pelvic landmarks could be significantly affected by the acoustic properties of the penetrated tissues. Imprecise depth estimation could lead to a miscalculation of the pelvic orientation and subsequently to a misalignment of the acetabular cup implant. But so far, no solution has been presented, which compensates for acoustic property differences for correct depth estimation. In this paper, we present a novel approach to determine pelvic orientation from ultrasound images by applying a hierarchical registration scheme based on patch statistical shape models to compensate for differences in speed of sound. The method was validated based on plastic bones and a cadaveric specimen.
Collapse
Affiliation(s)
- Steffen Schumann
- Institute for Surgical Technology and Biomechanics, University of Bern, Bern, Switzerland.
| | | | | |
Collapse
|
39
|
Hacihaliloglu I, Abugharbieh R, Hodgson AJ, Rohling RN. Automatic adaptive parameterization in local phase feature-based bone segmentation in ultrasound. ULTRASOUND IN MEDICINE & BIOLOGY 2011; 37:1689-1703. [PMID: 21821346 DOI: 10.1016/j.ultrasmedbio.2011.06.006] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/21/2010] [Revised: 06/02/2011] [Accepted: 06/14/2011] [Indexed: 05/31/2023]
Abstract
Intensity-invariant local phase features based on Log-Gabor filters have been recently shown to produce highly accurate localizations of bone surfaces from three-dimensional (3-D) ultrasound. A key challenge, however, remains in the proper selection of filter parameters, whose values have so far been chosen empirically and kept fixed for a given image. Since Log-Gabor filter responses widely change when varying the filter parameters, actual parameter selection can significantly affect the quality of extracted features. This article presents a novel method for contextual parameter selection that autonomously adapts to image content. Our technique automatically selects the scale, bandwidth and orientation parameters of Log-Gabor filters for optimizing local phase symmetry. The proposed approach incorporates principle curvature computed from the Hessian matrix and directional filter banks in a phase scale-space framework. Evaluations performed on carefully designed in vitro experiments demonstrate 35% improvement in accuracy of bone surface localization compared with empirically-set parameterization results. Results from a pilot in vivo study on human subjects, scanned in the operating room, show similar improvements.
Collapse
Affiliation(s)
- Ilker Hacihaliloglu
- Department of Electrical and Computer Engineering, University of British Columbia, Vancouver, BC, Canada
| | | | | | | |
Collapse
|
40
|
Talib H, Peterhans M, García J, Styner M, González Ballester MA. Information Filtering for Ultrasound-Based Real-Time Registration. IEEE Trans Biomed Eng 2011; 58:531-40. [DOI: 10.1109/tbme.2010.2063703] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
41
|
Fieten LJ, Radermacher K, Kernenbach MA, Heger S. Integration of model-based weighting into an ICP variant to account for measurement errors in intra-operative A-Mode ultrasound-based registration. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2010; 2010:6264-7. [PMID: 21097352 DOI: 10.1109/iembs.2010.5628071] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
This paper addresses error modeling in A-Mode ultrasound- (US-) based registration and integration of model-based weighting into the Random-ICP (R-ICP) algorithm. The R-ICP is a variant of the Iterative Closest Point (ICP) algorithm, and it was suggested for surface-based registration using A-Mode US in the context of skull surgery. In that application area the R-ICP could yield high accuracy even in case of a small number of data points and a very inaccurate user-interactive pre-registration. However, it cannot cope with unequal point uncertainty, which is an important drawback in the context of hip surgery: Uncertainty about the average speed of sound is an error source, whose impact on the registration accuracy increases with the thickness of the scanned soft tissue. It can, therefore, lead to considerable localization errors if a thick soft tissue layer is scanned, and it might vary a lot from data point to data point as the soft tissue thickness is inhomogeneous. The present work investigates how to account for this error source considering also other error sources such as the establishment of point correspondences. Simulation results show that registration accuracy can be substantially improved when model-based weighting is integrated into the R-ICP.
Collapse
Affiliation(s)
- Lorenz J Fieten
- Medical Engineering, Helmholtz Institute for Biomedical Engineering, RWTH Aachen University, Germany.
| | | | | | | |
Collapse
|
42
|
Towards accurate, robust and practical ultrasound-CT registration of vertebrae for image-guided spine surgery. Int J Comput Assist Radiol Surg 2010; 6:523-37. [DOI: 10.1007/s11548-010-0536-2] [Citation(s) in RCA: 30] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2010] [Accepted: 10/11/2010] [Indexed: 10/18/2022]
|
43
|
Prager RW, Ijaz UZ, Gee AH, Treece GM. Three-dimensional ultrasound imaging. Proc Inst Mech Eng H 2010; 224:193-223. [PMID: 20349815 DOI: 10.1243/09544119jeim586] [Citation(s) in RCA: 64] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
This review is about the development of three-dimensional (3D) ultrasonic medical imaging, how it works, and where its future lies. It assumes knowledge of two-dimensional (2D) ultrasound, which is covered elsewhere in this issue. The three main ways in which 3D ultrasound may be acquired are described: the mechanically swept 3D probe, the 2D transducer array that can acquire intrinsically 3D data, and the freehand 3D ultrasound. This provides an appreciation of the constraints implicit in each of these approaches together with their strengths and weaknesses. Then some of the techniques that are used for processing the 3D data and the way this can lead to information of clinical value are discussed. A table is provided to show the range of clinical applications reported in the literature. Finally, the discussion relating to the technology and its clinical applications to explain why 3D ultrasound has been relatively slow to be adopted in routine clinics is drawn together and the issues that will govern its development in the future explored.
Collapse
Affiliation(s)
- R W Prager
- Department of Engineering, University of Cambridge, Cambridge, UK.
| | | | | | | |
Collapse
|
44
|
Schumann S, Puls M, Ecker T, Schwaegli T, Stifter J, Siebenrock KA, Zheng G. Determination of Pelvic Orientation from Ultrasound Images Using Patch-SSMs and a Hierarchical Speed of Sound Compensation Strategy. INFORMATION PROCESSING IN COMPUTER-ASSISTED INTERVENTIONS 2010. [DOI: 10.1007/978-3-642-13711-2_15] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
|
45
|
Mozes A, Chang TC, Arata L, Zhao W. Three-dimensional A-mode ultrasound calibration and registration for robotic orthopaedic knee surgery. Int J Med Robot 2009; 6:91-101. [PMID: 20014154 DOI: 10.1002/rcs.294] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Affiliation(s)
- Alon Mozes
- Department of Biomedical Engineering, University of Miami, 1251 Memorial Drive, Coral Gables, FL 33146, USA
| | | | | | | |
Collapse
|
46
|
Huang X, Ren J, Guiraudon G, Boughner D, Peters TM. Rapid dynamic image registration of the beating heart for diagnosis and surgical navigation. IEEE TRANSACTIONS ON MEDICAL IMAGING 2009; 28:1802-1814. [PMID: 19520634 DOI: 10.1109/tmi.2009.2024684] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/27/2023]
Abstract
Dynamic cardiac magnetic resonance imaging (MR) and computed tomography (CT) provide cardiologists and cardiac surgeons with high-quality 4-D images for diagnosis and therapy, yet the effective use of these high-quality anatomical models remains a challenge. Ultrasound (US) is a flexible imaging tool, but the US images produced are often difficult to interpret unless they are placed within their proper 3-D anatomical context. The ability to correlate real-time 3-D US volumes (RT3D US) with dynamic MR/CT images would offer a significant contribution to improve the quality of cardiac procedures. In this paper, we present a rapid two-step method for registering RT3D US to high-quality dynamic 3-D MR/CT images of the beating heart. This technique overcomes some major limitations of image registration (such as the correct registration result not necessarily occurring at the maximum of the mutual information (MI) metric) using the MI metric. We demonstrate the effectiveness of our method in a dynamic heart phantom (DHP) study and a human subject study. The achieved mean target registration error of CT+US images in the phantom study is 2.59 mm. Validation using human MR/US volumes shows a target registration error of 1.76 mm. We anticipate that this technique will substantially improve the quality of cardiac diagnosis and therapies.
Collapse
Affiliation(s)
- Xishi Huang
- Imaging Research Labs, Robarts Research Institute, London, ON N6A5K8, Canada.
| | | | | | | | | |
Collapse
|
47
|
Hacihaliloglu I, Abugharbieh R, Hodgson AJ, Rohling RN. Bone surface localization in ultrasound using image phase-based features. ULTRASOUND IN MEDICINE & BIOLOGY 2009; 35:1475-87. [PMID: 19616363 DOI: 10.1016/j.ultrasmedbio.2009.04.015] [Citation(s) in RCA: 45] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/31/2008] [Revised: 04/01/2009] [Accepted: 04/18/2009] [Indexed: 05/24/2023]
Abstract
Current practice in orthopedic surgery relies on intraoperative fluoroscopy as the main imaging modality for localization and visualization of bone tissue, fractures, implants and surgical tool positions. Ultrasound (US) has recently emerged as a potential nonionizing imaging alternative that promises safer operation while remaining relatively cheap and widely available. US images, however, often depict bone structures poorly, making automatic, accurate and robust localization of bone surfaces quite challenging. In this paper, we present a novel technique for automatic bone surface localization in US that uses local phase image information to derive symmetry-based features corresponding to tissue/bone interfaces through the use of 2-D Log-Gabor filters. We validate the performance of the proposed approach quantitatively using realistic phantom and in vitro experiments as well as qualitatively on in vivo data. Results demonstrate that the proposed technique detects bone surfaces with a localization mean error below 0.40 mm. Furthermore, small gaps between bone fragments can be detected with fracture displacement mean error below 0.33 mm for vertical misalignments, and 0.47 mm for horizontal misalignments.
Collapse
Affiliation(s)
- Ilker Hacihaliloglu
- Department of Electrical and Computer Engineering, University of British Columbia, Vancouver, BC, Canada
| | | | | | | |
Collapse
|
48
|
Huang X, Moore J, Guiraudon G, Jones DL, Bainbridge D, Ren J, Peters TM. Dynamic 2D ultrasound and 3D CT image registration of the beating heart. IEEE TRANSACTIONS ON MEDICAL IMAGING 2009; 28:1179-1189. [PMID: 19131293 DOI: 10.1109/tmi.2008.2011557] [Citation(s) in RCA: 31] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/27/2023]
Abstract
Two-dimensional ultrasound (US) is widely used in minimally invasive cardiac procedures due to its convenience of use and noninvasive nature. However, the low quality of US images often limits their utility as a means for guiding procedures, since it is often difficult to relate the images to their anatomical context. To improve the interpretability of the US images while maintaining US as a flexible anatomical and functional real-time imaging modality, we describe a multimodality image navigation system that integrates 2D US images with their 3D context by registering them to high quality preoperative models based on magnetic resonance imaging (MRI) or computed tomography (CT) images. The mapping from such a model to the patient is completed using spatial and temporal registrations. Spatial registration is performed by a two-step rapid registration method that first approximately aligns the two images as a starting point to an automatic registration procedure. Temporal alignment is performed with the aid of electrocardiograph (ECG) signals and a latency compensation method. Registration accuracy is measured by calculating the TRE. Results show that the error between the US and preoperative images of a beating heart phantom is 1.7 +/-0.4 mm, with a similar performance being observed in in vivo animal experiments.
Collapse
Affiliation(s)
- Xishi Huang
- Imaging Research Laboratories, Robarts Research Institute, London, ON N6A5K8, Canada.
| | | | | | | | | | | | | |
Collapse
|
49
|
|
50
|
Chen TK, Thurston AD, Ellis RE, Abolmaesumi P. A real-time freehand ultrasound calibration system with automatic accuracy feedback and control. ULTRASOUND IN MEDICINE & BIOLOGY 2009; 35:79-93. [PMID: 18829150 DOI: 10.1016/j.ultrasmedbio.2008.07.004] [Citation(s) in RCA: 29] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/06/2007] [Revised: 04/16/2008] [Accepted: 07/15/2008] [Indexed: 05/26/2023]
Abstract
This article describes a fully automatic, real-time, freehand ultrasound calibration system. The system was designed to be simple and sterilizable, intended for operating-room usage. The calibration system employed an automatic-error-retrieval and accuracy-control mechanism based on a set of ground-truth data. Extensive validations were conducted on a data set of 10,000 images in 50 independent calibration trials to thoroughly investigate the accuracy, robustness, and performance of the calibration system. On average, the calibration accuracy (measured in three-dimensional reconstruction error against a known ground truth) of all 50 trials was 0.66 mm. In addition, the calibration errors converged to submillimeter in 98% of all trials within 12.5 s on average. Overall, the calibration system was able to consistently, efficiently and robustly achieve high calibration accuracy with real-time performance.
Collapse
|