1
|
Zeng H, Zhou K, Ge S, Gao Y, Zhao J, Gao S, Zheng R. Anatomical Prior and Inter-Slice Consistency for Semi-Supervised Vertebral Structure Detection in 3D Ultrasound Volume. IEEE J Biomed Health Inform 2024; 28:2211-2222. [PMID: 38289848 DOI: 10.1109/jbhi.2024.3360102] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/01/2024]
Abstract
Three-dimensional (3D) ultrasound imaging technique has been applied for scoliosis assessment, but the current assessment method only uses coronal projection images and cannot illustrate the 3D deformity and vertebra rotation. The vertebra detection is essential to reveal 3D spine information, but the detection task is challenging due to complex data and limited annotations. We propose VertMatch to detect vertebral structures in 3D ultrasound volume containing a detector and classifier. The detector network finds the potential positions of structures on transverse slice globally, and then the local patches are cropped based on detected positions. The classifier is used to distinguish whether the patches contain real vertebral structures and screen the predicted positions from the detector. VertMatch utilizes unlabeled data in a semi-supervised manner, and we develop two novel techniques for semi-supervised learning: 1) anatomical prior is used to acquire high-quality pseudo labels; 2) inter-slice consistency is used to utilize more unlabeled data by inputting multiple adjacent slices. Experimental results demonstrate that VertMatch can detect vertebra accurately in ultrasound volume and outperforms state-of-the-art methods. Moreover, VertMatch is also validated in automatic spinous process angle measurement on forty subjects with scoliosis, and the results illustrate that it can be a promising approach for the 3D assessment of scoliosis.
Collapse
|
2
|
Yang Y, Wu R, Chen D, Fei C, Li D, Yang Y. An improved Fourier Ptychography algorithm for ultrasonic array imaging. Comput Biol Med 2023; 163:107157. [PMID: 37352636 DOI: 10.1016/j.compbiomed.2023.107157] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2022] [Revised: 06/03/2023] [Accepted: 06/07/2023] [Indexed: 06/25/2023]
Abstract
Inspired by the optical imaging algorithm, the Fourier Ptychography (FP) algorithm is adopted to improve the resolution of ultrasonic array imaging. In the FP algorithm, the steady-state spectrum is utilized to recover the high-resolution ultrasonic images. Meanwhile, the parameters of FP algorithm are empirical, which can affect the imaging quality of ultrasonic array. Then the particle swarm optimization (PSO) algorithm is used to optimize the parameters of FP algorithm to further improve the imaging quality of ultrasonic array. The tungsten imaging experiments and pig eye imaging experiments are conducted to demonstrate the feasibility and effectiveness of the developed algorithm. In addition, the proposed algorithm and the coherent wave superposition (CWS) algorithm are both based on single plane wave (SPW) algorithms and they are then compared. The results show that the CWS algorithm and FP algorithm have good longitudinal and lateral resolutions, respectively. The particle swarm optimization-based FP (PSOFP) imaging algorithm has both excellent lateral and longitudinal resolutions. The average lateral resolution of PSOFP imaging algorithm is improved by 34.47% compared with CWS imaging algorithm in the tungsten wires experiments, and the lateral boundary structure width of the lens is improved by 49.48% in the pig eye experiments. The proposed algorithm can effectively improve the ultrasonic imaging quality for medical application.
Collapse
Affiliation(s)
- Yaoyao Yang
- School of Microelectronics, Xidian University, Xi'an, 710071, China
| | - Runcong Wu
- School of Microelectronics, Xidian University, Xi'an, 710071, China
| | - Dongdong Chen
- School of Microelectronics, Xidian University, Xi'an, 710071, China.
| | - Chunlong Fei
- School of Microelectronics, Xidian University, Xi'an, 710071, China; Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China.
| | - Di Li
- School of Microelectronics, Xidian University, Xi'an, 710071, China
| | - Yintang Yang
- School of Microelectronics, Xidian University, Xi'an, 710071, China
| |
Collapse
|
3
|
Droppelmann G, Tello M, García N, Greene C, Jorquera C, Feijoo F. Lateral elbow tendinopathy and artificial intelligence: Binary and multilabel findings detection using machine learning algorithms. Front Med (Lausanne) 2022; 9:945698. [PMID: 36213676 PMCID: PMC9537568 DOI: 10.3389/fmed.2022.945698] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2022] [Accepted: 08/29/2022] [Indexed: 11/13/2022] Open
Abstract
Background Ultrasound (US) is a valuable technique to detect degenerative findings and intrasubstance tears in lateral elbow tendinopathy (LET). Machine learning methods allow supporting this radiological diagnosis. Aim To assess multilabel classification models using machine learning models to detect degenerative findings and intrasubstance tears in US images with LET diagnosis. Materials and methods A retrospective study was performed. US images and medical records from patients with LET diagnosis from January 1st, 2017, to December 30th, 2018, were selected. Datasets were built for training and testing models. For image analysis, features extraction, texture characteristics, intensity distribution, pixel-pixel co-occurrence patterns, and scales granularity were implemented. Six different supervised learning models were implemented for binary and multilabel classification. All models were trained to classify four tendon findings (hypoechogenicity, neovascularity, enthesopathy, and intrasubstance tear). Accuracy indicators and their confidence intervals (CI) were obtained for all models following a K-fold-repeated-cross-validation method. To measure multilabel prediction, multilabel accuracy, sensitivity, specificity, and receiver operating characteristic (ROC) with 95% CI were used. Results A total of 30,007 US images (4,324 exams, 2,917 patients) were included in the analysis. The RF model presented the highest mean values in the area under the curve (AUC), sensitivity, and also specificity by each degenerative finding in the binary classification. The AUC and sensitivity showed the best performance in intrasubstance tear with 0.991 [95% CI, 099, 0.99], and 0.775 [95% CI, 0.77, 0.77], respectively. Instead, specificity showed upper values in hypoechogenicity with 0.821 [95% CI, 0.82, −0.82]. In the multilabel classifier, RF also presented the highest performance. The accuracy was 0.772 [95% CI, 0.771, 0.773], a great macro of 0.948 [95% CI, 0.94, 0.94], and a micro of 0.962 [95% CI, 0.96, 0.96] AUC scores were detected. Diagnostic accuracy, sensitivity, and specificity with 95% CI were calculated. Conclusion Machine learning algorithms based on US images with LET presented high diagnosis accuracy. Mainly the random forest model shows the best performance in binary and multilabel classifiers, particularly for intrasubstance tears.
Collapse
Affiliation(s)
- Guillermo Droppelmann
- Research Center on Medicine, Exercise, Sport and Health, MEDS Clinic, Santiago, RM, Chile
- Health Sciences Ph.D. Program, Universidad Católica de Murcia UCAM, Murcia, Spain
- Principles and Practice of Clinical Research (PPCR), Harvard T.H. Chan School of Public Health, Boston, MA, United States
- *Correspondence: Guillermo Droppelmann,
| | - Manuel Tello
- School of Industrial Engineering, Pontificia Universidad Católica de Valparaíso, Valparaíso, Chile
| | - Nicolás García
- MSK Diagnostic and Interventional Radiology Department, MEDS Clinic, Santiago, RM, Chile
| | - Cristóbal Greene
- Hand and Elbow Unit, Department of Orthopaedic Surgery, MEDS Clinic, Santiago, RM, Chile
| | - Carlos Jorquera
- Facultad de Ciencias, Escuela de Nutrición y Dietética, Universidad Mayor, Santiago, RM, Chile
| | - Felipe Feijoo
- School of Industrial Engineering, Pontificia Universidad Católica de Valparaíso, Valparaíso, Chile
| |
Collapse
|
4
|
Huang Z, Zhao R, Leung FHF, Banerjee S, Lee TTY, Yang D, Lun DPK, Lam KM, Zheng YP, Ling SH. Joint Spine Segmentation and Noise Removal From Ultrasound Volume Projection Images With Selective Feature Sharing. IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:1610-1624. [PMID: 35041596 DOI: 10.1109/tmi.2022.3143953] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Volume Projection Imaging from ultrasound data is a promising technique to visualize spine features and diagnose Adolescent Idiopathic Scoliosis. In this paper, we present a novel multi-task framework to reduce the scan noise in volume projection images and to segment different spine features simultaneously, which provides an appealing alternative for intelligent scoliosis assessment in clinical applications. Our proposed framework consists of two streams: i) A noise removal stream based on generative adversarial networks, which aims to achieve effective scan noise removal in a weakly-supervised manner, i.e., without paired noisy-clean samples for learning; ii) A spine segmentation stream, which aims to predict accurate bone masks. To establish the interaction between these two tasks, we propose a selective feature-sharing strategy to transfer only the beneficial features, while filtering out the useless or harmful information. We evaluate our proposed framework on both scan noise removal and spine segmentation tasks. The experimental results demonstrate that our proposed method achieves promising performance on both tasks, which provides an appealing approach to facilitating clinical diagnosis.
Collapse
|
5
|
Xu X, Sanford T, Turkbey B, Xu S, Wood BJ, Yan P. Shadow-Consistent Semi-Supervised Learning for Prostate Ultrasound Segmentation. IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:1331-1345. [PMID: 34971530 PMCID: PMC9709821 DOI: 10.1109/tmi.2021.3139999] [Citation(s) in RCA: 20] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
Prostate segmentation in transrectal ultrasound (TRUS) image is an essential prerequisite for many prostate-related clinical procedures, which, however, is also a long-standing problem due to the challenges caused by the low image quality and shadow artifacts. In this paper, we propose a Shadow-consistent Semi-supervised Learning (SCO-SSL) method with two novel mechanisms, namely shadow augmentation (Shadow-AUG) and shadow dropout (Shadow-DROP), to tackle this challenging problem. Specifically, Shadow-AUG enriches training samples by adding simulated shadow artifacts to the images to make the network robust to the shadow patterns. Shadow-DROP enforces the segmentation network to infer the prostate boundary using the neighboring shadow-free pixels. Extensive experiments are conducted on two large clinical datasets (a public dataset containing 1,761 TRUS volumes and an in-house dataset containing 662 TRUS volumes). In the fully-supervised setting, a vanilla U-Net equipped with our Shadow-AUG&Shadow-DROP outperforms the state-of-the-arts with statistical significance. In the semi-supervised setting, even with only 20% labeled training data, our SCO-SSL method still achieves highly competitive performance, suggesting great clinical value in relieving the labor of data annotation. Source code is released at https://github.com/DIAL-RPI/SCO-SSL.
Collapse
|
6
|
Amniotic fluid segmentation based on pixel classification using local window information and distance angle pixel. Appl Soft Comput 2021. [DOI: 10.1016/j.asoc.2021.107196] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
|
7
|
Lyu J, Bi X, Banerjee S, Huang Z, Leung FHF, Lee TTY, Yang DD, Zheng YP, Ling SH. Dual-task ultrasound spine transverse vertebrae segmentation network with contour regularization. Comput Med Imaging Graph 2021; 89:101896. [PMID: 33752079 DOI: 10.1016/j.compmedimag.2021.101896] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2020] [Revised: 03/03/2021] [Accepted: 03/06/2021] [Indexed: 11/27/2022]
Abstract
3D ultrasound imaging has become one of the common diagnosis ways to assess scoliosis since it is radiation-free, real-time, and low-cost. Spine curvature angle measurement is an important step to assess scoliosis precisely. One way to calculate the angle is using the vertebrae features of the 2-D coronal images to identify the most tilted vertebrae. To do the measurement, the segmentation of the transverse vertebrae is an important step. In this paper, we propose a dual-task ultrasound transverse vertebrae segmentation network (D-TVNet) based on U-Net. First, we arrange an auxiliary shape regularization network to learn the contour segmentation of the bones. It improves the boundary segmentation and anti-interference ability of the U-Net by fusing some of the features of the auxiliary task and the main task. Then, we introduce the atrous spatial pyramid pooling (ASPP) module to the end of the down-sampling stage of the main task stream to improve the relative feature extraction ability. To further improve the boundary segmentation, we extendedly fuse the down-sampling output features of the auxiliary network in the ASPP. The experiment results show that the proposed D-TVNet achieves the best dice score of 86.68% and the mean dice score of 86.17% based on cross-validation, which is an improvement of 5.17% over the baseline U-Net. An automatic ultrasound spine bone segmentation network with promising results has been achieved.
Collapse
Affiliation(s)
- Juan Lyu
- College of Information and Communication Engineering, Harbin Engineering University, Harbin, China
| | - Xiaojun Bi
- College of Information and Communication Engineering, Harbin Engineering University, Harbin, China; College of Information Engineering, Minzu University of China, Beijing, China
| | - Sunetra Banerjee
- School of Biomedical Engineering, University of Technology Sydney, Ultimo, NSW 2007, Australia
| | - Zixun Huang
- Department of Electronic and Information Engineering, The Hong Kong Polytechnic University, Hung Hum, Hong Kong
| | - Frank H F Leung
- Department of Electronic and Information Engineering, The Hong Kong Polytechnic University, Hung Hum, Hong Kong
| | - Timothy Tin-Yan Lee
- Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hung Hum, Hong Kong
| | - De-De Yang
- Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hung Hum, Hong Kong
| | - Yong-Ping Zheng
- Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hung Hum, Hong Kong
| | - Sai Ho Ling
- School of Biomedical Engineering, University of Technology Sydney, Ultimo, NSW 2007, Australia.
| |
Collapse
|
8
|
Cengizler C, Kerem Ün M, Buyukkurt S. A novel evolutionary method for spine detection in ultrasound samples of spina bifida cases. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 198:105787. [PMID: 33080492 DOI: 10.1016/j.cmpb.2020.105787] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/25/2020] [Accepted: 09/30/2020] [Indexed: 06/11/2023]
Abstract
BACKGROUND AND OBJECTIVES Spina bifida is a fetal spine defect observed during pregnancy. The defect is caused by unfinished closure of the embryonic neural column. Common diagnosis of the defect is still based on manual examination which aims to detect any deformation on spinal axis. This study proposes a novel evolutionary method for locating spinal axis on sonograms of spina bifida pathology. METHODS The method involves a meta-heuristic evolutionary approach, where the sonogram is automatically divided into columns and bone regions belonging to the spine are classified. Accordingly, a specific genetic algorithm is utilized which constructs a set of candidate spine axes. Fitness of the candidate axes is measured by a proposed problem-specific fitness function. A combination of conventional genetic operators and a novel energy minimization approach is applied to each population in order to explore the problem search space. RESULTS Results show that presented algorithm is generally able to distinguish the spinal bones from others even in the presence of severe morphological defects. CONCLUSION It is observed that the presented approach is promising and in most samples the spines identified by the proposed algorithm closely match those drawn by the experts. A computer assisted ultrasound diagnosis system specialized for spina bifida cases does not exist yet, but an algorithm to identify the spine, such as the one presented in this work, is the first natural step towards a diagnosis system. In the future, we intend to improve the algorithm by improving the segmentation stage and further optimizing the various stages of the genetic algorithm.
Collapse
Affiliation(s)
- Caglar Cengizler
- Department of Biomedical Engineering, Faculty of Engineering, Cukurova University, 01330, Turkey.
| | - M Kerem Ün
- Department of Biomedical Engineering, Faculty of Engineering, Cukurova University, 01330, Turkey.
| | - Selim Buyukkurt
- Department of Obstetrics and Gynaecology, Medical Faculty, Cukurova University, 01330, Turkey.
| |
Collapse
|
9
|
Bone shadow segmentation from ultrasound data for orthopedic surgery using GAN. Int J Comput Assist Radiol Surg 2020; 15:1477-1485. [PMID: 32656685 DOI: 10.1007/s11548-020-02221-z] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2019] [Accepted: 06/20/2020] [Indexed: 10/23/2022]
Abstract
PURPOSE Real-time, two (2D) and three-dimensional (3D) ultrasound (US) has been investigated as a potential alternative to fluoroscopy imaging in various surgical and non-surgical orthopedic procedures. However, low signal to noise ratio, imaging artifacts and bone surfaces appearing several millimeters (mm) in thickness have hindered the wide spread adaptation of this safe imaging modality. Limited field of view and manual data collection cause additional problems during US-based orthopedic procedures. In order to overcome these limitations various bone segmentation and registration methods have been developed. Acoustic bone shadow is an important image artifact used to identify the presence of bone boundaries in the collected US data. Information about bone shadow region can be used (1) to guide the orthopedic surgeon or clinician to a standardized diagnostic viewing plane with minimal artifacts, (2) as a prior feature to improve bone segmentation and registration. METHOD In this work, we propose a computational method, based on a novel generative adversarial network (GAN) architecture, to segment bone shadow images from in vivo US scans in real-time. We also show how these segmented shadow images can be incorporated, as a proxy, to a multi-feature guided convolutional neural network (CNN) architecture for real-time and accurate bone surface segmentation. Quantitative and qualitative evaluation studies are performed on 1235 scans collected from 27 subjects using two different US machines. Finally, we provide qualitative and quantitative comparison results against state-of-the-art GANs. RESULTS We have obtained mean dice coefficient (± standard deviation) of [Formula: see text] ([Formula: see text]) for bone shadow segmentation, showing that the method is in close range with manual expert annotation. Statistical significant improvements against state-of-the-art GAN methods (paired t-test [Formula: see text]) is also obtained. Using the segmented bone shadow features average bone localization accuracy of 0.11 mm ([Formula: see text]) was achieved. CONCLUSIONS Reported accurate and robust results make the proposed method promising for various orthopedic procedures. Although we did not investigate in this work, the segmented bone shadow images could also be used as an additional feature to improve accuracy of US-based registration methods. Further extensive validations are required in order to fully understand the clinical utility of the proposed method.
Collapse
|
10
|
Automatic extraction of vertebral landmarks from ultrasound images: A pilot study. Comput Biol Med 2020; 122:103838. [DOI: 10.1016/j.compbiomed.2020.103838] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2020] [Revised: 05/12/2020] [Accepted: 05/26/2020] [Indexed: 11/17/2022]
|
11
|
Gueziri HE, Santaguida C, Collins DL. The state-of-the-art in ultrasound-guided spine interventions. Med Image Anal 2020; 65:101769. [PMID: 32668375 DOI: 10.1016/j.media.2020.101769] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2019] [Revised: 06/23/2020] [Accepted: 06/25/2020] [Indexed: 02/07/2023]
Abstract
During the last two decades, intra-operative ultrasound (iUS) imaging has been employed for various surgical procedures of the spine, including spinal fusion and needle injections. Accurate and efficient registration of pre-operative computed tomography or magnetic resonance images with iUS images are key elements in the success of iUS-based spine navigation. While widely investigated in research, iUS-based spine navigation has not yet been established in the clinic. This is due to several factors including the lack of a standard methodology for the assessment of accuracy, robustness, reliability, and usability of the registration method. To address these issues, we present a systematic review of the state-of-the-art techniques for iUS-guided registration in spinal image-guided surgery (IGS). The review follows a new taxonomy based on the four steps involved in the surgical workflow that include pre-processing, registration initialization, estimation of the required patient to image transformation, and a visualization process. We provide a detailed analysis of the measurements in terms of accuracy, robustness, reliability, and usability that need to be met during the evaluation of a spinal IGS framework. Although this review is focused on spinal navigation, we expect similar evaluation criteria to be relevant for other IGS applications.
Collapse
Affiliation(s)
- Houssem-Eddine Gueziri
- McConnell Brain Imaging Center, Montreal Neurological Institute and Hospital, Montreal (QC), Canada; McGill University, Montreal (QC), Canada.
| | - Carlo Santaguida
- Department of Neurology and Neurosurgery, McGill University Health Center, Montreal (QC), Canada
| | - D Louis Collins
- McConnell Brain Imaging Center, Montreal Neurological Institute and Hospital, Montreal (QC), Canada; McGill University, Montreal (QC), Canada
| |
Collapse
|
12
|
Shajudeen P, Tang S, Chaudhry A, Kim N, Reddy JN, Tasciotti E, Righetti R. Modeling and Analysis of Ultrasound Elastographic Axial Strains for Spine Fracture Identification. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2020; 67:898-909. [PMID: 31796395 DOI: 10.1109/tuffc.2019.2956730] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
This study reports the first use of ultrasound (US) elastography for imaging spinal fractures by assessing the mechanical response of the soft tissue at the posterior vertebra boundary to a uniaxial compression in rabbit ex vivo samples. Three-dimensional finite-element (FE) models of the vertebra-soft tissue complex in rabbit samples are generated and analyzed to evaluate the distribution of the axial normal and shear strains at the vertebra-soft tissue interface. Experiments on the same samples are performed to corroborate simulation findings. Results of this study indicate that the distribution of the axial strains manifests as distinct patterns around intact and fractured vertebrae. Numerical characteristics of the axial strain's spatial distribution are further used to construct two shape descriptors to make inferences on spinal abnormalities: 1) axial normal strain asymmetry for assessing the presence of fractures and 2) principal orientation of axial shear strain concentration regions (shear zones) for measurement of spinous process dislocation. This study demonstrates that axial normal strain and axial shear strain maps obtained via US elastography can provide a new means to detect spine fractures and abnormalities in the selected ex vivo animal models. Spinal fracture detection is important for the assessment of spinal cord injuries and stability. However, identification of spinal fractures using US is currently challenging. Our results show that features resulting from strain elastograms can serve as a useful adjunct to B-mode images in identifying spine fractures in the selected animal samples, and this information could be helpful in clinical settings.
Collapse
|
13
|
Pandey PU, Quader N, Guy P, Garbi R, Hodgson AJ. Ultrasound Bone Segmentation: A Scoping Review of Techniques and Validation Practices. ULTRASOUND IN MEDICINE & BIOLOGY 2020; 46:921-935. [PMID: 31982208 DOI: 10.1016/j.ultrasmedbio.2019.12.014] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/23/2019] [Revised: 12/04/2019] [Accepted: 12/11/2019] [Indexed: 06/10/2023]
Abstract
Ultrasound bone segmentation is an important yet challenging task for many clinical applications. Several works have emerged attempting to improve and automate bone segmentation, which has led to a variety of computational techniques, validation practices and applied clinical scenarios. We characterize this exciting and growing body of research by reviewing published ultrasound bone segmentation techniques. We review 56 articles in detail and categorize and discuss the image analysis techniques that have been used for bone segmentation. We highlight the general trends of this field in terms of clinical motivation, image analysis techniques, ultrasound modalities and the types of validation practices used to quantify segmentation performance. Finally, we present an outlook on promising areas of research based on the unaddressed needs for solving ultrasound bone segmentation.
Collapse
Affiliation(s)
- Prashant U Pandey
- Biomedical Engineering Department, University of British Columbia, Vacouver, British Columbia, Canada.
| | - Niamul Quader
- Electrical and Computer Engineering Department, University of British Columbia, Vacouver, British Columbia, Canada
| | - Pierre Guy
- Department of Orthopaedics, University of British Columbia, Vacouver, British Columbia, Canada
| | - Rafeef Garbi
- Electrical and Computer Engineering Department, University of British Columbia, Vacouver, British Columbia, Canada
| | - Antony J Hodgson
- Mechanical Engineering Department, University of British Columbia, Vacouver, British Columbia, Canada
| |
Collapse
|
14
|
Ungi T, Greer H, Sunderland KR, Wu V, Baum ZMC, Schlenger C, Oetgen M, Cleary K, Aylward SR, Fichtinger G. Automatic Spine Ultrasound Segmentation for Scoliosis Visualization and Measurement. IEEE Trans Biomed Eng 2020; 67:3234-3241. [PMID: 32167884 DOI: 10.1109/tbme.2020.2980540] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
OBJECTIVE Integrate tracked ultrasound and AI methods to provide a safer and more accessible alternative to X-ray for scoliosis measurement. We propose automatic ultrasound segmentation for 3-dimensional spine visualization and scoliosis measurement to address difficulties in using ultrasound for spine imaging. METHODS We trained a convolutional neural network for spine segmentation on ultrasound scans using data from eight healthy adult volunteers. We tested the trained network on eight pediatric patients. We evaluated image segmentation and 3-dimensional volume reconstruction for scoliosis measurement. RESULTS As expected, fuzzy segmentation metrics reduced when trained networks were translated from healthy volunteers to patients. Recall decreased from 0.72 to 0.64 (8.2% decrease), and precision from 0.31 to 0.27 (3.7% decrease). However, after finding optimal thresholds for prediction maps, binary segmentation metrics performed better on patient data. Recall decreased from 0.98 to 0.97 (1.6% decrease), and precision from 0.10 to 0.06 (4.5% decrease). Segmentation prediction maps were reconstructed to 3-dimensional volumes and scoliosis was measured in all patients. Measurement in these reconstructions took less than 1 minute and had a maximum error of 2.2° compared to X-ray. CONCLUSION automatic spine segmentation makes scoliosis measurement both efficient and accurate in tracked ultrasound scans. SIGNIFICANCE Automatic segmentation may overcome the limitations of tracked ultrasound that so far prevented its use as an alternative of X-ray in scoliosis measurement.
Collapse
|
15
|
Meng Q, Sinclair M, Zimmer V, Hou B, Rajchl M, Toussaint N, Oktay O, Schlemper J, Gomez A, Housden J, Matthew J, Rueckert D, Schnabel JA, Kainz B. Weakly Supervised Estimation of Shadow Confidence Maps in Fetal Ultrasound Imaging. IEEE TRANSACTIONS ON MEDICAL IMAGING 2019; 38:2755-2767. [PMID: 31021795 PMCID: PMC6892638 DOI: 10.1109/tmi.2019.2913311] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
Detecting acoustic shadows in ultrasound images is important in many clinical and engineering applications. Real-time feedback of acoustic shadows can guide sonographers to a standardized diagnostic viewing plane with minimal artifacts and can provide additional information for other automatic image analysis algorithms. However, automatically detecting shadow regions using learning-based algorithms is challenging because pixel-wise ground truth annotation of acoustic shadows is subjective and time consuming. In this paper, we propose a weakly supervised method for automatic confidence estimation of acoustic shadow regions. Our method is able to generate a dense shadow-focused confidence map. In our method, a shadow-seg module is built to learn general shadow features for shadow segmentation, based on global image-level annotations as well as a small number of coarse pixel-wise shadow annotations. A transfer function is introduced to extend the obtained binary shadow segmentation to a reference confidence map. In addition, a confidence estimation network is proposed to learn the mapping between input images and the reference confidence maps. This network is able to predict shadow confidence maps directly from input images during inference. We use evaluation metrics such as DICE, inter-class correlation, and so on, to verify the effectiveness of our method. Our method is more consistent than human annotation and outperforms the state-of-the-art quantitatively in shadow segmentation and qualitatively in confidence estimation of shadow regions. Furthermore, we demonstrate the applicability of our method by integrating shadow confidence maps into tasks such as ultrasound image classification, multi-view image fusion, and automated biometric measurements.
Collapse
|
16
|
Abstract
Ultrasound is a real-time, non-radiation-based imaging modality with an ability to acquire two-dimensional (2D) and three-dimensional (3D) data. Due to these capabilities, research has been carried out in order to incorporate it as an intraoperative imaging modality for various orthopedic surgery procedures. However, high levels of noise, different imaging artifacts, and bone surfaces appearing blurred with several mm in thickness have prohibited the widespread use of ultrasound as a standard of care imaging modality in orthopedics. In this chapter, we provided a detailed overview of numerous applications of 3D ultrasound in the domain of orthopedic surgery. Specifically, we discuss the advantages and disadvantages of methods proposed for segmentation and enhancement of bone ultrasound data and the successful application of these methods in clinical domain. Finally, a number of challenges are identified which need to be overcome in order for ultrasound to become a preferred imaging modality in orthopedics.
Collapse
|
17
|
FCN-based approach for the automatic segmentation of bone surfaces in ultrasound images. Int J Comput Assist Radiol Surg 2018; 13:1707-1716. [DOI: 10.1007/s11548-018-1856-x] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2018] [Accepted: 09/03/2018] [Indexed: 01/17/2023]
|
18
|
Takács M, Orlovits Z, Jáger B, Kiss RM. Comparison of spinal curvature parameters as determined by the ZEBRIS spine examination method and the Cobb method in children with scoliosis. PLoS One 2018; 13:e0200245. [PMID: 29985957 PMCID: PMC6037360 DOI: 10.1371/journal.pone.0200245] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2017] [Accepted: 05/28/2018] [Indexed: 12/12/2022] Open
Abstract
BACKGROUND AND PURPOSE The most common and gold standard method to diagnose and follow-up on scoliosis treatment is to capture biplanar X-ray images and then use these to determine the sagittal frontal spinal curvature angles by the Cobb method. Reducing exposure to radiation is an important aspect for consideration, especially regarding children. The ZEBRIS spinal examination method is an external, non-invasive measurement method that uses an ultrasound-based motion analysis system. The aim of this study is to compare angle values of patients with adolescent idiopathic scoliosis (AIS) determined by the ZEBRIS spine examination method with the angle values defined by the gold standard Cobb method on biplanar X-ray images. METHODS Subjects included 19 children with AIS (mean age 14.5±2.1 years, range 8-16 years, frontal plane thoracic Cobb angle 19.95±10.23°, thoracolumbar/lumbar angle 16.57±10.23°). The thoracic kyphosis and lumbar lordosis in the sagittal plane and the thoracic and lumbar scoliosis values were calculated by the Cobb method on biplanar X-ray images. The sagittal frontal spinal curvature angles were calculated from the position of the processus spinosus of 19 vertebrae, as determined by the ZEBRIS spine examination method. The validity of the ZEBRIS spine examination method was evaluated with Bland-Altman analyses between the sagittal and frontal spinal curvature parameters calculated from data determined by the ZEBRIS spine examination method and data obtained by the Cobb method on the X-ray images. RESULTS AND DISCUSSION Thoracic spinal curvature angles in sagittal and in frontal planes can be measured with sufficient accuracy. The slopes of the linear regression lines for thoracic kyphosis (TK) and thoracic scoliosis (TSC) are close to one (1.00 and 0.79 respectively), and the intercept values are below 5 degrees. The correlation between the TK and TSC values determined by the two methods is significant (p = 0.000) and excellent (rTK = 0.95, rTSC = 0.85). The differences are in the limit of agreement. The lumbar lordosis (LL) in the sagittal plane shows a very good correlation (rLL = 0.76); however the differences between the angles determined by the two methods are out of the limit of agreement in patients with major lumbar lordosis (LL≥50°). The thoracolumbar/lumbar spinal curvature angles in the frontal plane determined by ZEBRIS spine examination were underestimated at curvatures larger than 15°, mainly due to the rotational and pathological deformities of the scoliotic vertebrae. However, the correlation between lumbar scoliosis (LSC) values determined by the two methods is significant (p = 0.000) and excellent (rLSC = 0.84), the slopes are below one (0.71), the intercept values are below 5 degrees, and the differences between the angles determined by the two methods are within the limits of agreement. We could conclude that ZEBRIS spinal examination is a valid and reliable method for determination of sagittal and frontal curvatures during the treatment of patients with scoliosis. However, it cannot replace the biplanar X-ray examination for the visualization of spinal curvatures in the sagittal and frontal planes and the rotation of vertebral bodies during the diagnosis and annual evaluation of the progression.
Collapse
Affiliation(s)
- Mária Takács
- Department of Orthopedics, MÁV Hospital Szolnok, Szolnok, Hungary
| | - Zsanett Orlovits
- Institute of Mathematics, Budapest University of Technology and Economics, Budapest, Hungary
| | - Bence Jáger
- Department of Structural Engineering, Budapest University of Technology and Economics, Budapest, Hungary
| | - Rita M. Kiss
- Department of Mechatronics, Optics and Mechanical Engineering Informatics, Budapest University of Technology and Economics, Budapest, Hungary
- * E-mail:
| |
Collapse
|
19
|
Ilunga-Mbuyamba E, Avina-Cervantes JG, Lindner D, Arlt F, Ituna-Yudonago JF, Chalopin C. Patient-specific model-based segmentation of brain tumors in 3D intraoperative ultrasound images. Int J Comput Assist Radiol Surg 2018; 13:331-342. [PMID: 29330658 DOI: 10.1007/s11548-018-1703-0] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2017] [Accepted: 01/04/2018] [Indexed: 11/27/2022]
Abstract
PURPOSE Intraoperative ultrasound (iUS) imaging is commonly used to support brain tumor operation. The tumor segmentation in the iUS images is a difficult task and still under improvement because of the low signal-to-noise ratio. The success of automatic methods is also limited due to the high noise sensibility. Therefore, an alternative brain tumor segmentation method in 3D-iUS data using a tumor model obtained from magnetic resonance (MR) data for local MR-iUS registration is presented in this paper. The aim is to enhance the visualization of the brain tumor contours in iUS. METHODS A multistep approach is proposed. First, a region of interest (ROI) based on the specific patient tumor model is defined. Second, hyperechogenic structures, mainly tumor tissues, are extracted from the ROI of both modalities by using automatic thresholding techniques. Third, the registration is performed over the extracted binary sub-volumes using a similarity measure based on gradient values, and rigid and affine transformations. Finally, the tumor model is aligned with the 3D-iUS data, and its contours are represented. RESULTS Experiments were successfully conducted on a dataset of 33 patients. The method was evaluated by comparing the tumor segmentation with expert manual delineations using two binary metrics: contour mean distance and Dice index. The proposed segmentation method using local and binary registration was compared with two grayscale-based approaches. The outcomes showed that our approach reached better results in terms of computational time and accuracy than the comparative methods. CONCLUSION The proposed approach requires limited interaction and reduced computation time, making it relevant for intraoperative use. Experimental results and evaluations were performed offline. The developed tool could be useful for brain tumor resection supporting neurosurgeons to improve tumor border visualization in the iUS volumes.
Collapse
Affiliation(s)
- Elisee Ilunga-Mbuyamba
- CA Telematics, Engineering Division, Campus Irapuato-Salamanca, University of Guanajuato, Carr. Salamanca-Valle de Santiago km 3.5 + 1.8, Comunidad de Palo Blanco, 36885, Salamanca, Mexico
- Innovation Center Computer Assisted Surgery (ICCAS), University of Leipzig, 04103, Leipzig, Germany
| | - Juan Gabriel Avina-Cervantes
- CA Telematics, Engineering Division, Campus Irapuato-Salamanca, University of Guanajuato, Carr. Salamanca-Valle de Santiago km 3.5 + 1.8, Comunidad de Palo Blanco, 36885, Salamanca, Mexico.
| | - Dirk Lindner
- Department of Neurosurgery, University Hospital Leipzig, 04103, Leipzig, Germany
| | - Felix Arlt
- Department of Neurosurgery, University Hospital Leipzig, 04103, Leipzig, Germany
| | - Jean Fulbert Ituna-Yudonago
- CA Telematics, Engineering Division, Campus Irapuato-Salamanca, University of Guanajuato, Carr. Salamanca-Valle de Santiago km 3.5 + 1.8, Comunidad de Palo Blanco, 36885, Salamanca, Mexico
| | - Claire Chalopin
- Innovation Center Computer Assisted Surgery (ICCAS), University of Leipzig, 04103, Leipzig, Germany
| |
Collapse
|
20
|
Meiburger KM, Acharya UR, Molinari F. Automated localization and segmentation techniques for B-mode ultrasound images: A review. Comput Biol Med 2017; 92:210-235. [PMID: 29247890 DOI: 10.1016/j.compbiomed.2017.11.018] [Citation(s) in RCA: 57] [Impact Index Per Article: 8.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2017] [Revised: 11/30/2017] [Accepted: 11/30/2017] [Indexed: 12/14/2022]
Abstract
B-mode ultrasound imaging is used extensively in medicine. Hence, there is a need to have efficient segmentation tools to aid in computer-aided diagnosis, image-guided interventions, and therapy. This paper presents a comprehensive review on automated localization and segmentation techniques for B-mode ultrasound images. The paper first describes the general characteristics of B-mode ultrasound images. Then insight on the localization and segmentation of tissues is provided, both in the case in which the organ/tissue localization provides the final segmentation and in the case in which a two-step segmentation process is needed, due to the desired boundaries being too fine to locate from within the entire ultrasound frame. Subsequenly, examples of some main techniques found in literature are shown, including but not limited to shape priors, superpixel and classification, local pixel statistics, active contours, edge-tracking, dynamic programming, and data mining. Ten selected applications (abdomen/kidney, breast, cardiology, thyroid, liver, vascular, musculoskeletal, obstetrics, gynecology, prostate) are then investigated in depth, and the performances of a few specific applications are compared. In conclusion, future perspectives for B-mode based segmentation, such as the integration of RF information, the employment of higher frequency probes when possible, the focus on completely automatic algorithms, and the increase in available data are discussed.
Collapse
Affiliation(s)
- Kristen M Meiburger
- Biolab, Department of Electronics and Telecommunications, Politecnico di Torino, Torino, Italy
| | - U Rajendra Acharya
- Department of Electronic & Computer Engineering, Ngee Ann Polytechnic, Singapore; Department of Biomedical Engineering, School of Science and Technology, SUSS University, Singapore; Department of Biomedical Imaging, Faculty of Medicine, University of Malaya, Kuala Lumpur, Malaysia
| | - Filippo Molinari
- Biolab, Department of Electronics and Telecommunications, Politecnico di Torino, Torino, Italy.
| |
Collapse
|
21
|
Baka N, Leenstra S, van Walsum T. Random Forest-Based Bone Segmentation in Ultrasound. ULTRASOUND IN MEDICINE & BIOLOGY 2017; 43:2426-2437. [PMID: 28735735 DOI: 10.1016/j.ultrasmedbio.2017.04.022] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/19/2016] [Revised: 04/14/2017] [Accepted: 04/24/2017] [Indexed: 06/07/2023]
Abstract
Ultrasound (US) imaging is a safe alternative to radiography for guidance during minimally invasive orthopedic procedures. However, ultrasound is challenging to interpret because of the relatively low signal-to-noise ratio and its inherent speckle pattern that decreases image quality. Here we describe a method for automatic bone segmentation in 2-D ultrasound images using a patch-based random forest classifier and several ultrasound specific features, such as shadowing. We illustrate that existing shadow features are not robust to changes in US acquisition parameters, and propose a novel robust shadow feature. We evaluate the method on several US data sets and report that it favorably compares with existing techniques. We achieve a recall of 0.86 at a precision of 0.82 on a test set of 143 spinal US images.
Collapse
Affiliation(s)
- Nora Baka
- Biomedical Imaging Group Rotterdam, Departments of Radiology & Nuclear Medicine and Medical Informatics, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands
| | - Sieger Leenstra
- Department of Neurosurgery, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands
| | - Theo van Walsum
- Biomedical Imaging Group Rotterdam, Departments of Radiology & Nuclear Medicine and Medical Informatics, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands.
| |
Collapse
|
22
|
Shajudeen PMS, Righetti R. Spine surface detection from local phase‐symmetry enhanced ridges in ultrasound images. Med Phys 2017; 44:5755-5767. [DOI: 10.1002/mp.12509] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2017] [Revised: 05/29/2017] [Accepted: 06/23/2017] [Indexed: 11/08/2022] Open
Affiliation(s)
| | - Raffaella Righetti
- Department of Electrical and Computer Engineering Texas A&M University College Station TX 77840 USA
| |
Collapse
|
23
|
|
24
|
Abstract
Due to its real-time, non-radiation based three-dimensional (3D) imaging capabilities, ultrasound (US) has been incorporated into various orthopedic procedures. However, imaging artifacts, low signal-to-noise ratio (SNR) and bone boundaries appearing several mm in thickness make the analysis of US data difficult. This paper provides a review about the state-of-the-art bone segmentation and enhancement methods developed for two-dimensional (2D) and 3D US data. First, an overview for the appearance of bone surface response in B-mode data is presented. Then, classification of the proposed techniques in terms of the image information being used is provided. Specifically, the focus is given on segmentation and enhancement of B-mode US data. The review is concluded by discussing future directions of research and additional challenges which need to be overcome in order to make this imaging modality more successful in orthopedics.
Collapse
Affiliation(s)
- Ilker Hacihaliloglu
- Department of Biomedical Engineering, Rutgers University, NJ, USA
- Department of Radiology, Rutgers University Robert Wood Johnson Medical School, NJ, USA
| |
Collapse
|
25
|
Hacihaliloglu I. Enhancement of bone shadow region using local phase-based ultrasound transmission maps. Int J Comput Assist Radiol Surg 2017; 12:951-960. [PMID: 28285340 DOI: 10.1007/s11548-017-1556-y] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2017] [Accepted: 03/06/2017] [Indexed: 11/26/2022]
Abstract
PURPOSE Ultrasound is increasingly being employed in different orthopedic procedures as an imaging modality for real-time guidance. Nevertheless, low signal-to-noise-ratio and different imaging artifacts continue to hamper the success of ultrasound-based procedures. Bone shadow region is an important feature indicating the presence of bone/tissue interface in the acquired ultrasound data. Enhancement and automatic detection of this region could improve the sensitivity of ultrasound for imaging bone and result in improved guidance for various orthopedic procedures. METHODS In this work, a method is introduced for the enhancement of bone shadow regions from B-mode ultrasound data. The method is based on the combination of three different image phase features: local phase tensor, local weighted mean phase angle, and local phase energy. The combined local phase image features are used as an input to an [Formula: see text] norm-based contextual regularization method which emphasizes uncertainty in the shadow regions. The enhanced bone shadow images are automatically segmented and compared against expert segmentation. RESULTS Qualitative and quantitative validation was performed on 100 in vivo US scans obtained from five subjects by scanning femur and vertebrae bones. Validation against expert segmentation achieved a mean dice similarity coefficient of 0.88. CONCLUSIONS The encouraging results obtained in this initial study suggest that the proposed method is promising enough for further evaluation. The calculated bone shadow maps could be incorporated into different ultrasound bone segmentation and registration approaches as an additional feature.
Collapse
Affiliation(s)
- Ilker Hacihaliloglu
- Department of Biomedical Engineering, Rutgers University, Piscataway, NJ, USA.
- Department of Radiology, Rutgers University Robert Wood Johnson Medical School, New Brunswick, NJ, USA.
| |
Collapse
|