1
|
Chen H, Yu MA, Chen C, Zhou K, Qi S, Chen Y, Xiao R. FDE-net: Frequency-domain enhancement network using dynamic-scale dilated convolution for thyroid nodule segmentation. Comput Biol Med 2023; 153:106514. [PMID: 36628913 DOI: 10.1016/j.compbiomed.2022.106514] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2022] [Revised: 12/22/2022] [Accepted: 12/31/2022] [Indexed: 01/05/2023]
Abstract
Thyroid nodules, a common disease of endocrine system, have a probability of nearly 10% to turn into malignant nodules and thus pose a serious threat to health. Automatic segmentation of thyroid nodules is of great importance for clinicopathological diagnosis. This work proposes FDE-Net, a combined segmental frequency domain enhancement and dynamic scale cavity convolutional network for thyroid nodule segmentation. In FDE-Net, traditional image omics method is introduced to enhance the feature image in the segmented frequency domain. Such an approach reduces the influence of noise and strengthens the detail and contour information of the image. The proposed method introduces a cascade cross-scale attention module, which addresses the insensitivity of the network to the change in target scale by fusing the features of different receptive fields and improves the ability of the network to identify multiscale target regions. It repeatedly uses the high-dimensional feature image to improve segmentation accuracy in accordance with the simple structure of thyroid nodules. In this study, 1355 ultrasound images are used for training and testing. Quantitative evaluation results showed that the Dice coefficient of FDE-Net in thyroid nodule segmentation was 83.54%, which is better than other methods. Therefore, FDE-Net can enable the accurate and rapid segmentation of thyroid nodules.
Collapse
Affiliation(s)
- Hongyu Chen
- School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing, 100083, China
| | - Ming-An Yu
- Department of Interventional Medicine, China-Japan Friendship Hospital, Beijing, 100029, China
| | - Cheng Chen
- School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing, 100083, China
| | - Kangneng Zhou
- School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing, 100083, China
| | - Siyu Qi
- School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing, 100083, China
| | - Yunqing Chen
- School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing, 100083, China
| | - Ruoxiu Xiao
- School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing, 100083, China; Shunde Innovation School, University of Science and Technology Beijing, Foshan, 100024, China.
| |
Collapse
|
2
|
Chen J, You H, Li K. A review of thyroid gland segmentation and thyroid nodule segmentation methods for medical ultrasound images. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2020; 185:105329. [PMID: 31955006 DOI: 10.1016/j.cmpb.2020.105329] [Citation(s) in RCA: 44] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/31/2019] [Revised: 01/08/2020] [Accepted: 01/08/2020] [Indexed: 05/07/2023]
Abstract
Background and objective Thyroid image segmentation is an indispensable part in computer-aided diagnosis systems and medical image diagnoses of thyroid diseases. There have been dozens of studies on thyroid gland segmentation and thyroid nodule segmentation in ultrasound images. The aim of this work is to categorize and review the thyroid gland segmentation and thyroid nodule segmentation methods in medical ultrasound. Methods This work proposes a categorization approach of thyroid gland segmentation and thyroid nodule segmentation methods according to the theoretical bases of segmentation methods. The segmentation methods are categorized into four groups, including contour and shape based methods, region based methods, machine and deep learning methods and hybrid methods. The representative articles are reviewed with detailed descriptions of methods and analyses of correlations between methods. The evaluation metrics for the reviewed segmentation methods are named uniformly in this work. The segmentation performance results using the uniformly named evaluation metrics are compared. Results After careful investigation, 28 representative papers are selected for comprehensive analyses and comparisons in this review. The dominant thyroid gland segmentation methods are machine and deep learning methods. The training of massive data makes these models have better segmentation performance and robustness. But deep learning models usually require plenty of marked training data and long training time. For thyroid nodule segmentation, the most common methods are contour and shape based methods, which have good segmentation performance. However, most of them are tested on small datasets. Conclusions Based on the comprehensive consideration of application scenario, image features, method practicability and segmentation performance, the appropriate segmentation method for specific situation can be selected. Furthermore, several limitations of current thyroid ultrasound image segmentation methods are presented, which may be overcome in future studies, such as the segmentation of pathological or abnormal thyroid glands, identification of the specific nodular diseases, and the standard thyroid ultrasound image datasets.
Collapse
Affiliation(s)
- Junying Chen
- School of Software Engineering, South China University of Technology, Guangzhou, Guangdong 510006, China.
| | - Haijun You
- School of Software Engineering, South China University of Technology, Guangzhou, Guangdong 510006, China.
| | - Kai Li
- Department of Ultrasound, The Third Affiliated Hospital of Sun Yat-Sen University, Guangzhou, Guangdong 510630, China.
| |
Collapse
|
3
|
Wu P, Liu Y, Li Y, Liu B. Robust Prostate Segmentation Using Intrinsic Properties of TRUS Images. IEEE TRANSACTIONS ON MEDICAL IMAGING 2015; 34:1321-1335. [PMID: 25576565 DOI: 10.1109/tmi.2015.2388699] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
Accurate segmentation is usually crucial in transrectal ultrasound (TRUS) image based prostate diagnosis; however, it is always hampered by heavy speckles. Contrary to the traditional view that speckles are adverse to segmentation, we exploit intrinsic properties induced by speckles to facilitate the task, based on the observations that sizes and orientations of speckles provide salient cues to determine the prostate boundary. Since the speckle orientation changes in accordance with a statistical prior rule, rotation-invariant texture feature is extracted along the orientations revealed by the rule. To address the problem of feature changes due to different speckle sizes, TRUS images are split into several arc-like strips. In each strip, every individual feature vector is sparsely represented, and representation residuals are obtained. The residuals, along with the spatial coherence inherited from biological tissues, are combined to segment the prostate preliminarily via graph cuts. After that, the segmentation is fine-tuned by a novel level sets model, which integrates (1) the prostate shape prior, (2) dark-to-light intensity transition near the prostate boundary, and (3) the texture feature just obtained. The proposed method is validated on two 2-D image datasets obtained from two different sonographic imaging systems, with the mean absolute distance on the mid gland images only 1.06±0.53 mm and 1.25±0.77 mm, respectively. The method is also extended to segment apex and base images, producing competitive results over the state of the art.
Collapse
|
4
|
Maroulis DE, Savelonas MA, Iakovidis DK, Karkanis SA, Dimitropoulos N. Variable Background Active Contour Model for Computer-Aided Delineation of Nodules in Thyroid Ultrasound Images. ACTA ACUST UNITED AC 2007; 11:537-43. [PMID: 17912970 DOI: 10.1109/titb.2006.890018] [Citation(s) in RCA: 33] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
This paper presents a computer-aided approach for nodule delineation in thyroid ultrasound (US) images. The developed algorithm is based on a novel active contour model, named variable background active contour (VBAC), and incorporates the advantages of the level set region-based active contour without edges (ACWE) model, offering noise robustness and the ability to delineate multiple nodules. Unlike the classic active contour models that are sensitive in the presence of intensity inhomogeneities, the proposed VBAC model considers information of variable background regions. VBAC has been evaluated on synthetic images, as well as on real thyroid US images. From the quantification of the results, two major impacts have been derived: 1) higher average accuracy in the delineation of hypoechoic thyroid nodules, which exceeds 91%; and 2) faster convergence when compared with the ACWE model.
Collapse
Affiliation(s)
- Dimitris E Maroulis
- Realtime Systems and Image Analysis Group, Department of Informatics and Telecommunications, University of Athens, Athens 15784, Greece.
| | | | | | | | | |
Collapse
|
5
|
|
6
|
Tsantis S, Dimitropoulos N, Cavouras D, Nikiforidis G. A hybrid multi-scale model for thyroid nodule boundary detection on ultrasound images. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2006; 84:86-98. [PMID: 17055608 DOI: 10.1016/j.cmpb.2006.09.006] [Citation(s) in RCA: 16] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/13/2006] [Revised: 09/14/2006] [Accepted: 09/14/2006] [Indexed: 05/12/2023]
Abstract
A hybrid model for thyroid nodule boundary detection on ultrasound images is introduced. The segmentation model combines the advantages of the "á trous" wavelet transform to detect sharp gray-level variations and the efficiency of the Hough transform to discriminate the region of interest within an environment with excessive structural noise. The proposed method comprise three major steps: a wavelet edge detection procedure for speckle reduction and edge map estimation, based on local maxima representation. Subsequently, a multiscale structure model is utilised in order to acquire a contour representation by means of local maxima chaining with similar attributes to form significant structures. Finally, the Hough transform is employed with 'a priori' knowledge related to the nodule's shape in order to distinguish the nodule's contour from adjacent structures. The comparative study between our automatic method and manual delineations demonstrated that the boundaries extracted by the hybrid model are closely correlated with that of the physicians. The proposed hybrid method can be of value to thyroid nodules' shape-based classification and as an educational tool for inexperienced radiologists.
Collapse
Affiliation(s)
- S Tsantis
- Department of Medical Physics, School of Medicine, University of Patras, Rio Patras 26500, Greece.
| | | | | | | |
Collapse
|
7
|
Noble JA, Boukerroui D. Ultrasound image segmentation: a survey. IEEE TRANSACTIONS ON MEDICAL IMAGING 2006; 25:987-1010. [PMID: 16894993 DOI: 10.1109/tmi.2006.877092] [Citation(s) in RCA: 452] [Impact Index Per Article: 25.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/11/2023]
Abstract
This paper reviews ultrasound segmentation paper methods, in a broad sense, focusing on techniques developed for medical B-mode ultrasound images. First, we present a review of articles by clinical application to highlight the approaches that have been investigated and degree of validation that has been done in different clinical domains. Then, we present a classification of methodology in terms of use of prior information. We conclude by selecting ten papers which have presented original ideas that have demonstrated particular clinical usefulness or potential specific to the ultrasound segmentation problem.
Collapse
Affiliation(s)
- J Alison Noble
- Department of Engineering Science, University of Oxford, UK.
| | | |
Collapse
|
8
|
Sheng C, Xin Y, Liping Y, Kun S. Segmentation in Echocardiographic Sequences using Shape-based Snake Model Combined with Generalized Hough Transformation. Int J Cardiovasc Imaging 2005; 22:33-45. [PMID: 16374528 DOI: 10.1007/s10554-005-4933-5] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/22/2005] [Accepted: 04/05/2005] [Indexed: 10/25/2022]
Abstract
A novel method for segmentation of cardiac structures in temporal echocardiographic sequences based on the snake model is presented. The method is motivated by the observation that the structures of neighboring frames have consistent locations and shapes that aid in segmentation. To cooperate with the constraining information provided by the neighboring frames, we combine the template matching with the conventional snake model. It means that the model not only is driven by conventional internal and external forces, but also combines an additional constraint, the matching degree to measure the similarity between the neighboring prior shape and the derived contour. Furthermore, in order to auto or semi-automatically segment the sequent images without manually drawing the initial contours in each image, generalized Hough transformation (GHT) is used to roughly estimate the initial contour by transforming the neighboring prior shape. The method is particularly useful in case of the large frame-to-frame displacement of structure such as mitral valve. As a result, the active contour can easily detect the desirable boundaries in ultrasound images and has a high penetrability through the interference of various undesirables, such as the speckle, the tissue-related textures and the artifacts.
Collapse
Affiliation(s)
- Chen Sheng
- Institute of Image Processing and Pattern Recognition, Shanghai Jiaotong University, Shanghai 200030, P.R. China.
| | | | | | | |
Collapse
|
9
|
Zhang WY, Rohling RN, Pai DK. Surface extraction with a three-dimensional freehand ultrasound system. ULTRASOUND IN MEDICINE & BIOLOGY 2004; 30:1461-1473. [PMID: 15588957 DOI: 10.1016/j.ultrasmedbio.2004.08.020] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/10/2004] [Revised: 08/02/2004] [Accepted: 08/13/2004] [Indexed: 05/24/2023]
Abstract
This paper presents a system for acquiring three-dimensional ultrasound data and extracting surfaces of the examined structures. The acquisition is performed freehand with a PC-based two dimensional ultrasound machine and an optical tracker. The extraction of surfaces from ultrasound data are normally inhibited by speckle, shadowing and gaps in the acquired data. A new method is developed that extracts a surface directly from the irregularly spaced, noisy freehand ultrasound data. The freehand data are first interpolated with radial basis functions and then a mesh is formed along an isosurface of the functional interpolation. The ability of radial basis functions to smooth speckle and interpolate across gaps is demonstrated on a series of experiments with phantoms and human tissue in a water bath. The geometry of the extracted surface matches the external measurements with an average difference ranging from 0.8 to 2.9 mm. These differences are within the range of errors from calibration, resolution and landmark localization. The experiments also show the ability to create continuous and realistic surfaces from scans that require multiple sweeps over a structure.
Collapse
Affiliation(s)
- Wayne Y Zhang
- Department of Electrical and Computer Engineering, University of British Columbia, Vancouver, British Columbia V6T 1Z4, Canada
| | | | | |
Collapse
|