1
|
Song Z, Wu H, Chen W, Slowik A. Improving automatic segmentation of liver tumor images using a deep learning model. Heliyon 2024; 10:e28538. [PMID: 38571625 PMCID: PMC10988037 DOI: 10.1016/j.heliyon.2024.e28538] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2023] [Revised: 03/17/2024] [Accepted: 03/20/2024] [Indexed: 04/05/2024] Open
Abstract
Liver tumors are one of the most aggressive malignancies in the human body. Computer-aided technology and liver interventional surgery are effective in the prediction, identification and management of liver neoplasms. One of the important processes is to accurately grasp the morphological structure of the liver and liver blood vessels. However, accurate identification and segmentation of hepatic blood vessels in CT images poses a formidable challenge. Manually locating and segmenting liver vessels in CT images is time-consuming and impractical. There is an imperative clinical requirement for a precise and effective algorithm to segment liver vessels. In response to this demand, the current paper advocates a liver vessel segmentation approach that employs an enhanced 3D fully convolutional neural network V-Net. The network model improves the basic network structure according to the characteristics of liver vessels. First, a pyramidal convolution block is introduced between the encoder and decoder of the network to improve the network localization ability. Then, multi-resolution deep supervision is introduced in the network, resulting in more robust segmentation. Finally, by fusing feature maps of different resolutions, the overall segmentation result is predicted. Evaluation experiments on public datasets demonstrate that our improved scheme can increase the segmentation ability of existing network models for liver vessels. Compared with the existing work, the experimental outcomes demonstrate that the technique presented in this manuscript has attained superior performance on the Dice Coefficient index, which can promote the treatment of liver tumors.
Collapse
Affiliation(s)
- Zhendong Song
- School of Mechanical and Electrical Engineering, Shenzhen Polytechnic University, Shenzhen, 518055, China
| | - Huiming Wu
- School of Mechanical and Electrical Engineering, Shenzhen Polytechnic University, Shenzhen, 518055, China
| | - Wei Chen
- School of Mechanical and Electrical Engineering, Shenzhen Polytechnic University, Shenzhen, 518055, China
| | - Adam Slowik
- Koszalin University of Technology, Koszalin, Poland
| |
Collapse
|
2
|
Zhang X, He M, Li H. DAU-Net: A medical image segmentation network combining the Hadamard product and dual scale attention gate. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2024; 21:2753-2767. [PMID: 38454705 DOI: 10.3934/mbe.2024122] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/09/2024]
Abstract
Medical image segmentation has an important application value in the modern medical field, it can help doctors accurately locate and analyze the tissue structure, lesion areas, and organ boundaries in the image, which provides key information support for clinical diagnosis and treatment, but there are still a large number of problems in the accuracy of the segmentation, so in this paper, we propose a medical image segmentation network combining the Hadamard product and dual-scale attention gate (DAU-Net). First, the Hadamard product is introduced in the structure of the fifth layer of the codec for element-by-element multiplication, which can generate feature representations with more representational capabilities. Second, in the jump connection module, we propose a dual scale attention gating (DSAG), which can highlight more valuable features and achieve more efficient jump connections. Finally, in the decoder feature structure, the final segmentation result is obtained by aggregating the feature information provided by each part, and decoding is achieved by up-sampling operation. Through experiments on two public datasets, Luna and Isic2017, DAU-Net is able to extract feature information more efficiently using different modules and has better segmentation results compared to classical segmentation models such as U-Net and U-Net++, and also verifies the effectiveness of the model.
Collapse
Affiliation(s)
- Xiaoyan Zhang
- School of Computer Science and Technology, Xi'an University of Science and Technology, Xi'an 710054, China
| | - Mengmeng He
- School of Computer Science and Technology, Xi'an University of Science and Technology, Xi'an 710054, China
| | - Hongan Li
- School of Computer Science and Technology, Xi'an University of Science and Technology, Xi'an 710054, China
- State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing 100191, China
| |
Collapse
|
3
|
He R, Xu S, Liu Y, Li Q, Liu Y, Zhao N, Yuan Y, Zhang H. Three-Dimensional Liver Image Segmentation Using Generative Adversarial Networks Based on Feature Restoration. Front Med (Lausanne) 2022; 8:794969. [PMID: 35071275 PMCID: PMC8777029 DOI: 10.3389/fmed.2021.794969] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2021] [Accepted: 11/22/2021] [Indexed: 11/13/2022] Open
Abstract
Medical imaging provides a powerful tool for medical diagnosis. In the process of computer-aided diagnosis and treatment of liver cancer based on medical imaging, accurate segmentation of liver region from abdominal CT images is an important step. However, due to defects of liver tissue and limitations of CT imaging procession, the gray level of liver region in CT image is heterogeneous, and the boundary between the liver and those of adjacent tissues and organs is blurred, which makes the liver segmentation an extremely difficult task. In this study, aiming at solving the problem of low segmentation accuracy of the original 3D U-Net network, an improved network based on the three-dimensional (3D) U-Net, is proposed. Moreover, in order to solve the problem of insufficient training data caused by the difficulty of acquiring labeled 3D data, an improved 3D U-Net network is embedded into the framework of generative adversarial networks (GAN), which establishes a semi-supervised 3D liver segmentation optimization algorithm. Finally, considering the problem of poor quality of 3D abdominal fake images generated by utilizing random noise as input, deep convolutional neural networks (DCNN) based on feature restoration method is designed to generate more realistic fake images. By testing the proposed algorithm on the LiTS-2017 and KiTS19 dataset, experimental results show that the proposed semi-supervised 3D liver segmentation method can greatly improve the segmentation performance of liver, with a Dice score of 0.9424 outperforming other methods.
Collapse
Affiliation(s)
- Runnan He
- Peng Cheng Laboratory, Shenzhen, China
| | - Shiqi Xu
- School of Computer Science and Technology, Harbin Institute of Technology (HIT), Harbin, China
| | - Yashu Liu
- School of Computer Science and Technology, Harbin Institute of Technology (HIT), Harbin, China
| | - Qince Li
- Peng Cheng Laboratory, Shenzhen, China
- School of Computer Science and Technology, Harbin Institute of Technology (HIT), Harbin, China
| | - Yang Liu
- School of Computer Science and Technology, Harbin Institute of Technology (HIT), Harbin, China
| | - Na Zhao
- School of Instrument Science and Engineering, Southeast University, Nanjing, China
| | - Yongfeng Yuan
- School of Computer Science and Technology, Harbin Institute of Technology (HIT), Harbin, China
| | - Henggui Zhang
- Peng Cheng Laboratory, Shenzhen, China
- School of Physics and Astronomy, The University of Manchester, Manchester, United Kingdom
- Key Laboratory of Medical Electrophysiology of Ministry of Education and Medical Electrophysiological Key Laboratory of Sichuan Province, Institute of Cardiovascular Research, Southwest Medical University, Luzhou, China
| |
Collapse
|
4
|
Automatic Liver Segmentation in CT Images with Enhanced GAN and Mask Region-Based CNN Architectures. BIOMED RESEARCH INTERNATIONAL 2021; 2021:9956983. [PMID: 34957310 PMCID: PMC8702320 DOI: 10.1155/2021/9956983] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/29/2021] [Revised: 09/22/2021] [Accepted: 11/26/2021] [Indexed: 01/10/2023]
Abstract
Liver image segmentation has been increasingly employed for key medical purposes, including liver functional assessment, disease diagnosis, and treatment. In this work, we introduce a liver image segmentation method based on generative adversarial networks (GANs) and mask region-based convolutional neural networks (Mask R-CNN). Firstly, since most resulting images have noisy features, we further explored the combination of Mask R-CNN and GANs in order to enhance the pixel-wise classification. Secondly, k-means clustering was used to lock the image aspect ratio, in order to get more essential anchors which can help boost the segmentation performance. Finally, we proposed a GAN Mask R-CNN algorithm which achieved superior performance in comparison with the conventional Mask R-CNN, Mask-CNN, and k-means algorithms in terms of the Dice similarity coefficient (DSC) and the MICCAI metrics. The proposed algorithm also achieved superior performance in comparison with ten state-of-the-art algorithms in terms of six Boolean indicators. We hope that our work can be effectively used to optimize the segmentation and classification of liver anomalies.
Collapse
|
5
|
Chen L, Song H, Wang C, Cui Y, Yang J, Hu X, Zhang L. Liver tumor segmentation in CT volumes using an adversarial densely connected network. BMC Bioinformatics 2019; 20:587. [PMID: 31787071 PMCID: PMC6886252 DOI: 10.1186/s12859-019-3069-x] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/01/2023] Open
Abstract
Background Malignant liver tumor is one of the main causes of human death. In order to help physician better diagnose and make personalized treatment schemes, in clinical practice, it is often necessary to segment and visualize the liver tumor from abdominal computed tomography images. Due to the large number of slices in computed tomography sequence, developing an automatic and reliable segmentation method is very favored by physicians. However, because of the noise existed in the scan sequence and the similar pixel intensity of liver tumors with their surrounding tissues, besides, the size, position and shape of tumors also vary from one patient to another, automatic liver tumor segmentation is still a difficult task. Results We perform the proposed algorithm to the Liver Tumor Segmentation Challenge dataset and evaluate the segmentation results. Experimental results reveal that the proposed method achieved an average Dice score of 68.4% for tumor segmentation by using the designed network, and ASD, MSD, VOE and RVD improved from 27.8 to 21, 147 to 124, 0.52 to 0.46 and 0.69 to 0.73, respectively after performing adversarial training strategy, which proved the effectiveness of the proposed method. Conclusions The testing results show that the proposed method achieves improved performance, which corroborated the adversarial training based strategy can achieve more accurate and robustness results on liver tumor segmentation task.
Collapse
Affiliation(s)
- Lei Chen
- School of Computer Science & Technology, Beijing Institute of Technology, 5 South Zhongguancun Street, Beijing, 100081, China
| | - Hong Song
- School of Computer Science & Technology, Beijing Institute of Technology, 5 South Zhongguancun Street, Beijing, 100081, China.
| | - Chi Wang
- School of Computer Science & Technology, Beijing Institute of Technology, 5 South Zhongguancun Street, Beijing, 100081, China
| | - Yutao Cui
- School of Computer Science & Technology, Beijing Institute of Technology, 5 South Zhongguancun Street, Beijing, 100081, China
| | - Jian Yang
- School of Optics and Electronics & Technology, Beijing Institute of Technology, 5 South Zhongguancun Street, Beijing, 100081, China
| | - Xiaohua Hu
- College of Computing & Informatics, Drexel University, Philadelphia, PA, USA
| | - Le Zhang
- College of Computer Science, Sichuan University, Chengdu, China
| |
Collapse
|
6
|
Zhang Y, Folkert MR, Huang X, Ren L, Meyer J, Tehrani JN, Reynolds R, Wang J. Enhancing liver tumor localization accuracy by prior-knowledge-guided motion modeling and a biomechanical model. Quant Imaging Med Surg 2019; 9:1337-1349. [PMID: 31448218 PMCID: PMC6685812 DOI: 10.21037/qims.2019.07.04] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2019] [Accepted: 07/10/2019] [Indexed: 11/06/2022]
Abstract
BACKGROUND Pre-treatment liver tumor localization remains a challenging task for radiation therapy, mostly due to the limited tumor contrast against normal liver tissues, and the respiration-induced liver tumor motion. Recently, we developed a biomechanical modeling-based, deformation-driven cone-beam CT estimation technique (Bio-CBCT), which achieved substantially improved accuracy on low-contrast liver tumor localization. However, the accuracy of Bio-CBCT is still affected by the limited tissue contrast around the caudal liver boundary, which reduces the accuracy of the boundary condition that is fed into the biomechanical modeling process. In this study, we developed a motion modeling and biomechanical modeling-guided CBCT estimation technique (MM-Bio-CBCT), to further improve the liver tumor localization accuracy by incorporating a motion model into the CBCT estimation process. METHODS MM-Bio-CBCT estimates new CBCT images through deforming a prior high-quality CT or CBCT volume. The deformation vector field (DVF) is solved by iteratively matching the digitally-reconstructed-radiographs (DRRs) of the deformed prior image to the acquired 2D cone-beam projections. Using the same solved DVF, the liver tumor volume contoured on the prior image can be transferred onto the new CBCT image for automatic tumor localization. To maximize the accuracy of the solved DVF, MM-Bio-CBCT employs two strategies for additional DVF optimization: (I) prior-knowledge-guided liver boundary motion modeling with motion patterns extracted from a prior 4D imaging set like 4D-CTs/4D-CBCTs, to improve the liver boundary DVF accuracy; and (II) finite-element-analysis-based biomechanical modeling of the liver volume to improve the intra-liver DVF accuracy. We evaluated the accuracy of MM-Bio-CBCT on both the digital extended-cardiac-torso (XCAT) phantom images and real liver patient images. The liver tumor localization accuracy of MM-Bio-CBCT was evaluated and compared with that of the purely intensity-driven 2D-3D deformation technique, the 2D-3D deformation technique with motion modeling, and the Bio-CBCT technique. Metrics including the DICE coefficient and the center-of-mass-error (COME) were assessed for quantitative evaluation. RESULTS Using limited-view 20 projections for CBCT estimation, the average (± SD) DICE coefficients between the estimated and the 'gold-standard' liver tumors of the XCAT study were 0.57±0.31, 0.78±0.26, 0.83±0.21, and 0.89±0.11 for 2D-3D deformation, 2D-3D deformation with motion modeling, Bio-CBCT and MM-Bio-CBCT techniques, respectively. Using 20 projections for estimation, the patient study yielded average DICE results of 0.63±0.21, 0.73±0.13 and 0.78±0.12, and 0.83±0.09, correspondingly. The MM-Bio-CBCT localized the liver tumor to an average COME of ~2 mm for both the XCAT and the liver patient studies. CONCLUSIONS Compared to Bio-CBCT, MM-Bio-CBCT further improves the accuracy of liver tumor localization. MM-Bio-CBCT can potentially be used towards pre-treatment liver tumor localization and intra-treatment liver tumor location verification to achieve substantial radiotherapy margin reduction.
Collapse
Affiliation(s)
- You Zhang
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, TX, USA
| | - Michael R. Folkert
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, TX, USA
| | - Xiaokun Huang
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, TX, USA
| | - Lei Ren
- Department of Radiation Oncology, Duke University Medical Center, Durham, NC, USA
| | - Jeffrey Meyer
- Department of Radiation Oncology and Molecular Radiation Sciences, Johns Hopkins University School of Medicine, Baltimore, USA
| | - Joubin Nasehi Tehrani
- Department of Radiation Oncology, University of Virginia Medical Center, Charlottesville, VA, USA
| | - Robert Reynolds
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, TX, USA
| | - Jing Wang
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, TX, USA
| |
Collapse
|
7
|
Deng Z, Guo Q, Zhu Z. Dynamic Regulation of Level Set Parameters Using 3D Convolutional Neural Network for Liver Tumor Segmentation. JOURNAL OF HEALTHCARE ENGINEERING 2019; 2019:4321645. [PMID: 30918620 PMCID: PMC6409057 DOI: 10.1155/2019/4321645] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/19/2018] [Accepted: 02/06/2019] [Indexed: 02/07/2023]
Abstract
Segmentation of liver tumors plays an important role in the choice of therapeutic strategies for liver disease and treatment monitoring. In this paper, we generalize the process of a level set with a novel algorithm of dynamic regulation to energy functional parameters. The presented method is fully automatic once the tumor has been detected. First, a 3D convolutional neural network with dense layers for classification is used to estimate current contour location relative to the tumor boundary. Second, the output 3D CNN probabilities can dynamically regulate parameters of the level set functional over the process of segmentation. Finally, for full automation, appropriate initializations and local window size are generated based on the current contour position probabilities. We demonstrate the proposed method on the dataset of MICCAI 2017 LiTS Challenge and 3DIRCADb that include low contrast and heterogeneous tumors as well as noisy images. To illustrate the strength of our method, we evaluated it against the state-of-the-art methods. Compared with the level set framework with fixed parameters, our method performed better significantly with an average DICE improvement of 0.15. We also analyzed a challenging dataset 3DIRCADb of tumors and obtained a competitive DICE of 0.85 ± 0.06 with the proposed method.
Collapse
Affiliation(s)
- Zhuofu Deng
- College of Software, Northeastern University, Shenyang 110004, China
| | - Qingzhe Guo
- College of Software, Northeastern University, Shenyang 110004, China
| | - Zhiliang Zhu
- College of Software, Northeastern University, Shenyang 110004, China
| |
Collapse
|