1
|
Zhang L, Zhang J. Ultrasound image denoising using generative adversarial networks with residual dense connectivity and weighted joint loss. PeerJ Comput Sci 2022; 8:e873. [PMID: 35494868 PMCID: PMC9044345 DOI: 10.7717/peerj-cs.873] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2021] [Accepted: 01/11/2022] [Indexed: 06/12/2023]
Abstract
BACKGROUND Ultrasound imaging has been recognized as a powerful tool in clinical diagnosis. Nonetheless, the presence of speckle noise degrades the signal-to-noise of ultrasound images. Various denoising algorithms cannot fully reduce speckle noise and retain image features well for ultrasound imaging. The application of deep learning in ultrasound image denoising has attracted more and more attention in recent years. METHODS In the article, we propose a generative adversarial network with residual dense connectivity and weighted joint loss (GAN-RW) to avoid the limitations of traditional image denoising algorithms and surpass the most advanced performance of ultrasound image denoising. The denoising network is based on U-Net architecture which includes four encoder and four decoder modules. Each of the encoder and decoder modules is replaced with residual dense connectivity and BN to remove speckle noise. The discriminator network applies a series of convolutional layers to identify differences between the translated images and the desired modality. In the training processes, we introduce a joint loss function consisting of a weighted sum of the L1 loss function, binary cross-entropy with a logit loss function and perceptual loss function. RESULTS We split the experiments into two parts. First, experiments were performed on Berkeley segmentation (BSD68) datasets corrupted by a simulated speckle. Compared with the eight existing denoising algorithms, the GAN-RW achieved the most advanced despeckling performance in terms of the peak signal-to-noise ratio (PSNR), structural similarity (SSIM), and subjective visual effect. When the noise level was 15, the average value of the GAN-RW increased by approximately 3.58% and 1.23% for PSNR and SSIM, respectively. When the noise level was 25, the average value of the GAN-RW increased by approximately 3.08% and 1.84% for PSNR and SSIM, respectively. When the noise level was 50, the average value of the GAN-RW increased by approximately 1.32% and 1.98% for PSNR and SSIM, respectively. Secondly, experiments were performed on the ultrasound images of lymph nodes, the foetal head, and the brachial plexus. The proposed method shows higher subjective visual effect when verifying on the ultrasound images. In the end, through statistical analysis, the GAN-RW achieved the highest mean rank in the Friedman test.
Collapse
Affiliation(s)
- Lun Zhang
- School of Information Science and Engineering, Yunnan University, Kunming, Yunnan, China
- Yunnan Vocational Institute of Energy Technology, Qujing, Yunnan, China
| | - Junhua Zhang
- School of Information Science and Engineering, Yunnan University, Kunming, Yunnan, China
| |
Collapse
|
2
|
Split and Merge Watershed: a two-step method for cell segmentation in fluorescence microscopy images. Biomed Signal Process Control 2019; 53. [PMID: 33719364 DOI: 10.1016/j.bspc.2019.101575] [Citation(s) in RCA: 27] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
The development of advanced techniques in medical imaging has allowed scanning of the human body to microscopic levels, making research on cell behavior more complex and more in-depth. Recent studies have focused on cellular heterogeneity since cell-to-cell differences are always present in the cell population and this variability contains valuable information. However, identifying each cell is not an easy task because, in the images acquired from the microscope, there are clusters of cells that are touching one another. Therefore, the segmentation stage is a problem of considerable difficulty in cell image processing. Although several methods for cell segmentation are described in the literature, they have drawbacks in terms of over-segmentation, under-segmentation or misidentification. Consequently, our main motivation in studying cell segmentation was to develop a new method to achieve a good tradeoff between accurately identifying all relevant elements and not inserting segmentation artifacts. This article presents a new method for cell segmentation in fluorescence microscopy images. The proposed approach combines the well-known Marker-Controlled Watershed algorithm (MC-Watershed) with a new, two-step method based on Watershed, Split and Merge Watershed (SM-Watershed): in the first step, or split phase, the algorithm identifies the clusters using inherent characteristics of the cell, such as size and convexity, and separates them using watershed. In the second step, or the merge stage, it identifies the over-segmented regions using proper features of the cells and eliminates the divisions. Before applying our two-step method, the input image is first preprocessed, and the MC-Watershed algorithm is used to generate an initial segmented image. However, this initial result may not be suitable for subsequent tasks, such as cell count or feature extraction, because not all cells are separated, and some cells may be mistakenly confused with the background. Thus, our proposal corrects this issue with its two-step process, reaching a high performance, a suitable tradeoff between over-segmentation and under-segmentation and preserving the shape of the cell, without the need of any labeled data or relying on machine learning processes. The latter is advantageous over state-of-the-art techniques that in order to achieve similar results require labeled data, which may not be available for all of the domains. Two cell datasets were used to validate this approach, and the results were compared with other methods in the literature, using traditional metrics and quality visual assessment. We obtained 90% of average visual accuracy and an F-index higher than 80%. This proposal outperforms other techniques for cell separation, achieving an acceptable balance between over-segmentation and under-segmentation, which makes it suitable for several applications in cell identification, such as virus infection analysis, high-content cell screening, drug discovery, and morphometry.
Collapse
|
3
|
Digital Image Analysis of Cells and Computational Tools for the Study of Mechanism of RSV Entry to Human Bronchial Epithelium. SISTEMAS E TECNOLOGIAS DE INFORMACAO : ATAS DE 12A CONFERENCIA IBERICA DE SISTEMAS E TECNOLOGIAS DE INFORMACAO (CISTI'2017) : 21 A 24 DE JUNHO DE 2017, LISBOA, PORTUGAL = INFORMATION SYSTEMS AND TECHNOLOGIES : PROCEEDINGS OF THE 12TH IB... 2017; 2017. [PMID: 34337619 DOI: 10.23919/cisti.2017.7975726] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Abstract
this paper presents a research proposal which has been developed as a doctoral thesis in the PhD program in Computer Systems Engineering at the Universidad del Norte since August 2015. This research focuses on the analysis of cell images of the human bronchial epithelium infected with the Respiratory Syncytial Virus in order to understand the mechanisms of entry of the virus into the human body. Due to the large amount of information that is processed, it is necessary to use computational tools to finally differentiate between infected and uninfected cells.
Collapse
|
4
|
Suárez-Mejías C, Pérez-Carrasco JA, Serrano C, López-Guerra JL, Parra-Calderón C, Gómez-Cía T, Acha B. Three-dimensional segmentation of retroperitoneal masses using continuous convex relaxation and accumulated gradient distance for radiotherapy planning. Med Biol Eng Comput 2016; 55:1-15. [PMID: 27099157 DOI: 10.1007/s11517-016-1505-x] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2015] [Accepted: 03/28/2016] [Indexed: 11/25/2022]
Abstract
An innovative algorithm has been developed for the segmentation of retroperitoneal tumors in 3D radiological images. This algorithm makes it possible for radiation oncologists and surgeons semiautomatically to select tumors for possible future radiation treatment and surgery. It is based on continuous convex relaxation methodology, the main novelty being the introduction of accumulated gradient distance, with intensity and gradient information being incorporated into the segmentation process. The algorithm was used to segment 26 CT image volumes. The results were compared with manual contouring of the same tumors. The proposed algorithm achieved 90 % sensitivity, 100 % specificity and 84 % positive predictive value, obtaining a mean distance to the closest point of 3.20 pixels. The algorithm's dependence on the initial manual contour was also analyzed, with results showing that the algorithm substantially reduced the variability of the manual segmentation carried out by different specialists. The algorithm was also compared with four benchmark algorithms (thresholding, edge-based level-set, region-based level-set and continuous max-flow with two labels). To the best of our knowledge, this is the first time the segmentation of retroperitoneal tumors for radiotherapy planning has been addressed.
Collapse
Affiliation(s)
- Cristina Suárez-Mejías
- Technological Innovation Group, Virgen del Rocío University Hospital, Seville, Spain.
- Signal Theory and Communications Department, University of Seville, Seville, Spain.
| | | | - Carmen Serrano
- Signal Theory and Communications Department, University of Seville, Seville, Spain
| | | | - Carlos Parra-Calderón
- Technological Innovation Group, Virgen del Rocío University Hospital, Seville, Spain
| | - Tomás Gómez-Cía
- Surgery Unit, Virgen del Rocío University Hospital, Seville, Spain
| | - Begoña Acha
- Signal Theory and Communications Department, University of Seville, Seville, Spain
| |
Collapse
|
5
|
Steger S, Bozoglu N, Kuijper A, Wesarg S. Application of radial ray based segmentation to cervical lymph nodes in CT images. IEEE TRANSACTIONS ON MEDICAL IMAGING 2013; 32:888-900. [PMID: 23362249 DOI: 10.1109/tmi.2013.2242901] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
The 3D-segmentation of lymph nodes in computed tomography images is required for staging and disease progression monitoring. Major challenges are shape and size variance, as well as low contrast, image noise, and pathologies. In this paper, radial ray based segmentation is applied to lymph nodes. From a seed point, rays are cast into all directions and an optimization technique determines a radius for each ray based on image appearance and shape knowledge. Lymph node specific appearance cost functions are introduced and their optimal parameters are determined. For the first time, the resulting segmentation accuracy of different appearance cost functions and optimization strategies is compared. Further contributions are extensions to reduce the dependency on the seed point, to support a larger variety of shapes, and to enable interaction. The best results are obtained using graph-cut on a combination of the direction weighted image gradient and accumulated intensities outside a predefined intensity range. Evaluation on 100 lymph nodes shows that with an average symmetric surface distance of 0.41 mm the segmentation accuracy is close to manual segmentation and outperforms existing radial ray and model based methods. The method's inter-observer-variability of 5.9% for volume assessment is lower than the 15.9% obtained using manual segmentation.
Collapse
|
6
|
Xu S, Liu H, Song E. Marker-controlled watershed for lesion segmentation in mammograms. J Digit Imaging 2012; 24:754-63. [PMID: 21327973 DOI: 10.1007/s10278-011-9365-2] [Citation(s) in RCA: 57] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022] Open
Abstract
Lesion segmentation, which is a critical step in computer-aided diagnosis system, is a challenging task as lesion boundaries are usually obscured, irregular, and low contrast. In this paper, an accurate and robust algorithm for the automatic segmentation of breast lesions in mammograms is proposed. The traditional watershed transformation is applied to the smoothed (by the morphological reconstruction) morphological gradient image to obtain the lesion boundary in the belt between the internal and external markers. To automatically determine the internal and external markers, the rough region of the lesion is identified by a template matching and a thresholding method. Then, the internal marker is determined by performing a distance transform and the external marker by morphological dilation. The proposed algorithm is quantitatively compared to the dynamic programming boundary tracing method and the plane fitting and dynamic programming method on a set of 363 lesions (size range, 5-42 mm in diameter; mean, 15 mm), using the area overlap metric (AOM), Hausdorff distance (HD), and average minimum Euclidean distance (AMED). The mean ± SD of the values of AOM, HD, and AMED for our method were respectively 0.72 ± 0.13, 5.69 ± 2.85 mm, and 1.76 ± 1.04 mm, which is a better performance than two other proposed segmentation methods. The results also confirm the potential of the proposed algorithm to allow reliable segmentation and quantification of breast lesion in mammograms.
Collapse
Affiliation(s)
- Shengzhou Xu
- School of Computer Science and Technology, Huazhong University of Science and Technology, 1037 Luoyu Road, Wuhan 430074, China.
| | | | | |
Collapse
|
7
|
Debats OA, Litjens GJS, Barentsz JO, Karssemeijer N, Huisman HJ. Automated 3-dimensional segmentation of pelvic lymph nodes in magnetic resonance images. Med Phys 2012; 38:6178-87. [PMID: 22047383 DOI: 10.1118/1.3654162] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
PURPOSE Computer aided diagnosis (CAD) of lymph node metastases may help reduce reading time and improve interpretation of the large amount of image data in a 3-D pelvic MRI exam. The purpose of this study was to develop an algorithm for automated segmentation of pelvic lymph nodes from a single seed point, as part of a CAD system for the classification of normal vs metastatic lymph nodes, and to evaluate its performance compared to other algorithms. METHODS The authors' database consisted of pelvic MR images of 146 consecutive patients, acquired between January 2008 and April 2010. Each dataset included four different MR sequences, acquired after infusion of a lymph node specific contrast medium based on ultrasmall superparamagnetic particles of iron oxide. All data sets were analyzed by two expert readers who, reading in consensus, annotated and manually segmented the lymph nodes. The authors compared four segmentation algorithms: confidence connected region growing (CCRG), extended CCRG (ECC), graph cut segmentation (GCS), and a segmentation method based on a parametric shape and appearance model (PSAM). The methods were ranked based on spatial overlap with the manual segmentations, and based on diagnostic accuracy in a CAD system, with the experts' annotations as reference standard. RESULTS A total of 2347 manually annotated lymph nodes were included in the analysis, of which 566 contained a metastasis. The mean spatial overlap (Dice similarity coefficient) was: 0.35 (CCRG), 0.57 (ECC), 0.44 (GCS), and 0.46 (PSAM). When combined with the classification system, the area under the ROC curve was: 0.805 (CCRG), 0.890 (ECC), 0.807 (GCS), 0.891 (PSAM), and 0.935 (manual segmentation). CONCLUSIONS We identified two segmentation methods, ECC and PSAM, that achieve a high diagnostic accuracy when used in conjunction with a CAD system for classification of normal vs metastatic lymph nodes. The manual segmentations still achieve the highest diagnostic accuracy.
Collapse
Affiliation(s)
- O A Debats
- Radboud University Nijmegen Medical Centre, Nijmegen, Gelderland, The Netherlands.
| | | | | | | | | |
Collapse
|
8
|
Sammet S, Evans KD, Irfanoglu MO, Strapp A, Machiraju R. The feasibility of hybrid automatic segmentation of axillary lymph nodes from a 3-D sonogram. ULTRASOUND IN MEDICINE & BIOLOGY 2011; 37:2075-2085. [PMID: 22033128 DOI: 10.1016/j.ultrasmedbio.2011.09.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/24/2010] [Revised: 08/03/2011] [Accepted: 09/06/2011] [Indexed: 05/31/2023]
Abstract
The use of manual segmentation of lymph nodes, within an ultrasound image, is challenging due to operator dependency and speckle. A group of 23 healthy female volunteers consented to a short imaging session to capture a maximum of three axillary lymph nodes. A feasibility study was completed using both automatic and manual segmentation techniques to analyze a sample of 45, three-dimensional (3-D) nodal volume sets. Level-set segmentation based on geodesic active contours and shape-space learning based on a level-set segmentation approach was used to capture global node shapes. Most of the image feature based segmentation methods failed; however, a more precise automatic segmentation algorithm was obtained using a superimposed shape model. Shape model based segmentation significantly improved the segmentation compared with standard level sets. The best segmentation results were achieved when an experienced sonographer assisted with setting seed surfaces. The initialization of seed surfaces improved the capture of the global shape and lymphatic vessels.
Collapse
Affiliation(s)
- Steffen Sammet
- The Ohio State University Department of Radiology, Columbus, OH, USA
| | | | | | | | | |
Collapse
|
9
|
Murali S, Leong DFM, Lee JJL, Cool SM, Nurcombe V. Comparative assessment of the effects of gender-specific heparan sulfates on mesenchymal stem cells. J Biol Chem 2011; 286:17755-65. [PMID: 21454472 DOI: 10.1074/jbc.m110.148874] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022] Open
Abstract
We compare here the structural and functional properties of heparan sulfate (HS) chains from both male or female adult mouse liver through a combination of molecular sieving, enzymatic cleavage, and strong anion exchange-HPLC. The results demonstrated that male and female HS chains are significantly different by a number of parameters; size determination showed that HS chain lengths were ∼100 and ∼22 kDa, comprising 30-40 and 6-8 disaccharide repeats, respectively. Enzymatic depolymerization and disaccharide composition analyses also demonstrated significant differences in domain organization and fine structure. N-Unsubstituted glucosamine (ΔHexA-GlcNH(3)(+), ΔHexA-GlcNH(3)(+)(6S), ΔHexA(2S)-GlcNH(3)(+), and N-acetylglucosamine (ΔHexA-GlcNAc) are the predominant disaccharides in male mouse liver HS. However, N-sulfated glucosamine (ΔHexA-GlcNSO(3)) is the predominant disaccharide found in female liver. These structurally different male and female liver HS forms exert differential effects on human mesenchymal cell proliferation and subsequent osteogenic differentiation. The present study demonstrates the potential usefulness of gender-specific liver HS for the manipulation of human mesenchymal cell properties, including expansion, multipotentiality, and subsequent matrix mineralization. Our results suggest that HS chains show both tissue- and gender-specific differences in biochemical composition that directly reflect their biological activity.
Collapse
Affiliation(s)
- Sadasivam Murali
- Stem Cells and Tissue Repair Group, Institute of Medical Biology, 8A Biomedical Grove, 06-06 Immunos, Singapore 138648
| | | | | | | | | |
Collapse
|
10
|
|