1
|
Sun S, Huang Y, Inoue K, Hara K. Order Space-Based Morphology for Color Image Processing. J Imaging 2023; 9:139. [PMID: 37504816 PMCID: PMC10381322 DOI: 10.3390/jimaging9070139] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2023] [Revised: 06/01/2023] [Accepted: 07/06/2023] [Indexed: 07/29/2023] Open
Abstract
Mathematical morphology is a fundamental tool based on order statistics for image processing, such as noise reduction, image enhancement and feature extraction, and is well-established for binary and grayscale images, whose pixels can be sorted by their pixel values, i.e., each pixel has a single number. On the other hand, each pixel in a color image has three numbers corresponding to three color channels, e.g., red (R), green (G) and blue (B) channels in an RGB color image. Therefore, it is difficult to sort color pixels uniquely. In this paper, we propose a method for unifying the orders of pixels sorted in each color channel separately, where we consider that a pixel exists in a three-dimensional space called order space, and derive a single order by a monotonically nondecreasing function defined on the order space. We also fuzzify the proposed order space-based morphological operations, and demonstrate the effectiveness of the proposed method by comparing with a state-of-the-art method based on hypergraph theory. The proposed method treats three orders of pixels sorted in respective color channels equally. Therefore, the proposed method is consistent with the conventional morphological operations for binary and grayscale images.
Collapse
Affiliation(s)
- Shanqian Sun
- Department of Media Design, Faculty of Design, Kyushu University, 4-9-1, Shiobaru, Minami-ku, Fukuoka 815-8540, Japan
| | - Yunjia Huang
- Department of Media Design, Faculty of Design, Kyushu University, 4-9-1, Shiobaru, Minami-ku, Fukuoka 815-8540, Japan
| | - Kohei Inoue
- Department of Media Design, Faculty of Design, Kyushu University, 4-9-1, Shiobaru, Minami-ku, Fukuoka 815-8540, Japan
| | - Kenji Hara
- Department of Media Design, Faculty of Design, Kyushu University, 4-9-1, Shiobaru, Minami-ku, Fukuoka 815-8540, Japan
| |
Collapse
|
2
|
Bembenek M, Mandziy T, Ivasenko I, Berehulyak O, Vorobel R, Slobodyan Z, Ropyak L. Multiclass Level-Set Segmentation of Rust and Coating Damages in Images of Metal Structures. Sensors (Basel) 2022; 22:7600. [PMID: 36236705 PMCID: PMC9571848 DOI: 10.3390/s22197600] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/03/2022] [Revised: 09/30/2022] [Accepted: 10/05/2022] [Indexed: 06/16/2023]
Abstract
This paper describes the combined detection of coating and rust damages on painted metal structures through the multiclass image segmentation technique. Our prior works were focused solely on the localization of rust damages and rust segmentation under different ambient conditions (different lighting conditions, presence of shadows, low background/object color contrast). This paper method proposes three types of damages: coating crack, coating flaking, and rust damage. Background, paint flaking, and rust damage are objects that can be separated in RGB color-space alone. For their preliminary classification SVM is used. As for paint cracks, color features are insufficient for separating it from other defect types as they overlap with the other three classes in RGB color space. For preliminary paint crack segmentation we use the valley detection approach, which analyses the shape of defects. A multiclass level-set approach with a developed penalty term is used as a framework for the advanced final damage segmentation stage. Model training and accuracy assessment are fulfilled on the created dataset, which contains input images of corresponding defects with respective ground truth data provided by the expert. A quantitative analysis of the accuracy of the proposed approach is provided. The efficiency of the approach is demonstrated on authentic images of coated surfaces.
Collapse
Affiliation(s)
- Michał Bembenek
- Department of Manufacturing Systems, Faculty of Mechanical Engineering and Robotics, AGH University of Science and Technology, 30-059 Kraków, Poland
| | - Teodor Mandziy
- Department of the Theory of Wave Processes and Optical Systems of Diagnostics, Karpenko Physico-Mechanical Institute of the NAS of Ukraine, 5 Naukova St., 79060 Lviv, Ukraine
| | - Iryna Ivasenko
- Department of the Theory of Wave Processes and Optical Systems of Diagnostics, Karpenko Physico-Mechanical Institute of the NAS of Ukraine, 5 Naukova St., 79060 Lviv, Ukraine
| | - Olena Berehulyak
- Department of the Theory of Wave Processes and Optical Systems of Diagnostics, Karpenko Physico-Mechanical Institute of the NAS of Ukraine, 5 Naukova St., 79060 Lviv, Ukraine
| | - Roman Vorobel
- Department of the Theory of Wave Processes and Optical Systems of Diagnostics, Karpenko Physico-Mechanical Institute of the NAS of Ukraine, 5 Naukova St., 79060 Lviv, Ukraine
- Department of Computer Sciences, University of Lodz, Pomorska Str. 149/153, 90-236 Lodz, Poland
| | - Zvenomyra Slobodyan
- Department of Corrosion and Corrosion Protection, Karpenko Physico-Mechanical Institute of the NAS of Ukraine, 5 Naukova St., 79060 Lviv, Ukraine
| | - Liubomyr Ropyak
- Department of Computerized Engineering, Ivano-Frankivsk National Technical University of Oil and Gas, 76019 Ivano-Frankivsk, Ukraine
| |
Collapse
|
3
|
Giuliani D. Metaheuristic Algorithms Applied to Color Image Segmentation on HSV Space. J Imaging 2022; 8:jimaging8010006. [PMID: 35049847 PMCID: PMC8779226 DOI: 10.3390/jimaging8010006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2021] [Accepted: 12/31/2021] [Indexed: 11/16/2022] Open
Abstract
In this research, we propose an unsupervised method for segmentation and edge extraction of color images on the HSV space. This approach is composed of two different phases in which are applied two metaheuristic algorithms, respectively the Firefly (FA) and the Artificial Bee Colony (ABC) algorithms. In the first phase, we performed a pixel-based segmentation on each color channel, applying the FA algorithm and the Gaussian Mixture Model. The FA algorithm automatically detects the number of clusters, given by histogram maxima of each single-band image. The detected maxima define the initial means for the parameter estimation of the GMM. Applying the Bayes’ rule, the posterior probabilities of the GMM can be used for assigning pixels to clusters. After processing each color channel, we recombined the segmented components in the final multichannel image. A further reduction in the resultant cluster colors is obtained using the inner product as a similarity index. In the second phase, once we have assigned all pixels to the corresponding classes of the HSV space, we carry out the second step with a region-based segmentation applied to the corresponding grayscale image. For this purpose, the bioinspired Artificial Bee Colony algorithm is performed for edge extraction.
Collapse
Affiliation(s)
- Donatella Giuliani
- School of Economics, Management and Statistics, University of Bologna, 40126 Bologna, Italy
| |
Collapse
|
4
|
Akazawa T, Kinoshita Y, Shiota S, Kiya H. Three-Color Balancing for Color Constancy Correction. J Imaging 2021; 7:jimaging7100207. [PMID: 34677293 PMCID: PMC8538974 DOI: 10.3390/jimaging7100207] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2021] [Revised: 09/22/2021] [Accepted: 10/02/2021] [Indexed: 11/16/2022] Open
Abstract
This paper presents a three-color balance adjustment for color constancy correction. White balancing is a typical adjustment for color constancy in an image, but there are still lighting effects on colors other than white. Cheng et al. proposed multi-color balancing to improve the performance of white balancing by mapping multiple target colors into corresponding ground truth colors. However, there are still three problems that have not been discussed: choosing the number of target colors, selecting target colors, and minimizing error which causes computational complexity to increase. In this paper, we first discuss the number of target colors for multi-color balancing. From our observation, when the number of target colors is greater than or equal to three, the best performance of multi-color balancing in each number of target colors is almost the same regardless of the number of target colors, and it is superior to that of white balancing. Moreover, if the number of target colors is three, multi-color balancing can be performed without any error minimization. Accordingly, we propose three-color balancing. In addition, the combination of three target colors is discussed to achieve color constancy correction. In an experiment, the proposed method not only outperforms white balancing but also has almost the same performance as Cheng’s method with 24 target colors.
Collapse
|
5
|
Geread RS, Morreale P, Dony RD, Brouwer E, Wood GA, Androutsos D, Khademi A. IHC Color Histograms for Unsupervised Ki67 Proliferation Index Calculation. Front Bioeng Biotechnol 2019; 7:226. [PMID: 31632956 PMCID: PMC6779686 DOI: 10.3389/fbioe.2019.00226] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2019] [Accepted: 09/03/2019] [Indexed: 12/23/2022] Open
Abstract
Automated image analysis tools for Ki67 breast cancer digital pathology images would have significant value if integrated into diagnostic pathology workflows. Such tools would reduce the workload of pathologists, while improving efficiency, and accuracy. Developing tools that are robust and reliable to multicentre data is challenging, however, differences in staining protocols, digitization equipment, staining compounds, and slide preparation can create variabilities in image quality and color across digital pathology datasets. In this work, a novel unsupervised color separation framework based on the IHC color histogram (IHCCH) is proposed for the robust analysis of Ki67 and hematoxylin stained images in multicentre datasets. An "overstaining" threshold is implemented to adjust for background overstaining, and an automated nuclei radius estimator is designed to improve nuclei detection. Proliferation index and F1 scores were compared between the proposed method and manually labeled ground truth data for 30 TMA cores that have ground truths for Ki67+ and Ki67- nuclei. The method accurately quantified the PI over the dataset, with an average proliferation index difference of 3.25%. To ensure the method generalizes to new, diverse datasets, 50 Ki67 TMAs from the Protein Atlas were used to test the validated approach. As the ground truth for this dataset is PI ranges, the automated result was compared to the PI range. The proposed method correctly classified 74 out of 80 TMA images, resulting in a 92.5% accuracy. In addition to these validations experiments, performance was compared to two color-deconvolution based methods, and to six machine learning classifiers. In all cases, the proposed work maintained more consistent (reproducible) results, and higher PI quantification accuracy.
Collapse
Affiliation(s)
- Rokshana S Geread
- Image Analysis in Medicine Lab, Ryerson University, Toronto, ON, Canada
| | - Peter Morreale
- School of Engineering, University of Guelph, Guelph, ON, Canada
| | - Robert D Dony
- School of Engineering, University of Guelph, Guelph, ON, Canada
| | - Emily Brouwer
- Ontario Veterinarian College, University of Guelph, Guelph, ON, Canada
| | - Geoffrey A Wood
- Ontario Veterinarian College, University of Guelph, Guelph, ON, Canada
| | | | - April Khademi
- Image Analysis in Medicine Lab, Ryerson University, Toronto, ON, Canada
| |
Collapse
|
6
|
Iglesias C, Luo L, Martínez J, Kelly DJ, Taboada J, Pérez I. Obtaining the sGAG distribution profile in articular cartilage color images. BIOMED ENG-BIOMED TE 2019; 64:591-600. [PMID: 30951496 DOI: 10.1515/bmt-2018-0055] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2018] [Accepted: 12/05/2018] [Indexed: 11/15/2022]
Abstract
The articular cartilage tissue is an essential component of joints as it reduces the friction between the two bones. Its load-bearing properties depend mostly on proteoglycan distribution, which can be analyzed through the study of the presence of sulfated glycosaminoglycan (sGAG). Currently, sGAG distribution in articular cartilage is not completely known; it is calculated by means of laboratory tests that imply the inherent inaccuracy of a manual procedure. This paper presents an easy-to-use desktop software application for obtaining the sGAG distribution profile in tissue. This app uses color images of stained cartilage tissues taken under a microscope, so researchers at the Trinity Centre for Bioengineering (Dublin, Ireland) can understand the qualitative distribution of sGAG with depth in the studied tissues.
Collapse
Affiliation(s)
- Carla Iglesias
- Department of Natural Resources and Environmental Engineering, University of Vigo, 36310 Vigo, Spain
| | - Lu Luo
- Trinity Centre for Bioengineering, School of Engineering, Trinity College Dublin, Dublin 2, Ireland
| | | | - Daniel J Kelly
- Trinity Centre for Bioengineering, School of Engineering, Trinity College Dublin, Dublin 2, Ireland
| | - Javier Taboada
- Department of Natural Resources and Environmental Engineering, University of Vigo, 36310 Vigo, Spain
| | - Ignacio Pérez
- Department of Natural Resources and Environmental Engineering, University of Vigo, 36310 Vigo, Spain
| |
Collapse
|