1
|
Wang S, Liu X, Li Y, Sun X, Li Q, She Y, Xu Y, Huang X, Lin R, Kang D, Wang X, Tu H, Liu W, Huang F, Chen J. A deep learning-based stripe self-correction method for stitched microscopic images. Nat Commun 2023; 14:5393. [PMID: 37669977 PMCID: PMC10480181 DOI: 10.1038/s41467-023-41165-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Accepted: 08/22/2023] [Indexed: 09/07/2023] Open
Abstract
Stitched fluorescence microscope images inevitably exist in various types of stripes or artifacts caused by uncertain factors such as optical devices or specimens, which severely affects the image quality and downstream quantitative analysis. Here, we present a deep learning-based Stripe Self-Correction method, so-called SSCOR. Specifically, we propose a proximity sampling scheme and adversarial reciprocal self-training paradigm that enable SSCOR to utilize stripe-free patches sampled from the stitched microscope image itself to correct their adjacent stripe patches. Comparing to off-the-shelf approaches, SSCOR can not only adaptively correct non-uniform, oblique, and grid stripes, but also remove scanning, bubble, and out-of-focus artifacts, achieving the state-of-the-art performance across different imaging conditions and modalities. Moreover, SSCOR does not require any physical parameter estimation, patch-wise manual annotation, or raw stitched information in the correction process. This provides an intelligent prior-free image restoration solution for microscopists or even microscope companies, thus ensuring more precise biomedical applications for researchers.
Collapse
Affiliation(s)
- Shu Wang
- College of Mechanical Engineering and Automation, Fuzhou University, Fuzhou, 350108, China
- College of Computer and Data Science, Fuzhou University, Fuzhou, 350108, China
- Key Laboratory of OptoElectronic Science and Technology for Medicine of Ministry of Education, Fujian Provincial Key Laboratory of Photonics Technology, Fujian Normal University, Fuzhou, 350007, China
| | - Xiaoxiang Liu
- College of Computer and Data Science, Fuzhou University, Fuzhou, 350108, China
| | - Yueying Li
- College of Mechanical Engineering and Automation, Fuzhou University, Fuzhou, 350108, China
| | - Xinquan Sun
- College of Mechanical Engineering and Automation, Fuzhou University, Fuzhou, 350108, China
| | - Qi Li
- College of Computer and Data Science, Fuzhou University, Fuzhou, 350108, China
| | - Yinhua She
- College of Computer and Data Science, Fuzhou University, Fuzhou, 350108, China
| | - Yixuan Xu
- College of Mechanical Engineering and Automation, Fuzhou University, Fuzhou, 350108, China
| | - Xingxin Huang
- Key Laboratory of OptoElectronic Science and Technology for Medicine of Ministry of Education, Fujian Provincial Key Laboratory of Photonics Technology, Fujian Normal University, Fuzhou, 350007, China
| | - Ruolan Lin
- Department of Radiology, Fujian Medical University Union Hospital, Fuzhou, 350001, China
| | - Deyong Kang
- Department of Pathology, Fujian Medical University Union Hospital, Fuzhou, 350001, China
| | - Xingfu Wang
- Department of Pathology, The First Affiliated Hospital of Fujian Medical University, Fuzhou, 350005, China
| | - Haohua Tu
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, IL, 61801, USA
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, IL, 61801, USA
| | - Wenxi Liu
- College of Computer and Data Science, Fuzhou University, Fuzhou, 350108, China.
| | - Feng Huang
- College of Mechanical Engineering and Automation, Fuzhou University, Fuzhou, 350108, China.
| | - Jianxin Chen
- Key Laboratory of OptoElectronic Science and Technology for Medicine of Ministry of Education, Fujian Provincial Key Laboratory of Photonics Technology, Fujian Normal University, Fuzhou, 350007, China.
| |
Collapse
|
3
|
Wang Y, Gu Y, Li X. A Novel Low Rank Smooth Flat-Field Correction Algorithm for Hyperspectral Microscopy Imaging. IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:3862-3872. [PMID: 35969574 DOI: 10.1109/tmi.2022.3198946] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
A flat-field correction method is proposed for multiple measured hyperspectral microscopy imaging in this paper. As the most crucial preprocessing process in quantitative microscopic analysis, flat-field correction solves the uneven illumination caused by vignetting in microscopic images, and guarantees the precision of spatial and spectral information in hyperspectral microscopic imaging. In order to carry out flat-field correction and extract uneven illumination among groups of hyperspectral microscopic data containing hundreds of bands simultaneously, two properties of vignetting have been exploited: i) low-rank property is reflected by little information contained in vignetting; ii) local smoothness can be observed as a gradual change in brightness of vignetting, which is typically equivalent to the sparseness in spatial frequency domain. Combining the two properties above, a novel Low Rank Smooth Flat-field Correction (LRSFC) model modified from common orthogonal basis extraction is proposed, while an optimization is solved based on alternating direction multiplier method (ADMM), obtaining a unique flat-field term with low-rank and smooth properties. Qualitative and quantitative experimental assessments indicate that LRSFC does not add extra cell texture to the extracted flat-field term, whose performance appears prior to other state-of-the-art flat-field correction methods.
Collapse
|
4
|
Application of Intelligent Image Matching and Visual Communication in Brand Design. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:5964851. [PMID: 36035837 PMCID: PMC9410961 DOI: 10.1155/2022/5964851] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/22/2022] [Accepted: 06/15/2022] [Indexed: 11/17/2022]
Abstract
In this paper, from the perspective of improving the visual communication of brand design, image texture intelligent matching processing is needed, proposing a brand design texture intelligent matching method based on visual communication, constructing a brand design texture intelligent information acquisition model under visual communication, using automatic image imaging technology for texture imaging and feature segmentation of brand design, and extracting typical brand design and ethnic design language of texture histogram, texture segmentation, and automatic matching under visual communication according to histogram distribution, brand design texture information enhancement and optimization detection by regularized feature fusion method, extraction of edge contour feature points of brand design, and texture matching with the extracted edge contour feature points of decorative patterns as input statistics. The adaptive performance of texture matching for a brand design using this method is better, and the texture discrimination ability is stronger, which improves the application research of better reflecting brand design in modern visual communication design and promotes the innovative combination of traditional cultural elements and modern design.
Collapse
|
5
|
Microvessel quantification by fully convolutional neural networks associated with type 2 inflammation in chronic rhinosinusitis. Ann Allergy Asthma Immunol 2022; 128:697-704.e1. [PMID: 35257872 DOI: 10.1016/j.anai.2022.02.025] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2021] [Revised: 02/08/2022] [Accepted: 02/27/2022] [Indexed: 12/29/2022]
Abstract
BACKGROUND The pathogenesis of chronic rhinosinusitis (CRS) is still unclear, and little is known about angiogenesis in this disease. We utilized a fully convolutional network (FCN), which has been extensively used in image processing to study angiogenesis in CRS. OBJECTIVE To explore the tissue quantification of microvessels and their potential association with inflammation in CRS by using FCN to reflect the angiogenesis condition in CRS. METHODS For endotyping of CRS, tissue homogenates of 79 patients with CRS who had undergone functional endoscopic sinus surgery and 17 control subjects were analyzed for interferon gamma, transforming growth factor beta, interleukin (IL)-1β, IL-5, IL-6, IL-8, IL-10, IL-17, tumor necrosis factor alpha, eosinophilic cationic protein, immunoglobulin E, and Staphylococcus aureus-immunoglobulin E(SE-IgE). A total of 552 hematoxylin and eosin-stained images of 27 CRS tissue samples were used to develop an FCN, going through training, validation, and evaluation processes. An optimized FCN was applied to quantify the microvessels of tissue samples of all subjects. Correlation analysis between microvessel quantification with phenotype, endotype, clinical characteristics, and cytokine expression of CRS was carried out. RESULTS Quantification of microvessels in type 2 and non-type 2 CRS demonstrated considerable differences, with a higher expression in type 2 CRS. There was a strong negative correlation between the area ratio of microvessels with tissue tumor necrosis factor alpha and transforming growth factor beta levels and a mildly positive correlation with tissue IL-5 and eosinophilic cationic protein concentration. CONCLUSION FCN proved to facilitate the analysis of microvessels in airway tissue samples. This study elucidated the close association of angiogenesis with endotyping, suggesting that treatment aiming at antagonizing angiogenesis may assist to the therapy for the recrudescent and refractory CRS.
Collapse
|