An automated approach to the segmentation of HEp-2 cells for the indirect immunofluorescence ANA test

MF-Net: Automated Muscle Fiber Segmentation From Immunofluorescence Images Using a Local-Global Feature Fusion Network

Histological assessment of skeletal muscle slices is very important for the accurate evaluation of weightless muscle atrophy. The accurate identification and segmentation of muscle fiber boundary is an important prerequisite for the evaluation of skeletal muscle fiber atrophy. However, there are many challenges to segment muscle fiber from immunofluorescence images, including the presence of low contrast in fiber boundaries in immunofluorescence images and the influence of background noise. Due to the limitations of traditional convolutional neural network-based segmentation methods in capturing global information, they cannot achieve ideal segmentation results. In this paper, we propose a muscle fiber segmentation network (MF-Net) method for effective segmentation of macaque muscle fibers in immunofluorescence images. The network adopts a dual encoder branch composed of convolutional neural networks and transformer to effectively capture local and global feature information in the immunofluorescence image, highlight foreground features, and suppress irrelevant background noise. In addition, a low-level feature decoder module is proposed to capture more global context information by combining different image scales to supplement the missing detail pixels. In this study, a comprehensive experiment was carried out on the immunofluorescence datasets of six macaques' weightlessness models and compared with the state-of-the-art deep learning model. It is proved from five segmentation indices that the proposed automatic segmentation method can be accurately and effectively applied to muscle fiber segmentation in shank immunofluorescence images.

Split and Merge Watershed: a two-step method for cell segmentation in fluorescence microscopy images

The development of advanced techniques in medical imaging has allowed scanning of the human body to microscopic levels, making research on cell behavior more complex and more in-depth. Recent studies have focused on cellular heterogeneity since cell-to-cell differences are always present in the cell population and this variability contains valuable information. However, identifying each cell is not an easy task because, in the images acquired from the microscope, there are clusters of cells that are touching one another. Therefore, the segmentation stage is a problem of considerable difficulty in cell image processing. Although several methods for cell segmentation are described in the literature, they have drawbacks in terms of over-segmentation, under-segmentation or misidentification. Consequently, our main motivation in studying cell segmentation was to develop a new method to achieve a good tradeoff between accurately identifying all relevant elements and not inserting segmentation artifacts. This article presents a new method for cell segmentation in fluorescence microscopy images. The proposed approach combines the well-known Marker-Controlled Watershed algorithm (MC-Watershed) with a new, two-step method based on Watershed, Split and Merge Watershed (SM-Watershed): in the first step, or split phase, the algorithm identifies the clusters using inherent characteristics of the cell, such as size and convexity, and separates them using watershed. In the second step, or the merge stage, it identifies the over-segmented regions using proper features of the cells and eliminates the divisions. Before applying our two-step method, the input image is first preprocessed, and the MC-Watershed algorithm is used to generate an initial segmented image. However, this initial result may not be suitable for subsequent tasks, such as cell count or feature extraction, because not all cells are separated, and some cells may be mistakenly confused with the background. Thus, our proposal corrects this issue with its two-step process, reaching a high performance, a suitable tradeoff between over-segmentation and under-segmentation and preserving the shape of the cell, without the need of any labeled data or relying on machine learning processes. The latter is advantageous over state-of-the-art techniques that in order to achieve similar results require labeled data, which may not be available for all of the domains. Two cell datasets were used to validate this approach, and the results were compared with other methods in the literature, using traditional metrics and quality visual assessment. We obtained 90% of average visual accuracy and an F-index higher than 80%. This proposal outperforms other techniques for cell separation, achieving an acceptable balance between over-segmentation and under-segmentation, which makes it suitable for several applications in cell identification, such as virus infection analysis, high-content cell screening, drug discovery, and morphometry.

A novel generic dictionary-based denoising method for improving noisy and densely packed nuclei segmentation in 3D time-lapse fluorescence microscopy images

Time-lapse fluorescence microscopy is an essential technique for quantifying various characteristics of cellular processes, i.e. cell survival, migration, and differentiation. To perform high-throughput quantification of cellular processes, nuclei segmentation and tracking should be performed in an automated manner. Nevertheless, nuclei segmentation and tracking are challenging tasks due to embedded noise, intensity inhomogeneity, shape variation as well as a weak boundary of nuclei. Although several nuclei segmentation approaches have been reported in the literature, dealing with embedded noise remains the most challenging part of any segmentation algorithm. We propose a novel denoising algorithm, based on sparse coding, that can both enhance very faint and noisy nuclei signal but simultaneously detect nuclei position accurately. Furthermore our method is based on a limited number of parameters, with only one being critical, which is the approximate size of the objects of interest. We also show that our denoising method coupled with classical segmentation method works properly in the context of the most challenging cases. To evaluate the performance of the proposed method, we tested our method on two datasets from the cell tracking challenge. Across all datasets, the proposed method achieved satisfactory results with 96:96% recall for the C. elegans dataset. Besides, in the Drosophila dataset, our method achieved very high recall (99:3%).

An Automatic HEp-2 Specimen Analysis System Based on an Active Contours Model and an SVM Classification

The antinuclear antibody (ANA) test is widely used for screening, diagnosing, and monitoring of autoimmune diseases. The most common methods to determine ANA are indirect immunofluorescence (IIF), performed by human epithelial type 2 (HEp-2) cells, as substrate antigen. The evaluation of ANA consist an analysis of fluorescence intensity and staining patterns. This paper presents a complete and fully automatic system able to characterize IIF images. The fluorescence intensity classification was obtained by performing an image preprocessing phase and implementing a Support Vector Machines (SVM) classifier. The cells identification problem has been addressed by developing a flexible segmentation methods, based on the Hough transform for ellipses, and on an active contours model. In order to classify the HEp-2 cells, six SVM and one k-nearest neighbors (KNN)classifiers were developed. The system was tested on a public database consisting of 2080 IIF images. Unlike almost all work presented on this topic, the proposed system automatically addresses all phases of the HEp-2 image analysis process. All results have been evaluated by comparing them with some of the most representative state-of-the-art work, demonstrating the goodness of the system in the characterization of HEp-2 images.

A computer-aided diagnosis system for HEp-2 fluorescence intensity classification

BACKGROUND AND OBJECTIVE

The indirect immunofluorescence (IIF) on HEp-2 cells is the recommended technique for the detection of antinuclear antibodies. However, it is burdened by some limitations, as it is time consuming and subjective, and it requires trained personnel. In other fields the adoption of deep neural networks has provided an effective high-level abstraction of the raw data, resulting in the ability to automatically generate optimized high-level features.

METHODS

To alleviate IIF limitations, this paper presents a computer-aided diagnosis (CAD) system classifying HEp-2 fluorescence intensity: it represents each image using an Invariant Scattering Convolutional Network (Scatnet), which is locally translation invariant and stable to deformations, a characteristic useful in case of HEp-2 samples. To cope with the inter-observer discrepancies found in the dataset, we also introduce a method for gold standard computation that assigns a label and a reliability score to each HEp-2 sample on the basis of annotations provided by expert physicians. Features by Scatnet and gold standard information are then used to train a Support Vector Machine.

RESULTS

The proposed CAD is tested on a new dataset of 1771 images annotated by three independent medical centers. The performances achieved by our CAD in recognizing positive, weak positive and negative samples are also compared against those obtained by other two approaches presented so far in the literature. The same system trained on this new dataset is then tested on two public datasets, namely MIVIA and I3Asel.

CONCLUSIONS

The results confirm the effectiveness of our proposal, also revealing that it achieves the same performance as medical experts.

Unsupervised HEp-2 mitosis recognition in indirect immunofluorescence imaging

Automated HEp-2 mitotic cell recognition in IIF images is an important and yet scarcely explored step in the computer-aided diagnosis of autoimmune disorders. Such step is necessary to assess the goodness of the HEp-2 samples and helps the early diagnosis of the most difficult or ambiguous cases. In this work, we propose a completely unsupervised approach for HEp-2 mitotic cell recognition that overcomes the problem of mitotic/non-mitotic class imbalance due to the limited number of mitotic cells. Our technique automatically selects a limited set of candidate cells from the HEp-2 slide and then applies a clustering algorithm to identify the mitotic ones based on their texture. Finally, a second stage of clustering discriminates between positive and negative mitoses. Experiments on public IIF images demonstrate the performance of our technique compared to previous approaches.

A New Unsupervised Approach for Segmenting and Counting Cells in High-Throughput Microscopy Image Sets

New technological advances in automated microscopy have given rise to large volumes of data, which have made human-based analysis infeasible, heightening the need for automatic systems for high-throughput microscopy applications. In particular, in the field of fluorescence microscopy, automatic tools for image analysis are making an essential contribution in order to increase the statistical power of the cell analysis process. The development of these automatic systems is a difficult task due to both the diversification of the staining patterns and the local variability of the images. In this paper, we present an unsupervised approach for automatic cell segmentation and counting, namely CSC, in high-throughput microscopy images. The segmentation is performed by dividing the whole image into square patches that undergo a gray level clustering followed by an adaptive thresholding. Subsequently, the cell labeling is obtained by detecting the centers of the cells, using both distance transform and curvature analysis, and by applying a region growing process. The advantages of CSC are manifold. The foreground detection process works on gray levels rather than on individual pixels, so it proves to be very efficient. Moreover, the combination of distance transform and curvature analysis makes the counting process very robust to clustered cells. A further strength of the CSC method is the limited number of parameters that must be tuned. Indeed, two different versions of the method have been considered, CSC-7 and CSC-3, depending on the number of parameters to be tuned. The CSC method has been tested on several publicly available image datasets of real and synthetic images. Results in terms of standard metrics and spatially aware measures show that CSC outperforms the current state-of-the-art techniques.

Performance analysis of automated evaluation of Crithidia luciliae-based indirect immunofluorescence tests in a routine setting - strengths and weaknesses

BACKGROUND

Antibodies directed against dsDNA are a highly specific diagnostic marker for the presence of systemic lupus erythematosus and of particular importance in its diagnosis. To assess anti-dsDNA antibodies, the Crithidia luciliae-based indirect immunofluorescence test (CLIFT) is one of the assays considered to be the best choice. To overcome the drawback of subjective result interpretation that inheres indirect immunofluorescence assays in general, automated systems have been introduced into the market during the last years. Among these systems is the EUROPattern Suite, an advanced automated fluorescence microscope equipped with different software packages, capable of automated pattern interpretation and result suggestion for ANA, ANCA and CLIFT analysis.

METHODS

We analyzed the performance of the EUROPattern Suite with its automated fluorescence interpretation for CLIFT in a routine setting, reflecting the everyday life of a diagnostic laboratory. Three hundred and twelve consecutive samples were collected, sent to the Central Diagnostic Laboratory of the Maastricht University Medical Centre with a request for anti-dsDNA analysis over a period of 7 months.

RESULTS

Agreement between EUROPattern assay analysis and the visual read was 93.3%. Sensitivity and specificity were 94.1% and 93.2%, respectively. The EUROPattern Suite performed reliably and greatly supported result interpretation.

CONCLUSIONS

Automated image acquisition is readily performed and automated image classification gives a reliable recommendation for assay evaluation to the operator. The EUROPattern Suite optimizes workflow and contributes to standardization between different operators or laboratories.

[Autoimmune hepatitis: Immunological diagnosis]

Autoimmune hepatopathies (AIHT) including autoimmune hepatitis (AIH), primary biliary cirrhosis (PBC), primary sclerosing cholangitis (PSC) and autoimmune cholangitis (AIC), represent an impressive entities in clinical practice. Their pathogenesis is not perfectly elucidated. Several factors are involved in the initiation of hepatic autoimmune and inflammatory phenomena such as genetic predisposition, molecular mimicry and/or abnormalities of T-regulatory lymphocytes. AIHT have a wide spectrum of presentation, ranging from asymptomatic forms to severe acute liver failure. The diagnosis of AIHT is based on the presence of hyperglobulinemia, cytolysis, cholestasis, typical even specific circulating auto-antibodies, distinctive of AIH or PBC, and histological abnormalities as well as necrosis and inflammation. Anti-F actin, anti-LKM1, anti-LC1 antibodies permit to distinguish between AIH type 1 and AIH type 2. Anti-SLA/LP antibodies are rather associated to more severe hepatitis, and particularly useful for the diagnosis of seronegative AIH for other the antibodies. Due to the relevant diagnostic value of anti-M2, anti-Sp100, and anti-gp210 antibodies, the diagnosis of PBC is more affordable than that of PSC and AIC. Based on clinical data, the immunological diagnosis of AIHT takes advantage of the various specialized laboratory techniques including immunofluorescence, immunodot or blot, and the Elisa systems, provided of a closer collaboration between the biologist and the physician.

HEp-2 Specimen Image Segmentation and Classification Using Very Deep Fully Convolutional Network

Reliable identification of Human Epithelial-2 (HEp-2) cell patterns can facilitate the diagnosis of systemic autoimmune diseases. However, traditional approach requires experienced experts to manually recognize the cell patterns, which suffers from the inter-observer variability. In this paper, an automatic pattern recognition system using fully convolutional network (FCN) was proposed to simultaneously address the segmentation and classification problem of HEp-2 specimen images. The proposed system transforms the residual network (ResNet) to fully convolutional ResNet (FCRN) enabling the network to perform semantic segmentation task. A sand-clock shape residual module is proposed to effectively and economically improve the performance of FCRN. The publicly available I3A-2014 data set was used to train the FCRN model to classify HEp-2 specimen images into seven catalogs: homogeneous, speckled, nucleolar, centromere, golgi, nuclear membrane, and mitotic spindle. The proposed system achieves a mean class accuracy of 94.94% for leave-one-out tests, which outperforms the winner of ICPR 2014, i.e., 89.93%. At the same time, our model also achieves a segmentation accuracy of 89.03%, which is 19.05% higher than that of the benchmark approach, i.e., 69.98%.

Digital Image Analysis of Cells and Computational Tools for the Study of Mechanism of RSV Entry to Human Bronchial Epithelium

this paper presents a research proposal which has been developed as a doctoral thesis in the PhD program in Computer Systems Engineering at the Universidad del Norte since August 2015. This research focuses on the analysis of cell images of the human bronchial epithelium infected with the Respiratory Syncytial Virus in order to understand the mechanisms of entry of the virus into the human body. Due to the large amount of information that is processed, it is necessary to use computational tools to finally differentiate between infected and uninfected cells.

Quantitative analysis of the heterogeneous population of endocytic vesicles

The quantitative characterization of endocytic vesicles in images acquired with microscope is critically important for deciphering of endocytosis mechanisms. Image segmentation is the most important step of quantitative image analysis. In spite of availability of many segmentation methods, the accurate segmentation is challenging when the images are heterogeneous with respect to object shapes and signal intensities what is typical for images of endocytic vesicles. We present a Morphological reconstruction and Contrast mapping segmentation method (MrComas) for the segmentation of the endocytic vesicle population that copes with the heterogeneity in their shape and intensity. The method uses morphological opening and closing by reconstruction in the vicinity of local minima and maxima respectively thus creating the strong contrast between their basins of attraction. As a consequence, the intensity is flattened within the objects and their edges are enhanced. The method accurately recovered quantitative characteristics of synthetic images that preserve characteristic features of the endocytic vesicle population. In benchmarks and quantitative comparisons with two other popular segmentation methods, namely manual thresholding and Squash plugin, MrComas shows the best segmentation results on real biological images of EGFR (Epidermal Growth Factor Receptor) endocytosis. As a proof of feasibility, the method was applied to quantify the dynamical behavior of Early Endosomal Autoantigen 1 (EEA1)-positive endosome subpopulations during EGF-stimulated endocytosis.

Mining textural knowledge in biological images: Applications, methods and trends

Texture analysis is a major task in many areas of computer vision and pattern recognition, including biological imaging. Indeed, visual textures can be exploited to distinguish specific tissues or cells in a biological sample, to highlight chemical reactions between molecules, as well as to detect subcellular patterns that can be evidence of certain pathologies. This makes automated texture analysis fundamental in many applications of biomedicine, such as the accurate detection and grading of multiple types of cancer, the differential diagnosis of autoimmune diseases, or the study of physiological processes. Due to their specific characteristics and challenges, the design of texture analysis systems for biological images has attracted ever-growing attention in the last few years. In this paper, we perform a critical review of this important topic. First, we provide a general definition of texture analysis and discuss its role in the context of bioimaging, with examples of applications from the recent literature. Then, we review the main approaches to automated texture analysis, with special attention to the methods of feature extraction and encoding that can be successfully applied to microscopy images of cells or tissues. Our aim is to provide an overview of the state of the art, as well as a glimpse into the latest and future trends of research in this area.

ANAlyte: A modular image analysis tool for ANA testing with indirect immunofluorescence

BACKGROUND AND OBJECTIVES

The automated analysis of indirect immunofluorescence images for Anti-Nuclear Autoantibody (ANA) testing is a fairly recent field that is receiving ever-growing interest from the research community. ANA testing leverages on the categorization of intensity level and fluorescent pattern of IIF images of HEp-2 cells to perform a differential diagnosis of important autoimmune diseases. Nevertheless, it suffers from tremendous lack of repeatability due to subjectivity in the visual interpretation of the images. The automatization of the analysis is seen as the only valid solution to this problem. Several works in literature address individual steps of the work-flow, nonetheless integrating such steps and assessing their effectiveness as a whole is still an open challenge.

METHODS

We present a modular tool, ANAlyte, able to characterize a IIF image in terms of fluorescent intensity level and fluorescent pattern without any user-interactions. For this purpose, ANAlyte integrates the following: (i) Intensity Classifier module, that categorizes the intensity level of the input slide based on multi-scale contrast assessment; (ii) Cell Segmenter module, that splits the input slide into individual HEp-2 cells; (iii) Pattern Classifier module, that determines the fluorescent pattern of the slide based on the pattern of the individual cells.

RESULTS

To demonstrate the accuracy and robustness of our tool, we experimentally validated ANAlyte on two different public benchmarks of IIF HEp-2 images with rigorous leave-one-out cross-validation strategy. We obtained overall accuracy of fluorescent intensity and pattern classification respectively around 85% and above 90%. We assessed all results by comparisons with some of the most representative state of the art works.

CONCLUSIONS

Unlike most of the other works in the recent literature, ANAlyte aims at the automatization of all the major steps of ANA image analysis. Results on public benchmarks demonstrate that the tool can characterize HEp-2 slides in terms of intensity and fluorescent pattern with accuracy better or comparable with the state of the art techniques, even when such techniques are run on manually segmented cells. Hence, ANAlyte can be proposed as a valid solution to the problem of ANA testing automatization.

Design of a Computer-Assisted System to Automatically Detect Cell Types Using ANA IIF Images for the Diagnosis of Autoimmune Diseases

Indirect immunofluorescence technique applied on HEp-2 cell substrates provides the major screening method to detect ANA patterns in the diagnosis of autoimmune diseases. Currently, the ANA patterns are mostly inspected by experienced physicians to identify abnormal cell patterns. The objective of this study is to design a computer-assisted system to automatically detect cell patterns of IIF images for the diagnosis of autoimmune diseases in the clinical setting. The system simulates the functions of modern flow cytometer and provides the diagnostic reports generated by the system to the technicians and physicians through the radar graphs, box-plots, and tables. The experimental results show that, among the IIF images collected from 17 patients, 6 were classified as coarse-speckled, 3 as diffused, 2 as discrete-speckled, 1 as fine-speckled, 2 as nucleolar, and 3 as peripheral patterns, which were consistent with the patterns determined by the physicians. In addition to recognition of cell patterns, the system also provides the function to automatically generate the report for each patient. The time needed for the whole procedure is less than 30 min, which is more efficient than the manual operation of the physician after inspecting the ANA IIF images. Besides, the system can be easily deployed on many desktop and laptop computers. In conclusion, the designed system, containing functions for automatic detection of ANA cell pattern and generation of diagnostic report, is effective and efficient to assist physicians to diagnose patients with autoimmune diseases. The limitations of the current developed system include (1) only a unique cell pattern was considered for the IIF images collected from a patient, and (2) the cells during the process of mitosis were not adopted for cell classification.