Fast unsupervised nuclear segmentation and classification scheme for automatic allred cancer scoring in immunohistochemical breast tissue images

Research and application of omics and artificial intelligence in cancer

Cancer has a high incidence and lethality rate, which is a significant threat to human health. With the development of high-throughput technologies, different types of cancer genomics data have been accumulated, including genomics, epigenomics, transcriptomics, proteomics, and metabolomics. A comprehensive analysis of various omics data is needed to understand the underlying mechanisms of tumor development. However, integrating such a massive amount of data is one of the main challenges today. Artificial intelligence (AI) techniques such as machine learning are now becoming practical tools for analyzing and understanding multi-omics data on diseases. Enabling great optimization of existing research paradigms for cancer screening, diagnosis, and treatment. In addition, intelligent healthcare has received widespread attention with the development of healthcare informatization. As an essential part of innovative healthcare, practical, intelligent prognosis analysis and personalized treatment for cancer patients are also necessary. This paper introduces the advanced multi-omics data analysis technology in recent years, presents the cases and advantages of the combination of both omics data and AI applied to cancer diseases, and finally briefly describes the challenges faced by multi-omics analysis and AI at the current stage, aiming to provide new perspectives for oncology research and the possibility of personalized cancer treatment.

Employing Atrous Pyramid Convolutional Deep Learning Approach for Detection to Diagnose Breast Cancer Tumors

Breast cancer is among the most common diseases and one of the most common causes of death in the female population worldwide. Early identification of breast cancer improves survival. Therefore, radiologists will be able to make more accurate diagnoses if a computerized system is developed to detect breast cancer. Computer-aided design techniques have the potential to help medical professionals to determine the specific location of breast tumors and better manage this disease more rapidly and accurately. MIAS datasets were used in this study. The aim of this study is to evaluate a noise reduction for mammographic pictures and to identify salt and pepper, Gaussian, and Poisson so that precise mass detection operations can be estimated. As a result, it provides a method for noise reduction known as quantum wavelet transform (QWT) filtering and an image morphology operator for precise mass segmentation in mammographic images by utilizing an Atrous pyramid convolutional neural network as the deep learning model for classification of mammographic images. The hybrid methodology dubbed QWT-APCNN is compared to earlier methods in terms of peak signal-to-noise ratio (PSNR) and mean square error (MSE) in noise reduction and detection accuracy for mass area recognition. Compared to state-of-the-art approaches, the proposed method performed better at noise reduction and segmentation according to different evaluation criteria such as an accuracy rate of 98.57%, 92% sensitivity, 88% specificity, 90% DSS, and ROC and AUC rate of 88.77.

BAWGNet: Boundary aware wavelet guided network for the nuclei segmentation in histopathology images

Precise cell nucleus segmentation is very critical in many biologically related analyses and disease diagnoses. However, the variability in nuclei structure, color, and modalities of histopathology images make the automatic computer-aided nuclei segmentation task very difficult. Traditional encoder-decoder based deep learning schemes mainly utilize the spatial domain information that may limit the performance of recognizing small nuclei regions in subsequent downsampling operations. In this paper, a boundary aware wavelet guided network (BAWGNet) is proposed by incorporating a boundary aware unit along with an attention mechanism based on a wavelet domain guidance in each stage of the encoder-decoder output. Here the high-frequency 2 Dimensional discrete wavelet transform (2D-DWT) coefficients are utilized in the attention mechanism to guide the spatial information obtained from the encoder-decoder output stages to leverage the nuclei segmentation task. On the other hand, the boundary aware unit (BAU) captures the nuclei's boundary information, ensuring accurate prediction of the nuclei pixels in the edge region. Furthermore, the preprocessing steps used in our methodology confirm the data's uniformity by converting it to similar color statistics. Extensive experimentations conducted on three benchmark histopathology datasets (DSB, MoNuSeg and TNBC) exhibit the outstanding segmentation performance of the proposed method (with dice scores 90.82%, 85.74%, and 78.57%, respectively). Implementation of the proposed architecture is available at https://github.com/tamjidimtiaz/BAWGNet.

Oncogenic Role of the NFATC2/NEDD4/FBP1 Axis in Cholangiocarcinoma

Nuclear factor of activated T cells 2 (NFATC2) is reported to contribute to the initiation and progression of various cancers; however, its expression and function in cholangiocarcinoma (CCA) tissues remain elusive. Herein, we investigated the expression pattern, clinicopathologic characteristics, cell biological functions, and potential mechanisms of NFATC2 in CCA tissues. Real-time reverse-transcription PCR (RT-qPCR) and immunohistochemistry were performed to analyze the expression of NFATC2 in human CCA tissues. Cell counting kit 8, colony formation, flow cytometry, Western blotting, and Transwell assays, and in vivo xenograft and pulmonary metastasis models, were used to explore the effect of NFATC2 on the proliferation and metastasis of CCA. A dual-luciferase reporter system, oligonucleotide pull-down, chromatin immunoprecipitation, immunofluorescence, and coimmunoprecipitation were performed to reveal the potential mechanisms. We found that NFATC2 was upregulated in CCA tissues and cells, and its aberrantly high levels were associated with a poorer differentiation pattern. Functionally, NFATC2 overexpression promoted CCA cell proliferation and metastasis, whereas knockdown of NFATC2 led to opposite result. Mechanistically, NFATC2 could be enriched in the promoter region of neural precursor cell-expressed developmentally downregulated protein 4 (NEDD4) to facilitate its expression. Furthermore, NEDD4 targeted fructose-1, 6-bisphosphatase 1 (FBP1) and inhibited FBP1 expression via ubiquitination. In addition, silencing NEDD4 rescued the effects of NFATC2 overexpression on CCA cells. NEDD4 was upregulated in human CCA tissues, and its expression levels were positively correlated with those of NFATC2. We thus conclude that NFATC2 promotes the progression of CCA via the NEDD4/FBP1 axis, emphasizing the oncogenic role of NFATC2 in CCA progression.

SMILE: Cost-sensitive multi-task learning for nuclear segmentation and classification with imbalanced annotations

High throughput nuclear segmentation and classification of whole slide images (WSIs) is crucial to biological analysis, clinical diagnosis and precision medicine. With the advances of CNN algorithms and the continuously growing datasets, considerable progress has been made in nuclear segmentation and classification. However, few works consider how to reasonably deal with nuclear heterogeneity in the following two aspects: imbalanced data distribution and diversified morphology characteristics. The minority classes might be dominated by the majority classes due to the imbalanced data distribution and the diversified morphology characteristics may lead to fragile segmentation results. In this study, a cost-Sensitive MultI-task LEarning (SMILE) framework is conducted to tackle the data heterogeneity problem. Based on the most popular multi-task learning backbone in nuclei segmentation and classification, we propose a multi-task correlation attention (MTCA) to perform feature interaction of multiple high relevant tasks to learn better feature representation. A cost-sensitive learning strategy is proposed to solve the imbalanced data distribution by increasing the penalization for the error classification of the minority classes. Furthermore, we propose a novel post-processing step based on the coarse-to-fine marker-controlled watershed scheme to alleviate fragile segmentation when nuclei are with large size and unclear contour. Extensive experiments show that the proposed method achieves state-of-the-art performances on CoNSeP and MoNuSAC 2020 datasets. The code is available at: https://github.com/panxipeng/nuclear_segandcls.

Lightweight Separable Convolution Network for Breast Cancer Histopathological Identification

Breast cancer is one of the leading causes of death among women worldwide. Histopathological images have proven to be a reliable way to find out if someone has breast cancer over time, however, it could be time consuming and require much resources when observed physically. In order to lessen the burden on the pathologists and save lives, there is need for an automated system to effectively analysis and predict the disease diagnostic. In this paper, a lightweight separable convolution network (LWSC) is proposed to automatically learn and classify breast cancer from histopathological images. The proposed architecture aims to treat the problem of low quality by extracting the visual trainable features of the histopathological image using a contrast enhancement algorithm. LWSC model implements separable convolution layers stacked in parallel with multiple filters of different sizes in order to obtain wider receptive fields. Additionally, the factorization and the utilization of bottleneck convolution layers to reduce model dimension were introduced. These methods reduce the number of trainable parameters as well as the computational cost sufficiently with greater non-linear expressive capacity than plain convolutional networks. The evaluation results depict that the proposed LWSC model performs optimally, obtaining 97.23% accuracy, 97.71% sensitivity, and 97.93% specificity on multi-class categories. Compared with other models, the proposed LWSC obtains comparable performance.

An Approach toward Automatic Specifics Diagnosis of Breast Cancer Based on an Immunohistochemical Image

The paper explored the problem of automatic diagnosis based on immunohistochemical image analysis. The issue of automated diagnosis is a preliminary and advisory statement for a diagnostician. The authors studied breast cancer histological and immunohistochemical images using the following biomarkers progesterone, estrogen, oncoprotein, and a cell proliferation biomarker. The authors developed a breast cancer diagnosis method based on immunohistochemical image analysis. The proposed method consists of algorithms for image preprocessing, segmentation, and the determination of informative indicators (relative area and intensity of cells) and an algorithm for determining the molecular genetic breast cancer subtype. An adaptive algorithm for image preprocessing was developed to improve the quality of the images. It includes median filtering and image brightness equalization techniques. In addition, the authors developed a software module part of the HIAMS software package based on the Java programming language and the OpenCV computer vision library. Four molecular genetic breast cancer subtypes could be identified using this solution: subtype Luminal A, subtype Luminal B, subtype HER2/neu amplified, and basalt-like subtype. The developed algorithm for the quantitative characteristics of the immunohistochemical images showed sufficient accuracy in determining the cancer subtype "Luminal A". It was experimentally established that the relative area of the nuclei of cells covered with biomarkers of progesterone, estrogen, and oncoprotein was more than 85%. The given approach allows for automating and accelerating the process of diagnosis. Developed algorithms for calculating the quantitative characteristics of cells on immunohistochemical images can increase the accuracy of diagnosis.

Allred Scoring of ER-IHC Stained Whole-Slide Images for Hormone Receptor Status in Breast Carcinoma

Hormone receptor status is determined primarily to identify breast cancer patients who may benefit from hormonal therapy. The current clinical practice for the testing using either Allred score or H-score is still based on laborious manual counting and estimation of the amount and intensity of positively stained cancer cells in immunohistochemistry (IHC)-stained slides. This work integrates cell detection and classification workflow for breast carcinoma estrogen receptor (ER)-IHC-stained images and presents an automated evaluation system. The system first detects all cells within the specific regions and classifies them into negatively, weakly, moderately, and strongly stained, followed by Allred scoring for ER status evaluation. The generated Allred score relies heavily on accurate cell detection and classification and is compared against pathologists' manual estimation. Experiments on 40 whole-slide images show 82.5% agreement on hormonal treatment recommendation, which we believe could be further improved with an advanced learning model and enhancement to address the cases with 0% ER status. This promising system can automate the exhaustive exercise to provide fast and reliable assistance to pathologists and medical personnel. The system has the potential to improve the overall standards of prognostic reporting for cancer patients, benefiting pathologists, patients, and also the public at large.

A review: The detection of cancer cells in histopathology based on machine vision

Machine vision is being employed in defect detection, size measurement, pattern recognition, image fusion, target tracking and 3D reconstruction. Traditional cancer detection methods are dominated by manual detection, which wastes time and manpower, and heavily relies on the pathologists' skill and work experience. Therefore, these manual detection approaches are not convenient for the inheritance of domain knowledge, and are not suitable for the rapid development of medical care in the future. The emergence of machine vision can iteratively update and learn the domain knowledge of cancer cell pathology detection to achieve automated, high-precision, and consistent detection. Consequently, this paper reviews the use of machine vision to detect cancer cells in histopathology images, as well as the benefits and drawbacks of various detection approaches. First, we review the application of image preprocessing and image segmentation in histopathology for the detection of cancer cells, and compare the benefits and drawbacks of different algorithms. Secondly, for the characteristics of histopathological cancer cell images, the research progress of shape, color and texture features and other methods is mainly reviewed. Furthermore, for the classification methods of histopathological cancer cell images, the benefits and drawbacks of traditional machine vision approaches and deep learning methods are compared and analyzed. Finally, the above research is discussed and forecasted, with the expected future development tendency serving as a guide for future research.

A whole-slide image (WSI)-based immunohistochemical feature prediction system improves the subtyping of lung cancer

BACKGROUND

Clinically, accurate pathological diagnosis is often challenged by insufficient tissue amounts and the unaffordability of additional immunohistochemical or genetic tests; thus, there is an urgent need for a universal approach to improve the subtyping of lung cancer without the above limitations. Here we aimed to develop a deep learning system to predict the immunohistochemistry (IHC) phenotype directly from whole-slide images (WSIs) to improve the subtyping of lung cancer from surgical resection and biopsy specimens.

METHODS

A total of 1914 patients with lung cancer from three independent hospitals in China were enrolled for WSI-based immunohistochemical feature prediction system (WIFPS) development and validation.

RESULTS

The WIFPS could directly predict the IHC status of nine subtype-specific biomarkers, including CK7, TTF-1, Napsin A, CK5/6, P63, P40, CD56, Synaptophysin, and Chromogranin A, achieving average areas under the curve (AUCs) of 0.912, 0.906, and 0.888 and overall diagnostic accuracies of 0.925, 0.941, and 0.887 in the validation datasets of total, external surgical resection specimens and biopsy specimens, respectively. The histological subtyping performance of the WIFPS remained comparable with that of general pathologists (GPs), with Cohen's kappa values ranging from 0.7646 to 0.8282. Furthermore, the WIFPS could be trained to not only predict the IHC status of anaplastic lymphoma kinase (ALK), programmed death-1 (PD-1), and programmed death ligand 1 (PD-L1), but also predict EGFR and KRAS mutation status, with AUCs from 0.525 to 0.917, as detected in separate populations.

CONCLUSIONS

In this study, the WIFPS showed its proficiency as a useful complement to traditional histologic subtyping for integrated immunohistochemical spectrum prediction as well as potential in the detection of gene mutations.

Dilated and soft attention-guided convolutional neural network for breast cancer histology images classification

Breast cancer is one of the most common types of cancer in women, and histopathological imaging is considered the gold standard for its diagnosis. However, the great complexity of histopathological images and the considerable workload make this work extremely time-consuming, and the results may be affected by the subjectivity of the pathologist. Therefore, the development of an accurate, automated method for analysis of histopathological images is critical to this field. In this article, we propose a deep learning method guided by the attention mechanism for fast and effective classification of haematoxylin and eosin-stained breast biopsy images. First, this method takes advantage of DenseNet and uses the feature map's information. Second, we introduce dilated convolution to produce a larger receptive field. Finally, spatial attention and channel attention are used to guide the extraction of the most useful visual features. With the use of fivefold cross-validation, the best model obtained an accuracy of 96.47% on the BACH2018 dataset. We also evaluated our method on other datasets, and the experimental results demonstrated that our model has reliable performance. This study indicates that our histopathological image classifier with a soft attention-guided deep learning model for breast cancer shows significantly better results than the latest methods. It has great potential as an effective tool for automatic evaluation of digital histopathological microscopic images for computer-aided diagnosis.

Deep Learning Technology in Pathological Image Analysis of Breast Tissue

To explore the application value of the multilevel pyramid convolutional neural network (MPCNN) model based on convolutional neural network (CNN) in breast histopathology image analysis, in this study, based on CNN algorithm and softmax classifier (SMC), a sparse autoencoder (SAE) is introduced to optimize it. The sliding window method is used to identify cells, and the CNN + SMC pathological image cell detection method is established. Furthermore, the local region active contour (LRAC) is introduced to optimize it and the LRAC fine segmentation model driven by local Gaussian distribution is established. On this basis, the sparse automatic encoder is further introduced to optimize it and the MPCNN model is established. The proposed algorithm is evaluated on the pathological image data set. The results showed that the Acc value, F value, and Re value of pathological cell detection of CNN + SMC algorithm were significantly higher than those of the other two algorithms (P < 0.05). The Dice, OL, Sen, and Spe values of pathological image regional segmentation of CNN algorithm were significantly higher than those of the other two algorithms, and the difference was statistically significant (P < 0.05). The accuracy, recall, and F-measure of the optimized CNN algorithm for detecting breast histopathological images were 85.25%, 89.27%, and 80.09%, respectively. In the two databases with segmentation standards, the segmentation accuracy of MPCNN is 55%, 73.1%, 78.8%, and 82.1%. In the deep convolution network model, the training time of the MPCNN algorithm is about 80 min. It shows that when the feature dimension is low, the feature map extracted by MPCNN is more effective than the traditional feature extraction method.

Identification of SLC38A7 as a Prognostic Marker and Potential Therapeutic Target of Lung Squamous Cell Carcinoma

BACKGROUND

No effective molecular targeted therapy has been established for SCC. We conducted a comprehensive study of SCC patients using RNA-sequencing and TCGA dataset to clarify the driver oncogene of SCC.

METHOD

Forty-six samples of 23 patients were totally analyzed with RNA-sequencing. We then searched for candidate-oncogenes of SCC using the TCGA database. To identify candidate oncogenes, we used the following 2 criteria: (1) the genes of interest were overexpressed in tumor tissues of SCC patients in comparison to normal tissues; and (2) using an integrated mRNA expression and DNA copy number profiling analysis using the TCGA dataset, the DNA copy number of the genes was positively correlated with the mRNA expression.

RESULT

We identified 188 candidate-oncogenes. Among those, the high expression of SLC38A7 was a strong prognostic marker that was significantly associated with a poor prognosis in terms of both overall survival (OS) and recurrence-free survival in the TCGA dataset (P < 0.05). Additionally, 202 resected SCC specimens were also subjected to an immunohistochemical analysis. Patients with the high expression of SLC38A7 (alternative name is sodium-coupled amino acid transporters 7) protein showed significantly shorter OS in comparison to those with the low expression of SLC38A7 protein [median OS 3.9 years (95% confidence interval, 2.4-6.4 years) vs 2.2 years (95% confidence interval, 1.9-4.1 years); log rank test: P = 0.0021].

CONCLUSION

SLC38A7, which is the primary lysosomal glutamine transporter required for the extracellular protein-dependent growth of cancer cells, was identified as a candidate therapeutic target of SCC.

Stain Color Adaptive Normalization (SCAN) algorithm: Separation and standardization of histological stains in digital pathology

BACKGROUND AND OBJECTIVE

The diagnosis of histopathological images is based on the visual analysis of tissue slices under a light microscope. However, the histological tissue appearance may assume different color intensities depending on the staining process, operator ability and scanner specifications. This stain variability affects the diagnosis of the pathologist and decreases the accuracy of computer-aided diagnosis systems. In this context, the stain normalization process has proved to be a powerful tool to cope with this issue, allowing to standardize the stain color appearance of a source image respect to a reference image.

METHODS

In this paper, novel fully automated stain separation and normalization approaches for hematoxylin and eosin stained histological slides are presented. The proposed algorithm, named SCAN (Stain Color Adaptive Normalization), is based on segmentation and clustering strategies for cellular structures detection. The SCAN algorithm is able to improve the contrast between histological tissue and background and preserve local structures without changing the color of the lumen and the background.

RESULTS

Both stain separation and normalization techniques were qualitatively and quantitively validated on a multi-tissue and multiscale dataset, with highly satisfactory results, outperforming the state-of-the-art approaches. SCAN was also tested on whole-slide images with high performances and low computational times.

CONCLUSIONS

The potential contribution of the proposed standardization approach is twofold: the improvement of visual diagnosis in digital histopathology and the development of powerful pre-processing strategies to automated classification techniques for cancer detection.