Histology image analysis for carcinoma detection and grading

Colorectal cancer histopathology image analysis: A comparative study of prognostic values of automatically extracted morphometric nuclear features in multispectral and red-blue-green imagery

OBJECTIVES

Multispectral imaging (MSI) has been utilized to predict the prognosis of colorectal cancer (CRC) patients, however, our understanding of the prognostic value of nuclear morphological parameters of bright-field MSI in CRC is still limited. This study was designed to compare the efficiency of MSI and standard red-green-blue (RGB) images in predicting the prognosis of CRC.

METHODS

We compared the efficiency of MS and conventional RGB images on the quantitative assessment of hematoxylin-eosin (HE) stained histopathology images. A pipeline was developed using a pixel-wise support vector machine (SVM) classifier for gland-stroma segmentation, and a marker-controlled watershed algorithm was used for nuclei segmentation. The correlation between extracted morphological parameters and the five-year disease-free survival (5-DFS) was analyzed.

RESULTS

Forty-seven nuclear morphological parameters were extracted in total. Based on Kaplan-Meier analysis, eight features derived from MS images and seven featured derived from RGB images were significantly associated with 5-DFS, respectively. Compared with RGB images, MSI showed higher accuracy, precision, and Dice index in nuclei segmentation. Multivariate analysis indicated that both integrated parameters 1 (factors negatively correlated with CRC prognosis including nuclear number, circularity, eccentricity, major axis length) and 2 (factors positively correlated with CRC prognosis including nuclear average area, area perimeter, total area/total perimeter ratio, average area/perimeter ratio) in MS images were independent prognostic factors of 5-DFS, in contrast with only integrated parameter 1 (P<0.001) in RGB images. More importantly, the quantification of HE-stained MS images displayed higher accuracy in predicting 5-DFS compared with RGB images (76.9% vs 70.9%).

CONCLUSIONS

Quantitative evaluation of HE-stained MS images could yield more information and better predictive performance for CRC prognosis than conventional RGB images, thereby contributing to precision oncology.

A quantitative analysis of artificial intelligence research in cervical cancer: a bibliometric approach utilizing CiteSpace and VOSviewer

Background

Cervical cancer, a severe threat to women's health, is experiencing a global increase in incidence, notably among younger demographics. With artificial intelligence (AI) making strides, its integration into medical research is expanding, particularly in cervical cancer studies. This bibliometric study aims to evaluate AI's role, highlighting research trends and potential future directions in the field.

Methods

This study systematically retrieved literature from the Web of Science Core Collection (WoSCC), employing VOSviewer and CiteSpace for analysis. This included examining collaborations and keyword co-occurrences, with a focus on the relationship between citing and cited journals and authors. A burst ranking analysis identified research hotspots based on citation frequency.

Results

The study analyzed 927 articles from 2008 to 2024 by 5,299 authors across 81 regions. China, the U.S., and India were the top contributors, with key institutions like the Chinese Academy of Sciences and the NIH leading in publications. Schiffman, Mark, featured among the top authors, while Jemal, A, was the most cited. 'Diagnostics' and 'IEEE Access' stood out for publication volume and citation impact, respectively. Keywords such as 'cervical cancer,' 'deep learning,' 'classification,' and 'machine learning' were dominant. The most cited article was by Berner, ES; et al., published in 2008.

Conclusions

AI's application in cervical cancer research is expanding, with a growing scholarly community. The study suggests that AI, especially deep learning and machine learning, will remain a key research area, focusing on improving diagnostics and treatment. There is a need for increased international collaboration to maximize AI's potential in advancing cervical cancer research and patient care.

Computerised assessment-a novel approach for calculation of percentage of hypomineralized lesion on incisors and its correlation with aesthetic concern

Introduction

Molar-incisor hypomineralization (MIH) is a localized, qualitative, demarcated enamel defect that affects first permanent molars (FPMs) and/or permanent incisors. The aim of present study was to introduce a novel computerised assessment process to detect and quantify the percentage opacity associated with MIH affected maxillary central incisors.

Methodology

Children (8-16 years) enrolled in the primary study having mild (white/cream or yellow/brown) MIH lesion on fully erupted maxillary permanent central incisor. 50 standardised images of MIH lesions were captured in an artificially lit room with fixed parameters and were anonymized and securely stored. Images were analysed by AI-driven computerised software and generates output classifications via a sophisticated algorithm crafted using a meticulously annotated image dataset as reference through supervised machine learning (SML). For the validation of computerised assessment of MIH lesions, the percentage of demarked opacity was calculated using ADOBE PHOTOSHOP CS7.

Results

The percentage of MIH lesion was calculated through histogram plotting with the maxima ranging from 7.29 % to 71.21 % with the mean value of 34.51 %. The validation score ranged from 10.29 % to 67.27 % with the mean value of 35.32 %. The difference between the two was statistically not significant. Out of 50 patients; 11 patients had 1-30 % of surface affected with MIH and 2 had aesthetic concern; 24 had 30-60 % of surface affected and 13 had aesthetic concern; 15 had >60 % of surface affected and 12 had aesthetic concerns.

Conclusions

The proposed approach exhibit sufficient quality to be integrated into a dental software addressing practical challenges encountered in daily clinical settings.

Emerging Biohybrids of Aptamer-Based Nano-Biosensing Technologies for Effective Early Cancer Detection

Cancer is a leading global cause of mortality, which underscores the imperative of early detection for improved patient outcomes. Biorecognition molecules, especially aptamers, have emerged as highly effective tools for early and accurate cancer cell identification. Aptamers, with superior versatility in synthesis and modification, offer enhanced binding specificity and stability compared with conventional antibodies. Hence, this article reviews diagnostic strategies employing aptamer-based biohybrid nano-biosensing technologies, focusing on their utility in detecting cancer biomarkers and abnormal cells. Recent developments include the synthesis of nano-aptamers using diverse nanomaterials, such as metallic nanoparticles, metal oxide nanoparticles, carbon-derived substances, and biohybrid nanostructures. The integration of these nanomaterials with aptamers significantly enhances sensitivity and specificity, promising innovative and efficient approaches for cancer diagnosis. This convergence of nanotechnology with aptamer research holds the potential to revolutionize cancer treatment through rapid, accurate, and non-invasive diagnostic methods.

ML3CNet: Non-local means-assisted automatic framework for lung cancer subtypes classification using histopathological images

BACKGROUND AND OBJECTIVE

Lung cancer (LC) has a high fatality rate that continuously affects human lives all over the world. Early detection of LC prolongs human life and helps to prevent the disease. Histopathological inspection is a common method to diagnose LC. Visual inspection of histopathological diagnosis necessitates more inspection time, and the decision depends on the subjective perception of clinicians. Usually, machine learning techniques mostly depend on traditional feature extraction which is labor-intensive and may not be appropriate for enormous data. In this work, a convolutional neural network (CNN)-based architecture is proposed for the more effective classification of lung tissue subtypes using histopathological images.

METHODS

Authors have utilized the first-time nonlocal mean (NLM) filter to suppress the effect of noise from histopathological images. NLM filter efficiently eliminated noise while preserving the edges of images. Then, the obtained denoised images are given as input to the proposed multi-headed lung cancer classification convolutional neural network (ML3CNet). Furthermore, the model quantization technique is utilized to reduce the size of the proposed model for the storage of the data. Reduction in model size requires less memory and speeds up data processing.

RESULTS

The effectiveness of the proposed model is compared with the other existing state-of-the-art methods. The proposed ML3CNet achieved an average classification accuracy of 99.72%, sensitivity of 99.66%, precision of 99.64%, specificity of 99.84%, F-1 score of 0.9965, and area under the curve of 0.9978. The quantized accuracy of 98.92% is attained by the proposed model. To validate the applicability of the proposed ML3CNet, it has also been tested on the colon cancer dataset.

CONCLUSION

The findings reveal that the proposed approach can be beneficial to automatically classify LC subtypes that might assist healthcare workers in making decisions more precisely. The proposed model can be implemented on the hardware using Raspberry Pi for practical realization.

HSG-MGAF Net: Heterogeneous subgraph-guided multiscale graph attention fusion network for interpretable prediction of whole-slide image

BACKGROUND AND OBJECTIVE

Pathological whole slide image (WSI) prediction and region of interest (ROI) localization are important issues in computer-aided diagnosis and postoperative analysis in clinical applications. Existing computer-aided methods for predicting WSI are mainly based on multiple instance learning (MIL) and its variants. However, most of the methods are based on instance independence and identical distribution assumption and performed at a single scale, which not fully exploit the hierarchical multiscale heterogeneous information contained in WSI.

METHODS

Heterogeneous Subgraph-Guided Multiscale Graph Attention Fusion Network (HSG-MGAF Net) is proposed to build the topology of critical image patches at two scales for adaptive WSI prediction and lesion localization. The HSG-MGAF Net simulates the hierarchical heterogeneous information of WSI through graph and hypergraph at two scales, respectively. This framework not only fully exploits the low-order and potential high-order correlations of image patches at each scale, but also leverages the heterogeneous information of the two scales for adaptive WSI prediction.

RESULTS

We validate the superiority of the proposed method on the CAMELYON16 and the TCGA- NSCLC, and the results show that HSG-MGAF Net outperforms the state-of-the-art method on both datasets. The average ACC, AUC and F1 score of HSG-MGAF Net can reach 92.7 %/0.951/0.892 and 92.2 %/0.957/0.919, respectively. The obtained heatmaps can also localize the positive regions more accurately, which have great consistency with the pixel-level labels.

CONCLUSIONS

The results demonstrate that HSG-MGAF Net outperforms existing weakly supervised learning methods by introducing critical heterogeneous information between the two scales. This approach paves the way for further research on light weighted heterogeneous graph-based WSI prediction and ROI localization.

Deep learning-based identification of esophageal cancer subtypes through analysis of high-resolution histopathology images

Esophageal cancer (EC) remains a significant health challenge globally, with increasing incidence and high mortality rates. Despite advances in treatment, there remains a need for improved diagnostic methods and understanding of disease progression. This study addresses the significant challenges in the automatic classification of EC, particularly in distinguishing its primary subtypes: adenocarcinoma and squamous cell carcinoma, using histopathology images. Traditional histopathological diagnosis, while being the gold standard, is subject to subjectivity and human error and imposes a substantial burden on pathologists. This study proposes a binary class classification system for detecting EC subtypes in response to these challenges. The system leverages deep learning techniques and tissue-level labels for enhanced accuracy. We utilized 59 high-resolution histopathological images from The Cancer Genome Atlas (TCGA) Esophageal Carcinoma dataset (TCGA-ESCA). These images were preprocessed, segmented into patches, and analyzed using a pre-trained ResNet101 model for feature extraction. For classification, we employed five machine learning classifiers: Support Vector Classifier (SVC), Logistic Regression (LR), Decision Tree (DT), AdaBoost (AD), Random Forest (RF), and a Feed-Forward Neural Network (FFNN). The classifiers were evaluated based on their prediction accuracy on the test dataset, yielding results of 0.88 (SVC and LR), 0.64 (DT and AD), 0.82 (RF), and 0.94 (FFNN). Notably, the FFNN classifier achieved the highest Area Under the Curve (AUC) score of 0.92, indicating its superior performance, followed closely by SVC and LR, with a score of 0.87. This suggested approach holds promising potential as a decision-support tool for pathologists, particularly in regions with limited resources and expertise. The timely and precise detection of EC subtypes through this system can substantially enhance the likelihood of successful treatment, ultimately leading to reduced mortality rates in patients with this aggressive cancer.

Escin-sorafenib synergy up-regulates LC3-II and p62 to induce apoptosis in hepatocellular carcinoma cells

INTRODUCTION

Hepatocellular carcinoma (HCC) is a common solid cancer and the leading cause of cancer deaths worldwide. Sorafenib is the first drug used to treat HCC but its effectiveness needs to be improved, and it is important to find ways to treat cancer that combine sorafenib with other drugs. Synergistic therapies lower effective drug doses and side effects while enhancing the anticancer effect.

PURPOSE

In the present study, the therapeutic potential of sorafenib in combination with escin and its underlying mechanism in targeting liver cancer has been established.

STUDY DESIGN/METHODS

The IC50 of sorafenib and escin against HepG2, PLC/PRF5 and Huh7 cell lines were determined using MTT assay. The combination index, dose reduction index, isobologram and concentrations producing synergy were evaluated using the Chou-Talaly algorithm. The sub-effective concentration of sorafenib and escin was selected to analyze cytotoxic synergistic potential. Cellular ROS, mitochondrial membrane potential, annexin V and cell cycle were evaluated using a flow-cytometer, and autophagy biomarkers were determined using western blotting. Moreover, autophagy was knocked down using ATG5 siRNA to confirm its role. A DEN-induced liver cancer rat model was developed to check the synergy of sorafenib and escin.

RESULTS

Different concentrations of escin reduced the IC50 of sorafenib in HepG2, PLC/PRF5 and Huh7 cell lines. Chou-Talaly algorithm determined cytotoxic synergistic concentrations of sorafenib and escin in these cell lines. Mechanistically, this combination over-expressed p62 and LC-II, reflecting autophagy block and induced late apoptosis, further reconfirmed by ATG5 knockdown. Sorafenib and escin combination  reduced HCC serum biomarker α-feto protein (α-FP) by 1.5 folds. This combination restricted liver weight, tumor number and size, also, conserved morphological features of liver cells. The combination selectively targeted the G0 /G1 phase of cancer cells.

CONCLUSION

Escin and sorafenib combination potentially up-regulates p62 to block autophagy to induce late apoptosis in liver cancer cells.

Enhancing breast cancer classification via histopathological image analysis: Leveraging self-supervised contrastive learning and transfer learning

Breast cancer, a significant threat to women's health, demands early detection. Automating histopathological image analysis offers a promising solution to enhance efficiency and accuracy in diagnosis. This study addresses the challenge of breast cancer histopathological image classification by leveraging the ResNet architecture, known for its depth and skip connections. In this work, two distinct approaches were pursued, each driven by unique motivations. The first approach aimed to improve the learning process through self-supervised contrastive learning. It utilizes a small subset of the training data for initial model training and progressively expands the training set by incorporating confidently labeled data from the unlabeled pool, ultimately achieving a reliable model with limited training data. The second approach focused on optimizing the architecture by combining ResNet50 and Inception module to get a lightweight and efficient classifier. The dataset utilized in this work comprises histopathological images categorized into benign and malignant classes at varying magnification levels (40X, 100X, 200X, 400X), all originating from the same source image. The results demonstrate state-of-the-art performance, achieving 98% accuracy for images magnified at 40X and 200X, and 94% for 100X and 400X. Notably, the proposed architecture boasts a substantially reduced parameter count of approximately 3.6 million, contrasting with existing leading architectures, which possess parameter sizes at least twice as large.

BRCA1/TP53 tumor proteins inhibited by novel analogues of curcumin - Insight from computational modelling, dynamic simulation and experimental validation

The current study aimed to design novel curcumin analogue inhibitors with antiproliferative and antitumor activity towards BRCA1 and TP53 tumor proteins and to study their therapeutic potential by computer-aided molecular designing and experimental investigations. Four curcumin analogues were computationally designed and their drug-likeness and pharmacokinetic properties were predicted. The binding of these analogues against six protein targets belonging to BRCA1 and TP53 tumor proteins were modelled by molecular docking and their binding energies were compared with that of curcumin and the standard drug cyclophosphamide and its validated target. The stabilities of selected docked complexes were confirmed by molecular dynamic simulation (MDS) and MMGBSA calculations. The best-docked analogue was chemically synthesized, characterized, and used for in vitro cytotoxic screening using DLA, EAC, and C127I cell lines. In vivo antitumor studies were carried out in Swiss Albino Mice. The study revealed that the designed analogues satisfied drug-likeness and pharmacokinetic properties and demonstrated better binding affinity to the selected targets than curcumin. Among the analogues, NLH demonstrated significant interaction with the BRCA1-BRCT-c domain (TG3; binding energy -8.3 kcal/mol) when compared to the interaction of curcumin (binding energy -6.19 kcal) and cyclophosphamide (binding energy -3.8 kcal/mol) and its usual substrate (TG7). The MDS and MM/GBSA studies revealed that the binding free energy of the NLH-TG3 complex (-61.24 kcal/mol) was better when compared to that of the cyclophosphamide-TG7 complex (-21.67 kcal/mol). In vitro, cytotoxic studies showed that NLH demonstrated significant antiproliferative activities against tumor cell lines. The in vivo study depicted NLH possesses the potential for tumor inhibition. Thus, the newly synthesized curcumin analogue is probably used to develop novel therapeutic agents against breast cancer.

Classification of Multiple H&E Images via an Ensemble Computational Scheme

In this work, a computational scheme is proposed to identify the main combinations of handcrafted descriptors and deep-learned features capable of classifying histological images stained with hematoxylin and eosin. The handcrafted descriptors were those representatives of multiscale and multidimensional fractal techniques (fractal dimension, lacunarity and percolation) applied to quantify the histological images with the corresponding representations via explainable artificial intelligence (xAI) approaches. The deep-learned features were obtained from different convolutional neural networks (DenseNet-121, EfficientNet-b2, Inception-V3, ResNet-50 and VGG-19). The descriptors were investigated through different associations. The most relevant combinations, defined through a ranking algorithm, were analyzed via a heterogeneous ensemble of classifiers with the support vector machine, naive Bayes, random forest and K-nearest neighbors algorithms. The proposed scheme was applied to histological samples representative of breast cancer, colorectal cancer, oral dysplasia and liver tissue. The best results were accuracy rates of 94.83% to 100%, with the identification of pattern ensembles for classifying multiple histological images. The computational scheme indicated solutions exploring a reduced number of features (a maximum of 25 descriptors) and with better performance values than those observed in the literature. The presented information in this study is useful to complement and improve the development of computer-aided diagnosis focused on histological images.

TGMIL: A hybrid multi-instance learning model based on the Transformer and the Graph Attention Network for whole-slide images classification of renal cell carcinoma

BACKGROUND AND OBJECTIVES

The pathological diagnosis of renal cell carcinoma is crucial for treatment. Currently, the multi-instance learning method is commonly used for whole-slide image classification of renal cell carcinoma, which is mainly based on the assumption of independent identical distribution. But this is inconsistent with the need to consider the correlation between different instances in the diagnosis process. Furthermore, the problem of high resource consumption of pathology images is still urgent to be solved. Therefore, we propose a new multi-instance learning method to solve this problem.

METHODS

In this study, we proposed a hybrid multi-instance learning model based on the Transformer and the Graph Attention Network, called TGMIL, to achieve whole-slide image of renal cell carcinoma classification without pixel-level annotation or region of interest extraction. Our approach is divided into three steps. First, we designed a feature pyramid with the multiple low magnifications of whole-slide image named MMFP. It makes the model incorporates richer information, and reduces memory consumption as well as training time compared to the highest magnification. Second, TGMIL amalgamates the Transformer and the Graph Attention's capabilities, adeptly addressing the loss of instance contextual and spatial. Within the Graph Attention network stream, an easy and efficient approach employing max pooling and mean pooling yields the graph adjacency matrix, devoid of extra memory consumption. Finally, the outputs of two streams of TGMIL are aggregated to achieve the classification of renal cell carcinoma.

RESULTS

On the TCGA-RCC validation set, a public dataset for renal cell carcinoma, the area under a receiver operating characteristic (ROC) curve (AUC) and accuracy of TGMIL were 0.98±0.0015,0.9191±0.0062, respectively. It showcased remarkable proficiency on the private validation set of renal cell carcinoma pathology images, attaining AUC of 0.9386±0.0162 and ACC of 0.9197±0.0124. Furthermore, on the public breast cancer whole-slide image test dataset, CAMELYON 16, our model showed good classification performance with an accuracy of 0.8792.

CONCLUSIONS

TGMIL models the diagnostic process of pathologists and shows good classification performance on multiple datasets. Concurrently, the MMFP module efficiently diminishes resource requirements, offering a novel angle for exploring computational pathology images.

Prediction of cancer recurrence based on compact graphs of whole slide images

Cancer recurrence is one of the primary causes of patient mortality following treatment, indicating increased aggressiveness of cancer cells and difficulties in achieving a cure. A critical step to improve patients' survival is accurately predicting recurrence status and giving appropriate treatment. Whole Slide Images (WSIs) are a common type of image data in the field of digital pathology, containing high-resolution tissue information. Furthermore, WSIs of primary tumors contain microenvironmental information directly associated with the growth of tumor cells. To effectively utilize this microenvironmental information. Firstly, we represented microenvironmental features of histopathological images as compact graphs. Secondly, this work aims to develop an enhanced lightweight graph neural network called the Adaptive Graph Clustering Network (AGCNet) for predicting cancer recurrence. Experiments are conducted on three cancer datasets from The Cancer Genome Atlas (TCGA), and AGCNet achieved an accuracy of 81.81% in BLCA, 69.66% in PAAD, and 81.96% in STAD. These results indicated that AGCNet is an effective model for predicting cancer recurrence and is expected to be applied in clinical applications.

Prostate cancer detection and segmentation on MRI using non-local mask R-CNN with histopathological ground truth

BACKGROUND

Automatic detection and segmentation of intraprostatic lesions (ILs) on preoperative multiparametric-magnetic resonance images (mp-MRI) can improve clinical workflow efficiency and enhance the diagnostic accuracy of prostate cancer and is an essential step in dominant intraprostatic lesion boost.

PURPOSE

The goal is to improve the detection and segmentation accuracy of 3D ILs in MRI by a proposed a deep learning (DL)-based algorithm with histopathological ground truth.

METHODS

This retrospective study included 262 patients with in vivo prostate biparametric MRI (bp-MRI) scans and were divided into three cohorts based on their data analysis and annotation. Histopathological ground truth was established by using histopathology images as delineation reference standard on cohort 1, which consisted of 64 patients and was randomly split into 20 training, 12 validation, and 32 testing patients. Cohort 2 consisted of 158 patients with bp-MRI based lesion delineation, and was randomly split into 104 training, 15 validation, and 39 testing patients. Cohort 3 consisted of 40 unannotated patients, used in semi-supervised learning. We proposed a non-local Mask R-CNN and boosted its performance by applying different training techniques. The performance of non-local Mask R-CNN was compared with baseline Mask R-CNN, 3D U-Net and an experienced radiologist's delineation and was evaluated by detection rate, dice similarity coefficient (DSC), sensitivity, and Hausdorff Distance (HD).

RESULTS

The independent testing set consists of 32 patients with histopathological ground truth. With the training technique maximizing detection rate, the non-local Mask R-CNN achieved 80.5% and 94.7% detection rate; 0.548 and 0.604 DSC; 5.72 and 6.36 95 HD (mm); 0.613 and 0.580 sensitivity for ILs of all Gleason Grade groups (GGGs) and clinically significant ILs (GGG > 2), which outperformed baseline Mask R-CNN and 3D U-Net. For clinically significant ILs, the model segmentation accuracy was significantly higher than that of the experienced radiologist involved in the study, who achieved 0.512 DSC (p = 0.04), 8.21 (p = 0.041) 95 HD (mm), and 0.398 (p = 0.001) sensitivity.

CONCLUSION

The proposed DL model achieved state-of-art performance and has the potential to help improve radiotherapy treatment planning and noninvasive prostate cancer diagnosis.

Evaluating the effectiveness of stain normalization techniques in automated grading of invasive ductal carcinoma histopathological images

Debates persist regarding the impact of Stain Normalization (SN) on recent breast cancer histopathological studies. While some studies propose no influence on classification outcomes, others argue for improvement. This study aims to assess the efficacy of SN in breast cancer histopathological classification, specifically focusing on Invasive Ductal Carcinoma (IDC) grading using Convolutional Neural Networks (CNNs). The null hypothesis asserts that SN has no effect on the accuracy of CNN-based IDC grading, while the alternative hypothesis suggests the contrary. We evaluated six SN techniques, with five templates selected as target images for the conventional SN techniques. We also utilized seven ImageNet pre-trained CNNs for IDC grading. The performance of models trained with and without SN was compared to discern the influence of SN on classification outcomes. The analysis unveiled a p-value of 0.11, indicating no statistically significant difference in Balanced Accuracy Scores between models trained with StainGAN-normalized images, achieving a score of 0.9196 (the best-performing SN technique), and models trained with non-normalized images, which scored 0.9308. As a result, we did not reject the null hypothesis, indicating that we found no evidence to support a significant discrepancy in effectiveness between stain-normalized and non-normalized datasets for IDC grading tasks. This study demonstrates that SN has a limited impact on IDC grading, challenging the assumption of performance enhancement through SN.

Future Practices of Breast Pathology Using Digital and Computational Pathology

Pathology clinical practice has evolved by adopting technological advancements initially regarded as potentially disruptive, such as electron microscopy, immunohistochemistry, and genomic sequencing. Breast pathology has a critical role as a medical domain, where the patient's pathology diagnosis has significant implications for prognostication and treatment of diseases. The advent of digital and computational pathology has brought about significant advancements in the field, offering new possibilities for enhancing diagnostic accuracy and improving patient care. Digital slide scanning enables to conversion of glass slides into high-fidelity digital images, supporting the review of cases in a digital workflow. Digitization offers the capability to render specimen diagnoses, digital archival of patient specimens, collaboration, and telepathology. Integration of image analysis and machine learning-based systems layered atop the high-resolution digital images offers novel workflows to assist breast pathologists in their clinical, educational, and research endeavors. Decision support tools may improve the detection and classification of breast lesions and the quantification of immunohistochemical studies. Computational biomarkers may help to contribute to patient management or outcomes. Furthermore, using digital and computational pathology may increase standardization and quality assurance, especially in areas with high interobserver variability. This review explores the current landscape and possible future applications of digital and computational techniques in the field of breast pathology.

Graph Neural Network for representation learning of lung cancer

The emergence of image-based systems to improve diagnostic pathology precision, involving the intent to label sets or bags of instances, greatly hinges on Multiple Instance Learning for Whole Slide Images(WSIs). Contemporary works have shown excellent performance for a neural network in MIL settings. Here, we examine a graph-based model to facilitate end-to-end learning and sample suitable patches using a tile-based approach. We propose MIL-GNN to employ a graph-based Variational Auto-encoder with a Gaussian mixture model to discover relations between sample patches for the purposes to aggregate patch details into an individual vector representation. Using the classical MIL dataset MUSK and distinguishing two lung cancer sub-types, lung cancer called adenocarcinoma (LUAD) and lung squamous cell carcinoma (LUSC), we exhibit the efficacy of our technique. We achieved a 97.42% accuracy on the MUSK dataset and a 94.3% AUC on the classification of lung cancer sub-types utilizing features.

Exploration and Enhancement of Classifiers in the Detection of Lung Cancer from Histopathological Images

Lung cancer is a prevalent malignancy that impacts individuals of all genders and is often diagnosed late due to delayed symptoms. To catch it early, researchers are developing algorithms to study lung cancer images. The primary objective of this work is to propose a novel approach for the detection of lung cancer using histopathological images. In this work, the histopathological images underwent preprocessing, followed by segmentation using a modified approach of KFCM-based segmentation and the segmented image intensity values were dimensionally reduced using Particle Swarm Optimization (PSO) and Grey Wolf Optimization (GWO). Algorithms such as KL Divergence and Invasive Weed Optimization (IWO) are used for feature selection. Seven different classifiers such as SVM, KNN, Random Forest, Decision Tree, Softmax Discriminant, Multilayer Perceptron, and BLDC were used to analyze and classify the images as benign or malignant. Results were compared using standard metrics, and kappa analysis assessed classifier agreement. The Decision Tree Classifier with GWO feature extraction achieved good accuracy of 85.01% without feature selection and hyperparameter tuning approaches. Furthermore, we present a methodology to enhance the accuracy of the classifiers by employing hyperparameter tuning algorithms based on Adam and RAdam. By combining features from GWO and IWO, and using the RAdam algorithm, the Decision Tree classifier achieves the commendable accuracy of 91.57%.

Escin enhanced the efficacy of sorafenib by autophagy-mediated apoptosis in lung cancer cells

Combining anti-cancer drugs has been exploited as promising treatment strategy to target lung cancer. Synergistic chemotherapies increase anti-cancer effect and reduce effective drug doses and side effects. In this study, therapeutic potential of escin in combination with sorafenib has been explored. 3-(4,5-Dimethylthiazol-2-yl)-2 5-diphenyltetrazolium bromide assay was used to calculate IC50 values. The synergy was evaluated using Chou-Talaly algorithm. Cellular reactive oxygen species, mitochondrial membrane potential, annexin V, and cell-cycle studies were done by flow-cytometer, and autophagy biomarkers expression were determined using western blotting. Moreover, autophagy was knocked down using ATG5 siRNA to confirm its role, diethylnitrosamine-induced lung cancer model was used to check the synergy of sorafenib/escin. Escin significantly reduced the IC50 of sorafenib in A549 and NCIH460 cells. The combination of sorafenib/escin produced a 2.95 and 5.45 dose reduction index for sorafenib in A549 and NCI-H460 cells. The combination of over-expressed p62 and LC3-II reflects autophagy block-mediated late apoptosis. This phenomenon was reconfirmed by ATG5 knockdown. This combination also selectively targeted G0/G1 phase of cancer cells. In in vivo study, the combination reduced tumour load and lower elevated serum biochemical parameters. The combination of sorafenib/escin synergistically inhibits autophagy to induce late apoptosis in lung cancer cells' G0/G1 phase.

The value of deep neural networks in the pathological classification of thyroid tumors

BACKGROUND

To explore the distinguishing diagnostic value and clinical application potential of deep neural networks (DNN) for pathological images of thyroid tumors.

METHODS

A total of 799 pathological thyroid images of 559 patients with thyroid tumors were retrospectively analyzed. The pathological types included papillary thyroid carcinoma (PTC), medullary thyroid carcinoma (MTC), follicular thyroid carcinoma (FTC), adenomatous goiter, adenoma, and normal thyroid gland. The dataset was divided into a training set and a test set. Resnet50, Resnext50, EfficientNet, and Densenet121 were trained using the training set data and tested with the test set data to determine the diagnostic efficiency of different pathology types and to further analyze the causes of misdiagnosis.

RESULTS

The recall, precision, negative predictive value (NPV), accuracy, specificity, and F1 scores of the four models ranged from 33.33% to 100.00%. The area under curve (AUC) ranged from 0.822 to 0.994, and the Kappa coefficient ranged from 0.7508 to 0.7713. However, the performance of diagnosing FTC, adenoma, and adenomatous goiter was slightly inferior to other types of pathological tissues.

CONCLUSION

The DNN model achieved satisfactory results in the task of classifying thyroid tumors by learning thyroid pathology images. These results indicate the potential of the DNN model for the efficient diagnosis of thyroid tumor histopathology.

Motionless volumetric structured light sheet microscopy

To meet the increasing need for low-cost, compact imaging technology with cellular resolution, we have developed a microLED-based structured light sheet microscope for three-dimensional ex vivo and in vivo imaging of biological tissue in multiple modalities. All the illumination structure is generated directly at the microLED panel-which serves as the source-so light sheet scanning and modulation is completely digital, yielding a system that is simpler and less prone to error than previously reported methods. Volumetric images with optical sectioning are thus achieved in an inexpensive, compact form factor without any moving parts. We demonstrate the unique properties and general applicability of our technique by ex vivo imaging of porcine and murine tissue from the gastrointestinal tract, kidney, and brain.

Removing non-nuclei information from histopathological images: A preprocessing step towards improving nuclei segmentation methods

Disease interpretation by computer-aided diagnosis systems in digital pathology depends on reliable detection and segmentation of nuclei in hematoxylin and eosin (HE) images. These 2 tasks are challenging since appearance of both cell nuclei and background structures are very variable. This paper presents a method to improve nuclei detection and segmentation in HE images by removing tiles that only contain background information. The method divides each image into smaller patches and uses their projection to the noiselet space to capture different spatial features from non-nuclei background and nuclei structures. The noiselet features are clustered by a K-means algorithm and the resultant partition, defined by the cluster centroids, is herein named the noiselet code-book. A part of an image, a tile, is divided into patches and represented by the histogram of occurrences of the projected patches in the noiselet code-book. Finally, with these histograms, a classifier learns to differentiate between nuclei and non-nuclei tiles. By applying a conventional watershed-marked method to detect and segment nuclei, evaluation consisted in comparing pure watershed method against denoising-plus-watershed in an open database with 8 different types of tissues. The averaged F-score of nuclei detection improved from 0.830 to 0.86 and the dice score after segmentation increased from 0.701 to 0.723.

Blur-specific image quality assessment of microscopic hyperspectral images

Hyperspectral (HS) imaging (HSI) expands the number of channels captured within the electromagnetic spectrum with respect to regular imaging. Thus, microscopic HSI can improve cancer diagnosis by automatic classification of cells. However, homogeneous focus is difficult to achieve in such images, being the aim of this work to automatically quantify their focus for further image correction. A HS image database for focus assessment was captured. Subjective scores of image focus were obtained from 24 subjects and then correlated to state-of-the-art methods. Maximum Local Variation, Fast Image Sharpness block-based Method and Local Phase Coherence algorithms provided the best correlation results. With respect to execution time, LPC was the fastest.

ENHANCED SHARP-GAN FOR HISTOPATHOLOGY IMAGE SYNTHESIS

Histopathology image synthesis aims to address the data shortage issue in training deep learning approaches for accurate cancer detection. However, existing methods struggle to produce realistic images that have accurate nuclei boundaries and less artifacts, which limits the application in downstream tasks. To address the challenges, we propose a novel approach that enhances the quality of synthetic images by using nuclei topology and contour regularization. The proposed approach uses the skeleton map of nuclei to integrate nuclei topology and separate touching nuclei. In the loss function, we propose two new contour regularization terms that enhance the contrast between contour and non-contour pixels and increase the similarity between contour pixels. We evaluate the proposed approach on the two datasets using image quality metrics and a downstream task (nuclei segmentation). The proposed approach outperforms Sharp-GAN in all four image quality metrics on two datasets. By integrating 6k synthetic images from the proposed approach into training, a nuclei segmentation model achieves the state-of-the-art segmentation performance on TNBC dataset and its detection quality (DQ), segmentation quality (SQ), panoptic quality (PQ), and aggregated Jaccard index (AJI) is 0.855, 0.863, 0.691, and 0.683, respectively.

Automated Lung Cancer Segmentation in Tissue Micro Array Analysis Histopathological Images Using a Prototype of Computer-Assisted Diagnosis

Background: Lung cancer is a fatal disease that kills approximately 85% of those diagnosed with it. In recent years, advances in medical imaging have greatly improved the acquisition, storage, and visualization of various pathologies, making it a necessary component in medicine today. Objective: Develop a computer-aided diagnostic system to detect lung cancer early by segmenting tumor and non-tumor tissue on Tissue Micro Array Analysis (TMA) histopathological images. Method: The prototype computer-aided diagnostic system was developed to segment tumor areas, non-tumor areas, and fundus on TMA histopathological images. Results: The system achieved an average accuracy of 83.4% and an F-measurement of 84.4% in segmenting tumor and non-tumor tissue. Conclusion: The computer-aided diagnostic system provides a second diagnostic opinion to specialists, allowing for more precise diagnoses and more appropriate treatments for lung cancer.

Nanoscale Prognosis of Colorectal Cancer Metastasis from AFM Image Processing of Histological Sections

Early ascertainment of metastatic tumour phases is crucial to improve cancer survival, formulate an accurate prognostic report of disease advancement, and, most importantly, quantify the metastatic progression and malignancy state of primary cancer cells with a universal numerical indexing system. This work proposes an early improvement to metastatic cancer detection with 97.7 nm spatial resolution by indexing the metastatic cancer phases from the analysis of atomic force microscopy images of human colorectal cancer histological sections. The procedure applies variograms of residuals of Gaussian filtering and theta statistics of colorectal cancer tissue image settings. This methodology elucidates the early metastatic progression at the nanoscale level by setting metastatic indexes and critical thresholds based on relatively large histological sections and categorising the malignancy state of a few suspicious cells not identified with optical image analysis. In addition, we sought to detect early tiny morphological differentiations indicating potential cell transition from epithelial cell phenotypes of low metastatic potential to those of high metastatic potential. This metastatic differentiation, which is also identified in higher moments of variograms, sets different hierarchical levels for metastatic progression dynamics.

Artificial intelligence in breast cancer histopathology

This is a review on the use of artificial intelligence for digital breast pathology. A systematic search on PubMed was conducted, identifying 17,324 research papers related to breast cancer pathology. Following a semimanual screening, 664 papers were retrieved and pursued. The papers are grouped into six major tasks performed by pathologists-namely, molecular and hormonal analysis, grading, mitotic figure counting, ki-67 indexing, tumour-infiltrating lymphocyte assessment, and lymph node metastases identification. Under each task, open-source datasets for research to build artificial intelligence (AI) tools are also listed. Many AI tools showed promise and demonstrated feasibility in the automation of routine pathology investigations. We expect continued growth of AI in this field as new algorithms mature.

Lung Cancer Subtype Diagnosis by Fusing Image-Genomics Data and Hybrid Deep Networks

Accurate diagnosis of cancer subtypes is crucial for precise treatment, because different cancer subtypes are involved with different pathology and require different therapies. Although deep learning techniques have made great success in computer vision and other fields, they do not work well on Lung cancer subtype diagnosis, due to the distinction of slide images between different cancer subtypes is ambiguous. Furthermore, they often over-fit to high-dimensional genomics data with limited samples, and do not fuse the image and genomics data in a sensible way. In this paper, we propose a hybrid deep network based approach LungDIG for Lung cancer subtype Diagnosis by fusing Image-Genomics data. LungDIG first tiles the tissue slide image into small patches and extracts the patch-level features by fine-tuning an Inception-V3 model. Since the patches may contain some false positives in non-diagnostic regions, it further designs a patch-level feature combination strategy to integrate the extracted patch features and maintain the diversity between different cancer subtypes. At the same time, it extracts the genomics features from Copy Number Variation data by an attention based nonlinear extractor. Next, it fuses the image and genomics features by an attention based multilayer perceptron (MLP) to diagnose cancer subtype. Experiments on TCGA lung cancer data show that LungDIG can not only achieve higher accuracy for cancer subtype diagnosis than state-of-the-art methods, but also have a high authenticity and good interpretability.

Breast Tumor Tissue Image Classification Using DIU-Net

Inspired by the observation that pathologists pay more attention to the nuclei regions when analyzing pathological images, this study utilized soft segmentation to imitate the visual focus mechanism and proposed a new segmentation-classification joint model to achieve superior classification performance for breast cancer pathology images. Aiming at the characteristics of different sizes of nuclei in pathological images, this study developed a new segmentation network with excellent cross-scale description ability called DIU-Net. To enhance the generalization ability of the segmentation network, that is, to avoid the segmentation network from learning low-level features, we proposed the Complementary Color Conversion Scheme in the training phase. In addition, due to the disparity between the area of the nucleus and the background in the pathology image, there is an inherent data imbalance phenomenon, dice loss and focal loss were used to overcome this problem. In order to further strengthen the classification performance of the model, this study adopted a joint training scheme, so that the output of the classification network can not only be used to optimize the classification network itself, but also optimize the segmentation network. In addition, this model can also provide the pathologist model's attention area, increasing the model's interpretability. The classification performance verification of the proposed method was carried out with the BreaKHis dataset. Our method obtains binary/multi-class classification accuracy 97.24/93.75 and 98.19/94.43 for 200× and 400× images, outperforming existing methods.

A Survey on AI Techniques for Thoracic Diseases Diagnosis Using Medical Images

Thoracic diseases refer to disorders that affect the lungs, heart, and other parts of the rib cage, such as pneumonia, novel coronavirus disease (COVID-19), tuberculosis, cardiomegaly, and fracture. Millions of people die every year from thoracic diseases. Therefore, early detection of these diseases is essential and can save many lives. Earlier, only highly experienced radiologists examined thoracic diseases, but recent developments in image processing and deep learning techniques are opening the door for the automated detection of these diseases. In this paper, we present a comprehensive review including: types of thoracic diseases; examination types of thoracic images; image pre-processing; models of deep learning applied to the detection of thoracic diseases (e.g., pneumonia, COVID-19, edema, fibrosis, tuberculosis, chronic obstructive pulmonary disease (COPD), and lung cancer); transfer learning background knowledge; ensemble learning; and future initiatives for improving the efficacy of deep learning models in applications that detect thoracic diseases. Through this survey paper, researchers may be able to gain an overall and systematic knowledge of deep learning applications in medical thoracic images. The review investigates a performance comparison of various models and a comparison of various datasets.

Performance analysis of seven Convolutional Neural Networks (CNNs) with transfer learning for Invasive Ductal Carcinoma (IDC) grading in breast histopathological images

Computer-aided Invasive Ductal Carcinoma (IDC) grading classification systems based on deep learning have shown that deep learning may achieve reliable accuracy in IDC grade classification using histopathology images. However, there is a dearth of comprehensive performance comparisons of Convolutional Neural Network (CNN) designs on IDC in the literature. As such, we would like to conduct a comparison analysis of the performance of seven selected CNN models: EfficientNetB0, EfficientNetV2B0, EfficientNetV2B0-21k, ResNetV1-50, ResNetV2-50, MobileNetV1, and MobileNetV2 with transfer learning. To implement each pre-trained CNN architecture, we deployed the corresponded feature vector available from the TensorFlowHub, integrating it with dropout and dense layers to form a complete CNN model. Our findings indicated that the EfficientNetV2B0-21k (0.72B Floating-Point Operations and 7.1 M parameters) outperformed other CNN models in the IDC grading task. Nevertheless, we discovered that practically all selected CNN models perform well in the IDC grading task, with an average balanced accuracy of 0.936 ± 0.0189 on the cross-validation set and 0.9308 ± 0.0211on the test set.

Bacteriocins as Potential Therapeutic Approaches in the Treatment of Various Cancers: A Review of In Vitro Studies

Simple Summary

Current cancer treatment strategies such as surgery, chemotherapy, and radiotherapy, have significant drawbacks. There is a need for a breakthrough approach to cancer treatment. Bacteriocin, an antimicrobial peptide, has shown several anticancer properties in vitro. Therefore, this article reviews the effect of bacteriocin on cancer cells and how bacteriocins affect cancer cells in vitro. This article aims to promote additional bacteriocin research, particularly in vivo studies, to fully understand the potential of bacteriocin as a cancer treatment agent.

Abstract

Cancer is regarded as one of the most common and leading causes of death. Despite the availability of conventional treatments against cancer cells, current treatments are not the optimal treatment for cancer as they possess the possibility of causing various unwanted side effects to the body. As a result, this prompts a search for an alternative treatment without exhibiting any additional side effects. One of the promising novel therapeutic candidates against cancer is an antimicrobial peptide produced by bacteria called bacteriocin. It is a non-toxic peptide that is reported to exhibit potency against cancer cell lines. Experimental studies have outlined the therapeutic potential of bacteriocin against various cancer cell lines. In this review article, the paper focuses on the various bacteriocins and their cytotoxic effects, mode of action and efficacies as therapeutic agents against various cancer cell lines.

A Deep Learning Computer-Aided Diagnosis Approach for Breast Cancer

Breast cancer is a gigantic burden on humanity, causing the loss of enormous numbers of lives and amounts of money. It is the world’s leading type of cancer among women and a leading cause of mortality and morbidity. The histopathological examination of breast tissue biopsies is the gold standard for diagnosis. In this paper, a computer-aided diagnosis (CAD) system based on deep learning is developed to ease the pathologist’s mission. For this target, five pre-trained convolutional neural network (CNN) models are analyzed and tested—Xception, DenseNet201, InceptionResNetV2, VGG19, and ResNet152—with the help of data augmentation techniques, and a new approach is introduced for transfer learning. These models are trained and tested with histopathological images obtained from the BreakHis dataset. Multiple experiments are performed to analyze the performance of these models through carrying out magnification-dependent and magnification-independent binary and eight-class classifications. The Xception model has shown promising performance through achieving the highest classification accuracies for all the experiments. It has achieved a range of classification accuracies from 93.32% to 98.99% for magnification-independent experiments and from 90.22% to 100% for magnification-dependent experiments.

Automatic segmentation of breast cancer histological images based on dual-path feature extraction network

The traditional manual breast cancer diagnosis method of pathological images is time-consuming and labor-intensive, and it is easy to be misdiagnosed. Computer-aided diagnosis of WSIs gradually comes into people*s sight. However, the complexity of high-resolution breast cancer pathological images poses a great challenge to automatic diagnosis, and the existing algorithms are often difficult to balance the accuracy and efficiency. In order to solve these problems, this paper proposes an automatic image segmentation method based on dual-path feature extraction network for breast pathological WSIs, which has a good segmentation accuracy. Specifically, inspired by the concept of receptive fields in the human visual system, dilated convolutional networks are introduced to encode rich contextual information. Based on the channel attention mechanism, a feature attention module and a feature fusion module are proposed to effectively filter and combine the features. In addition, this method uses a light-weight backbone network and performs pre-processing on the data, which greatly reduces the computational complexity of the algorithm. Compared with the classic models, it has improved accuracy and efficiency and is highly competitive.

A Novel Cartesian Plot Analysis for Fixed Monolayers That Relates Cell Phenotype to Transfer of Contents between Fibroblasts and Cancer Cells by Cell-Projection Pumping

We recently described cell-projection pumping as a mechanism transferring cytoplasm between cells. The uptake of fibroblast cytoplasm by co-cultured SAOS-2 osteosarcoma cells changes SAOS-2 morphology and increases cell migration and proliferation, as seen by single-cell tracking and in FACS separated SAOS-2 from co-cultures. Morphological changes in SAOS-2 seen by single cell tracking are consistent with previous observations in fixed monolayers of SAOS-2 co-cultures. Notably, earlier studies with fixed co-cultures were limited by the absence of a quantitative method for identifying sub-populations of co-cultured cells, or for quantitating transfer relative to control populations of SAOS-2 or fibroblasts cultured alone. We now overcome that limitation by a novel Cartesian plot analysis that identifies individual co-cultured cells as belonging to one of five distinct cell populations, and also gives numerical measure of similarity to control cell populations. We verified the utility of the method by first confirming the previously established relationship between SAOS-2 morphology and uptake of fibroblast contents, and also demonstrated similar effects in other cancer cell lines including from melanomas, and cancers of the ovary and colon. The method was extended to examine global DNA methylation, and while there was no clear effect on SAOS-2 DNA methylation, co-cultured fibroblasts had greatly reduced DNA methylation, similar to cancer associated fibroblasts.

A review: The detection of cancer cells in histopathology based on machine vision

Machine vision is being employed in defect detection, size measurement, pattern recognition, image fusion, target tracking and 3D reconstruction. Traditional cancer detection methods are dominated by manual detection, which wastes time and manpower, and heavily relies on the pathologists' skill and work experience. Therefore, these manual detection approaches are not convenient for the inheritance of domain knowledge, and are not suitable for the rapid development of medical care in the future. The emergence of machine vision can iteratively update and learn the domain knowledge of cancer cell pathology detection to achieve automated, high-precision, and consistent detection. Consequently, this paper reviews the use of machine vision to detect cancer cells in histopathology images, as well as the benefits and drawbacks of various detection approaches. First, we review the application of image preprocessing and image segmentation in histopathology for the detection of cancer cells, and compare the benefits and drawbacks of different algorithms. Secondly, for the characteristics of histopathological cancer cell images, the research progress of shape, color and texture features and other methods is mainly reviewed. Furthermore, for the classification methods of histopathological cancer cell images, the benefits and drawbacks of traditional machine vision approaches and deep learning methods are compared and analyzed. Finally, the above research is discussed and forecasted, with the expected future development tendency serving as a guide for future research.

Automated Cancer Diagnostics via Analysis of Optical and Chemical Images by Deep and Shallow Learning

Optical microscopy has long been the gold standard to analyse tissue samples for the diagnostics of various diseases, such as cancer. The current diagnostic workflow is time-consuming and labour-intensive, and manual annotation by a qualified pathologist is needed. With the ever-increasing number of tissue blocks and the complexity of molecular diagnostics, new approaches have been developed as complimentary or alternative solutions for the current workflow, such as digital pathology and mass spectrometry imaging (MSI). This study compares the performance of a digital pathology workflow using deep learning for tissue recognition and an MSI approach utilising shallow learning to annotate formalin-fixed and paraffin-embedded (FFPE) breast cancer tissue microarrays (TMAs). Results show that both deep learning algorithms based on conventional optical images and MSI-based shallow learning can provide automated diagnostics with F1-scores higher than 90%, with the latter intrinsically built on biochemical information that can be used for further analysis.

Differential diagnostic value of the ResNet50, random forest, and DS ensemble models for papillary thyroid carcinoma and other thyroid nodules

Objective To explore the differential diagnostic efficiency of the residual network (ResNet)50, random forest (RF), and DS ensemble models for papillary thyroid carcinoma (PTC) and other pathological types of thyroid nodules.

Methods This study retrospectively analyzed 559 patients with thyroid nodules and collected thyroid pathological images and auxiliary examination results (laboratory and ultrasound results) to construct datasets. The pathological image dataset was used to train a ResNet50 model, the text dataset was used to train a random forest (RF) model, and a DS ensemble model was constructed from the results of the two models. The differential diagnostic values of the three models for PTC and other types of thyroid nodules were then compared.

Results The DS ensemble model had the highest sensitivity, specificity, accuracy, and area under the receiver operating characteristic curve (85.87%, 97.18%, 93.77%, and 0.982, respectively).

Conclusions Compared with Resnet50 and the RF models trained only on imaging data or text information, respectively, the DS ensemble model showed better diagnostic value for PTC.

Deep Interpretable Classification and Weakly-Supervised Segmentation of Histology Images via Max-Min Uncertainty

Weakly-supervised learning (WSL) has recently triggered substantial interest as it mitigates the lack of pixel-wise annotations. Given global image labels, WSL methods yield pixel-level predictions (segmentations), which enable to interpret class predictions. Despite their recent success, mostly with natural images, such methods can face important challenges when the foreground and background regions have similar visual cues, yielding high false-positive rates in segmentations, as is the case in challenging histology images. WSL training is commonly driven by standard classification losses, which implicitly maximize model confidence, and locate the discriminative regions linked to classification decisions. Therefore, they lack mechanisms for modeling explicitly non-discriminative regions and reducing false-positive rates. We propose novel regularization terms, which enable the model to seek both non-discriminative and discriminative regions, while discouraging unbalanced segmentations. We introduce high uncertainty as a criterion to localize non-discriminative regions that do not affect classifier decision, and describe it with original Kullback-Leibler (KL) divergence losses evaluating the deviation of posterior predictions from the uniform distribution. Our KL terms encourage high uncertainty of the model when the latter inputs the latent non-discriminative regions. Our loss integrates: (i) a cross-entropy seeking a foreground, where model confidence about class prediction is high; (ii) a KL regularizer seeking a background, where model uncertainty is high; and (iii) log-barrier terms discouraging unbalanced segmentations. Comprehensive experiments and ablation studies over the public GlaS colon cancer data and a Camelyon16 patch-based benchmark for breast cancer show substantial improvements over state-of-the-art WSL methods, and confirm the effect of our new regularizers (our code is publicly available at https://github.com/sbelharbi/deep-wsl-histo-min-max-uncertainty).

Enhanced Watershed Segmentation Algorithm-Based Modified ResNet50 Model for Brain Tumor Detection

This work delivers a novel technique to detect brain tumor with the help of enhanced watershed modeling integrated with a modified ResNet50 architecture. It also involves stochastic approaches to help in developing enhanced watershed modeling. Cancer diseases, primarily the brain tumor, have been exponentially raised which has alarmed researchers from academia and industry. Nowadays, researchers need to attain a more effective, accurate, and trustworthy brain tumor tissue detection and classification approach. Different from traditional machine learning methods that are just targeting to enhance classification efficiency, this work highlights the process to extract several deep features to diagnose brain tumor effectively. This paper explains the modeling of a novel technique by integrating the modified ResNet50 with the Enhanced Watershed Segmentation (EWS) algorithm for brain tumor classification and deep feature extraction. The proposed model uses the ResNet50 model with a modified layer architecture including five convolutional layers and three fully connected layers. The proposed method can retain the optimal computational efficiency with high-dimensional deep features. This work obtains a comprised feature set by retrieving the diverse deep features from the ResNet50 deep learning model and feeds them as input to the classifier. The good performing capability of the proposed model is achieved by using hybrid features of ResNet50. The brain tumor tissue images were extracted by the suggested hybrid deep feature-based modified ResNet50 model and the EWS-based modified ResNet50 model with a high classification accuracy of 92% and 90%, respectively.

Spatial analysis of histology in 3D: quantification and visualization of organ and tumor level tissue environment

Histological changes in tissue are of primary importance in pathological research and diagnosis. Automated histological analysis requires ability to computationally separate pathological alterations from normal tissue. Conventional histopathological assessments are performed from individual tissue sections, leading to the loss of three-dimensional context of the tissue. Yet, the tissue context and spatial determinants are critical in several pathologies, such as in understanding growth patterns of cancer in its local environment. Here, we develop computational methods for visualization and quantitative assessment of histopathological alterations in three dimensions. First, we reconstruct the 3D representation of the whole organ from serial sectioned tissue. Then, we proceed to analyze the histological characteristics and regions of interest in 3D. As our example cases, we use whole slide images representing hematoxylin-eosin stained whole mouse prostates in a Pten+/- mouse prostate tumor model. We show that quantitative assessment of tumor sizes, shapes, and separation between spatial locations within the organ enable characterizing and grouping tumors. Further, we show that 3D visualization of tissue with computationally quantified features provides an intuitive way to observe tissue pathology. Our results underline the heterogeneity in composition and cellular organization within individual tumors. As an example, we show how prostate tumors have nuclear density gradients indicating areas of tumor growth directions and reflecting varying pressure from the surrounding tissue. The methods presented here are applicable to any tissue and different types of pathologies. This work provides a proof-of-principle for gaining a comprehensive view from histology by studying it quantitatively in 3D.

Breast histopathological image analysis using image processing techniques for diagnostic puposes: A methodological review

Breast cancer in women is the second most common cancer worldwide. Early detection of breast cancer can reduce the risk of human life. Non-invasive techniques such as mammograms and ultrasound imaging are popularly used to detect the tumour. However, histopathological analysis is necessary to determine the malignancy of the tumour as it analyses the image at the cellular level. Manual analysis of these slides is time consuming, tedious, subjective and are susceptible to human errors. Also, at times the interpretation of these images are inconsistent between laboratories. Hence, a Computer-Aided Diagnostic system that can act as a decision support system is need of the hour. Moreover, recent developments in computational power and memory capacity led to the application of computer tools and medical image processing techniques to process and analyze breast cancer histopathological images. This review paper summarizes various traditional and deep learning based methods developed to analyze breast cancer histopathological images. Initially, the characteristics of breast cancer histopathological images are discussed. A detailed discussion on the various potential regions of interest is presented which is crucial for the development of Computer-Aided Diagnostic systems. We summarize the recent trends and choices made during the selection of medical image processing techniques. Finally, a detailed discussion on the various challenges involved in the analysis of BCHI is presented along with the future scope.

Detection of Structure Characteristics and Its Discontinuity Based Field Programmable Gate Array Processor in Cancer Cell by Wavelet Transform

Digital clinical histopathology is one of the crucial techniques for precise cancer cell diagnosing in modern medicine. The Synovial Sarcoma (SS) cancer cell patterns seem to be a spindle shaped cell (SSC) structure and it is very difficult to identify the exact oval shaped cell structure through pathologist’s eye perception. Meanwhile, there is necessitating for monitoring and securing the successful and effective image data processing in the the huge network data which is also a complex one. A field programmable Gate Array (FPGA) was regarded as a necessary one for this. In this work, based on FPGA a Cancer Cell classification is made for the regulation and execution. Hence, mathematically the SSC regularity structures and its discontinuities are measured by the holder exponent (HE) function. In this research work, HE values have been determined by Wavelet Transform Modulus Maxima (WTMM) and Wavelet Leader (WL) methods with basis function of Haar wavelet based on FPGA Processor. The quantitative parameters such as Mean of Asymptotic Discontinuity (MAD), Mean of Removable Discontinuity (MRD) and Number of Discontinuity Points (NDPs) have been considered to determine the prediction of discontinuity detection between WTMM and WL methods. With the help of receiver operating characteristics (ROC) curve, the significant difference of discontinuity detection performance between both the methods has been analyzed. From the experimental results, it is clear that the WL method is more practically feasible and it gives satisfactory performance, in terms of sensitivity and specificity percentage values, which are 80.56% and 59.46%, respectively in the blue color components of the SNR 20 dB noise image.

Diagnostic Benefit of High b-Value Computed Diffusion-Weighted Imaging in Patients with Hepatic Metastasis

Diffusion-weighted imaging (DWI) has rapidly become an essential tool for the detection of malignant liver lesions. The aim of this study was to investigate the usefulness of high b-value computed DWI (c-DWI) in comparison to standard DWI in patients with hepatic metastases. In total, 92 patients with histopathologic confirmed primary tumors with hepatic metastasis were retrospectively analyzed by two readers. DWI was obtained with b-values of 50, 400 and 800 or 1000 s/mm² on a 1.5 T magnetic resonance imaging (MRI) scanner. C-DWI was calculated with a monoexponential model with high b-values of 1000, 2000, 3000, 4000 and 5000 s/mm². All c-DWI images with high b-values were compared to the acquired DWI sequence at a b-value of 800 or 1000 s/mm² in terms of volume, lesion detectability and image quality. In the group of a b-value of 800 from a b-value of 2000 s/mm², hepatic lesion sizes were significantly smaller than on acquired DWI (metastases lesion sizes b = 800 vs. b 2000 s/mm²: mean 25 cm³ (range 10-60 cm³) vs. mean 17.5 cm³ (range 5-35 cm³), p < 0.01). In the second group at a high b-value of 1500 s/mm², liver metastases were larger than on c-DWI at higher b-values (b = 1500 vs. b 2000 s/mm², mean 10 cm³ (range 4-24 cm³) vs. mean 9 cm³ (range 5-19 cm³), p < 0.01). In both groups, there was a clear reduction in lesion detectability at b = 2000 s/mm², with hepatic metastases being less visible compared to c-DWI images at b = 1500 s/mm² in at least 80% of all patients. Image quality dropped significantly starting from c-DWI at b = 3000 s/mm². In both groups, almost all high b-values images at b = 4000 s/mm² and 5000 s/mm² were not diagnostic due to poor image quality. High c-DWI b-values up to b = 1500 s/mm² offer comparable detectability for hepatic metastases compared to standard DWI. Higher b-value images over 2000 s/mm² lead to a noticeable reduction in imaging quality, which could hamper diagnosis.

Integrating pathomics with radiomics and genomics for cancer prognosis: A brief review

In the last decade, the focus of computational pathology research community has shifted from replicating the pathological examination for diagnosis done by pathologists to unlocking and discovering "sub-visual" prognostic image cues from the histopathological image. While we are getting more knowledge and experience in digital pathology, the emerging goal is to integrate other-omics or modalities that will contribute for building a better prognostic assay. In this paper, we provide a brief review of representative works that focus on integrating pathomics with radiomics and genomics for cancer prognosis. It includes: correlation of pathomics and genomics; fusion of pathomics and genomics; fusion of pathomics and radiomics. We also present challenges, potential opportunities, and avenues for future work.