Predicting non-small cell lung cancer prognosis by fully automated microscopic pathology image features

Accurate Kidney Pathological Image Classification Method Based on Deep Learning and Multi-Modal Fusion Method with Application to Membranous Nephropathy

Membranous nephropathy is one of the most prevalent conditions responsible for nephrotic syndrome in adults. It is clinically nonspecific and mainly diagnosed by kidney biopsy pathology, with three prevalent techniques: light microscopy, electron microscopy, and immunofluorescence microscopy. Manual observation of glomeruli one by one under the microscope is very time-consuming, and there are certain differences in the observation results between physicians. This study makes use of whole-slide images scanned by a light microscope as well as immunofluorescence images to classify patients with membranous nephropathy. The framework mainly includes a glomerular segmentation module, a confidence coefficient extraction module, and a multi-modal fusion module. This framework first identifies and segments the glomerulus from whole-slide images and immunofluorescence images, and then a glomerular classifier is trained to extract the features of each glomerulus. The results are then combined to produce the final diagnosis. The results of the experiments show that the F1-score of image classification results obtained by combining two kinds of features, which can reach 97.32%, is higher than those obtained by using only light-microscopy-observed images or immunofluorescent images, which reach 92.76% and 93.20%, respectively. Experiments demonstrate that considering both WSIs and immunofluorescence images is effective in improving the diagnosis of membranous nephropathy.

Non-Association of Driver Alterations in PTEN with Differential Gene Expression and Gene Methylation in IDH1 Wildtype Glioblastomas

During oncogenesis, alterations in driver genes called driver alterations (DAs) modulate the transcriptome, methylome and proteome through oncogenic signaling pathways. These modulatory effects of any DA may be analyzed by examining differentially expressed mRNAs (DEMs), differentially methylated genes (DMGs) and differentially expressed proteins (DEPs) between tumor samples with and without that DA. We aimed to analyze these modulations with 12 common driver genes in Isocitrate Dehydrogenase 1 wildtype glioblastomas (IDH1-W-GBs). Using Cbioportal, groups of tumor samples with and without DAs in these 12 genes were generated from the IDH1-W-GBs available from "The Cancer Genomics Atlas Firehose Legacy Study Group" (TCGA-FL-SG) on Glioblastomas (GBs). For all 12 genes, samples with and without DAs were compared for DEMs, DMGs and DEPs. We found that DAs in PTEN were unassociated with any DEM or DMG in contrast to DAs in all other drivers, which were associated with several DEMs and DMGs. This contrasting PTEN-related property of being unassociated with differential gene expression or methylation in IDH1-W-GBs was unaffected by concurrent DAs in other common drivers or by the types of DAs affecting PTEN. From the lists of DEMs and DMGs associated with some common drivers other than PTEN, enriched gene ontology terms and insights into the co-regulatory effects of these drivers on the transcriptome were obtained. The findings from this study can improve our understanding of the molecular mechanisms underlying gliomagenesis with potential therapeutic benefits.

Using deep learning to predict survival outcome in non-surgical cervical cancer patients based on pathological images

PURPOSE

We analyzed clinical features and the representative HE-stained pathologic images to predict 5-year overall survival via the deep-learning approach in cervical cancer patients in order to assist oncologists in designing the optimal treatment strategies.

METHODS

The research retrospectively collected 238 non-surgical cervical cancer patients treated with radiochemotherapy from 2014 to 2017. These patients were randomly divided into the training set (n = 165) and test set (n = 73). Then, we extract deep features after segmenting the HE-stained image into patches of size 224 × 224. A Lasso-Cox model was constructed with clinical data to predict 5-year OS. C-index evaluated this model performance with 95% CI, calibration curve, and ROC.

RESULTS

Based on multivariate analysis, 2 of 11 clinical characteristics (C-index 0.68) and 2 of 2048 pathomic features (C-index 0.74) and clinical-pathomic model (C-index 0.83) of nomograms predict 5-year survival in the training set, respectively. In test set, compared with the pathomic and clinical characteristics used alone, the clinical-pathomic model had an AUC of 0.750 (95% CI 0.540-0.959), the clinical predictor model had an AUC of 0.729 (95% CI 0.551-0.909), and the pathomic model AUC was 0.703 (95% CI 0.487-0.919). Based on appropriate nomogram scores, we divided patients into high-risk and low-risk groups, and Kaplan-Meier survival probability curves for both groups showed statistical differences.

CONCLUSION

We built a clinical-pathomic model to predict 5-year OS in non-surgical cervical cancer patients, which may be a promising method to improve the precision of personalized therapy.

Detection of Necrosis in Digitised Whole-Slide Images for Better Grading of Canine Soft-Tissue Sarcomas Using Machine-Learning

The definitive diagnosis of canine soft-tissue sarcomas (STSs) is based on histological assessment of formalin-fixed tissues. Assessment of parameters, such as degree of differentiation, necrosis score and mitotic score, give rise to a final tumour grade, which is important in determining prognosis and subsequent treatment modalities. However, grading discrepancies are reported to occur in human and canine STSs, which can result in complications regarding treatment plans. The introduction of digital pathology has the potential to help improve STS grading via automated determination of the presence and extent of necrosis. The detected necrotic regions can be factored in the grading scheme or excluded before analysing the remaining tissue. Here we describe a method to detect tumour necrosis in histopathological whole-slide images (WSIs) of STSs using machine learning. Annotated areas of necrosis were extracted from WSIs and the patches containing necrotic tissue fed into a pre-trained DenseNet161 convolutional neural network (CNN) for training, testing and validation. The proposed CNN architecture reported favourable results, with an overall validation accuracy of 92.7% for necrosis detection which represents the number of correctly classified data instances over the total number of data instances. The proposed method, when vigorously validated represents a promising tool to assist pathologists in evaluating necrosis in canine STS tumours, by increasing efficiency, accuracy and reducing inter-rater variation.

Inference of core needle biopsy whole slide images requiring definitive therapy for prostate cancer

BACKGROUND

Prostate cancer is often a slowly progressive indolent disease. Unnecessary treatments from overdiagnosis are a significant concern, particularly low-grade disease. Active surveillance has being considered as a risk management strategy to avoid potential side effects by unnecessary radical treatment. In 2016, American Society of Clinical Oncology (ASCO) endorsed the Cancer Care Ontario (CCO) Clinical Practice Guideline on active surveillance for the management of localized prostate cancer.

METHODS

Based on this guideline, we developed a deep learning model to classify prostate adenocarcinoma into indolent (applicable for active surveillance) and aggressive (necessary for definitive therapy) on core needle biopsy whole slide images (WSIs). In this study, we trained deep learning models using a combination of transfer, weakly supervised, and fully supervised learning approaches using a dataset of core needle biopsy WSIs (n=1300). In addition, we performed an inter-rater reliability evaluation on the WSI classification.

RESULTS

We evaluated the models on a test set (n=645), achieving ROC-AUCs of 0.846 for indolent and 0.980 for aggressive. The inter-rater reliability evaluation showed s-scores in the range of 0.10 to 0.95, with the lowest being on the WSIs with both indolent and aggressive classification by the model, and the highest on benign WSIs.

CONCLUSION

The results demonstrate the promising potential of deployment in a practical prostate adenocarcinoma histopathological diagnostic workflow system.

Application of digital pathology and machine learning in the liver, kidney and lung diseases

The development of rapid and accurate Whole Slide Imaging (WSI) has paved the way for the application of Artificial Intelligence (AI) to digital pathology. The availability of WSI in the recent years allowed the rapid development of various AI technologies to blossom. WSI-based digital pathology combined with neural networks can automate arduous and time-consuming tasks of slide evaluation. Machine Learning (ML)-based AI has been demonstrated to outperform pathologists by eliminating inter- and intra-observer subjectivity, obtaining quantitative data from slide images, and extracting hidden image patterns that are relevant to disease subtype and progression. In this review, we outline the functionality of different AI technologies such as neural networks and deep learning and discover how aspects of different diseases make them benefit from the implementation of AI. AI has proven to be valuable in many different organs, with this review focusing on the liver, kidney, and lungs. We also discuss how AI and image analysis not only can grade diseases objectively but also discover aspects of diseases that have prognostic value. In the end, we review the current status of the integration of AI in pathology and share our vision on the future of digital pathology.

Recurrence risk stratification for locally advanced cervical cancer using multi-modality transformer network

Objectives

Recurrence risk evaluation is clinically significant for patients with locally advanced cervical cancer (LACC). We investigated the ability of transformer network in recurrence risk stratification of LACC based on computed tomography (CT) and magnetic resonance (MR) images.

Methods

A total of 104 patients with pathologically diagnosed LACC between July 2017 and December 2021 were enrolled in this study. All patients underwent CT and MR scanning, and their recurrence status was identified by the biopsy. We randomly divided patients into training cohort (48 cases, non-recurrence: recurrence = 37: 11), validation cohort (21 cases, non-recurrence: recurrence = 16: 5), and testing cohort (35 cases, non-recurrence: recurrence = 27: 8), upon which we extracted 1989, 882 and 315 patches for model's development, validation and evaluation, respectively. The transformer network consisted of three modality fusion modules to extract multi-modality and multi-scale information, and a fully-connected module to perform recurrence risk prediction. The model's prediction performance was assessed by six metrics, including the area under the receiver operating characteristic curve (AUC), accuracy, f1-score, sensitivity, specificity and precision. Univariate analysis with F-test and T-test were conducted for statistical analysis.

Results

The proposed transformer network is superior to conventional radiomics methods and other deep learning networks in both training, validation and testing cohorts. Particularly, in testing cohort, the transformer network achieved the highest AUC of 0.819 ± 0.038, while four conventional radiomics methods and two deep learning networks got the AUCs of 0.680 ± 0.050, 0.720 ± 0.068, 0.777 ± 0.048, 0.691 ± 0.103, 0.743 ± 0.022 and 0.733 ± 0.027, respectively.

Conclusions

The multi-modality transformer network showed promising performance in recurrence risk stratification of LACC and may be used as an effective tool to help clinicians make clinical decisions.

Deep learning-based predictions of clear and eosinophilic phenotypes in clear cell renal cell carcinoma

We have recently shown that histological phenotypes focusing on clear and eosinophilic cytoplasm in clear cell renal cell carcinoma (ccRCC) correlated with prognosis and the response to angiogenesis inhibition and checkpoint blockade. This study aims to objectively show the diagnostic utility of clear or eosinophilic phenotypes of ccRCC by developing an artificial intelligence (AI) model using the TCGA-ccRCC dataset and to demonstrate if the clear or eosinophilic predicted phenotypes correlate with pathological factors and gene signatures associated with angiogenesis and cancer immunity. Before the development of the AI model, histological evaluation using hematoxylin and eosin whole-slide images of the TCGA-ccRCC cohort (n = 435) was performed by a urologic pathologist. The AI model was developed as follows. First, the highest-grade area on each whole slide image was captured for image processing. Second, the selected regions were cropped into tiles. Third, the AI model was trained using transfer learning on a deep convolutional neural network, and clear or eosinophilic predictions were scaled as AI scores. Next, we verified the AI model using a validation cohort (n = 95). Finally, we evaluated the accuracy of the prognostic predictions of the AI model and revealed that the AI model detected clear and eosinophilic phenotypes with high accuracy. The AI model stratified the patients' outcomes, and the predicted eosinophilic phenotypes correlated with adverse clinicopathological characteristics and high immune-related gene signatures. In conclusion, the AI-based histologic subclassification accurately predicted clear or eosinophilic phenotypes of ccRCC, allowing for consistently reproducible stratification for prognostic and therapeutic stratification.

Lung Cancer Subtype Diagnosis by Fusing Image-Genomics Data and Hybrid Deep Networks

Accurate diagnosis of cancer subtypes is crucial for precise treatment, because different cancer subtypes are involved with different pathology and require different therapies. Although deep learning techniques have made great success in computer vision and other fields, they do not work well on Lung cancer subtype diagnosis, due to the distinction of slide images between different cancer subtypes is ambiguous. Furthermore, they often over-fit to high-dimensional genomics data with limited samples, and do not fuse the image and genomics data in a sensible way. In this paper, we propose a hybrid deep network based approach LungDIG for Lung cancer subtype Diagnosis by fusing Image-Genomics data. LungDIG first tiles the tissue slide image into small patches and extracts the patch-level features by fine-tuning an Inception-V3 model. Since the patches may contain some false positives in non-diagnostic regions, it further designs a patch-level feature combination strategy to integrate the extracted patch features and maintain the diversity between different cancer subtypes. At the same time, it extracts the genomics features from Copy Number Variation data by an attention based nonlinear extractor. Next, it fuses the image and genomics features by an attention based multilayer perceptron (MLP) to diagnose cancer subtype. Experiments on TCGA lung cancer data show that LungDIG can not only achieve higher accuracy for cancer subtype diagnosis than state-of-the-art methods, but also have a high authenticity and good interpretability.

Anticancer activity of Pseudomonas aeruginosa derived peptide with iRGD in colon cancer therapy

Objectives

Colon cancer is well-known as a life-threatening disease. Since the current treatment modalities for this type of cancer are powerful yet face some limitations, finding novel treatments is required to achieve better outcomes with fewer side effects. Here we investigated the therapeutic potential of Azurin-p28 alone or along with iRGD (Ac-CRGDKGPDC-amide) as a tumor-penetrating peptide and 5-fluorouracil (5-FU) for colon cancer.

Materials and Methods

Inhibitory effect of p28 with or without iRGD/5-FU was studied in CT26 and HT29, as well as the xenograft animal model of cancer. The effect of p28 alone or along with iRGD/5-FU on cell migration, apoptotic activity, and cell cycle of the cell lines was assessed. Level of the BAX and BCL2 genes, tumor suppressor genes [(p53 and collagen type-Iα1 (COL1A1), collagen type-Iα2 (COL1A2)] were assessed by quantitative RT-PCR.

Results

These findings show that using p28 with or without iRGD and 5-FU raised the level of p53 and BAX but decreased BCL2, compared with control and 5-FU groups in tissues of the tumor, which result in raising the apoptosis.

Conclusion

It seems that p28 may be used as a new therapeutic approach in colon cancer therapy that can enhance the anti-tumor effect of 5-FU.

Multiclass prediction of different dementia syndromes based on multi-centric volumetric MRI imaging

INTRODUCTION

Dementia syndromes can be difficult to diagnose. We aimed at building a classifier for multiple dementia syndromes using magnetic resonance imaging (MRI).

METHODS

Atlas-based volumetry was performed on T1-weighted MRI data of 426 patients and 51 controls from the multi-centric German Research Consortium of Frontotemporal Lobar Degeneration including patients with behavioral variant frontotemporal dementia, Alzheimer's disease, the three subtypes of primary progressive aphasia, i.e., semantic, logopenic and nonfluent-agrammatic variant, and the atypical parkinsonian syndromes progressive supranuclear palsy and corticobasal syndrome. Support vector machine classification was used to classify each patient group against controls (binary classification) and all seven diagnostic groups against each other in a multi-syndrome classifier (multiclass classification).

RESULTS

The binary classification models reached high prediction accuracies between 71 and 95% with a chance level of 50%. Feature importance reflected disease-specific atrophy patterns. The multi-syndrome model reached accuracies of more than three times higher than chance level but was far from 100%. Multi-syndrome model performance was not homogenous across dementia syndromes, with better performance in syndromes characterized by regionally specific atrophy patterns. Whereas diseases generally could be classified vs controls more correctly with increasing severity and duration, differentiation between diseases was optimal in disease-specific windows of severity and duration.

DISCUSSION

Results suggest that automated methods applied to MR imaging data can support physicians in diagnosis of dementia syndromes. It is particularly relevant for orphan diseases beside frequent syndromes such as Alzheimer's disease.

CAMR: cross-aligned multimodal representation learning for cancer survival prediction

MOTIVATION

Accurately predicting cancer survival is crucial for helping clinicians to plan appropriate treatments, which largely improves the life quality of cancer patients and spares the related medical costs. Recent advances in survival prediction methods suggest that integrating complementary information from different modalities, e.g. histopathological images and genomic data, plays a key role in enhancing predictive performance. Despite promising results obtained by existing multimodal methods, the disparate and heterogeneous characteristics of multimodal data cause the so-called modality gap problem, which brings in dramatically diverse modality representations in feature space. Consequently, detrimental modality gaps make it difficult for comprehensive integration of multimodal information via representation learning and therefore pose a great challenge to further improvements of cancer survival prediction.

RESULTS

To solve the above problems, we propose a novel method called cross-aligned multimodal representation learning (CAMR), which generates both modality-invariant and -specific representations for more accurate cancer survival prediction. Specifically, a cross-modality representation alignment learning network is introduced to reduce modality gaps by effectively learning modality-invariant representations in a common subspace, which is achieved by aligning the distributions of different modality representations through adversarial training. Besides, we adopt a cross-modality fusion module to fuse modality-invariant representations into a unified cross-modality representation for each patient. Meanwhile, CAMR learns modality-specific representations which complement modality-invariant representations and therefore provides a holistic view of the multimodal data for cancer survival prediction. Comprehensive experiment results demonstrate that CAMR can successfully narrow modality gaps and consistently yields better performance than other survival prediction methods using multimodal data.

AVAILABILITY AND IMPLEMENTATION

CAMR is freely available at https://github.com/wxq-ustc/CAMR.

SUPPLEMENTARY INFORMATION

Supplementary data are available at Bioinformatics online.

The value of artificial intelligence in the diagnosis of lung cancer: A systematic review and meta-analysis

Lung cancer is a common malignant tumor disease with high clinical disability and death rates. Currently, lung cancer diagnosis mainly relies on manual pathology section analysis, but the low efficiency and subjective nature of manual film reading can lead to certain misdiagnoses and omissions. With the continuous development of science and technology, artificial intelligence (AI) has been gradually applied to imaging diagnosis. Although there are reports on AI-assisted lung cancer diagnosis, there are still problems such as small sample size and untimely data updates. Therefore, in this study, a large amount of recent data was included, and meta-analysis was used to evaluate the value of AI for lung cancer diagnosis. With the help of STATA16.0, the value of AI-assisted lung cancer diagnosis was assessed by specificity, sensitivity, negative likelihood ratio, positive likelihood ratio, diagnostic ratio, and plotting the working characteristic curves of subjects. Meta-regression and subgroup analysis were used to investigate the value of AI-assisted lung cancer diagnosis. The results of the meta-analysis showed that the combined sensitivity of the AI-aided diagnosis system for lung cancer diagnosis was 0.87 [95% CI (0.82, 0.90)], specificity was 0.87 [95% CI (0.82, 0.91)] (CI stands for confidence interval.), the missed diagnosis rate was 13%, the misdiagnosis rate was 13%, the positive likelihood ratio was 6.5 [95% CI (4.6, 9.3)], the negative likelihood ratio was 0.15 [95% CI (0.11, 0.21)], a diagnostic ratio of 43 [95% CI (24, 76)] and a sum of area under the combined subject operating characteristic (SROC) curve of 0.93 [95% CI (0.91, 0.95)]. Based on the results, the AI-assisted diagnostic system for CT (Computerized Tomography), imaging has considerable diagnostic accuracy for lung cancer diagnosis, which is of significant value for lung cancer diagnosis and has greater feasibility of realizing the extension application in the field of clinical diagnosis.

Vision transformer-based weakly supervised histopathological image analysis of primary brain tumors

Diagnosis of primary brain tumors relies heavily on histopathology. Although various computational pathology methods have been developed for automated diagnosis of primary brain tumors, they usually require neuropathologists' annotation of region of interests or selection of image patches on whole-slide images (WSI). We developed an end-to-end Vision Transformer (ViT) - based deep learning architecture for brain tumor WSI analysis, yielding a highly interpretable deep-learning model, ViT-WSI. Based on the principle of weakly supervised machine learning, ViT-WSI accomplishes the task of major primary brain tumor type and subtype classification. Using a systematic gradient-based attribution analysis procedure, ViT-WSI can discover diagnostic histopathological features for primary brain tumors. Furthermore, we demonstrated that ViT-WSI has high predictive power of inferring the status of three diagnostic glioma molecular markers, IDH1 mutation, p53 mutation, and MGMT methylation, directly from H&E-stained histopathological images, with patient level AUC scores of 0.960, 0.874, and 0.845, respectively.

Tumor-identification method for predicting recurrence of early-stage lung adenocarcinoma using digital pathology images by machine learning

Lung cancer is one of the cancers with the highest morbidity and mortality in the world. Recurrence often occurs even after complete resection of early-stage lung cancer, and prediction of recurrence after resection is clinically important. However, the pathological characteristics of the recurrence of pathological stage IB lung adenocarcinoma (LAIB) have not yet been elucidated. Therefore, the problem is what type of histological image of lung adenocarcinoma recurs, and it is important to examine the histological image of recurrence. We attempted to predict recurrence of early lung adenocarcinoma after resection on the basis of digital pathological images of hematoxylin and eosin-stained specimens and machine learning applying a convolutional neural network. We constructed a model that extracts the features of two-color spaces and a switching model that automatically switches between our extraction model and one that extracts the features of one-color space for each image. We then developed a tumor-identification method for predicting the presence or absence of LAIB recurrence using these models. We conducted an experiment involving 55 patients with LAIB who underwent surgical resection to evaluate the proposed method. The proposed method determined LAIB recurrence with an accuracy of 84.8%. The use of digital pathology and machine learning can be used for highly accurate prediction of LAIB recurrence after surgical resection. The proposed method has the potential for objective postoperative follow-up observation.

Multi-scale pathology image texture signature is a prognostic factor for resectable lung adenocarcinoma: a multi-center, retrospective study

BACKGROUND

Tumor histomorphology analysis plays a crucial role in predicting the prognosis of resectable lung adenocarcinoma (LUAD). Computer-extracted image texture features have been previously shown to be correlated with outcome. However, a comprehensive, quantitative, and interpretable predictor remains to be developed.

METHODS

In this multi-center study, we included patients with resectable LUAD from four independent cohorts. An automated pipeline was designed for extracting texture features from the tumor region in hematoxylin and eosin (H&E)-stained whole slide images (WSIs) at multiple magnifications. A multi-scale pathology image texture signature (MPIS) was constructed with the discriminative texture features in terms of overall survival (OS) selected by the LASSO method. The prognostic value of MPIS for OS was evaluated through univariable and multivariable analysis in the discovery set (n = 111) and the three external validation sets (V₁, n = 115; V₂, n = 116; and V₃, n = 246). We constructed a Cox proportional hazards model incorporating clinicopathological variables and MPIS to assess whether MPIS could improve prognostic stratification. We also performed histo-genomics analysis to explore the associations between texture features and biological pathways.

RESULTS

A set of eight texture features was selected to construct MPIS. In multivariable analysis, a higher MPIS was associated with significantly worse OS in the discovery set (HR 5.32, 95%CI 1.72-16.44; P = 0.0037) and the three external validation sets (V₁: HR 2.63, 95%CI 1.10-6.29, P = 0.0292; V₂: HR 2.99, 95%CI 1.34-6.66, P = 0.0075; V₃: HR 1.93, 95%CI 1.15-3.23, P = 0.0125). The model that integrated clinicopathological variables and MPIS had better discrimination for OS compared to the clinicopathological variables-based model in the discovery set (C-index, 0.837 vs. 0.798) and the three external validation sets (V₁: 0.704 vs. 0.679; V₂: 0.728 vs. 0.666; V₃: 0.696 vs. 0.669). Furthermore, the identified texture features were associated with biological pathways, such as cytokine activity, structural constituent of cytoskeleton, and extracellular matrix structural constituent.

CONCLUSIONS

MPIS was an independent prognostic biomarker that was robust and interpretable. Integration of MPIS with clinicopathological variables improved prognostic stratification in resectable LUAD and might help enhance the quality of individualized postoperative care.

Weakly Supervised Learning for Poorly Differentiated Adenocarcinoma Classification in GastricEndoscopic Submucosal Dissection Whole Slide Images

Objective: Endoscopic submucosal dissection (ESD) is the preferred technique for treating early gastric cancers including poorly differentiated adenocarcinoma without ulcerative findings. The histopathological classification of poorly differentiated adenocarcinoma including signet ring cell carcinoma is of pivotal importance for determining further optimum cancer treatment(s) and clinical outcomes. Because conventional diagnosis by pathologists using microscopes is time-consuming and limited in terms of human resources, it is very important to develop computer-aided techniques that can rapidly and accurately inspect large number of histopathological specimen whole-slide images (WSIs). Computational pathology applications which can assist pathologists in detecting and classifying gastric poorly differentiated adenocarcinoma from ESD WSIs would be of great benefit for routine histopathological diagnostic workflow. Methods: In this study, we trained the deep learning model to classify poorly differentiated adenocarcinoma in ESD WSIs by transfer and weakly supervised learning approaches. Results: We evaluated the model on ESD, endoscopic biopsy, and surgical specimen WSI test sets, achieving and ROC-AUC up to 0.975 in gastric ESD test sets for poorly differentiated adenocarcinoma. Conclusion: The deep learning model developed in this study demonstrates the high promising potential of deployment in a routine practical gastric ESD histopathological diagnostic workflow as a computer-aided diagnosis system.

Registered Clinical Trials for Artificial Intelligence in Lung Disease: A Scoping Review on ClinicalTrials.gov

Clinical trials are the most effective tools to evaluate the advantages of various diagnostic and treatment modalities. AI used in medical issues, including screening, diagnosis, and treatment decisions, improves health outcomes and patient experiences. This study's objective was to investigate the traits of registered trials on artificial intelligence for lung disease. Clinical studies on AI for lung disease that were present in the ClinicalTrials.gov database were searched, and fifty-three registered trials were included. Forty-six (72.1%) were observational trials, compared to seven (27.9%) that were interventional trials. Only eight trials (15.4%) were completed. Thirty (56.6%) trials were accepting applicants. Clinical studies often included a large number of cases; for example, 24 (32.0%) trials included samples of 100-1000 cases, while 14 (17.5%) trials included samples of 1000-2000 cases. Of the interventional trials, twenty (15.7%) were retrospective studies and twenty (65.7%) were prospective studies.

Polyphenic risk score shows robust predictive ability for long-term future suicidality

Suicides are preventable tragedies, if risk factors are tracked and mitigated. We had previously developed a new quantitative suicidality risk assessment instrument (Convergent Functional Information for Suicidality, CFI-S), which is in essence a simple polyphenic risk score, and deployed it in a busy urban hospital Emergency Department, in a naturalistic cohort of consecutive patients. We report a four years follow-up of that population (n = 482). Overall, the single administration of the CFI-S was significantly predictive of suicidality over the ensuing 4 years (occurrence- ROC AUC 80%, severity- Pearson correlation 0.44, imminence-Cox regression Hazard Ratio 1.33). The best predictive single phenes (phenotypic items) were feeling useless (not needed), a past history of suicidality, and social isolation. We next used machine learning approaches to enhance the predictive ability of CFI-S. We divided the population into a discovery cohort (n = 255) and testing cohort (n = 227), and developed a deep neural network algorithm that showed increased accuracy for predicting risk of future suicidality (increasing the ROC AUC from 80 to 90%), as well as a similarity network classifier for visualizing patient’s risk. We propose that the widespread use of CFI-S for screening purposes, with or without machine learning enhancements, can boost suicidality prevention efforts. This study also identified as top risk factors for suicidality addressable social determinants.

Hierarchical cancer heterogeneity analysis based on histopathological imaging features

In cancer research, supervised heterogeneity analysis has important implications. Such analysis has been traditionally based on clinical/demographic/molecular variables. Recently, histopathological imaging features, which are generated as a byproduct of biopsy, have been shown as effective for modeling cancer outcomes, and a handful of supervised heterogeneity analysis has been conducted based on such features. There are two types of histopathological imaging features, which are extracted based on specific biological knowledge and using automated imaging processing software, respectively. Using both types of histopathological imaging features, our goal is to conduct the first supervised cancer heterogeneity analysis that satisfies a hierarchical structure. That is, the first type of imaging features defines a rough structure, and the second type defines a nested and more refined structure. A penalization approach is developed, which has been motivated by but differs significantly from penalized fusion and sparse group penalization. It has satisfactory statistical and numerical properties. In the analysis of lung adenocarcinoma data, it identifies a heterogeneity structure significantly different from the alternatives and has satisfactory prediction and stability performance.

A collaborative workflow between pathologists and deep learning for the evaluation of tumour cellularity in lung adenocarcinoma

AIMS

The reporting of tumour cellularity in cancer samples has become a mandatory task for pathologists. However, the estimation of tumour cellularity is often inaccurate. Therefore, we propose a collaborative workflow between pathologists and artificial intelligence (AI) models to evaluate tumour cellularity in lung cancer samples and propose a protocol to apply it to routine practice.

METHODS AND RESULTS

We developed a quantitative model of lung adenocarcinoma that was validated and tested on 50 cases, and a collaborative workflow where pathologists could access the AI results and adjust their original tumour cellularity scores (adjusted-score) that we tested on 151 cases. The adjusted-score was validated by comparing them with a ground truth established by manual annotation of haematoxylin and eosin slides with reference to immunostains with thyroid transcription factor-1 and napsin A. For training, validation, testing the AI and testing the collaborative workflow, we used 40, 10, 50 and 151 whole slide images of lung adenocarcinoma, respectively. The sensitivity and specificity of tumour segmentation were 97 and 87%, respectively, and the accuracy of nuclei recognition was 99%. One pathologist's visually estimated scores were compared to the adjusted-score, and the pathologist's scores were altered in 87% of cases. Comparison with the ground truth revealed that the adjusted-score was more precise than the pathologists' scores (P < 0.05).

CONCLUSION

We proposed a collaborative workflow between AI and pathologists as a model to improve daily practice and enhance the prediction of tumour cellularity for genetic tests.

Comparative analysis of machine learning algorithms for multi-syndrome classification of neurodegenerative syndromes

Importance

The entry of artificial intelligence into medicine is pending. Several methods have been used for the predictions of structured neuroimaging data, yet nobody compared them in this context.

Objective

Multi-class prediction is key for building computational aid systems for differential diagnosis. We compared support vector machine, random forest, gradient boosting, and deep feed-forward neural networks for the classification of different neurodegenerative syndromes based on structural magnetic resonance imaging.

Design, setting, and participants

Atlas-based volumetry was performed on multi-centric T1-weighted MRI data from 940 subjects, i.e., 124 healthy controls and 816 patients with ten different neurodegenerative diseases, leading to a multi-diagnostic multi-class classification task with eleven different classes.

Interventions

N.A.

Main outcomes and measures

Cohen’s kappa, accuracy, and F1-score to assess model performance.

Results

Overall, the neural network produced both the best performance measures and the most robust results. The smaller classes however were better classified by either the ensemble learning methods or the support vector machine, while performance measures for small classes were comparatively low, as expected. Diseases with regionally specific and pronounced atrophy patterns were generally better classified than diseases with widespread and rather weak atrophy.

Conclusions and relevance

Our study furthermore underlines the necessity of larger data sets but also calls for a careful consideration of different machine learning methods that can handle the type of data and the classification task best.

SAFARI: shape analysis for AI-segmented images

Background

Recent developments to segment and characterize the regions of interest (ROI) within medical images have led to promising shape analysis studies. However, the procedures to analyze the ROI are arbitrary and vary by study. A tool to translate the ROI to analyzable shape representations and features is greatly needed.

Results

We developed SAFARI (shape analysis for AI-segmented images), an open-source R package with a user-friendly online tool kit for ROI labelling and shape feature extraction of segmented maps, provided by AI-algorithms or manual segmentation. We demonstrated that half of the shape features extracted by SAFARI were significantly associated with survival outcomes in a case study on 143 consecutive patients with stage I–IV lung cancer and another case study on 61 glioblastoma patients.

Conclusions

SAFARI is an efficient and easy-to-use toolkit for segmenting and analyzing ROI in medical images. It can be downloaded from the comprehensive R archive network (CRAN) and accessed at https://lce.biohpc.swmed.edu/safari/.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12880-022-00849-8.

Intratumor graph neural network recovers hidden prognostic value of multi-biomarker spatial heterogeneity

Biomarkers are indispensable for precision medicine. However, focused single-biomarker development using human tissue has been complicated by sample spatial heterogeneity. To address this challenge, we tested a representation of primary tumor that synergistically integrated multiple in situ biomarkers of extracellular matrix from multiple sampling regions into an intratumor graph neural network. Surprisingly, the differential prognostic value of this computational model over its conventional non-graph counterpart approximated that of combined routine prognostic biomarkers (tumor size, nodal status, histologic grade, molecular subtype, etc.) for 995 breast cancer patients under a retrospective study. This large prognostic value, originated from implicit but interpretable regional interactions among the graphically integrated in situ biomarkers, would otherwise be lost if they were separately developed into single conventional (spatially homogenized) biomarkers. Our study demonstrates an alternative route to cancer prognosis by taping the regional interactions among existing biomarkers rather than developing novel biomarkers.

A novel pipeline for computerized mouse spermatogenesis staging

MOTIVATION

Differentiating 12 stages of the mouse seminiferous epithelial cycle is vital towards understanding the dynamic spermatogenesis process. However, it is challenging since two adjacent spermatogenic stages are morphologically similar. Distinguishing Stages I-III from Stages IV-V is important for histologists to understand sperm development in wildtype mice and spermatogenic defects in infertile mice. To achieve this, we propose a novel pipeline for computerized spermatogenesis staging (CSS).

RESULTS

The CSS pipeline comprises four parts: (i) A seminiferous tubule segmentation model is developed to extract every single tubule; (ii) A multi-scale learning (MSL) model is developed to integrate local and global information of a seminiferous tubule to distinguish Stages I-V from Stages VI-XII; (iii) a multi-task learning (MTL) model is developed to segment the multiple testicular cells for Stages I-V without an exhaustive requirement for manual annotation; (iv) A set of 204D image-derived features is developed to discriminate Stages I-III from Stages IV-V by capturing cell-level and image-level representation. Experimental results suggest that the proposed MSL and MTL models outperform classic single-scale and single-task models when manual annotation is limited. In addition, the proposed image-derived features are discriminative between Stages I-III and Stages IV-V. In conclusion, the CSS pipeline can not only provide histologists with a solution to facilitate quantitative analysis for spermatogenesis stage identification but also help them to uncover novel computerized image-derived biomarkers.

AVAILABILITY AND IMPLEMENTATION

https://github.com/jydada/CSS.

SUPPLEMENTARY INFORMATION

Supplementary data are available at Bioinformatics online.

A novel transfer-learning based physician-level general and subtype classifier for non-small cell lung cancer

Confirming histological patterns of lung carcinoma is important for determining the prognosis and the next steps of treatment for a patient. Confirming the histologic patterns (subtype) of lung adenocarcinoma is important for determining the prognosis and treatment options for a patient. The task is challenging, and often requires the input of experienced pathologists, who by themselves lack interobserver concordance. A computer-aided diagnosis holds the potential to accelerate the time to diagnosis. As many adenocarcinoma tissue samples contain multiple histologic patterns, accurate computer-aided diagnosis requires annotations manually labeled by pathologists. We propose a method that merges weak supervised learning and Integrated Learning using Transfer Learning using two datasets: The Cancer Genome Atlas (TCGA), and the Clinical Proteomic Tumor Analysis Consortium (CPTAC) to reduce the need for manual annotation by a pathologist while maintaining accuracy. Whole-slide images (WSI) are first determined to be either adenocarcinoma or squamous cell carcinoma, then further identify the subtypes by generating weak classifiers for each subtype, then using integrated learning to create a strong classifier. Our model was evaluated with independent datasets from the CPTAC dataset and a dataset from a private hospital. It can achieve AUC values of 0.86, 0.91, 0.82, 0.77, 0.96, 0.98 in Acinar, LPA, Micropapillary, Papillary, Solid, and Normal, respectively.

Breast Cancer Dataset, Classification and Detection Using Deep Learning

Incorporating scientific research into clinical practice via clinical informatics, which includes genomics, proteomics, bioinformatics, and biostatistics, improves patients' treatment. Computational pathology is a growing subspecialty with the potential to integrate whole slide images, multi-omics data, and health informatics. Pathology and laboratory medicine are critical to diagnosing cancer. This work will review existing computational and digital pathology methods for breast cancer diagnosis with a special focus on deep learning. The paper starts by reviewing public datasets related to breast cancer diagnosis. Additionally, existing deep learning methods for breast cancer diagnosis are reviewed. The publicly available code repositories are introduced as well. The paper is closed by highlighting challenges and future works for deep learning-based diagnosis.

Weakly supervised learning for multi-organ adenocarcinoma classification in whole slide images

The primary screening by automated computational pathology algorithms of the presence or absence of adenocarcinoma in biopsy specimens (e.g., endoscopic biopsy, transbronchial lung biopsy, and needle biopsy) of possible primary organs (e.g., stomach, colon, lung, and breast) and radical lymph node dissection specimen is very useful and should be a powerful tool to assist surgical pathologists in routine histopathological diagnostic workflow. In this paper, we trained multi-organ deep learning models to classify adenocarcinoma in biopsy and radical lymph node dissection specimens whole slide images (WSIs). We evaluated the models on five independent test sets (stomach, colon, lung, breast, lymph nodes) to demonstrate the feasibility in multi-organ and lymph nodes specimens from different medical institutions, achieving receiver operating characteristic areas under the curves (ROC-AUCs) in the range of 0.91 -0.98.

Survival prediction of stomach cancer using expression data and deep learning models with histopathological images

Accurately predicting patient survival is essential for cancer treatment decision. However, the prognostic prediction model based on histopathological images of stomach cancer patients is still yet to be developed. We propose a deep learning-based model (MultiDeepCox-SC) that predicts overall survival in patients with stomach cancer by integrating histopathological images, clinical data, and gene expression data. The MultiDeepCox-SC not only automatedly selects patches with more information for survival prediction, without manual labeling for histopathological images, but also identifies genetic and clinical risk factors associated with survival in stomach cancer. The prognostic accuracy of the MultiDeepCox-SC (C-index = 0.744) surpasses the result only based on histopathological image (C-index = 0.660). The risk score of our model was still an independent predictor of survival outcome after adjustment for potential confounders, including pathologic stage, grade, age, race, and gender on The Cancer Genome Atlas dataset (hazard ratio 1.555, p = 3.53e-08) and the external test set (hazard ratio 2.912, p = 9.42e-4). Our fully automated online prognostic tool based on histopathological images, clinical data, and gene expression data could be utilized to improve pathologists' efficiency and accuracy (https://yu.life.sjtu.edu.cn/DeepCoxSC).

ICSDA: a multi-modal deep learning model to predict breast cancer recurrence and metastasis risk by integrating pathological, clinical and gene expression data

Breast cancer patients often have recurrence and metastasis after surgery. Predicting the risk of recurrence and metastasis for a breast cancer patient is essential for the development of precision treatment. In this study, we proposed a novel multi-modal deep learning prediction model by integrating hematoxylin & eosin (H&E)-stained histopathological images, clinical information and gene expression data. Specifically, we segmented tumor regions in H&E into image blocks (256 × 256 pixels) and encoded each image block into a 1D feature vector using a deep neural network. Then, the attention module scored each area of the H&E-stained images and combined image features with clinical and gene expression data to predict the risk of recurrence and metastasis for each patient. To test the model, we downloaded all 196 breast cancer samples from the Cancer Genome Atlas with clinical, gene expression and H&E information simultaneously available. The samples were then divided into the training and testing sets with a ratio of 7: 3, in which the distributions of the samples were kept between the two datasets by hierarchical sampling. The multi-modal model achieved an area-under-the-curve value of 0.75 on the testing set better than those based solely on H&E image, sequencing data and clinical data, respectively. This study might have clinical significance in identifying high-risk breast cancer patients, who may benefit from postoperative adjuvant treatment.

Deep learning-based image analysis predicts PD-L1 status from H&E-stained histopathology images in breast cancer

Programmed death ligand-1 (PD-L1) has been recently adopted for breast cancer as a predictive biomarker for immunotherapies. The cost, time, and variability of PD-L1 quantification by immunohistochemistry (IHC) are a challenge. In contrast, hematoxylin and eosin (H&E) is a robust staining used routinely for cancer diagnosis. Here, we show that PD-L1 expression can be predicted from H&E-stained images by employing state-of-the-art deep learning techniques. With the help of two expert pathologists and a designed annotation software, we construct a dataset to assess the feasibility of PD-L1 prediction from H&E in breast cancer. In a cohort of 3,376 patients, our system predicts the PD-L1 status in a high area under the curve (AUC) of 0.91 - 0.93. Our system is validated on two external datasets, including an independent clinical trial cohort, showing consistent prediction performance. Furthermore, the proposed system predicts which cases are prone to pathologists miss-interpretation, showing it can serve as a decision support and quality assurance system in clinical practice.

Clinical Implications and Molecular Characterization of Drebrin-Positive, Tumor-Infiltrating Exhausted T Cells in Lung Cancer

T cells express an actin-binding protein, drebrin, which is recruited to the contact site between the T cells and antigen-presenting cells during the formation of immunological synapses. However, little is known about the clinical implications of drebrin-expressing, tumor-infiltrating lymphocytes (TILs). To address this issue, we evaluated 34 surgical specimens of pathological stage I-IIIA squamous cell lung cancer. The immune context of primary tumors was investigated using fluorescent multiplex immunohistochemistry. The high-speed scanning of whole-slide images was performed, and the tissue localization of TILs in the tumor cell nest and surrounding stroma was automatically profiled and quantified. Drebrin-expressing T cells were characterized using drebrin⁺ T cells induced in vitro and publicly available single-cell RNA sequence (scRNA-seq) database. Survival analysis using the propensity scores revealed that a high infiltration of drebrin⁺ TILs within the tumor cell nest was independently associated with short relapse-free survival and overall survival. Drebrin⁺ T cells induced in vitro co-expressed multiple exhaustion-associated molecules. The scRNA-seq analyses confirmed that the exhausted tumor-infiltrating CD8⁺ T cells specifically expressed drebrin. Our study suggests that drebrin-expressing T cells present an exhausted phenotype and that tumor-infiltrating drebrin⁺ T cells affect clinical outcomes in patients with resectable squamous cell lung cancer.

Biology and medicine in the landscape of quantum advantages

Quantum computing holds substantial potential for applications in biology and medicine, spanning from the simulation of biomolecules to machine learning methods for subtyping cancers on the basis of clinical features. This potential is encapsulated by the concept of a quantum advantage, which is contingent on a reduction in the consumption of a computational resource, such as time, space or data. Here, we distill the concept of a quantum advantage into a simple framework to aid researchers in biology and medicine pursuing the development of quantum applications. We then apply this framework to a wide variety of computational problems relevant to these domains in an effort to (i) assess the potential of practical advantages in specific application areas and (ii) identify gaps that may be addressed with novel quantum approaches. In doing so, we provide an extensive survey of the intersection of biology and medicine with the current landscape of quantum algorithms and their potential advantages. While we endeavour to identify specific computational problems that may admit practical advantages throughout this work, the rapid pace of change in the fields of quantum computing, classical algorithms and biological research implies that this intersection will remain highly dynamic for the foreseeable future.

Multiple-instance-learning-based detection of coeliac disease in histological whole-slide images

We present a multiple-instance-learning-based scheme for detecting coeliac disease, an autoimmune disorder affecting the intestine, in histological whole-slide images (WSIs) of duodenal biopsies. We train our model to detect 2 distinct classes, normal tissue and coeliac disease, on the patch-level, and in turn leverage slide-level classifications. Using 5-fold cross-validation in a training set of 1841 (1163 normal; 680 coeliac disease) WSIs, our model classifies slides as normal with accuracy (96.7±0.6)%, precision (98.0±1.7)%, and recall (96.8±2.5)%, and as coeliac disease with accuracy (96.7±0.5)%, precision (94.9±3.7)%, and recall (96.5±2.9)% where the error bars are the cross-validation standard deviation. We apply our model to 2 test sets: one containing 191 WSIs (126 normal; 65 coeliac) from the same sources as the training data, and another from a completely independent source, containing 34 WSIs (17 normal; 17 coeliac), obtained with a scanner model not represented in the training data. Using the same-source test data, our model classifies slides as normal with accuracy 96.5%, precision 98.4% and recall 96.1%, and positive for coeliac disease with accuracy 96.5%, precision 93.5%, and recall 97.3%. Using the different-source test data the model classifies slides as normal with accuracy 94.1% (32/34), precision 89.5%, and recall 100%, and as positive for coeliac disease with accuracy 94.1%, precision 100%, and recall 88.2%. We discuss generalising our approach to screen for a range of pathologies.

Deep Learning-Based Classification of Uterine Cervical and Endometrial Cancer Subtypes from Whole-Slide Histopathology Images

Uterine cervical and endometrial cancers have different subtypes with different clinical outcomes. Therefore, cancer subtyping is essential for proper treatment decisions. Furthermore, an endometrial and endocervical origin for an adenocarcinoma should also be distinguished. Although the discrimination can be helped with various immunohistochemical markers, there is no definitive marker. Therefore, we tested the feasibility of deep learning (DL)-based classification for the subtypes of cervical and endometrial cancers and the site of origin of adenocarcinomas from whole slide images (WSIs) of tissue slides. WSIs were split into 360 × 360-pixel image patches at 20× magnification for classification. Then, the average of patch classification results was used for the final classification. The area under the receiver operating characteristic curves (AUROCs) for the cervical and endometrial cancer classifiers were 0.977 and 0.944, respectively. The classifier for the origin of an adenocarcinoma yielded an AUROC of 0.939. These results clearly demonstrated the feasibility of DL-based classifiers for the discrimination of cancers from the cervix and uterus. We expect that the performance of the classifiers will be much enhanced with an accumulation of WSI data. Then, the information from the classifiers can be integrated with other data for more precise discrimination of cervical and endometrial cancers.

Classification and Prognosis Analysis of Pancreatic Cancer Based on DNA Methylation Profile and Clinical Information

Pancreatic adenocarcinoma (PAAD) has a poor prognosis with high individual variation in the treatment response among patients; however, there is no standard molecular typing method for PAAD prognosis in clinical practice. We analyzed DNA methylation data from The Cancer Genome Atlas database, which identified 1235 differentially methylated DNA genes between PAAD and adjacent tissue samples. Among these, 78 methylation markers independently affecting PAAD prognosis were identified after adjusting for significant clinical factors. Based on these genes, two subtypes of PAAD were identified through consistent clustering. Fourteen specifically methylated genes were further identified to be associated with survival. Further analyses of the transcriptome data identified 301 differentially expressed cancer driver genes between the two PAAD subtypes and the degree of immune cell infiltration differed significantly between the subtypes. The 14 specific genes characterizing the unique methylation patterns of the subtypes were used to construct a Bayesian network-based prognostic prediction model for typing that showed good predictive value (area under the curve value of 0.937). This study provides new insight into the heterogeneity of pancreatic tumors from an epigenetic perspective, offering new strategies and targets for personalized treatment plan evaluation and precision medicine for patients with PAAD.

Current updates of CRISPR/Cas9-mediated genome editing and targeting within tumor cells: an innovative strategy of cancer management

Clustered regularly interspaced short palindromic repeats-associated protein (CRISPR/Cas9), an adaptive microbial immune system, has been exploited as a robust, accurate, efficient and programmable method for genome targeting and editing. This innovative and revolutionary technique can play a significant role in animal modeling, in vivo genome therapy, engineered cell therapy, cancer diagnosis and treatment. The CRISPR/Cas9 endonuclease system targets a specific genomic locus by single guide RNA (sgRNA), forming a heteroduplex with target DNA. The Streptococcus pyogenes Cas9/sgRNA:DNA complex reveals a bilobed architecture with target recognition and nuclease lobes. CRISPR/Cas9 assembly can be hijacked, and its nanoformulation can be engineered as a delivery system for different clinical utilizations. However, the efficient and safe delivery of the CRISPR/Cas9 system to target tissues and cancer cells is very challenging, limiting its clinical utilization. Viral delivery strategies of this system may have many advantages, but disadvantages such as immune system stimulation, tumor promotion risk and small insertion size outweigh these advantages. Thus, there is a desperate need to develop an efficient non-viral physical delivery system based on simple nanoformulations. The delivery strategies of CRISPR/Cas9 by a nanoparticle-based system have shown tremendous potential, such as easy and large-scale production, combination therapy, large insertion size and efficient in vivo applications. This review aims to provide in-depth updates on Streptococcus pyogenic CRISPR/Cas9 structure and its mechanistic understanding. In addition, the advances in its nanoformulation-based delivery systems, including lipid-based, polymeric structures and rigid NPs coupled to special ligands such as aptamers, TAT peptides and cell-penetrating peptides, are discussed. Furthermore, the clinical applications in different cancers, clinical trials and future prospects of CRISPR/Cas9 delivery and genome targeting are also discussed.

Machine Learning for Lung Cancer Diagnosis, Treatment, and Prognosis

The recent development of imaging and sequencing technologies enables systematic advances in the clinical study of lung cancer. Meanwhile, the human mind is limited in effectively handling and fully utilizing the accumulation of such enormous amounts of data. Machine learning-based approaches play a critical role in integrating and analyzing these large and complex datasets, which have extensively characterized lung cancer through the use of different perspectives from these accrued data. In this review, we provide an overview of machine learning-based approaches that strengthen the varying aspects of lung cancer diagnosis and therapy, including early detection, auxiliary diagnosis, prognosis prediction, and immunotherapy practice. Moreover, we highlight the challenges and opportunities for future applications of machine learning in lung cancer.

Guiding Irregular Nuclear Morphology on Nanopillar Arrays for Malignancy Differentiation in Tumor Cells

For more than a century, abnormal nuclei in tumor cells, presenting subnuclear invaginations and folds on the nuclear envelope, have been known to be associated with high malignancy and poor prognosis. However, current nuclear morphology analysis focuses on the features of the entire nucleus, overlooking the malignancy-related subnuclear features in nanometer scale. The main technical challenge is to probe such tiny and randomly distributed features inside cells. We here employ nanopillar arrays to guide subnuclear features into ordered patterns, enabling their quantification as a strong indicator of cell malignancy. Both breast and liver cancer cells were validated as well as the quantification of nuclear abnormality heterogeneity. The alterations of subnuclear patterns were also explored as effective readouts for drug treatment. We envision that this nanopillar-enabled quantification of subnuclear abnormal features in tumor cells opens a new angle in characterizing malignant cells and studying the unique nuclear biology in cancer.

Multi-modality artificial intelligence in digital pathology

In common medical procedures, the time-consuming and expensive nature of obtaining test results plagues doctors and patients. Digital pathology research allows using computational technologies to manage data, presenting an opportunity to improve the efficiency of diagnosis and treatment. Artificial intelligence (AI) has a great advantage in the data analytics phase. Extensive research has shown that AI algorithms can produce more up-to-date and standardized conclusions for whole slide images. In conjunction with the development of high-throughput sequencing technologies, algorithms can integrate and analyze data from multiple modalities to explore the correspondence between morphological features and gene expression. This review investigates using the most popular image data, hematoxylin-eosin stained tissue slide images, to find a strategic solution for the imbalance of healthcare resources. The article focuses on the role that the development of deep learning technology has in assisting doctors' work and discusses the opportunities and challenges of AI.

Hesperidin Inhibits the p53-MDMXInteraction-Induced Apoptosis of Non-Small-Cell Lung Cancer and Enhances the Antitumor Effect of Carboplatin

Objective

This study aimed to observe the effect of hesperidin on the apoptosis, proliferation, and invasion of non-small-cell lung cancer, as well as to explore the possible mechanism. The inhibitory effect of hesperidin combined with carboplatin on non-small-cell lung cancer was also investigated.

Methods

A549 and NCI-H460 cells were treated with different concentrations of hesperidin (10, 50, and 100 μM). The effect of siRNA knockdown on MDMX on the antitumor effect of hesperidin was observed. CCK-8 was used to detect cell activity. The apoptosis rate was determined by TUNEL. The transwell assay detects the ability of cell migration and invasion. The expression levels of the apoptosis-related proteins p53, MDM2, MDMX, p21, PUMA, Bcl-2, and Bax were detected by qRT-PCR. Cell-proliferation and transwell assays were used to detect the effects of the combined use of hesperidin and carboplatin on lung cancer cells.

Results

Hesperidin significantly inhibited the activity and invasion of A549 and NCI-H460 cells in a dose-dependent manner. Hesperidin also induced the apoptosis of A549 and NCI-H460 cells. Hesperidin further inhibited the interaction between p53 and MDMX, increased the expression of p53, and played an anticancer role. The combination of hesperidin and carboplatin showed the most obvious antitumor effect.

Conclusion

Hesperidin can inhibit lung cancer by inhibiting the interaction between p53 and MDMX. Moreover, the combination of hesperidin and carboplatin can inhibit the migration and invasion of lung cancer cell lines through p53 upregulation, thereby increasing the antitumor effect of carboplatin.

Can We Quantify Aging-Associated Postural Changes Using Photogrammetry? A Systematic Review

BACKGROUND

Aging is widely known to be associated with changes in standing posture. Recent advancements in the field of computerized image processing have allowed for improved analyses of several health conditions using photographs. However, photogrammetry's potential for assessing aging-associated postural changes is yet unclear. Thus, the aim of this review is to evaluate the potential of photogrammetry in quantifying age-related postural changes.

MATERIALS AND METHODS

We searched the databases PubMed Central, Scopus, Embase, and SciELO from the beginning of records to March 2021. Inclusion criteria were: (a) participants were older adults aged ≥60; (b) standing posture was assessed by photogrammetric means. PRISMA guidelines were followed. We used the Newcastle-Ottawa Scale to assess methodological quality.

RESULTS

Of 946 articles reviewed, after screening and the removal of duplicates, 11 reports were found eligible for full-text assessment, of which 5 full studies met the inclusion criteria. Significant changes occurring with aging included deepening of thoracic kyphosis, flattening of lumbar lordosis, and increased sagittal inclination.

CONCLUSIONS

These changes agree with commonly described aging-related postural changes. However, detailed quantification of these changes was not found; the photogrammetrical methods used were often unvalidated and did not adhere to known protocols. These methodological difficulties call for further studies using validated photogrammetrical methods and improved research methodologies.

Machine learning for rhabdomyosarcoma histopathology

Correctly diagnosing a rare childhood cancer such as sarcoma can be critical to assigning the correct treatment regimen. With a finite number of pathologists worldwide specializing in pediatric/young adult sarcoma histopathology, access to expert differential diagnosis early in case assessment is limited for many global regions. The lack of highly-trained sarcoma pathologists is especially pronounced in low to middle-income countries, where pathology expertise may be limited despite a similar rate of sarcoma incidence. To address this issue in part, we developed a deep learning convolutional neural network (CNN)-based differential diagnosis system to act as a pre-pathologist screening tool that quantifies diagnosis likelihood amongst trained soft-tissue sarcoma subtypes based on whole histopathology tissue slides. The CNN model is trained on a cohort of 424 centrally-reviewed histopathology tissue slides of alveolar rhabdomyosarcoma, embryonal rhabdomyosarcoma and clear-cell sarcoma tumors, all initially diagnosed at the originating institution and subsequently validated by central review. This CNN model was able to accurately classify the withheld testing cohort with resulting receiver operating characteristic (ROC) area under curve (AUC) values above 0.889 for all tested sarcoma subtypes. We subsequently used the CNN model to classify an externally-sourced cohort of human alveolar and embryonal rhabdomyosarcoma samples and a cohort of 318 histopathology tissue sections from genetically engineered mouse models of rhabdomyosarcoma. Finally, we investigated the overall robustness of the trained CNN model with respect to histopathological variations such as anaplasia, and classification outcomes on histopathology slides from untrained disease models. Overall positive results from our validation studies coupled with the limited worldwide availability of sarcoma pathology expertise suggests the potential of machine learning to assist local pathologists in quickly narrowing the differential diagnosis of sarcoma subtype in children, adolescents, and young adults.

Lung Cancer Classification and Prediction Using Machine Learning and Image Processing

Lung cancer is a potentially lethal illness. Cancer detection continues to be a challenge for medical professionals. The true cause of cancer and its complete treatment have still not been discovered. Cancer that is caught early enough can be treated. Image processing methods such as noise reduction, feature extraction, identification of damaged regions, and maybe a comparison with data on the medical history of lung cancer are used to locate portions of the lung that have been impacted by cancer. This research shows an accurate classification and prediction of lung cancer using technology that is enabled by machine learning and image processing. To begin, photos need to be gathered. In the experimental investigation, 83 CT scans from 70 distinct patients were utilized as the dataset. The geometric mean filter is used during picture preprocessing. As a consequence, image quality is enhanced. The K-means technique is then used to segment the images. The part of the image may be found using this segmentation. Then, classification methods using machine learning are used. For the classification, ANN, KNN, and RF are some of the machine learning techniques that were used. It is found that the ANN model is producing more accurate results for predicting lung cancer.

High-Resolution Histopathological Image Classification Model Based on Fused Heterogeneous Networks with Self-Supervised Feature Representation

Applying machine learning technology to automatic image analysis and auxiliary diagnosis of whole slide image (WSI) may help to improve the efficiency, objectivity, and consistency of pathological diagnosis. Due to its extremely high resolution, it is still a great challenge to directly process WSI through deep neural networks. In this paper, we propose a novel model for the task of classification of WSIs. The model is composed of two parts. The first part is a self-supervised encoding network with a UNet-like architecture. Each patch from a WSI is encoded as a compressed latent representation. These features are placed according to their corresponding patch’s original location in WSI, forming a feature cube. The second part is a classification network fused by 4 famous network blocks with heterogeneous architectures, with feature cube as input. Our model effectively expresses the feature and preserves location information of each patch. The fused network integrates heterogeneous features generated by different networks which yields robust classification results. The model is evaluated on two public datasets with comparison to baseline models. The evaluation results show the effectiveness of the proposed model.

Exploring pathological signatures for predicting the recurrence of early-stage hepatocellular carcinoma based on deep learning

Background

Postoperative recurrence impedes the curability of early-stage hepatocellular carcinoma (E-HCC). We aimed to establish a novel recurrence-related pathological prognosticator with artificial intelligence, and investigate the relationship between pathological features and the local immunological microenvironment.

Methods

A total of 576 whole-slide images (WSIs) were collected from 547 patients with E-HCC in the Zhongshan cohort, which was randomly divided into a training cohort and a validation cohort. The external validation cohort comprised 147 Tumor Node Metastasis (TNM) stage I patients from The Cancer Genome Atlas (TCGA) database. Six types of HCC tissues were identified by a weakly supervised convolutional neural network. A recurrence-related histological score (HS) was constructed and validated. The correlation between immune microenvironment and HS was evaluated through extensive immunohistochemical data.

Results

The overall classification accuracy of HCC tissues was 94.17%. The C-indexes of HS in the training, validation and TCGA cohorts were 0.804, 0.739 and 0.708, respectively. Multivariate analysis showed that the HS (HR= 4.05, 95% CI: 3.40-4.84) was an independent predictor for recurrence-free survival. Patients in HS high-risk group had elevated preoperative alpha-fetoprotein levels, poorer tumor differentiation and a higher proportion of microvascular invasion. The immunohistochemistry data linked the HS to local immune cell infiltration. HS was positively correlated with the expression level of peritumoral CD14+ cells (p= 0.013), and negatively with the intratumoral CD8+ cells (p&lt; 0.001).

Conclusions

The study established a novel histological score that predicted short-term and long-term recurrence for E-HCCs using deep learning, which could facilitate clinical decision making in recurrence prediction and management.

The Significance of External Quality Assessment Schemes for Molecular Testing in Clinical Laboratories

Simple Summary

Patients and clinicians often rely on the outcome of laboratory tests, but can we really trust these test results? Good quality management is key for laboratories to guarantee reliable test results. This review focusses on external quality assessment (EQA) schemes which are a tool for laboratories to examine and improve the quality of their testing routines. In this review, an overview of the role and importance of EQA schemes for clinical laboratories is given, and different types of EQA schemes and EQA providers available on the market are discussed, as well as recent developments in the EQA landscape.

Abstract

External quality assessment (EQA) schemes are a tool for clinical laboratories to evaluate and manage the quality of laboratory practice with the support of an independent party (i.e., an EQA provider). Depending on the context, there are different types of EQA schemes available, as well as various EQA providers, each with its own field of expertise. In this review, an overview of the general requirements for EQA schemes and EQA providers based on international guidelines is provided. The clinical and scientific value of these kinds of schemes for clinical laboratories, clinicians and patients are highlighted, in addition to the support EQA can provide to other types of laboratories, e.g., laboratories affiliated to biotech companies. Finally, recent developments and challenges in laboratory medicine and quality management, for example, the introduction of artificial intelligence in the laboratory and the shift to a more individual-approach instead of a laboratory-focused approach, are discussed. EQA schemes should represent current laboratory practice as much as possible, which poses the need for EQA providers to introduce latest laboratory innovations in their schemes and to apply up-to-date guidelines. By incorporating these state-of-the-art techniques, EQA aims to contribute to continuous learning.

The state of the art for artificial intelligence in lung digital pathology

Lung diseases carry a significant burden of morbidity and mortality worldwide. The advent of digital pathology (DP) and an increase in computational power have led to the development of artificial intelligence (AI)-based tools that can assist pathologists and pulmonologists in improving clinical workflow and patient management. While previous works have explored the advances in computational approaches for breast, prostate, and head and neck cancers, there has been a growing interest in applying these technologies to lung diseases as well. The application of AI tools on radiology images for better characterization of indeterminate lung nodules, fibrotic lung disease, and lung cancer risk stratification has been well documented. In this article, we discuss methodologies used to build AI tools in lung DP, describing the various hand-crafted and deep learning-based unsupervised feature approaches. Next, we review AI tools across a wide spectrum of lung diseases including cancer, tuberculosis, idiopathic pulmonary fibrosis, and COVID-19. We discuss the utility of novel imaging biomarkers for different types of clinical problems including quantification of biomarkers like PD-L1, lung disease diagnosis, risk stratification, and prediction of response to treatments such as immune checkpoint inhibitors. We also look briefly at some emerging applications of AI tools in lung DP such as multimodal data analysis, 3D pathology, and transplant rejection. Lastly, we discuss the future of DP-based AI tools, describing the challenges with regulatory approval, developing reimbursement models, planning clinical deployment, and addressing AI biases. © 2022 The Authors. The Journal of Pathology published by John Wiley & Sons Ltd on behalf of The Pathological Society of Great Britain and Ireland.