An oral cavity squamous cell carcinoma quantitative histomorphometric-based image classifier of nuclear morphology can risk stratify patients for disease-specific survival

The current landscape of artificial intelligence in oral and maxillofacial surgery- a narrative review

OBJECTIVE

This narrative review aims to explore the current applications and future prospects of AI within the subfields of oral and maxillofacial surgery (OMS), emphasizing its potential benefits and anticipated challenges.

METHODS

A detailed review of the literature was conducted to evaluate the role of AI in oral and maxillofacial surgery. All domains within OMS were reviewed with a focus on diagnostic, therapeutic and prognostic interventions.

RESULTS

AI has been successfully integrated into surgical specialties to enhance clinical outcomes. In OMS, AI demonstrates potential to improve clinical and administrative workflows in both ambulatory and hospital-based settings. Notable applications include more accurate risk prediction, minimally invasive surgical techniques, and optimized postoperative management.

CONCLUSION

OMS stands to benefit enormously from the integration of AI. However, significant roadblocks, such as ethical concerns, data security, and integration challenges, must be addressed to ensure effective adoption. Further research and innovation are needed to fully realize the potential of AI in this specialty.

Extreme wrinkling of the nuclear lamina is a morphological marker of cancer

Nuclear atypia is a hallmark of cancer. A recent model posits that excess surface area, visible as folds/wrinkles in the lamina of a rounded nucleus, allows the nucleus to take on diverse shapes with little mechanical resistance. Whether this model is applicable to normal and cancer nuclei in human tissues is unclear. We image nuclear lamins in patient tissues and find: (a) nuclear laminar wrinkles are present in control and cancer tissue but are obscured in hematoxylin and eosin (H&E) images, (b) nuclei rarely have a smooth lamina, and (c) wrinkled nuclei assume diverse shapes. Deep learning reveals the presence of extreme nuclear laminar wrinkling in cancer tissues, which is confirmed by Fourier analysis. These data support a model in which excess surface area in the nuclear lamina enables nuclear shape diversity in vivo. Extreme laminar wrinkling is a marker of cancer, and imaging the lamina may benefit cancer diagnosis.

Histomorphometric Analysis of Oral Squamous Cell Carcinoma, Apparently Normal Adjacent Mucosa and Epithelial Dysplasia

Oral squamous cell carcinoma (OSCC) comprises more than 90% of oral cavity cancer and remains the leading cause of death in oral disease. Limited studies have been conducted to evaluate cellular histomorphometry changes in OSCC compared to premalignant lesions such as Dysplastic leukoplakia (DL), Nondysplastic leukoplakia (NDL), and normal epithelial. This cross-sectional descriptive-analytical study was conducted on total 72 samples, including superficial areas of squamous cell carcinoma (SCCSF), Invasive Front of Squamous Cell Carcinoma (SCCIF), Apparently Normal Adjacent Oral Mucosa (SCCANM) or normal margin, Dysplastic leukoplakia (DL), Nondysplastic leukoplakia (NDL), and normal oral mucosa tissue (NOM) (N = 12 per group). ANOVA was used to compare the nucleus-to-cytoplasm ratio (N/C), nucleus area (NA), and cellular area (CA) of the stained hematoxylin and eosin (H&E) samples in the studied groups. A P value less than 0.05 was considered to be a significant level. There was a significant increase in the CA, NA, and N/C in the basal and parabasal layers from normal epithelium to dysplastic epithelium and OSCC. The highest NA, CA, and N/C were in the SCCIF and SCCSF groups, respectively, and the lowest was observed in NOM. In addition, SCCANM basal and parabasal layer cells had a significant difference in N/C compared to NOM, which indicates a high risk of SCCANM transformation into malignancy. Cell histomorphometry changes were observed from normal tissue to premalignant lesions and OSCC. These parameters can be used as indicators of the potential for transformation into malignancy in premalignant lesions.

The prognostic role of single cell invasion and nuclear diameter in early oral tongue squamous cell carcinoma

BACKGROUND

The clinical significance of single cell invasion and large nuclear diameter is not well documented in early-stage oral tongue squamous cell carcinoma (OTSCC).

METHODS

We used hematoxylin and eosin-stained sections to evaluate the presence of single cell invasion and large nuclei in a multicenter cohort of 311 cases treated for early-stage OTSCC.

RESULTS

Single cell invasion was associated in multivariable analysis with poor disease-specific survival (DSS) with a hazard ratio (HR) of 2.089 (95% CI 1.224-3.566, P = 0.007), as well as with disease-free survival (DFS) with a HR of 1.666 (95% CI 1.080-2.571, P = 0.021). Furthermore, large nuclei were associated with worse DSS (HR 2.070, 95% CI 1.216-3.523, P = 0.007) and with DFS in multivariable analysis (HR 1.645, 95% CI 1.067-2.538, P = 0.024).

CONCLUSION

Single cell invasion and large nuclei can be utilized for classifying early OTSCC into risk groups.

Hesperidin Inhibits Oral Cancer Cell Growth via Apoptosis and Inflammatory Signaling-Mediated Mechanisms: Evidence From In Vitro and In Silico Analyses

Background Oral carcinoma presents a significant health challenge, prompting the need for innovative therapeutic approaches. Elevation of inflammatory mediators, including tumor necrosis factor-alpha (TNF-α) and interleukin-6 (IL-6), has promoted cellular proliferation, inhibited apoptosis, and fostered oral cancer progression through complex signaling pathways. Hesperidin, a flavanone glycoside found in citrus fruits, is of keen interest in this study as it has been proven to have multiple health benefits through in vivo and in vitro studies. However, the mechanism behind the anticancer activity of hesperidin in oral carcinoma remains obscure. Aim The study aimed to explore the anticancer potential of hesperidin on human oral cancer cells (KB cells) by modulating pro-inflammatory and apoptotic signaling mechanisms. Methods Cancer cell growth inhibitory activity was assessed using the MTT (3-(4,5-Dimethylthiazol-2-yl)-2,5-Diphenyltetrazolium Bromide) assay. Gene expression analysis was performed using real-time RT-PCR analysis. In addition, in silico docking analysis was conducted to confirm the binding affinity of hesperidin with pro-inflammatory and apoptosis signaling molecules. The data were analyzed using one-way ANOVA and the "t" test. Results Utilizing the MTT assay, a dose-dependent cytotoxic effect of hesperidin was unveiled, with a remarkable IC50 value indicative of its potent inhibition of cell proliferation. Complementing these findings (p<0.05), qRT-PCR analysis demonstrated hesperidin's regulatory influence on key molecular targets within the KB cell line. Hesperidin treatment resulted in a noteworthy reduction in TNF-α, interleukin-1 beta (IL-1-β), IL-6, nuclear factor kappa-light-chain-enhancer of activated B cells (NF-κB), and B-cell lymphoma 2 (Bcl-2) mRNA expression levels (p<0.05), highlighting its inhibitory role in cell proliferation, migration, and inflammation processes. Simultaneously, hesperidin promoted the expression of BAX mRNA (p<0.05), indicating an enhancement in cell death. Molecular docking simulations further revealed robust binding affinities between hesperidin and target proteins, suggesting its potential to disrupt cellular functions and inflammatory signaling pathways in oral cancer cells. Conclusion The cytotoxic effects on the KB cell line and its anti-inflammatory properties position hesperidin as a compelling candidate for further exploration in the quest for effective oral carcinoma treatments. These findings shed light on the intricate molecular mechanisms underlying hesperidin's promise as a therapeutic agent against oral carcinoma.

Identifying primary tumor site of origin for liver metastases via a combination of handcrafted and deep learning features

Liver is one of the most common sites for metastases, which can occur on account of primary tumors from multiple sites of origin. Identifying the primary site of origin (PSO) of a metastasis can help in guiding therapeutic options for liver metastases. In this pilot study, we hypothesized that computer extracted handcrafted (HC) histomorphometric features can be utilized to identify the PSO of liver metastases. Cellular features, including tumor nuclei morphological and graph features as well as cytoplasm texture features, were extracted by computer algorithms from 175 slides (114 patients). The study comprised three experiments: (1) comparing and (2) fusing a machine learning (ML) model trained with HC pathomic features and deep learning (DL)-based classifiers to predict site of origin; (3) identifying the section of the primary tumor from which metastases were derived. For experiment 1, we divided the cohort into training sets composed of primary and matched liver metastases [60 patients, 121 whole slide images (WSIs)], and a hold-out validation set (54 patients, 54 WSIs) composed solely of liver metastases of known site of origin. Using the extracted HC features of the training set, a combination of supervised machine classifiers and unsupervised clustering was applied to identify the PSO. A random forest classifier achieved areas under the curve (AUCs) of 0.83, 0.64, 0.82, and 0.64 in classifying the metastatic tumor from colon, esophagus, breast, and pancreas on the validation set. The top features related to nuclear and peri-nuclear shape and textural attributes. We also trained a DL network to serve as a direct comparison to our method. The DL model achieved AUCs for colon: 0.94, esophagus: 0.66, breast: 0.79, and pancreas: 0.67 in identifying PSO. A decision fusion-based strategy was deployed to fuse the trained ML and DL classifiers and achieved slightly better results than ML or DL classifier alone (colon: 0.93, esophagus: 0.68, breast: 0.81, and pancreas: 0.69). For the third experiment, WSI-level attention maps were also generated using a trained DL network to generate a composite feature similarity heat map between paired primaries and their associated metastases. Our experiments revealed that epithelium-rich and moderately differentiated tumor regions of primary tumors were quantitatively similar to paired metastatic tumors. Our findings suggest that a combination of HC and DL features could potentially help identify the PSO for liver metastases while at the same time also potentially identify the spatial sites of origin for the metastases within primary tumors.

Recent Advances in Liver Tissue Engineering as an Alternative and Complementary Approach for Liver Transplantation

Acute and chronic liver diseases cause significant morbidity and mortality worldwide, affecting millions of people. Liver transplantation is the primary intervention method, replacing a non-functional liver with a functional one. However, the field of liver transplantation faces challenges such as donor shortage, postoperative complications, immune rejection, and ethical problems. Consequently, there is an urgent need for alternative therapies that can complement traditional transplantation or serve as an alternative method. In this review, we explore the potential of liver tissue engineering as a supplementary approach to liver transplantation, offering benefits to patients with severe liver dysfunctions.

Automated Cellular-Level Dual Global Fusion of Whole-Slide Imaging for Lung Adenocarcinoma Prognosis

Histopathologic whole-slide images (WSI) are generally considered the gold standard for cancer diagnosis and prognosis. Survival prediction based on WSI has recently attracted substantial attention. Nevertheless, it remains a central challenge owing to the inherent difficulties of predicting patient prognosis and effectively extracting informative survival-specific representations from WSI with highly compounded gigapixels. In this study, we present a fully automated cellular-level dual global fusion pipeline for survival prediction. Specifically, the proposed method first describes the composition of different cell populations on WSI. Then, it generates dimension-reduced WSI-embedded maps, allowing for efficient investigation of the tumor microenvironment. In addition, we introduce a novel dual global fusion network to incorporate global and inter-patch features of cell distribution, which enables the sufficient fusion of different types and locations of cells. We further validate the proposed pipeline using The Cancer Genome Atlas lung adenocarcinoma dataset. Our model achieves a C-index of 0.675 (±0.05) in the five-fold cross-validation setting and surpasses comparable methods. Further, we extensively analyze embedded map features and survival probabilities. These experimental results manifest the potential of our proposed pipeline for applications using WSI in lung adenocarcinoma and other malignancies.

Enhancing head and neck tumor management with artificial intelligence: Integration and perspectives

Head and neck tumors (HNTs) constitute a multifaceted ensemble of pathologies that primarily involve regions such as the oral cavity, pharynx, and nasal cavity. The intricate anatomical structure of these regions poses considerable challenges to efficacious treatment strategies. Despite the availability of myriad treatment modalities, the overall therapeutic efficacy for HNTs continues to remain subdued. In recent years, the deployment of artificial intelligence (AI) in healthcare practices has garnered noteworthy attention. AI modalities, inclusive of machine learning (ML), neural networks (NNs), and deep learning (DL), when amalgamated into the holistic management of HNTs, promise to augment the precision, safety, and efficacy of treatment regimens. The integration of AI within HNT management is intricately intertwined with domains such as medical imaging, bioinformatics, and medical robotics. This article intends to scrutinize the cutting-edge advancements and prospective applications of AI in the realm of HNTs, elucidating AI's indispensable role in prevention, diagnosis, treatment, prognostication, research, and inter-sectoral integration. The overarching objective is to stimulate scholarly discourse and invigorate insights among medical practitioners and researchers to propel further exploration, thereby facilitating superior therapeutic alternatives for patients.

Application and Performance of Artificial Intelligence (AI) in Oral Cancer Diagnosis and Prediction Using Histopathological Images: A Systematic Review

Oral cancer (OC) is one of the most common forms of head and neck cancer and continues to have the lowest survival rates worldwide, even with advancements in research and therapy. The prognosis of OC has not significantly improved in recent years, presenting a persistent challenge in the biomedical field. In the field of oncology, artificial intelligence (AI) has seen rapid development, with notable successes being reported in recent times. This systematic review aimed to critically appraise the available evidence regarding the utilization of AI in the diagnosis, classification, and prediction of oral cancer (OC) using histopathological images. An electronic search of several databases, including PubMed, Scopus, Embase, the Cochrane Library, Web of Science, Google Scholar, and the Saudi Digital Library, was conducted for articles published between January 2000 and January 2023. Nineteen articles that met the inclusion criteria were then subjected to critical analysis utilizing QUADAS-2, and the certainty of the evidence was assessed using the GRADE approach. AI models have been widely applied in diagnosing oral cancer, differentiating normal and malignant regions, predicting the survival of OC patients, and grading OC. The AI models used in these studies displayed an accuracy in a range from 89.47% to 100%, sensitivity from 97.76% to 99.26%, and specificity ranging from 92% to 99.42%. The models' abilities to diagnose, classify, and predict the occurrence of OC outperform existing clinical approaches. This demonstrates the potential for AI to deliver a superior level of precision and accuracy, helping pathologists significantly improve their diagnostic outcomes and reduce the probability of errors. Considering these advantages, regulatory bodies and policymakers should expedite the process of approval and marketing of these products for application in clinical scenarios.

Data-centric artificial intelligence in oncology: a systematic review assessing data quality in machine learning models for head and neck cancer

Machine learning models have been increasingly considered to model head and neck cancer outcomes for improved screening, diagnosis, treatment, and prognostication of the disease. As the concept of data-centric artificial intelligence is still incipient in healthcare systems, little is known about the data quality of the models proposed for clinical utility. This is important as it supports the generalizability of the models and data standardization. Therefore, this study overviews the quality of structured and unstructured data used for machine learning model construction in head and neck cancer. Relevant studies reporting on the use of machine learning models based on structured and unstructured custom datasets between January 2016 and June 2022 were sourced from PubMed, EMBASE, Scopus, and Web of Science electronic databases. Prediction model Risk of Bias Assessment (PROBAST) tool was used to assess the quality of individual studies before comprehensive data quality parameters were assessed according to the type of dataset used for model construction. A total of 159 studies were included in the review; 106 utilized structured datasets while 53 utilized unstructured datasets. Data quality assessments were deliberately performed for 14.2% of structured datasets and 11.3% of unstructured datasets before model construction. Class imbalance and data fairness were the most common limitations in data quality for both types of datasets while outlier detection and lack of representative outcome classes were common in structured and unstructured datasets respectively. Furthermore, this review found that class imbalance reduced the discriminatory performance for models based on structured datasets while higher image resolution and good class overlap resulted in better model performance using unstructured datasets during internal validation. Overall, data quality was infrequently assessed before the construction of ML models in head and neck cancer irrespective of the use of structured or unstructured datasets. To improve model generalizability, the assessments discussed in this study should be introduced during model construction to achieve data-centric intelligent systems for head and neck cancer management.

Automatic multi-tissue segmentation in pancreatic pathological images with selected multi-scale attention network

The morphology of tissues in pathological images has been used routinely by pathologists to assess the degree of malignancy of pancreatic ductal adenocarcinoma (PDAC). Automatic and accurate segmentation of tumor cells and their surrounding tissues is often a crucial step to obtain reliable morphological statistics. Nonetheless, it is still a challenge due to the great variation of appearance and morphology. In this paper, a selected multi-scale attention network (SMANet) is proposed to segment tumor cells, blood vessels, nerves, islets and ducts in pancreatic pathological images. The selected multi-scale attention module is proposed to enhance effective information, supplement useful information and suppress redundant information at different scales from the encoder and decoder. It includes selection unit (SU) module and multi-scale attention (MA) module. The selection unit module can effectively filter features. The multi-scale attention module enhances effective information through spatial attention and channel attention, and combines different level features to supplement useful information. This helps learn the information of different receptive fields to improve the segmentation of tumor cells, blood vessels and nerves. An original-feature fusion unit is also proposed to supplement the original image information to reduce the under-segmentation of small tissues such as islets and ducts. The proposed method outperforms state-of-the-arts deep learning algorithms on our PDAC pathological images and achieves competitive results on the GlaS challenge dataset. The mDice and mIoU have reached 0.769 and 0.665 in our PDAC dataset.

A novel pipeline for computerized mouse spermatogenesis staging

MOTIVATION

Differentiating 12 stages of the mouse seminiferous epithelial cycle is vital towards understanding the dynamic spermatogenesis process. However, it is challenging since two adjacent spermatogenic stages are morphologically similar. Distinguishing Stages I-III from Stages IV-V is important for histologists to understand sperm development in wildtype mice and spermatogenic defects in infertile mice. To achieve this, we propose a novel pipeline for computerized spermatogenesis staging (CSS).

RESULTS

The CSS pipeline comprises four parts: (i) A seminiferous tubule segmentation model is developed to extract every single tubule; (ii) A multi-scale learning (MSL) model is developed to integrate local and global information of a seminiferous tubule to distinguish Stages I-V from Stages VI-XII; (iii) a multi-task learning (MTL) model is developed to segment the multiple testicular cells for Stages I-V without an exhaustive requirement for manual annotation; (iv) A set of 204D image-derived features is developed to discriminate Stages I-III from Stages IV-V by capturing cell-level and image-level representation. Experimental results suggest that the proposed MSL and MTL models outperform classic single-scale and single-task models when manual annotation is limited. In addition, the proposed image-derived features are discriminative between Stages I-III and Stages IV-V. In conclusion, the CSS pipeline can not only provide histologists with a solution to facilitate quantitative analysis for spermatogenesis stage identification but also help them to uncover novel computerized image-derived biomarkers.

AVAILABILITY AND IMPLEMENTATION

https://github.com/jydada/CSS.

SUPPLEMENTARY INFORMATION

Supplementary data are available at Bioinformatics online.

Image analysis reveals differences in tumor multinucleations in Black and White patients with human papillomavirus-associated oropharyngeal squamous cell carcinoma

BACKGROUND

Understanding biological differences between different racial groups of human papillomavirus (HPV)-associated oropharyngeal squamous cell carcinoma (OPSCC) patients, who have differences in terms of incidence, survival, and tumor morphology, can facilitate accurate prognostic biomarkers, which can help develop personalized treatment strategies.

METHODS

This study evaluated whether there were morphologic differences between HPV-associated tumors from Black and White patients in terms of multinucleation index (MuNI), an image analysis-derived metric that measures density of multinucleated tumor cells within epithelial regions on hematoxylin-eosin images and previously has been prognostic in HPV-associated OPSCC patients. In this study, the authors specifically evaluated whether the same MuNI cutoff that was prognostic of overall survival (OS) and disease-free survival in their previous study, T_TR , is valid for Black and White patients, separately. We also evaluated population-specific cutoffs, T_B for Blacks and T_W for Whites, for risk stratification.

RESULTS

MuNI was statistically significantly different between Black (mean, 3.88e-4; median, 3.67e-04) and White patients (mean, 3.36e-04; median, 2.99e-04), with p = .0078. Using T_TR , MuNI was prognostic of OS in the entire population with hazard ratio (HR) of 1.71 (p = .002; 95% confidence interval [CI], 1.21-2.43) and in White patients with HR of 1.72 (p = .005; 95% CI, 1.18-2.51). Population-specific cutoff, T_W , yielded improved HR of 1.77 (p = .003; 95% CI, 1.21-2.58) for White patients, whereas T_B did not improve risk-stratification in Black patients with HR of 0.6 (p = .3; HR, 0.6; 95% CI, 0.2-1.80).

CONCLUSIONS

Histological difference between White and Black patient tumors in terms of multinucleated tumor cells suggests the need for considering population-specific prognostic biomarkers for personalized risk stratification strategies for HPV-associated OPSCC patients.

A Survey on the Use of Artificial Intelligence by Clinicians in Dentistry and Oral and Maxillofacial Surgery

Background: Applications of artificial intelligence (AI) in medicine and dentistry have been on the rise in recent years. In dental radiology, deep learning approaches have improved diagnostics, outperforming clinicians in accuracy and efficiency. This study aimed to provide information on clinicians' knowledge and perceptions regarding AI. Methods: A 21-item questionnaire was used to study the views of dentistry professionals on AI use in clinical practice. Results: In total, 302 questionnaires were answered and assessed. Most of the respondents rated their knowledge of AI as average (37.1%), below average (22.2%) or very poor (23.2%). The participants were largely convinced that AI would improve and bring about uniformity in diagnostics (mean Likert ± standard deviation 3.7 ± 1.27). Among the most serious concerns were the responsibility for machine errors (3.7 ± 1.3), data security or privacy issues (3.5 ± 1.24) and the divestment of healthcare to large technology companies (3.5 ± 1.28). Conclusions: Within the limitations of this study, insights into the acceptance and use of AI in dentistry are revealed for the first time.

A machine learning model for separating epithelial and stromal regions in oral cavity squamous cell carcinomas using H&E-stained histology images: A multi-center, retrospective study

OBJECTIVE

Tissue slides from Oral cavity squamous cell carcinoma (OC-SCC), particularly the epithelial regions, hold morphologic features that are both diagnostic and prognostic. Yet, previously developed approaches for automated epithelium segmentation in OC-SCC have not been independently tested in a multi-center setting. In this study, we aimed to investigate the effectiveness and applicability of a convolutional neural network (CNN) model to perform epithelial segmentation using digitized H&E-stained diagnostic slides from OC-SCC patients in a multi-center setting.

METHODS

A CNN model was developed to segment the epithelial regions of digitized slides (n = 810), retrospectively collected from five different centers. Deep learning models were trained and validated using well-annotated tissue microarray (TMA) images (n = 212) at various magnifications. The best performing model was locked down and used for independent testing with a total of 478 whole-slide images (WSIs). Manually annotated epithelial regions were used as the reference standard for evaluation. We also compared the model generated results with IHC-stained epithelium (n = 120) as the reference.

RESULTS

The locked-down CNN model trained on the TMA image training cohorts with 10x magnification achieved the best segmentation performance. The locked-down model performed consistently and yielded Pixel Accuracy, Recall Rate, Precision Rate, and Dice Coefficient that ranged from 95.8% to 96.6%, 79.1% to 93.8%, 85.7% to 89.3%, and 82.3% to 89.0%, respectively for the three independent testing WSI cohorts.

CONCLUSION

The automated model achieved a consistently accurate performance for automated epithelial region segmentation compared to manual annotations. This model could be integrated into a computer-aided diagnosis or prognosis system.

Correlation of histopathological patterns of OSCC patients with tumor site and habits

INTRODUCTION

Oral cancer is considered a major global public health problem. The causes of OSCC are tobacco, alcohol, viral infections such as EBV, HPV, and herpes simplex virus, poor oral hygiene (including sharp teeth and decay), ill-fitting denture, ultraviolet (UV) exposure, nutrition, and genetic predisposition. The etiology of oral cancer varies in different populations due to area-specific etiological factors.

OBJECTIVE

Finding a correlation of histopathological pattern to the tumor site and habits as an outcome of OSCC.

METHODS

This cross-sectional study was conducted in Karachi, Pakistan. A total of 100 known cases of an oral squamous cell carcinoma were diagnosed with the help of biopsy reports and were examined for histopathologic features, site of the lesion, and risk habits.

RESULTS

48 years was the mean age at the time of diagnosis with a distribution of 61% men and 39% women. The frequently affected site was buccal mucosa and the prime risk habit was gutka followed by betel quid. Histologically, the degree of differentiation shows that moderately differentiated OSCC was most commonly present, while the most prevalent histopathological pattern was spindle cell carcinoma. The statistical relation between lesion site and tobacco habits was found to be significant with a p value (p = 0.01).

CONCLUSION

Rates of oral squamous cell carcinoma are higher in males than females with a mean age at the time of diagnosis being less than 50 years. Frequently placing gutka in the buccal vestibule against buccal mucosa is responsible to make buccal mucosa the most common tumor site. This study provides baseline information regarding habits.

Machine-Learning Applications in Oral Cancer: A Systematic Review

Over the years, several machine-learning applications have been suggested to assist in various clinical scenarios relevant to oral cancer. We offer a systematic review to identify, assess, and summarize the evidence for reported uses in the areas of oral cancer detection and prevention, prognosis, pre-cancer, treatment, and quality of life. The main algorithms applied in the context of oral cancer applications corresponded to SVM, ANN, and LR, comprising 87.71% of the total published articles in the field. Genomic, histopathological, image, medical/clinical, spectral, and speech data were used most often to predict the four areas of application found in this review. In conclusion, our study has shown that machine-learning applications are useful for prognosis, diagnosis, and prevention of potentially malignant oral lesions (pre-cancer) and therapy. Nevertheless, we strongly recommended the application of these methods in daily clinical practice.

Computational Analysis of Routine Biopsies Improves Diagnosis and Prediction of Cardiac Allograft Vasculopathy

Background: Cardiac allograft vasculopathy (CAV) is a leading cause of morbidity and mortality for heart transplant recipients. While clinical risk factors for CAV have been established, no personalized prognostic test exists to confidently identify patients at high vs. low risk of developing aggressive CAV. The aim of this investigation was to leverage computational methods for analyzing digital pathology images from routine endomyocardial biopsies (EMB) to develop a precision medicine tool for predicting CAV years before overt clinical presentation. Methods: Clinical data from 1-year post-transplant was collected on 302 transplant recipients from the University of Pennsylvania, including 53 'early CAV' patients and 249 'no-CAV' controls. This data was used to generate a 'clinical model' (ClinCAV-Pr) for predicting future CAV development. From this cohort, n=183 archived EMBs were collected for CD31 and modified trichrome staining and then digitally scanned. These included 1-year post-transplant EMBs from 50 'early CAV' patients and 82 no-CAV patients, as well as 51 EMBs from 'disease control' patients obtained at the time of definitive coronary angiography confirming CAV. Using biologically-inspired, hand-crafted features extracted from digitized EMBs, quantitative histologic models for differentiating no-CAV from disease controls (HistoCAV-Dx), and for predicting future CAV from 1-year post-transplant EMBs were developed (HistoCAV-Pr). The performance of histologic and clinical models for predicting future CAV (i.e. HistoCAV-Pr and ClinCAV-Pr, respectively) were compared in a held-out validation set, before being combined to assess the added predictive value of an integrated predictive model (iCAV-Pr). Results: ClinCAV-Pr achieved modest performance on the independent test set, with area under the receiver operating curve (AUROC) of 0.70. The HistoCAV-Dx model for diagnosing CAV achieved excellent discrimination, with an AUROC of 0.91, while HistoCAV-Pr model for predicting CAV achieved good performance with an AUROC of 0.80. The integrated iCAV-Pr model achieved excellent predictive performance, with an AUROC of 0.93 on the held-out test set. Conclusions: Prediction of future CAV development is greatly improved by incorporation of computationally extracted histologic features. These results suggest morphologic details contained within regularly obtained biopsy tissue have the potential to enhance precision and personalization of treatment plans for post-heart transplant patients.

Computer extracted features of nuclear morphology in hematoxylin and eosin images distinguish Stage II and IV colon tumors

We assessed the utility of quantitative features of colon cancer nuclei, extracted from digitized hematoxylin and eosin-stained whole slide images (WSIs), to distinguish between Stage II from Stage IV colon cancers. Our discovery cohort comprised 100 Stage II and Stage IV colon cancer cases sourced from the University Hospitals Cleveland Medical Center (UHCMC). We performed initial (independent) model validation on 51 (143) Stage II and 79 (54) Stage IV colon cancer cases from UHCMC (The Cancer Genome Atlas's Colon Adenocarcinoma, TCGA-COAD, cohort). Our approach comprised the following steps, (1) a fully convolutional deep neural network with VGG-18 architecture was trained to locate cancer on WSIs, (2) another deep-learning model based on Mask-RCNN with Resnet-50 architecture was used to segment all nuclei from within the identified cancer region, (3) a total of 26,641 quantitative morphometric features pertaining to nuclear shape, size, and texture were extracted from within and outside tumor nuclei, (4) a random forest classifier was trained to distinguish between Stage II and Stage IV colon cancers using the 5 most discriminatory features selected by the Wilcoxon rank-sum test. Our trained classifier using these top 5 features yielded an AUC of 0.81 and 0.78, respectively, on the held-out cases in UHCMC and TCGA validation sets. For 197 TCGA-COAD cases, the Cox-proportional hazards model yielded a hazard ratio of 2.20 (95% CI: 1.24-3.88) with a concordance index of 0.71 using only top-five features for risk stratification of overall survival. The Kaplan-Meier estimate also showed statistically significant separation between the low-risk and high-risk patients with a log-rank p-value of 0.0097. Finally, unsupervised clustering of the top-five features revealed that Stage IV colon cancers with peritoneal spread were morphologically more similar to Stage II colon cancers with no long-term metastases than Stage IV colon cancers with hematogenous spread. This article is protected by copyright. All rights reserved.

Deep Learning on Oral Squamous Cell Carcinoma Ex Vivo Fluorescent Confocal Microscopy Data: A Feasibility Study

BACKGROUND

Ex vivo fluorescent confocal microscopy (FCM) is a novel and effective method for a fast-automatized histological tissue examination. In contrast, conventional diagnostic methods are primarily based on the skills of the histopathologist. In this study, we investigated the potential of convolutional neural networks (CNNs) for automatized classification of oral squamous cell carcinoma via ex vivo FCM imaging for the first time.

MATERIAL AND METHODS

Tissue samples from 20 patients were collected, scanned with an ex vivo confocal microscope immediately after resection, and investigated histopathologically. A CNN architecture (MobileNet) was trained and tested for accuracy.

RESULTS

The model achieved a sensitivity of 0.47 and specificity of 0.96 in the automated classification of cancerous tissue in our study.

CONCLUSION

In this preliminary work, we trained a CNN model on a limited number of ex vivo FCM images and obtained promising results in the automated classification of cancerous tissue. Further studies using large sample sizes are warranted to introduce this technology into clinics.

Prediction models applying machine learning to oral cavity cancer outcomes: A systematic review

OBJECTIVES

Machine learning platforms are now being introduced into modern oncological practice for classification and prediction of patient outcomes. To determine the current status of the application of these learning models as adjunctive decision-making tools in oral cavity cancer management, this systematic review aims to summarize the accuracy of machine-learning based models for disease outcomes.

METHODS

Electronic databases including PubMed, Scopus, EMBASE, Cochrane Library, LILACS, SciELO, PsychINFO, and Web of Science were searched up until December 21, 2020. Pertinent articles detailing the development and accuracy of machine learning prediction models for oral cavity cancer outcomes were selected in a two-stage process. Quality assessment was conducted using the Quality in Prognosis Studies (QUIPS) tool and results of base studies were qualitatively synthesized by all authors. Outcomes of interest were malignant transformation of precancer lesions, cervical lymph node metastasis, as well as treatment response, and prognosis of oral cavity cancer.

RESULTS

Twenty-seven articles out of 950 citations identified from electronic and manual searching were included in this study. Five studies had low bias concerns on the QUIPS tool. Prediction of malignant transformation, cervical lymph node metastasis, treatment response, and prognosis were reported in three, six, eight, and eleven articles respectively. Accuracy of these learning models on the internal or external validation sets ranged from 0.85 to 0.97 for malignant transformation prediction, 0.78-0.91 for cervical lymph node metastasis prediction, 0.64-1.00 for treatment response prediction, and 0.71-0.99 for prognosis prediction. In general, most trained algorithms predicting these outcomes performed better than alternate methods of prediction. We also found that models including molecular markers in training data had better accuracy estimates for malignant transformation, treatment response, and prognosis prediction.

CONCLUSION

Machine learning algorithms have a satisfactory to excellent accuracy for predicting three of four oral cavity cancer outcomes i.e., malignant transformation, nodal metastasis, and prognosis. However, considering the training approach of many available classifiers, these models may not be streamlined enough for clinical application currently.

Machine Learning in Drug Discovery: A Review

This review provides the feasible literature on drug discovery through ML tools and techniques that are enforced in every phase of drug development to accelerate the research process and deduce the risk and expenditure in clinical trials. Machine learning techniques improve the decision-making in pharmaceutical data across various applications like QSAR analysis, hit discoveries, de novo drug architectures to retrieve accurate outcomes. Target validation, prognostic biomarkers, digital pathology are considered under problem statements in this review. ML challenges must be applicable for the main cause of inadequacy in interpretability outcomes that may restrict the applications in drug discovery. In clinical trials, absolute and methodological data must be generated to tackle many puzzles in validating ML techniques, improving decision-making, promoting awareness in ML approaches, and deducing risk failures in drug discovery.

Association predictions of genomics, proteinomics, transcriptomics, microbiome, metabolomics, pathomics, radiomics, drug, symptoms, environment factor, and disease networks: A comprehensive approach

Currently, the research of multi-omics, such as genomics, proteinomics, transcriptomics, microbiome, metabolomics, pathomics, and radiomics, are hot spots. The relationship between multi-omics data, drugs, and diseases has received extensive attention from researchers. At the same time, multi-omics can effectively predict the diagnosis, prognosis, and treatment of diseases. In essence, these research entities, such as genes, RNAs, proteins, microbes, metabolites, pathways as well as pathological and medical imaging data, can all be represented by the network at different levels. And some computer and biology scholars have tried to use computational methods to explore the potential relationships between biological entities. We summary a comprehensive research strategy, that is to build a multi-omics heterogeneous network, covering multimodal data, and use the current popular computational methods to make predictions. In this study, we first introduce the calculation method of the similarity of biological entities at the data level, second discuss multimodal data fusion and methods of feature extraction. Finally, the challenges and opportunities at this stage are summarized. Some scholars have used such a framework to calculate and predict. We also summarize them and discuss the challenges. We hope that our review could help scholars who are interested in the field of bioinformatics, biomedical image, and computer research.

[Artificial intelligence, radiomics and pathomics to predict response and survival of patients treated with radiations]

Artificial intelligence approaches in medicine are more and more used and are extremely promising due to the growing number of data produced and the variety of data they allow to exploit. Thus, the computational analysis of medical images in particular, radiological (radiomics), or anatomopathological (pathomics), has shown many very interesting results for the prediction of the prognosis and the response of cancer patients. Radiotherapy is a discipline that particularly benefits from these new approaches based on computer science and imaging. This review will present the main principles of an artificial intelligence approach and in particular machine learning, the principles of a radiomic and pathomic approach and the potential of their use for the prediction of the prognosis of patients treated with radiotherapy.

Computational pathology reveals unique spatial patterns of immune response in H&E images from COVID-19 autopsies: preliminary findings

Purpose: We used computerized image analysis and machine learning approaches to characterize spatial arrangement features of the immune response from digitized autopsied H&E tissue images of the lung in coronavirus disease 2019 (COVID-19) patients. Additionally, we applied our approach to tease out potential morphometric differences from autopsies of patients who succumbed to COVID-19 versus H1N1. Approach: H&E lung whole slide images from autopsy specimens of nine COVID-19 and two H1N1 patients were computationally interrogated. 606 image patches ( ∼ 55 per patient) of 1024 × 882    pixels were extracted from the 11 autopsied patient studies. A watershed-based segmentation approach in conjunction with a machine learning classifier was employed to identify two types of nuclei families: lymphocytes and non-lymphocytes (i.e., other nucleated cells such as pneumocytes, macrophages, and neutrophils). Based off the proximity of the individual nuclei, clusters for each nuclei family were constructed. For each of the resulting clusters, a series of quantitative measurements relating to architecture and density of nuclei clusters were calculated. A receiver operating characteristics-based feature selection method, violin plots, and the t-distributed stochastic neighbor embedding algorithm were employed to study differences in immune patterns. Results: In COVID-19, the immune response consistently showed multiple small-size lymphocyte clusters, suggesting that lymphocyte response is rather modest, possibly due to lymphocytopenia. In H1N1, we found larger lymphocyte clusters that were proximal to large clusters of non-lymphocytes, a possible reflection of increased prevalence of macrophages and other immune cells. Conclusion: Our study shows the potential of computational pathology to uncover immune response features that may not be obvious by routine histopathology visual inspection.

Artificial Intelligence in Pathology

BACKGROUND

Increasing digitalization enables the use of artificial intelligence (AI) and machine learning in pathology. However, these technologies have only just begun to be implemented, and no randomized prospective trials have yet shown a benefit of AI-based diagnosis. In this review, we present current concepts, illustrate them with examples from representative publications, and discuss the possibilities and limitations of their use.

METHODS

This article is based on the results of a search in PubMed for articles published between January 1950 and January 2020 containing the searching terms "artificial intelligence," "deep learning," and "digital pathology," as well as the authors' own research findings.

RESULTS

Current research on AI in pathology focuses on supporting routine diagnosis and on prognostication, particularly for patients with cancer. Initial data indicate that pathologists can arrive at a diagnosis faster and more accurately with the aid of a computer. In a pilot study on the diagnosis of breast cancer, involving 70 patients, sensitivity for the detection of micrometastases rose from 83.3% (by a pathologist alone) to 91.2% (by a pathologist combined with a computer algorithm). The evidence likewise suggests that AI applied to histomorphological properties of cells during microscopy may enable the inference of certain genetic properties, such as mutations in key genes and deoxyribonucleic acid (DNA) methylation profiles.

CONCLUSION

Initial proof-of-concept studies for AI in pathology are now available. Randomized, prospective studies are now needed so that these early findings can be confirmed or falsified.

Artificial Intelligence-based methods in head and neck cancer diagnosis: an overview

BACKGROUND

This paper reviews recent literature employing Artificial Intelligence/Machine Learning (AI/ML) methods for diagnostic evaluation of head and neck cancers (HNC) using automated image analysis.

METHODS

Electronic database searches using MEDLINE via OVID, EMBASE and Google Scholar were conducted to retrieve articles using AI/ML for diagnostic evaluation of HNC (2009-2020). No restrictions were placed on the AI/ML method or imaging modality used.

RESULTS

In total, 32 articles were identified. HNC sites included oral cavity (n = 16), nasopharynx (n = 3), oropharynx (n = 3), larynx (n = 2), salivary glands (n = 2), sinonasal (n = 1) and in five studies multiple sites were studied. Imaging modalities included histological (n = 9), radiological (n = 8), hyperspectral (n = 6), endoscopic/clinical (n = 5), infrared thermal (n = 1) and optical (n = 1). Clinicopathologic/genomic data were used in two studies. Traditional ML methods were employed in 22 studies (69%), deep learning (DL) in eight studies (25%) and a combination of these methods in two studies (6%).

CONCLUSIONS

There is an increasing volume of studies exploring the role of AI/ML to aid HNC detection using a range of imaging modalities. These methods can achieve high degrees of accuracy that can exceed the abilities of human judgement in making data predictions. Large-scale multi-centric prospective studies are required to aid deployment into clinical practice.

Perspectives in pathomics in head and neck cancer

PURPOSE OF REVIEW

Pathology is the cornerstone of cancer care. Pathomics, which represents the use of artificial intelligence in digital pathology, is an emerging and promising field that will revolutionize medical and surgical pathology in the coming years. This review provides an overview of pathomics, its current and future applications and its most relevant applications in Head and Neck cancer care.

RECENT FINDINGS

The number of studies investigating the use of artificial intelligence in pathology is rapidly growing, especially as the utilization of deep learning has shown great potential with Whole Slide Images. Even though numerous steps still remain before its clinical use, Pathomics has been used for varied applications comprising of computer-assisted diagnosis, molecular anomalies prediction, tumor microenvironment and biomarker identification as well as prognosis evaluation. The majority of studies were performed on the most frequent cancers, notably breast, prostate, and lung. Interesting results were also found in Head and Neck cancers.

SUMMARY

Even if its use in Head and Neck cancer care is still low, Pathomics is a powerful tool to improve diagnosis, identify prognostic factors and new biomarkers. Important challenges lie ahead before its use in a clinical practice, notably the lack of information on how AI makes its decisions, the slow deployment of digital pathology, and the need for extensively validated data in order to obtain authorities approval. Regardless, pathomics will most likely improve pathology in general, including Head and Neck cancer care in the coming years.

Computerized tumor multinucleation index (MuNI) is prognostic in p16+ oropharyngeal carcinoma

BACKGROUNDPatients with p16+ oropharyngeal squamous cell carcinoma (OPSCC) are potentially cured with definitive treatment. However, there are currently no reliable biomarkers of treatment failure for p16+ OPSCC. Pathologist-based visual assessment of tumor cell multinucleation (MN) has been shown to be independently prognostic of disease-free survival (DFS) in p16+ OPSCC. However, its quantification is time intensive, subjective, and at risk of interobserver variability.METHODSWe present a deep-learning-based metric, the multinucleation index (MuNI), for prognostication in p16+ OPSCC. This approach quantifies tumor MN from digitally scanned H&E-stained slides. Representative H&E-stained whole-slide images from 1094 patients with previously untreated p16+ OPSCC were acquired from 6 institutions for optimization and validation of the MuNI.RESULTSThe MuNI was prognostic for DFS, overall survival (OS), or distant metastasis-free survival (DMFS) in p16+ OPSCC, with HRs of 1.78 (95% CI: 1.37-2.30), 1.94 (1.44-2.60), and 1.88 (1.43-2.47), respectively, independent of age, smoking status, treatment type, or tumor and lymph node (T/N) categories in multivariable analyses. The MuNI was also prognostic for DFS, OS, and DMFS in patients with stage I and stage III OPSCC, separately.CONCLUSIONMuNI holds promise as a low-cost, tissue-nondestructive, H&E stain-based digital biomarker test for counseling, treatment, and surveillance of patients with p16+ OPSCC. These data support further confirmation of the MuNI in prospective trials.FUNDINGNational Cancer Institute (NCI), NIH; National Institute for Biomedical Imaging and Bioengineering, NIH; National Center for Research Resources, NIH; VA Merit Review Award from the US Department of VA Biomedical Laboratory Research and Development Service; US Department of Defense (DOD) Breast Cancer Research Program Breakthrough Level 1 Award; DOD Prostate Cancer Idea Development Award; DOD Lung Cancer Investigator-Initiated Translational Research Award; DOD Peer-Reviewed Cancer Research Program; Ohio Third Frontier Technology Validation Fund; Wallace H. Coulter Foundation Program in the Department of Biomedical Engineering; Clinical and Translational Science Award (CTSA) program, Case Western Reserve University; NCI Cancer Center Support Grant, NIH; Career Development Award from the US Department of VA Clinical Sciences Research and Development Program; Dan L. Duncan Comprehensive Cancer Center Support Grant, NIH; and Computational Genomic Epidemiology of Cancer Program, Case Comprehensive Cancer Center. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH, the US Department of VA, the DOD, or the US Government.

Machine learning in oral squamous cell carcinoma: Current status, clinical concerns and prospects for future-A systematic review

BACKGROUND

Oral cancer can show heterogenous patterns of behavior. For proper and effective management of oral cancer, early diagnosis and accurate prediction of prognosis are important. To achieve this, artificial intelligence (AI) or its subfield, machine learning, has been touted for its potential to revolutionize cancer management through improved diagnostic precision and prediction of outcomes. Yet, to date, it has made only few contributions to actual medical practice or patient care.

OBJECTIVES

This study provides a systematic review of diagnostic and prognostic application of machine learning in oral squamous cell carcinoma (OSCC) and also highlights some of the limitations and concerns of clinicians towards the implementation of machine learning-based models for daily clinical practice.

DATA SOURCES

We searched OvidMedline, PubMed, Scopus, Web of Science, and Institute of Electrical and Electronics Engineers (IEEE) databases from inception until February 2020 for articles that used machine learning for diagnostic or prognostic purposes of OSCC.

ELIGIBILITY CRITERIA

Only original studies that examined the application of machine learning models for prognostic and/or diagnostic purposes were considered.

DATA EXTRACTION

Independent extraction of articles was done by two researchers (A.R. & O.Y) using predefine study selection criteria. We used the Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) in the searching and screening processes. We also used Prediction model Risk of Bias Assessment Tool (PROBAST) for assessing the risk of bias (ROB) and quality of included studies.

RESULTS

A total of 41 studies were published to have used machine learning to aid in the diagnosis/or prognosis of OSCC. The majority of these studies used the support vector machine (SVM) and artificial neural network (ANN) algorithms as machine learning techniques. Their specificity ranged from 0.57 to 1.00, sensitivity from 0.70 to 1.00, and accuracy from 63.4 % to 100.0 % in these studies. The main limitations and concerns can be grouped as either the challenges inherent to the science of machine learning or relating to the clinical implementations.

CONCLUSION

Machine learning models have been reported to show promising performances for diagnostic and prognostic analyses in studies of oral cancer. These models should be developed to further enhance explainability, interpretability, and externally validated for generalizability in order to be safely integrated into daily clinical practices. Also, regulatory frameworks for the adoption of these models in clinical practices are necessary.

The contribution of artificial intelligence to reducing the diagnostic delay in oral cancer

Oral cancer (OC) is the sixth most commonly reported malignant disease globally, with high rates of disease-related morbidity and mortality due to advanced loco-regional stage at diagnosis. Early detection and prompt treatment offer the best outcomes to patients, yet the majority of OC lesions are detected at late stages with 45% survival rate for 2 years. The primary cause of poor OC outcomes is unavailable or ineffective screening and surveillance at the local point-of-care level, leading to delays in specialist referral and subsequent treatment. Lack of adequate awareness of OC among the public and professionals, and barriers to accessing health care services in a timely manner also contribute to delayed diagnosis. As image analysis and diagnostic technologies are evolving, various artificial intelligence (AI) approaches, specific algorithms and predictive models are beginning to have a considerable impact in improving diagnostic accuracy for OC. AI based technologies combined with intraoral photographic images or optical imaging methods are under investigation for automated detection and classification of OC. These new methods and technologies have great potential to improve outcomes, especially in low-resource settings. Such approaches can be used to predict oral cancer risk as an adjunct to population screening by providing real-time risk assessment. The objective of this study is to (1) provide an overview of components of delayed OC diagnosis and (2) evaluate novel AI based approaches with respect to their utility and implications for improving oral cancer detection.

The convergence of high-tech emerging technologies into the next stage of organ-on-a-chips

Recently, organ-on-a-chips (OoCs) have been proposed as highly innovative, truly predictive tools with limitless potential for organ function modelling, drug discovery and testing. By mimicking human key organ functions in vitro, they are proposed as models for studying physiological processes as well as disease-related mechanisms to elucidate pathological pathways and test the safety and efficacy of potential drug candidates, with unprecedented degree of physiological and clinical relevance. Despite the numerous efforts from biology and engineering, we expect that OoC will reach the next level by benefitting from high-tech technologies such as biofabrication, artificial intelligence (AI), robotics and automation.

Deep Learning in Head and Neck Tumor Multiomics Diagnosis and Analysis: Review of the Literature

Head and neck tumors are the sixth most common neoplasms. Multiomics integrates multiple dimensions of clinical, pathologic, radiological, and biological data and has the potential for tumor diagnosis and analysis. Deep learning (DL), a type of artificial intelligence (AI), is applied in medical image analysis. Among the DL techniques, the convolution neural network (CNN) is used for image segmentation, detection, and classification and in computer-aided diagnosis. Here, we reviewed multiomics image analysis of head and neck tumors using CNN and other DL neural networks. We also evaluated its application in early tumor detection, classification, prognosis/metastasis prediction, and the signing out of the reports. Finally, we highlighted the challenges and potential of these techniques.

Recent Advances in the Application of Artificial Intelligence in Otorhinolaryngology-Head and Neck Surgery

This study presents an up-to-date survey of the use of artificial intelligence (AI) in the field of otorhinolaryngology, considering opportunities, research challenges, and research directions. We searched PubMed, the Cochrane Central Register of Controlled Trials, Embase, and the Web of Science. We initially retrieved 458 articles. The exclusion of non-English publications and duplicates yielded a total of 90 remaining studies. These 90 studies were divided into those analyzing medical images, voice, medical devices, and clinical diagnoses and treatments. Most studies (42.2%, 38/90) used AI for image-based analysis, followed by clinical diagnoses and treatments (24 studies). Each of the remaining two subcategories included 14 studies. Machine learning and deep learning have been extensively applied in the field of otorhinolaryngology. However, the performance of AI models varies and research challenges remain.

Reimagining T Staging Through Artificial Intelligence and Machine Learning Image Processing Approaches in Digital Pathology

Tumor stage and grade, visually assessed by pathologists from evaluation of pathology images in conjunction with radiographic imaging techniques, have been linked to outcome, progression, and survival for a number of cancers. The gold standard of staging in oncology has been the TNM (tumor-node-metastasis) staging system. Though histopathological grading has shown prognostic significance, it is subjective and limited by interobserver variability even among experienced surgical pathologists. Recently, artificial intelligence (AI) approaches have been applied to pathology images toward diagnostic-, prognostic-, and treatment prediction-related tasks in cancer. AI approaches have the potential to overcome the limitations of conventional TNM staging and tumor grading approaches, providing a direct prognostic prediction of disease outcome independent of tumor stage and grade. Broadly speaking, these AI approaches involve extracting patterns from images that are then compared against previously defined disease signatures. These patterns are typically categorized as either (1) handcrafted, which involve domain-inspired attributes, such as nuclear shape, or (2) deep learning (DL)-based representations, which tend to be more abstract. DL approaches have particularly gained considerable popularity because of the minimal domain knowledge needed for training, mostly only requiring annotated examples corresponding to the categories of interest. In this article, we discuss AI approaches for digital pathology, especially as they relate to disease prognosis, prediction of genomic and molecular alterations in the tumor, and prediction of treatment response in oncology. We also discuss some of the potential challenges with validation, interpretability, and reimbursement that must be addressed before widespread clinical deployment. The article concludes with a brief discussion of potential future opportunities in the field of AI for digital pathology and oncology.

Comparison of nomogram with machine learning techniques for prediction of overall survival in patients with tongue cancer

BACKGROUND

The prediction of overall survival in tongue cancer is important for planning of personalized care and patient counselling.

OBJECTIVES

This study compares the performance of a nomogram with a machine learning model to predict overall survival in tongue cancer. The nomogram and machine learning model were built using a large data set from the Surveillance, Epidemiology, and End Results (SEER) program database. The comparison is necessary to provide the clinicians with a comprehensive, practical, and most accurate assistive system to predict overall survival of this patient population.

METHODS

The data set used included the records of 7596 tongue cancer patients. The considered machine learning algorithms were logistic regression, support vector machine, Bayes point machine, boosted decision tree, decision forest, and decision jungle. These algorithms were mainly evaluated in terms of the areas under the receiver-operating characteristic (ROC) curve (AUC) and accuracy values. The performance of the algorithm that produced the best result was compared with a nomogram to predict overall survival in tongue cancer patients.

RESULTS

The boosted decision-tree algorithm outperformed other algorithms. When compared with a nomogram using external validation data, the boosted decision tree produced an accuracy of 88.7% while the nomogram showed an accuracy of 60.4%. In addition, it was found that age of patient, T stage, radiotherapy, and the surgical resection were the most prominent features with significant influence on the machine learning model's performance to predict overall survival.

CONCLUSION

The machine learning model provides more personalized and reliable prognostic information of tongue cancer than the nomogram. However, the level of transparency offered by the nomogram in estimating patients' outcomes seems more confident and strengthened the principle of shared decision making between the patient and clinician. Therefore, a combination of a nomogram - machine learning (NomoML) predictive model may help to improve care, provides information to patients, and facilitates the clinicians in making tongue cancer management-related decisions.

The use of artificial intelligence, machine learning and deep learning in oncologic histopathology

BACKGROUND

Recently, there has been a momentous drive to apply advanced artificial intelligence (AI) technologies to diagnostic medicine. The introduction of AI has provided vast new opportunities to improve health care and has introduced a new wave of heightened precision in oncologic pathology. The impact of AI on oncologic pathology has now become apparent, and its use with respect to oral oncology is still in the nascent stage.

DISCUSSION

A foundational overview of AI classification systems used in medicine and a review of common terminology used in machine learning and computational pathology will be presented. This paper provides a focused review on the recent advances in AI and deep learning in oncologic histopathology and oral oncology. In addition, specific emphasis on recent studies that have applied these technologies to oral cancer prognostication will also be discussed.

CONCLUSION

Machine and deep learning methods designed to enhance prognostication of oral cancer have been proposed with much of the work focused on prediction models on patient survival and locoregional recurrences in patients with oral squamous cell carcinomas (OSCC). Few studies have explored machine learning methods on OSCC digital histopathologic images. It is evident that further research at the whole slide image level is needed and future collaborations with computer scientists may progress the field of oral oncology.

Glandular orientation and shape determined by computational pathology could identify aggressive tumor for early colon carcinoma: a triple-center study

BACKGROUND

Identifying the early-stage colon adenocarcinoma (ECA) patients who have lower risk cancer vs. the higher risk cancer could improve disease prognosis. Our study aimed to explore whether the glandular morphological features determined by computational pathology could identify high risk cancer in ECA via H&E images digitally.

METHODS

532 ECA patients retrospectively from 2 independent data centers, as well as 113 from The Cancer Genome Atlas (TCGA), were enrolled in this study. Four tissue microarrays (TMAs) were constructed across ECA hematoxylin and eosin (H&E) stained slides. 797 quantitative glandular morphometric features were extracted and 5 most prognostic features were identified using minimum redundancy maximum relevance to construct an image classifier. The image classifier was evaluated on D2/D3 = 223, D4 = 46, D5 = 113. The expression of Ki67 and serum CEA levels were scored on D3, aiming to explore the correlations between image classifier and immunohistochemistry data and serum CEA levels. The roles of clinicopathological data and ECAHBC were evaluated by univariate and multivariate analyses for prognostic value.

RESULTS

The image classifier could predict ECA recurrence (accuracy of 88.1%). ECA histomorphometric-based image classifier (ECAHBC) was an independent prognostic factor for poorer disease-specific survival [DSS, (HR = 9.65, 95% CI 2.15-43.12, P = 0.003)]. Significant correlations were observed between ECAHBC-positive patients and positivity of Ki67 labeling index (Ki67Li) and serum CEA.

CONCLUSION

Glandular orientation and shape could predict the high risk cancer in ECA and contribute to precision oncology. Computational pathology is emerging as a viable and objective means of identifying predictive biomarkers for cancer patients.

The exploration of new therapeutic targets for HPV-negative head and neck squamous cell cancer through the construction of a ceRNA network and immune microenvironment analysis

Previous studies have shown that human papillomavirus (HPV)-negative patients with head and neck squamous cell cancer (HNSCC) suffer from an unsatisfactory prognosis. Long noncoding RNAs (lncRNAs) have been verified to participate in many biological processes, including regulating gene expression as competing endogenous RNAs (ceRNAs), while few studies focused the ceRNA network regulation mechanism in patients with HPV-negative HNSCC tumor. Meanwhile, the immune microenvironment may be critical in the development and prognosis of HPV-negative tumors. Our study aimed to further investigate the pathogenesis and potential biomarkers for the diagnosis, therapy and prognosis of HPV-negative HNSCC through a ceRNA network. Comprehensively analyzing the sequencing data of lncRNAs, microRNAs (miRNAs), and messenger RNAs (mRNAs) in The Cancer Genome Atlas HNSCC dataset, we constructed a differentially expressed ceRNA network containing 131 lncRNAs, 35 miRNAs and 162 mRNAs. Then, survival analysis in the network was cited to explore the prognostic biomarkers. Eight mRNAs, nine lncRNAs, and one miRNA were identified to be associated with prognosis. Neuropilin (NRP) binding function, retinoid X receptor (RXR) binding, and the vascular endothelial growth factor (VEGF) signaling pathway were associated with the enrichment analysis, and they also related to the immune microenvironment. Combined with the analysis of the immune microenvironment differences, we obtained new targeted therapies using an RXR agonist, or a combination of the VEGF monoclonal antibody and an NRP antagonist, which may provide a promising future for HPV-negative HNSCC patients.

Artificial intelligence in cancer diagnosis and prognosis: Opportunities and challenges

Cancer is an aggressive disease with a low median survival rate. Ironically, the treatment process is long and very costly due to its high recurrence and mortality rates. Accurate early diagnosis and prognosis prediction of cancer are essential to enhance the patient's survival rate. Developments in statistics and computer engineering over the years have encouraged many scientists to apply computational methods such as multivariate statistical analysis to analyze the prognosis of the disease, and the accuracy of such analyses is significantly higher than that of empirical predictions. Furthermore, as artificial intelligence (AI), especially machine learning and deep learning, has found popular applications in clinical cancer research in recent years, cancer prediction performance has reached new heights. This article reviews the literature on the application of AI to cancer diagnosis and prognosis, and summarizes its advantages. We explore how AI assists cancer diagnosis and prognosis, specifically with regard to its unprecedented accuracy, which is even higher than that of general statistical applications in oncology. We also demonstrate ways in which these methods are advancing the field. Finally, opportunities and challenges in the clinical implementation of AI are discussed. Hence, this article provides a new perspective on how AI technology can help improve cancer diagnosis and prognosis, and continue improving human health in the future.

Applications of machine learning in drug discovery and development

Drug discovery and development pipelines are long, complex and depend on numerous factors. Machine learning (ML) approaches provide a set of tools that can improve discovery and decision making for well-specified questions with abundant, high-quality data. Opportunities to apply ML occur in all stages of drug discovery. Examples include target validation, identification of prognostic biomarkers and analysis of digital pathology data in clinical trials. Applications have ranged in context and methodology, with some approaches yielding accurate predictions and insights. The challenges of applying ML lie primarily with the lack of interpretability and repeatability of ML-generated results, which may limit their application. In all areas, systematic and comprehensive high-dimensional data still need to be generated. With ongoing efforts to tackle these issues, as well as increasing awareness of the factors needed to validate ML approaches, the application of ML can promote data-driven decision making and has the potential to speed up the process and reduce failure rates in drug discovery and development.

Artificial intelligence in digital pathology - new tools for diagnosis and precision oncology

In the past decade, advances in precision oncology have resulted in an increased demand for predictive assays that enable the selection and stratification of patients for treatment. The enormous divergence of signalling and transcriptional networks mediating the crosstalk between cancer, stromal and immune cells complicates the development of functionally relevant biomarkers based on a single gene or protein. However, the result of these complex processes can be uniquely captured in the morphometric features of stained tissue specimens. The possibility of digitizing whole-slide images of tissue has led to the advent of artificial intelligence (AI) and machine learning tools in digital pathology, which enable mining of subvisual morphometric phenotypes and might, ultimately, improve patient management. In this Perspective, we critically evaluate various AI-based computational approaches for digital pathology, focusing on deep neural networks and 'hand-crafted' feature-based methodologies. We aim to provide a broad framework for incorporating AI and machine learning tools into clinical oncology, with an emphasis on biomarker development. We discuss some of the challenges relating to the use of AI, including the need for well-curated validation datasets, regulatory approval and fair reimbursement strategies. Finally, we present potential future opportunities for precision oncology.

Quantitative nuclear histomorphometric features are predictive of Oncotype DX risk categories in ductal carcinoma in situ: preliminary findings

Background

Oncotype DX (ODx) is a 12-gene assay assessing the recurrence risk (high, intermediate, and low) of ductal carcinoma in situ (pre-invasive breast cancer), which guides clinicians regarding prescription of radiotherapy. However, ODx is expensive, time-consuming, and tissue-destructive. In addition, the actual prognostic meaning for the intermediate ODx risk category remains unclear.

Methods

In this work, we evaluated the ability of quantitative nuclear histomorphometric features extracted from hematoxylin and eosin-stained slide images of 62 ductal carcinoma in situ (DCIS) patients to distinguish between the corresponding ODx risk categories. The prognostic value of the identified image signature was further evaluated on an independent validation set of 30 DCIS patients in its ability to distinguish those DCIS patients who progressed to invasive carcinoma versus those who did not. Following nuclear segmentation and feature extraction, feature ranking strategies were employed to identify the most discriminating features between individual ODx risk categories. The selected features were then combined with machine learning classifiers to establish models to predict ODx risk categories. The model performance was evaluated using the average area under the receiver operating characteristic curve (AUC) using cross validation. In addition, an unsupervised clustering approach was also implemented to evaluate the ability of nuclear histomorphometric features to discriminate between the ODx risk categories.

Results

Features relating to spatial distribution, orientation disorder, and texture of nuclei were identified as most discriminating between the high ODx and the intermediate, low ODx risk categories. Additionally, the AUC of the most discriminating set of features for the different classification tasks was as follows: (1) high vs low ODx (0.68), (2) high vs. intermediate ODx (0.67), (3) intermediate vs. low ODx (0.57), (4) high and intermediate vs. low ODx (0.63), (5) high vs. low and intermediate ODx (0.66). Additionally, the unsupervised clustering resulted in intermediate ODx risk category patients being co-clustered with low ODx patients compared to high ODx.

Conclusion

Our results appear to suggest that nuclear histomorphometric features can distinguish high from low and intermediate ODx risk category patients. Additionally, our findings suggest that histomorphometric features for intermediate ODx were more similar to low ODx compared to high ODx risk category.

A Novel Digital Score for Abundance of Tumour Infiltrating Lymphocytes Predicts Disease Free Survival in Oral Squamous Cell Carcinoma

Oral squamous cell carcinoma (OSCC) is the most common type of head and neck (H&N) cancers with an increasing worldwide incidence and a worsening prognosis. The abundance of tumour infiltrating lymphocytes (TILs) has been shown to be a key prognostic indicator in a range of cancers with emerging evidence of its role in OSCC progression and treatment response. However, the current methods of TIL analysis are subjective and open to variability in interpretation. An automated method for quantification of TIL abundance has the potential to facilitate better stratification and prognostication of oral cancer patients. We propose a novel method for objective quantification of TIL abundance in OSCC histology images. The proposed TIL abundance (TILAb) score is calculated by first segmenting the whole slide images (WSIs) into underlying tissue types (tumour, lymphocytes, etc.) and then quantifying the co-localization of lymphocytes and tumour areas in a novel fashion. We investigate the prognostic significance of TILAb score on digitized WSIs of Hematoxylin and Eosin (H&E) stained slides of OSCC patients. Our deep learning based tissue segmentation achieves high accuracy of 96.31%, which paves the way for reliable downstream analysis. We show that the TILAb score is a strong prognostic indicator (p = 0.0006) of disease free survival (DFS) on our OSCC test cohort. The automated TILAb score has a significantly higher prognostic value than the manual TIL score (p = 0.0024). In summary, the proposed TILAb score is a digital biomarker which is based on more accurate classification of tumour and lymphocytic regions, is motivated by the biological definition of TILs as tumour infiltrating lymphocytes, with the added advantages of objective and reproducible quantification.