Application of Artificial Intelligence in Pathology: Trends and Challenges

Evaluating ChatGPT's diagnostic potential for pathology images

Background

Chat Generative Pretrained Transformer (ChatGPT) is a type of large language model (LLM) developed by OpenAI, known for its extensive knowledge base and interactive capabilities. These attributes make it a valuable tool in the medical field, particularly for tasks such as answering medical questions, drafting clinical notes, and optimizing the generation of radiology reports. However, keeping accuracy in medical contexts is the biggest challenge to employing GPT-4 in a clinical setting. This study aims to investigate the accuracy of GPT-4, which can process both text and image inputs, in generating diagnoses from pathological images.

Methods

This study analyzed 44 histopathological images from 16 organs and 100 colorectal biopsy photomicrographs. The initial evaluation was conducted using the standard GPT-4 model in January 2024, with a subsequent re-evaluation performed in July 2024. The diagnostic accuracy of GPT-4 was assessed by comparing its outputs to a reference standard using statistical measures. Additionally, four pathologists independently reviewed the same images to compare their diagnoses with the model's outputs. Both scanned and photographed images were tested to evaluate GPT-4's generalization ability across different image types.

Results

GPT-4 achieved an overall accuracy of 0.64 in identifying tumor imaging and tissue origins. For colon polyp classification, accuracy varied from 0.57 to 0.75 in different subtypes. The model achieved 0.88 accuracy in distinguishing low-grade from high-grade dysplasia and 0.75 in distinguishing high-grade dysplasia from adenocarcinoma, with a high sensitivity in detecting adenocarcinoma. Consistency between initial and follow-up evaluations showed slight to moderate agreement, with Kappa values ranging from 0.204 to 0.375.

Conclusion

GPT-4 demonstrates the ability to diagnose pathological images, showing improved performance over earlier versions. Its diagnostic accuracy in cancer is comparable to that of pathology residents. These findings suggest that GPT-4 holds promise as a supportive tool in pathology diagnostics, offering the potential to assist pathologists in routine diagnostic workflows.

[A national survey from the French Society of Pathology on research and application of artificial intelligence in pathology]

The 2030 French Innovation Healthcare national plan defined "Digital Healthcare" as one of its priority. The deployment of digital pathology and artificial intelligence fits perfectly into this framework. Therefore we evaluated the pathologist's interest in those fields by conducting an online survey among members of the French Society of Pathology, mainly composed of senior pathologists and trainees (n=2301). We collected 123 answers originating nationwide and representative of all status of practice. A heavy majority of participants (83%) declared themselves "interested or very interested" in digital transition and AI. Twenty-six percent of participants took part in academic research projects and 20% in industrial research projects. With digital pathology becoming increasingly common nationwide, there is a growing interest of pathologists in the development and validation of AI algorithms. In order to support this dynamic, a commission for research on artificial intelligence has been created under the authority of the French Society of Pathology.

The prevalence and clinical significance of EGFR mutations in non-small cell lung cancer patients in Egypt: a screening study

BACKGROUND

Lung cancer is a form of cancer that is responsible for the largest incidence of deaths attributed to cancer worldwide. Non-small cell lung cancer (NSCLC) is the most prevalent of all the subtypes of the disease. Treatment with tyrosine kinase inhibitors (TKI) may help some people who have been diagnosed with non-small cell lung cancer. The presence of actionable mutations in the epidermal growth factor receptor (EGFR) gene is a key predictor of how a patient will respond to a TKI. Thus, the frequency of identification of mutations in EGFR gene in patients with NSCLC can facilitate personalized treatment.

OBJECTIVE

The objective of this study was to screen for mutations in the EGFR gene and to investigate whether there is a correlation between the screened mutations and various clinical and pathological factors, such as gender, smoking history, and age, in tissue samples from patients with NSCLC.

METHODS

The study comprised 333 NSCLC tissue samples from 230 males and 103 females with an average age of 50 years. Exons 18-21 of the EGFR gene have been examined using real-time PCR. Using SPSS, correlations between clinical and demographic variables were examined, and EGFR mutation and clinical features associations were studied.

RESULTS

The study's findings revealed that the incidence rate of EGFR mutation was 24.32% (81/333), with partial deletion of exon 19 (19-Del) and a point mutation of L858R in exon 21 accounting for 66.67% (P < 0.001) and 28.40% (P < 0.001) of the mutant cases, respectively. Patients who had the T790M mutation represent 4.94% (P = 0.004) of total number of patients. Females harbored EGFR mutations (54.32%) with higher frequency than men (45.68%) (P < 0.001), while nonsmokers had EGFR mutations (70.37%) more frequently than current smokers (29.63%) (P < 0.001).

CONCLUSION

The screening study conducted in Egypt reported that the EGFR mutations prevalence was 24.32% among Egyptians with NSCLC. The study also found a slight gender bias, with females having an incidence rate of these mutations higher than males. Additionally, nonsmokers had higher rates of mutations in EGFR gene compared to smokers. According to the findings, somatic EGFR mutations can be employed as a diagnostic tool for non-small cell lung cancer in Egypt, and they can be implemented in conjunction with clinical criteria to identify which patients are more likely to respond favorably to TKIs.

Artificial intelligence in surgical pathology - Where do we stand, where do we go?

Surgical and neuropathologists continuously search for new and disease-specific features, such as independent predictors of tumor prognosis or determinants of tumor entities and sub-entities. This is a task where artificial intelligence (AI)/machine learning (ML) systems could significantly contribute to help with tumor outcome prediction and the search for new diagnostic or treatment stratification biomarkers. AI systems are increasingly integrated into routine pathology workflows to improve accuracy, reproducibility, productivity and to reveal difficult-to-see features in complicated histological slides, including the quantification of important markers for tumor grading and staging. In this article, we review the infrastructure needed to facilitate digital and computational pathology. We address the barriers for its full deployment in the clinical setting and describe the use of AI in intraoperative or postoperative settings were frozen or formalin-fixed, paraffin-embedded materials are used. We also summarize quality assessment issues of slide digitization, new spatial biology approaches, and the determination of specific gene-expression from whole slide images. Finally, we highlight new innovative and future technologies, such as large language models, optical biopsies, and mass spectrometry imaging.

Publicly available datasets of breast histopathology H&E whole-slide images: A scoping review

Advancements in digital pathology and computing resources have made a significant impact in the field of computational pathology for breast cancer diagnosis and treatment. However, access to high-quality labeled histopathological images of breast cancer is a big challenge that limits the development of accurate and robust deep learning models. In this scoping review, we identified the publicly available datasets of breast H&E-stained whole-slide images (WSIs) that can be used to develop deep learning algorithms. We systematically searched 9 scientific literature databases and 9 research data repositories and found 17 publicly available datasets containing 10 385 H&E WSIs of breast cancer. Moreover, we reported image metadata and characteristics for each dataset to assist researchers in selecting proper datasets for specific tasks in breast cancer computational pathology. In addition, we compiled 2 lists of breast H&E patches and private datasets as supplementary resources for researchers. Notably, only 28% of the included articles utilized multiple datasets, and only 14% used an external validation set, suggesting that the performance of other developed models may be susceptible to overestimation. The TCGA-BRCA was used in 52% of the selected studies. This dataset has a considerable selection bias that can impact the robustness and generalizability of the trained algorithms. There is also a lack of consistent metadata reporting of breast WSI datasets that can be an issue in developing accurate deep learning models, indicating the necessity of establishing explicit guidelines for documenting breast WSI dataset characteristics and metadata.

Computational pathology: A survey review and the way forward

Computational Pathology (CPath) is an interdisciplinary science that augments developments of computational approaches to analyze and model medical histopathology images. The main objective for CPath is to develop infrastructure and workflows of digital diagnostics as an assistive CAD system for clinical pathology, facilitating transformational changes in the diagnosis and treatment of cancer that are mainly address by CPath tools. With evergrowing developments in deep learning and computer vision algorithms, and the ease of the data flow from digital pathology, currently CPath is witnessing a paradigm shift. Despite the sheer volume of engineering and scientific works being introduced for cancer image analysis, there is still a considerable gap of adopting and integrating these algorithms in clinical practice. This raises a significant question regarding the direction and trends that are undertaken in CPath. In this article we provide a comprehensive review of more than 800 papers to address the challenges faced in problem design all-the-way to the application and implementation viewpoints. We have catalogued each paper into a model-card by examining the key works and challenges faced to layout the current landscape in CPath. We hope this helps the community to locate relevant works and facilitate understanding of the field's future directions. In a nutshell, we oversee the CPath developments in cycle of stages which are required to be cohesively linked together to address the challenges associated with such multidisciplinary science. We overview this cycle from different perspectives of data-centric, model-centric, and application-centric problems. We finally sketch remaining challenges and provide directions for future technical developments and clinical integration of CPath. For updated information on this survey review paper and accessing to the original model cards repository, please refer to GitHub. Updated version of this draft can also be found from arXiv.

Modernizing metabolic dysfunction-associated steatotic liver disease diagnostics: the progressive shift from liver biopsy to noninvasive techniques

Metabolic dysfunction-associated steatotic liver disease (MASLD) is a growing public health concern worldwide. Liver biopsy is the gold standard for diagnosing and staging MASLD, but it is invasive and carries associated risks. In recent years, there has been significant progress in developing noninvasive techniques for evaluation. This review article discusses briefly current available noninvasive assessments and the various liver biopsy techniques available for MASLD, including invasive techniques such as transjugular and transcutaneous needle biopsy, intraoperative/laparoscopic biopsy, and the evolving role of endoscopic ultrasound-guided biopsy. In addition to discussing the various biopsy techniques, we review the current state of knowledge on the histopathologic evaluation of MASLD, including the various scoring systems used to grade and stage the disease. We also explore current and alternative modalities for histopathologic evaluation, such as whole slide imaging and the utility of immunohistochemistry. Overall, this review article provides a comprehensive overview of the progress in liver biopsy techniques for MASLD and compares invasive and noninvasive modalities. However, beyond clinical trials, the practical application of liver biopsy may be limited, as ongoing advancements in noninvasive fibrosis assessments are expected to more effectively identify candidates for MASLD treatment in real-world settings.

A Hybrid Deep Learning and Machine Learning Approach with Mobile-EfficientNet and Grey Wolf Optimizer for Lung and Colon Cancer Histopathology Classification

BACKGROUND

Lung and colon cancers are among the most prevalent and lethal malignancies worldwide, underscoring the urgent need for advanced diagnostic methodologies. This study aims to develop a hybrid deep learning and machine learning framework for the classification of Colon Adenocarcinoma, Colon Benign Tissue, Lung Adenocarcinoma, Lung Benign Tissue, and Lung Squamous Cell Carcinoma from histopathological images.

METHODS

Current approaches primarily rely on the LC25000 dataset, which, due to image augmentation, lacks the generalizability required for real-time clinical applications. To address this, Contrast Limited Adaptive Histogram Equalization (CLAHE) was applied to enhance image quality, and 1000 new images from the National Cancer Institute GDC Data Portal were introduced into the Colon Adenocarcinoma, Lung Adenocarcinoma, and Lung Squamous Cell Carcinoma classes, replacing augmented images to increase dataset diversity. A hybrid feature extraction model combining MobileNetV2 and EfficientNetB3 was optimized using the Grey Wolf Optimizer (GWO), resulting in the Lung and Colon histopathological classification technique (MEGWO-LCCHC). Cross-validation and hyperparameter tuning with Optuna were performed on various machine learning models, including XGBoost, LightGBM, and CatBoost.

RESULTS

The MEGWO-LCCHC technique achieved high classification accuracy, with the lightweight DNN model reaching 94.8%, LightGBM at 93.9%, XGBoost at 93.5%, and CatBoost at 93.3% on the test set.

CONCLUSIONS

The findings suggest that our approach enhances classification performance and offers improved generalizability for real-world clinical applications. The proposed MEGWO-LCCHC framework shows promise as a robust tool in cancer diagnostics, advancing the application of AI in oncology.

Artificial Intelligence in Uropathology

The global population is currently at unprecedented levels, with an estimated 7.8 billion people inhabiting the planet. We are witnessing a rise in cancer cases, attributed to improved control of cardiovascular diseases and a growing elderly population. While this has resulted in an increased workload for pathologists, it also presents an opportunity for advancement. The accurate classification of tumors and identification of prognostic and predictive factors demand specialized expertise and attention. Fortunately, the rapid progression of artificial intelligence (AI) offers new prospects in medicine, particularly in diagnostics such as image and surgical pathology. This article explores the transformative impact of AI in the field of uropathology, with a particular focus on its application in diagnosing, grading, and prognosticating various urological cancers. AI, especially deep learning algorithms, has shown significant potential in improving the accuracy and efficiency of pathology workflows. This comprehensive review is dedicated to providing an insightful overview of the primary data concerning the utilization of AI in diagnosing, predicting prognosis, and determining drug responses for tumors of the urinary tract. By embracing these advancements, we can look forward to improved outcomes and better patient care.

Unveiling the risks of ChatGPT in diagnostic surgical pathology

ChatGPT, an AI capable of processing and generating human-like language, has been studied in medical education and care, yet its potential in histopathological diagnosis remains unexplored. This study evaluates ChatGPT's reliability in addressing pathology-related diagnostic questions across ten subspecialties and its ability to provide scientific references. We crafted five clinico-pathological scenarios per subspecialty, simulating a pathologist using ChatGPT to refine differential diagnoses. Each scenario, aligned with current diagnostic guidelines and validated by expert pathologists, was posed as open-ended or multiple-choice questions, either requesting scientific references or not. Outputs were assessed by six pathologists according to. (1) usefulness in supporting the diagnosis and (2) absolute number of errors. We used directed acyclic graphs and structural causal models to determine the effect of each scenario type, field, question modality, and pathologist evaluation. We yielded 894 evaluations. ChatGPT provided useful answers in 62.2% of cases, and 32.1% of outputs contained no errors, while the remaining had at least one error. ChatGPT provided 214 bibliographic references: 70.1% correct, 12.1% inaccurate, and 17.8% non-existing. Scenario variability had the greatest impact on ratings, and latent knowledge across fields showed minimal variation. Although ChatGPT provided useful responses in one-third of cases, the frequency of errors and variability underscores its inadequacy for routine diagnostic use and highlights the need for discretion as a support tool. Imprecise referencing also suggests caution as a self-learning tool. It is essential to recognize the irreplaceable role of human experts in synthesizing images, clinical data, and experience for the intricate task of histopathological diagnosis.

Improving the Annotation Process in Computational Pathology: A Pilot Study with Manual and Semi-automated Approaches on Consumer and Medical Grade Devices

The development of reliable artificial intelligence (AI) algorithms in pathology often depends on ground truth provided by annotation of whole slide images (WSI), a time-consuming and operator-dependent process. A comparative analysis of different annotation approaches is performed to streamline this process. Two pathologists annotated renal tissue using semi-automated (Segment Anything Model, SAM)) and manual devices (touchpad vs mouse). A comparison was conducted in terms of working time, reproducibility (overlap fraction), and precision (0 to 10 accuracy rated by two expert nephropathologists) among different methods and operators. The impact of different displays on mouse performance was evaluated. Annotations focused on three tissue compartments: tubules (57 annotations), glomeruli (53 annotations), and arteries (58 annotations). The semi-automatic approach was the fastest and had the least inter-observer variability, averaging 13.6 ± 0.2 min with a difference (Δ) of 2%, followed by the mouse (29.9 ± 10.2, Δ = 24%), and the touchpad (47.5 ± 19.6 min, Δ = 45%). The highest reproducibility in tubules and glomeruli was achieved with SAM (overlap values of 1 and 0.99 compared to 0.97 for the mouse and 0.94 and 0.93 for the touchpad), though SAM had lower reproducibility in arteries (overlap value of 0.89 compared to 0.94 for both the mouse and touchpad). No precision differences were observed between operators (p = 0.59). Using non-medical monitors increased annotation times by 6.1%. The future employment of semi-automated and AI-assisted approaches can significantly speed up the annotation process, improving the ground truth for AI tool development.

Expanding role and scope of artificial intelligence in the field of gastrointestinal pathology

Digital pathology (DP) and its subsidiaries including artificial intelligence (AI) are rapidly making inroads into the area of diagnostic anatomic pathology (AP) including gastrointestinal (GI) pathology. It is poised to revolutionize the field of diagnostic AP. Historically, AP has been slow to adopt digital technology, but this is changing rapidly, with many centers worldwide transitioning to DP. Coupled with advanced techniques of AI such as deep learning and machine learning, DP is likely to transform histopathology from a subjective field to an objective, efficient, and transparent discipline. AI is increasingly integrated into GI pathology, offering numerous advancements and improvements in overall diagnostic accuracy, efficiency, and patient care. Specifically, AI in GI pathology enhances diagnostic accuracy, streamlines workflows, provides predictive insights, integrates multimodal data, supports research, and aids in education and training, ultimately improving patient care and outcomes. This review summarized the latest developments in the role and scope of AI in AP with a focus on GI pathology. The main aim was to provide updates and create awareness among the pathology community.

Artificial Intelligence in the Diagnosis of Onychomycosis-Literature Review

Onychomycosis is a common fungal nail infection that is difficult to diagnose due to its similarity to other nail conditions. Accurate identification is essential for effective treatment. The current gold standard methods include microscopic examination with potassium hydroxide, fungal cultures, and Periodic acid-Schiff biopsy staining. These conventional techniques, however, suffer from high turnover times, variable sensitivity, reliance on human interpretation, and costs. This study examines the potential of integrating AI (artificial intelligence) with visualization tools like dermoscopy and microscopy to improve the accuracy and efficiency of onychomycosis diagnosis. AI algorithms can further improve the interpretation of these images. The review includes 14 studies from PubMed and IEEE databases published between 2010 and 2024, involving clinical and dermoscopic pictures, histopathology slides, and KOH microscopic images. Data extracted include study type, sample size, image assessment model, AI algorithms, test performance, and comparison with clinical diagnostics. Most studies show that AI models achieve an accuracy comparable to or better than clinicians, suggesting a promising role for AI in diagnosing onychomycosis. Nevertheless, the niche nature of the topic indicates a need for further research.

Hallmarks of perineural invasion in pancreatic ductal adenocarcinoma: new biological dimensions

Pancreatic ductal adenocarcinoma (PDAC) is an aggressive malignant tumor with a high metastatic potential. Perineural invasion (PNI) occurs in the early stages of PDAC with a high incidence rate and is directly associated with a poor prognosis. It involves close interaction among PDAC cells, nerves and the tumor microenvironment. In this review, we detailed discuss PNI-related pain, six specific steps of PNI, and treatment of PDAC with PNI and emphasize the importance of novel technologies for further investigation.

Deep Residual Learning-Based Classification with Identification of Incorrect Predictions and Quantification of Cellularity and Nuclear Morphological Features in Digital Pathological Images of Common Astrocytic Tumors

Interobserver variations in the pathology of common astrocytic tumors impact diagnosis and subsequent treatment decisions. This study leveraged a residual neural network-50 (ResNet-50) in digital pathological images of diffuse astrocytoma, anaplastic astrocytoma, and glioblastoma to recognize characteristic pathological features and perform classification at the patch and case levels with identification of incorrect predictions. In addition, cellularity and nuclear morphological features, including axis ratio, circularity, entropy, area, irregularity, and perimeter, were quantified via a hybrid task cascade (HTC) framework and compared between different characteristic pathological features with importance weighting. A total of 95 cases, including 15 cases of diffuse astrocytoma, 11 cases of anaplastic astrocytoma, and 69 cases of glioblastoma, were collected in Taiwan Hualien Tzu Chi Hospital from January 2000 to December 2021. The results revealed that an optimized ResNet-50 model could recognize characteristic pathological features at the patch level and assist in diagnosis at the case level with accuracies of 0.916 and 0.846, respectively. Incorrect predictions were mainly due to indistinguishable morphologic overlap between anaplastic astrocytoma and glioblastoma tumor cell area, zones of scant vascular lumen with compact endothelial cells in the glioblastoma microvascular proliferation area mimicking the glioblastoma tumor cell area, and certain regions in diffuse astrocytoma with too low cellularity being misrecognized as the glioblastoma necrosis area. Significant differences were observed in cellularity and each nuclear morphological feature among different characteristic pathological features. Furthermore, using the extreme gradient boosting (XGBoost) algorithm, we found that entropy was the most important feature for classification, followed by cellularity, area, circularity, axis ratio, perimeter, and irregularity. Identifying incorrect predictions provided valuable feedback to machine learning design to further enhance accuracy and reduce errors in classification. Moreover, quantifying cellularity and nuclear morphological features with importance weighting provided the basis for developing an innovative scoring system to achieve objective classification and precision diagnosis among common astrocytic tumors.

Current Developments in Diagnosis of Salivary Gland Tumors: From Structure to Artificial Intelligence

Salivary glands tumors are uncommon neoplasms with variable incidence, heterogenous histologies and unpredictable biological behaviour. Most tumors are located in the parotid gland. Benign salivary tumors represent 54-79% of cases and pleomorphic adenoma is frequently diagnosed in this group. Salivary glands malignant tumors that are more commonly diagnosed are adenoid cystic carcinomas and mucoepidermoid carcinomas. Because of their diversity and overlapping features, these tumors require complex methods of evaluation. Diagnostic procedures include imaging techniques combined with clinical examination, fine needle aspiration and histopathological investigation of the excised specimens. This narrative review describes the advances in the diagnosis methods of these unusual tumors-from histomorphology to artificial intelligence algorithms.

Ethics of artificial intelligence in dermatology

The integration of artificial intelligence (AI) in dermatology holds promise for enhancing clinical accuracy, enabling earlier detection of skin malignancies, suggesting potential management of skin lesions and eruptions, and promoting improved continuity of care. AI implementation in dermatology, however, raises several ethical concerns. This review explores the current benefits and challenges associated with AI integration, underscoring ethical considerations related to autonomy, informed consent, and privacy. We also examine the ways in which beneficence, nonmaleficence, and distributive justice may be impacted. Clarifying the role of AI, striking a balance between security and transparency, fostering open dialogue with our patients, collaborating with developers of AI, implementing educational initiatives for dermatologists and their patients, and participating in the establishment of regulatory guidelines are essential to navigating ethical and responsible AI incorporation into dermatology.

Development of an Artificial-Intelligence-Based Tool for Automated Assessment of Cellularity in Bone Marrow Biopsies in Ph-Negative Myeloproliferative Neoplasms

The cellularity assessment in bone marrow biopsies (BMBs) for the diagnosis of Philadelphia chromosome (Ph)-negative myeloproliferative neoplasms (MPNs) is a key diagnostic feature and is usually performed by the human eyes through an optical microscope with consequent inter-observer and intra-observer variability. Thus, the use of an automated tool may reduce variability, improving the uniformity of the evaluation. The aim of this work is to develop an accurate AI-based tool for the automated quantification of cellularity in BMB histology. A total of 55 BMB histological slides, diagnosed as Ph- MPN between January 2018 and June 2023 from the archives of the Pathology Unit of University "Luigi Vanvitelli" in Naples (Italy), were scanned on Ventana DP200 or Epredia P1000 and exported as whole-slide images (WSIs). Fifteen BMBs were randomly selected to obtain a training set of AI-based tools. An expert pathologist and a trained resident performed annotations of hematopoietic tissue and adipose tissue, and annotations were exported as .tiff images and .png labels with two colors (black for hematopoietic tissue and yellow for adipose tissue). Subsequently, we developed a semantic segmentation model for hematopoietic tissue and adipose tissue. The remaining 40 BMBs were used for model verification. The performance of our model was compared with an evaluation of the cellularity of five expert hematopathologists and three trainees; we obtained an optimal concordance between our model and the expert pathologists' evaluation, with poorer concordance for trainees. There were no significant differences in cellularity assessments between two different scanners.

Knowledge and Perception of Artificial Intelligence among Faculty Members and Students at Batterjee Medical College

Background

Mounting research suggests that artificial intelligence (AI) is one of the innovations that aid in the patient's diagnosis and treatment, but unfortunately limited research has been conducted in this regard in the Kingdom of Saudi Arabia (KSA). Hence, this study aimed to assess the level of knowledge and awareness of AI among faculty members and medicine students in one of the premier medical colleges in KSA.

Methods

A cross-sectional descriptive study was conducted at Batterjee Medical College (BMC), Jeddah (KSA), from November 2022 to April 2023.

Result

A total of 131 participants contributed to our study, of which three were excluded due to incomplete responses, thereby giving a response rate of 98%.

Conclusion

85.4% of the respondents believe that AI has a positive impact on the healthcare system and physicians in general. Hence, there should be a mandatory course in medical schools that can prepare future doctors to diagnose patients more accurately, make predictions about patients' future health, and recommend better treatments.

Liquid biopsy for gastric cancer: Techniques, applications, and future directions

After the study of circulating tumor cells in blood through liquid biopsy (LB), this technique has evolved to encompass the analysis of multiple materials originating from the tumor, such as nucleic acids, extracellular vesicles, tumor-educated platelets, and other metabolites. Additionally, research has extended to include the examination of samples other than blood or plasma, such as saliva, gastric juice, urine, or stool. LB techniques are diverse, intricate, and variable. They must be highly sensitive, and pre-analytical, patient, and tumor-related factors significantly influence the detection threshold, diagnostic method selection, and potential results. Consequently, the implementation of LB in clinical practice still faces several challenges. The potential applications of LB range from early cancer detection to guiding targeted therapy or immunotherapy in both early and advanced cancer cases, monitoring treatment response, early identification of relapses, or assessing patient risk. On the other hand, gastric cancer (GC) is a disease often diagnosed at advanced stages. Despite recent advances in molecular understanding, the currently available treatment options have not substantially improved the prognosis for many of these patients. The application of LB in GC could be highly valuable as a non-invasive method for early diagnosis and for enhancing the management and outcomes of these patients. In this comprehensive review, from a pathologist's perspective, we provide an overview of the main options available in LB, delve into the fundamental principles of the most studied techniques, explore the potential utility of LB application in the context of GC, and address the obstacles that need to be overcome in the future to make this innovative technique a game-changer in cancer diagnosis and treatment within clinical practice.

Navigating the Future: A Comprehensive Review of Artificial Intelligence Applications in Gastrointestinal Cancer

This comprehensive review explores the transformative role of artificial intelligence (AI) in the realm of gastrointestinal cancer. Gastrointestinal cancers present unique challenges, necessitating precise diagnostic tools and personalized treatment strategies. Leveraging AI, particularly machine learning and deep learning algorithms, has demonstrated remarkable potential in revolutionizing early detection, treatment planning, prognosis, and drug development. The analysis of current research and technological advancements underscores the capacity of AI to unravel intricate patterns within extensive datasets, providing actionable insights that enhance diagnostic accuracy and treatment efficacy. The transformative impact of AI on the landscape of gastrointestinal cancer is emphasized, signaling a paradigm shift towards more precise and targeted cancer care. The conclusion emphasizes the need for sustained research efforts and collaborative initiatives among AI researchers, healthcare professionals, and policymakers. By fostering interdisciplinary collaboration, we can navigate the evolving field of gastrointestinal cancer care, embracing the potential of AI to improve patient outcomes and contribute to a more effective and personalized approach to cancer management.

Artificial intelligence in time-lapse system: advances, applications, and future perspectives in reproductive medicine

With the rising demand for in vitro fertilization (IVF) cycles, there is a growing need for innovative techniques to optimize procedure outcomes. One such technique is time-lapse system (TLS) for embryo incubation, which minimizes environmental changes in the embryo culture process. TLS also significantly advances predicting embryo quality, a crucial determinant of IVF cycle success. However, the current subjective nature of embryo assessments is due to inter- and intra-observer subjectivity, resulting in highly variable results. To address this challenge, reproductive medicine has gradually turned to artificial intelligence (AI) to establish a standardized and objective approach, aiming to achieve higher success rates. Extensive research is underway investigating the utilization of AI in TLS to predict multiple outcomes. These studies explore the application of popular AI algorithms, their specific implementations, and the achieved advancements in TLS. This review aims to provide an overview of the advances in AI algorithms and their particular applications within the context of TLS and the potential challenges and opportunities for further advancements in reproductive medicine.

Histopathology image classification: highlighting the gap between manual analysis and AI automation

The field of histopathological image analysis has evolved significantly with the advent of digital pathology, leading to the development of automated models capable of classifying tissues and structures within diverse pathological images. Artificial intelligence algorithms, such as convolutional neural networks, have shown remarkable capabilities in pathology image analysis tasks, including tumor identification, metastasis detection, and patient prognosis assessment. However, traditional manual analysis methods have generally shown low accuracy in diagnosing colorectal cancer using histopathological images. This study investigates the use of AI in image classification and image analytics using histopathological images using the histogram of oriented gradients method. The study develops an AI-based architecture for image classification using histopathological images, aiming to achieve high performance with less complexity through specific parameters and layers. In this study, we investigate the complicated state of histopathological image classification, explicitly focusing on categorizing nine distinct tissue types. Our research used open-source multi-centered image datasets that included records of 100.000 non-overlapping images from 86 patients for training and 7180 non-overlapping images from 50 patients for testing. The study compares two distinct approaches, training artificial intelligence-based algorithms and manual machine learning models, to automate tissue classification. This research comprises two primary classification tasks: binary classification, distinguishing between normal and tumor tissues, and multi-classification, encompassing nine tissue types, including adipose, background, debris, stroma, lymphocytes, mucus, smooth muscle, normal colon mucosa, and tumor. Our findings show that artificial intelligence-based systems can achieve 0.91 and 0.97 accuracy in binary and multi-class classifications. In comparison, the histogram of directed gradient features and the Random Forest classifier achieved accuracy rates of 0.75 and 0.44 in binary and multi-class classifications, respectively. Our artificial intelligence-based methods are generalizable, allowing them to be integrated into histopathology diagnostics procedures and improve diagnostic accuracy and efficiency. The CNN model outperforms existing machine learning techniques, demonstrating its potential to improve the precision and effectiveness of histopathology image analysis. This research emphasizes the importance of maintaining data consistency and applying normalization methods during the data preparation stage for analysis. It particularly highlights the potential of artificial intelligence to assess histopathological images.

Why do errors arise in artificial intelligence diagnostic tools in histopathology and how can we minimize them?

Artificial intelligence (AI)-based diagnostic tools can offer numerous benefits to the field of histopathology, including improved diagnostic accuracy, efficiency and productivity. As a result, such tools are likely to have an increasing role in routine practice. However, all AI tools are prone to errors, and these AI-associated errors have been identified as a major risk in the introduction of AI into healthcare. The errors made by AI tools are different, in terms of both cause and nature, to the errors made by human pathologists. As highlighted by the National Institute for Health and Care Excellence, it is imperative that practising pathologists understand the potential limitations of AI tools, including the errors made. Pathologists are in a unique position to be gatekeepers of AI tool use, maximizing patient benefit while minimizing harm. Furthermore, their pathological knowledge is essential to understanding when, and why, errors have occurred and so to developing safer future algorithms. This paper summarises the literature on errors made by AI diagnostic tools in histopathology. These include erroneous errors, data concerns (data bias, hidden stratification, data imbalances, distributional shift, and lack of generalisability), reinforcement of outdated practices, unsafe failure mode, automation bias, and insensitivity to impact. Methods to reduce errors in both tool design and clinical use are discussed, and the practical roles for pathologists in error minimisation are highlighted. This aims to inform and empower pathologists to move safely through this seismic change in practice and help ensure that novel AI tools are adopted safely.

[Artificial intelligence in pathological anatomy]

The review presents key concepts and global developments in the field of artificial intelligence used in pathological anatomy. The work examines two types of artificial intelligence (AI): weak and strong ones. A review of experimental algorithms using both deep machine learning and computer vision technologies to work with WSI images of preparations, diagnose and make a prognosis for various malignant neoplasms is carried out. It has been established that weak artificial intelligence at this stage of development of computer (digital) pathological anatomy shows significantly better results in speeding up and refining diagnostic procedures than strong artificial intelligence having signs of general intelligence. The article also discusses three options for the further development of AI assistants for pathologists based on the technologies of large language models (strong AI) ChatGPT (PathAsst), Flan-PaLM2 and LIMA. As a result of the analysis of the literature, key problems in the field were identified: the equipment of pathology institutions, the lack of experts in training neural networks, the lack of strict criteria for the clinical viability of AI diagnostic technologies.

Novel research and future prospects of artificial intelligence in cancer diagnosis and treatment

Research into the potential benefits of artificial intelligence for comprehending the intricate biology of cancer has grown as a result of the widespread use of deep learning and machine learning in the healthcare sector and the availability of highly specialized cancer datasets. Here, we review new artificial intelligence approaches and how they are being used in oncology. We describe how artificial intelligence might be used in the detection, prognosis, and administration of cancer treatments and introduce the use of the latest large language models such as ChatGPT in oncology clinics. We highlight artificial intelligence applications for omics data types, and we offer perspectives on how the various data types might be combined to create decision-support tools. We also evaluate the present constraints and challenges to applying artificial intelligence in precision oncology. Finally, we discuss how current challenges may be surmounted to make artificial intelligence useful in clinical settings in the future.

Histological classification of canine and feline lymphoma using a modular approach based on deep learning and advanced image processing

Histopathological examination of tissue samples is essential for identifying tumor malignancy and the diagnosis of different types of tumor. In the case of lymphoma classification, nuclear size of the neoplastic lymphocytes is one of the key features to differentiate the different subtypes. Based on the combination of artificial intelligence and advanced image processing, we provide a workflow for the classification of lymphoma with regards to their nuclear size (small, intermediate, and large). As the baseline for our workflow testing, we use a Unet++ model trained on histological images of canine lymphoma with individually labeled nuclei. As an alternative to the Unet++, we also used a publicly available pre-trained and unmodified instance segmentation model called Stardist to demonstrate that our modular classification workflow can be combined with different types of segmentation models if they can provide proper nuclei segmentation. Subsequent to nuclear segmentation, we optimize algorithmic parameters for accurate classification of nuclear size using a newly derived reference size and final image classification based on a pathologists-derived ground truth. Our image classification module achieves a classification accuracy of up to 92% on canine lymphoma data. Compared to the accuracy ranging from 66.67 to 84% achieved using measurements provided by three individual pathologists, our algorithm provides a higher accuracy level and reproducible results. Our workflow also demonstrates a high transferability to feline lymphoma, as shown by its accuracy of up to 84.21%, even though our workflow was not optimized for feline lymphoma images. By determining the nuclear size distribution in tumor areas, our workflow can assist pathologists in subtyping lymphoma based on the nuclei size and potentially improve reproducibility. Our proposed approach is modular and comprehensible, thus allowing adaptation for specific tasks and increasing the users' trust in computer-assisted image classification.

Revolutionizing Digital Pathology With the Power of Generative Artificial Intelligence and Foundation Models

Digital pathology has transformed the traditional pathology practice of analyzing tissue under a microscope into a computer vision workflow. Whole-slide imaging allows pathologists to view and analyze microscopic images on a computer monitor, enabling computational pathology. By leveraging artificial intelligence (AI) and machine learning (ML), computational pathology has emerged as a promising field in recent years. Recently, task-specific AI/ML (eg, convolutional neural networks) has risen to the forefront, achieving above-human performance in many image-processing and computer vision tasks. The performance of task-specific AI/ML models depends on the availability of many annotated training datasets, which presents a rate-limiting factor for AI/ML development in pathology. Task-specific AI/ML models cannot benefit from multimodal data and lack generalization, eg, the AI models often struggle to generalize to new datasets or unseen variations in image acquisition, staining techniques, or tissue types. The 2020s are witnessing the rise of foundation models and generative AI. A foundation model is a large AI model trained using sizable data, which is later adapted (or fine-tuned) to perform different tasks using a modest amount of task-specific annotated data. These AI models provide in-context learning, can self-correct mistakes, and promptly adjust to user feedback. In this review, we provide a brief overview of recent advances in computational pathology enabled by task-specific AI, their challenges and limitations, and then introduce various foundation models. We propose to create a pathology-specific generative AI based on multimodal foundation models and present its potentially transformative role in digital pathology. We describe different use cases, delineating how it could serve as an expert companion of pathologists and help them efficiently and objectively perform routine laboratory tasks, including quantifying image analysis, generating pathology reports, diagnosis, and prognosis. We also outline the potential role that foundation models and generative AI can play in standardizing the pathology laboratory workflow, education, and training.

Harnessing the Power of AI: A Comprehensive Review of Its Impact and Challenges in Nursing Science and Healthcare

This comprehensive review delves into the impact and challenges of Artificial Intelligence (AI) in nursing science and healthcare. AI has already demonstrated its transformative potential in these fields, with applications spanning from personalized care and diagnostic accuracy to predictive analytics and telemedicine. However, the integration of AI has its complexities, including concerns related to data privacy, ethical considerations, and biases in algorithms and datasets. The future of healthcare appears promising, with AI poised to advance diagnostics, treatment, and healthcare practices. Nevertheless, it is crucial to remember that AI should complement, not replace, healthcare professionals, preserving the essential human element of care. To maximize AI's potential in healthcare, interdisciplinary collaboration, ethical guidelines, and the protection of patient rights are essential. This review concludes with a call to action, emphasizing the need for ongoing research and collective efforts to ensure that AI contributes to improved healthcare outcomes while upholding the highest standards of ethics and patient-centered care.

Deep Learning in Barrett's Esophagus Diagnosis: Current Status and Future Directions

Barrett's esophagus (BE) represents a pre-malignant condition characterized by abnormal cellular proliferation in the distal esophagus. A timely and accurate diagnosis of BE is imperative to prevent its progression to esophageal adenocarcinoma, a malignancy associated with a significantly reduced survival rate. In this digital age, deep learning (DL) has emerged as a powerful tool for medical image analysis and diagnostic applications, showcasing vast potential across various medical disciplines. In this comprehensive review, we meticulously assess 33 primary studies employing varied DL techniques, predominantly featuring convolutional neural networks (CNNs), for the diagnosis and understanding of BE. Our primary focus revolves around evaluating the current applications of DL in BE diagnosis, encompassing tasks such as image segmentation and classification, as well as their potential impact and implications in real-world clinical settings. While the applications of DL in BE diagnosis exhibit promising results, they are not without challenges, such as dataset issues and the "black box" nature of models. We discuss these challenges in the concluding section. Essentially, while DL holds tremendous potential to revolutionize BE diagnosis, addressing these challenges is paramount to harnessing its full capacity and ensuring its widespread application in clinical practice.

Application of multiple-finding segmentation utilizing Mask R-CNN-based deep learning in a rat model of drug-induced liver injury

Drug-induced liver injury (DILI) presents significant diagnostic challenges, and recently artificial intelligence-based deep learning technology has been used to predict various hepatic findings. In this study, we trained a set of Mask R-CNN-based deep algorithms to learn and quantify typical toxicant induced-histopathological lesions, portal area, and connective tissue in Sprague Dawley rats. We compared a set of single-finding models (SFMs) and a combined multiple-finding model (MFM) for their ability to simultaneously detect, classify, and quantify multiple hepatic findings on rat liver slide images. All of the SFMs yielded mean average precision (mAP) values above 85%, suggesting that the models had been successfully established. The MFM showed better performance than the SFMs, with a total mAP value of 92.46%. We compared the model predictions for slide images with ground-truth annotations generated by an accredited pathologist. For the MFM, the overall and individual finding predictions were highly correlated with the annotated areas, with R-squared values of 0.852, 0.952, 0.999, 0.990, and 0.958 being obtained for portal area, infiltration, necrosis, vacuolation, and connective tissue (including fibrosis), respectively. Our results indicate that the proposed MFM could be a useful tool for detecting and predicting multiple hepatic findings in basic non-clinical study settings.

Banff Digital Pathology Working Group: Image Bank, Artificial Intelligence Algorithm, and Challenge Trial Developments

The Banff Digital Pathology Working Group (DPWG) was established with the goal to establish a digital pathology repository; develop, validate, and share models for image analysis; and foster collaborations using regular videoconferencing. During the calls, a variety of artificial intelligence (AI)-based support systems for transplantation pathology were presented. Potential collaborations in a competition/trial on AI applied to kidney transplant specimens, including the DIAGGRAFT challenge (staining of biopsies at multiple institutions, pathologists' visual assessment, and development and validation of new and pre-existing Banff scoring algorithms), were also discussed. To determine the next steps, a survey was conducted, primarily focusing on the feasibility of establishing a digital pathology repository and identifying potential hosts. Sixteen of the 35 respondents (46%) had access to a server hosting a digital pathology repository, with 2 respondents that could serve as a potential host at no cost to the DPWG. The 16 digital pathology repositories collected specimens from various organs, with the largest constituent being kidney (n = 12,870 specimens). A DPWG pilot digital pathology repository was established, and there are plans for a competition/trial with the DIAGGRAFT project. Utilizing existing resources and previously established models, the Banff DPWG is establishing new resources for the Banff community.

Artificial Intelligence in the Pathology of Gastric Cancer

Recent advances in artificial intelligence (AI) have provided novel tools for rapid and precise pathologic diagnosis. The introduction of digital pathology has enabled the acquisition of scanned slide images that are essential for the application of AI. The application of AI for improved pathologic diagnosis includes the error-free detection of potentially negligible lesions, such as a minute focus of metastatic tumor cells in lymph nodes, the accurate diagnosis of potentially controversial histologic findings, such as very well-differentiated carcinomas mimicking normal epithelial tissues, and the pathological subtyping of the cancers. Additionally, the utilization of AI algorithms enables the precise decision of the score of immunohistochemical markers for targeted therapies, such as human epidermal growth factor receptor 2 and programmed death-ligand 1. Studies have revealed that AI assistance can reduce the discordance of interpretation between pathologists and more accurately predict clinical outcomes. Several approaches have been employed to develop novel biomarkers from histologic images using AI. Moreover, AI-assisted analysis of the cancer microenvironment showed that the distribution of tumor-infiltrating lymphocytes was related to the response to the immune checkpoint inhibitor therapy, emphasizing its value as a biomarker. As numerous studies have demonstrated the significance of AI-assisted interpretation and biomarker development, the AI-based approach will advance diagnostic pathology.

Editorial on Special Issue "Artificial Intelligence in Pathological Image Analysis"

The artificial intelligence (AI), especially deep learning models, is highly compatible with medical images and natural language processing and is expected to be applied to pathological image analysis and other medical fields [...].