Clinical Validation of Artificial Intelligence-Augmented Pathology Diagnosis Demonstrates Significant Gains in Diagnostic Accuracy in Prostate Cancer Detection

A foundation model for clinical-grade computational pathology and rare cancers detection

The analysis of histopathology images with artificial intelligence aims to enable clinical decision support systems and precision medicine. The success of such applications depends on the ability to model the diverse patterns observed in pathology images. To this end, we present Virchow, the largest foundation model for computational pathology to date. In addition to the evaluation of biomarker prediction and cell identification, we demonstrate that a large foundation model enables pan-cancer detection, achieving 0.95 specimen-level area under the (receiver operating characteristic) curve across nine common and seven rare cancers. Furthermore, we show that with less training data, the pan-cancer detector built on Virchow can achieve similar performance to tissue-specific clinical-grade models in production and outperform them on some rare variants of cancer. Virchow's performance gains highlight the value of a foundation model and open possibilities for many high-impact applications with limited amounts of labeled training data.

Evaluation of AI-based Gleason grading algorithms "in the wild"

The biopsy Gleason score is an important prognostic marker for prostate cancer patients. It is, however, subject to substantial variability among pathologists. Artificial intelligence (AI)-based algorithms employing deep learning have shown their ability to match pathologists' performance in assigning Gleason scores, with the potential to enhance pathologists' grading accuracy. The performance of Gleason AI algorithms in research is mostly reported on common benchmark datasets or within public challenges. In contrast, many commercial algorithms are evaluated in clinical studies, for which data is not publicly released. As commercial AI vendors typically do not publish performance on public benchmarks, comparison between research and commercial AI is difficult. The aim of this study is to evaluate and compare the performance of top-ranked public and commercial algorithms using real-world data. We curated a diverse dataset of whole-slide prostate biopsy images through crowdsourcing, containing images with a range of Gleason scores and from diverse sources. Predictions were obtained from five top-ranked public algorithms from the PANDA challenge and from two commercial Gleason grading algorithms. Additionally, ten pathologists evaluated the data set in a reader study. Overall, the pairwise quadratic weighted kappa among pathologists ranged from 0.777 to 0.916. Both public and commercial algorithms showed high agreement with pathologists, with quadratic kappa ranging from 0.617 to 0.900. Commercial algorithms performed on par or outperformed top public algorithms.

Patient-Specific, Mechanistic Models of Tumor Growth Incorporating Artificial Intelligence and Big Data

Despite the remarkable advances in cancer diagnosis, treatment, and management over the past decade, malignant tumors remain a major public health problem. Further progress in combating cancer may be enabled by personalizing the delivery of therapies according to the predicted response for each individual patient. The design of personalized therapies requires the integration of patient-specific information with an appropriate mathematical model of tumor response. A fundamental barrier to realizing this paradigm is the current lack of a rigorous yet practical mathematical theory of tumor initiation, development, invasion, and response to therapy. We begin this review with an overview of different approaches to modeling tumor growth and treatment, including mechanistic as well as data-driven models based on big data and artificial intelligence. We then present illustrative examples of mathematical models manifesting their utility and discuss the limitations of stand-alone mechanistic and data-driven models. We then discuss the potential of mechanistic models for not only predicting but also optimizing response to therapy on a patient-specific basis. We describe current efforts and future possibilities to integrate mechanistic and data-driven models. We conclude by proposing five fundamental challenges that must be addressed to fully realize personalized care for cancer patients driven by computational models.

Artificial Intelligence Helps Pathologists Increase Diagnostic Accuracy and Efficiency in the Detection of Breast Cancer Lymph Node Metastases

The detection of lymph node metastases is essential for breast cancer staging, although it is a tedious and time-consuming task where the sensitivity of pathologists is suboptimal. Artificial intelligence (AI) can help pathologists detect lymph node metastases, which could help alleviate workload issues. We studied how pathologists' performance varied when aided by AI. An AI algorithm was trained using more than 32 000 breast sentinel lymph node whole slide images (WSIs) matched with their corresponding pathology reports from more than 8000 patients. The algorithm highlighted areas suspicious of harboring metastasis. Three pathologists were asked to review a dataset comprising 167 breast sentinel lymph node WSIs, of which 69 harbored cancer metastases of different sizes, enriched for challenging cases. Ninety-eight slides were benign. The pathologists read the dataset twice, both digitally, with and without AI assistance, randomized for slide and reading orders to reduce bias, separated by a 3-week washout period. Their slide-level diagnosis was recorded, and they were timed during their reads. The average reading time per slide was 129 seconds during the unassisted phase versus 58 seconds during the AI-assisted phase, resulting in an overall efficiency gain of 55% ( P <0.001). These efficiency gains are applied to both benign and malignant WSIs. Two of the 3 reading pathologists experienced significant sensitivity improvements, from 74.5% to 93.5% ( P ≤0.006). This study highlights that AI can help pathologists shorten their reading times by more than half and also improve their metastasis detection rate.

Computer-assisted urine cytology: Faster, cheaper, better?

Recent advancements in computer-assisted diagnosis (CAD) have catalysed significant progress in pathology, particularly in the realm of urine cytopathology. This review synthesizes the latest developments and challenges in CAD for diagnosing urothelial carcinomas, addressing the limitations of traditional urinary cytology. Through a literature review, we identify and analyse CAD models and algorithms developed for urine cytopathology, highlighting their methodologies and performance metrics. We discuss the potential of CAD to improve diagnostic accuracy, efficiency and patient outcomes, emphasizing its role in streamlining workflow and reducing errors. Furthermore, CAD tools have shown potential in exploring pathological conditions, uncovering novel biomarkers and prognostic/predictive features previously unknown or unseen. Finally, we examine the practical issues surrounding the integration of CAD into clinical practice, including regulatory approval, validation and training for pathologists. Despite the promising results, challenges remain, necessitating further research and validation efforts. Overall, CAD presents a transformative opportunity to revolutionize diagnostic practices in urine cytopathology, paving the way for enhanced patient care and outcomes.

Applications of Artificial Intelligence in Prostate Cancer Care: A Path to Enhanced Efficiency and Outcomes

The landscape of prostate cancer care has rapidly evolved. We have transitioned from the use of conventional imaging, radical surgeries, and single-agent androgen deprivation therapy to an era of advanced imaging, precision diagnostics, genomics, and targeted treatment options. Concurrently, the emergence of large language models (LLMs) has dramatically transformed the paradigm for artificial intelligence (AI). This convergence of advancements in prostate cancer management and AI provides a compelling rationale to comprehensively review the current state of AI applications in prostate cancer care. Here, we review the advancements in AI-driven applications across the continuum of the journey of a patient with prostate cancer from early interception to survivorship care. We subsequently discuss the role of AI in prostate cancer drug discovery, clinical trials, and clinical practice guidelines. In the localized disease setting, deep learning models demonstrated impressive performance in detecting and grading prostate cancer using imaging and pathology data. For biochemically recurrent diseases, machine learning approaches are being tested for improved risk stratification and treatment decisions. In advanced prostate cancer, deep learning can potentially improve prognostication and assist in clinical decision making. Furthermore, LLMs are poised to revolutionize information summarization and extraction, clinical trial design and operations, drug development, evidence synthesis, and clinical practice guidelines. Synergistic integration of multimodal data integration and human-AI integration are emerging as a key strategy to unlock the full potential of AI in prostate cancer care.

Effectiveness and Cost-effectiveness of Artificial Intelligence-assisted Pathology for Prostate Cancer Diagnosis in Sweden: A Microsimulation Study

BACKGROUND AND OBJECTIVE

Image-based artificial intelligence (AI) methods have shown high accuracy in prostate cancer (PCa) detection. Their impact on patient outcomes and cost effectiveness in comparison to human pathologists remains unknown. Our aim was to evaluate the effectiveness and cost-effectiveness of AI-assisted pathology for PCa diagnosis in Sweden.

METHODS

We modeled quadrennial prostate-specific antigen (PSA) screening for men between the ages of 50 and 74 yr over a lifetime horizon using a health care perspective. Men with PSA ≥3 ng/ml were referred for standard biopsy (SBx), for which cores were either examined via AI followed by a pathologist for AI-labeled positive cores, or a pathologist alone. The AI performance characteristics were estimated using an internal STHLM3 validation data set. Outcome measures included the number of tests, PCa incidence and mortality, overdiagnosis, quality-adjusted life years (QALYs), and the potential reduction in pathologist-evaluated biopsy cores if AI were used. Cost-effectiveness was assessed using the incremental cost-effectiveness ratio.

KEY FINDINGS AND LIMITATIONS

In comparison to a pathologist alone, the AI-assisted workflow increased the number of PSA tests, SBx procedures, and PCa deaths by ≤0.03%, and slightly reduced PCa incidence and overdiagnosis. AI would reduce the proportion of biopsy cores evaluated by a pathologist by 80%. At a cost of €10 per case, the AI-assisted workflow would cost less and result in <0.001% lower QALYs in comparison to a pathologist alone. The results were sensitive to the AI cost.

CONCLUSIONS AND CLINICAL IMPLICATIONS

According to our model, AI-assisted pathology would significantly decrease the workload of pathologists, would not affect patient quality of life, and would yield cost savings in Sweden when compared to a human pathologist alone.

PATIENT SUMMARY

We compared outcomes for prostate cancer patients and relevant costs for two methods of assessing prostate biopsies in Sweden: (1) artificial intelligence (AI) technology and review of positive biopsies by a human pathologist; and (2) a human pathologist alone for all biopsies. We found that addition of AI would reduce the pathology workload and save money, and would not affect patient outcomes when compared to a human pathologist alone. The results suggest that adding AI to prostate pathology in Sweden would save costs.

Early Breast Cancer Risk Assessment: Integrating Histopathology with Artificial Intelligence

Effective risk assessment in early breast cancer is essential for informed clinical decision-making, yet consensus on defining risk categories remains challenging. This paper explores evolving approaches in risk stratification, encompassing histopathological, immunohistochemical, and molecular biomarkers alongside cutting-edge artificial intelligence (AI) techniques. Leveraging machine learning, deep learning, and convolutional neural networks, AI is reshaping predictive algorithms for recurrence risk, thereby revolutionizing diagnostic accuracy and treatment planning. Beyond detection, AI applications extend to histological subtyping, grading, lymph node assessment, and molecular feature identification, fostering personalized therapy decisions. With rising cancer rates, it is crucial to implement AI to accelerate breakthroughs in clinical practice, benefiting both patients and healthcare providers. However, it is important to recognize that while AI offers powerful automation and analysis tools, it lacks the nuanced understanding, clinical context, and ethical considerations inherent to human pathologists in patient care. Hence, the successful integration of AI into clinical practice demands collaborative efforts between medical experts and computational pathologists to optimize patient outcomes.

[Artificial intelligence for pathology-how, where, and why?]

Artificial intelligence promises many innovations and simplifications in pathology, but also raises just as many questions and uncertainties. In this article, we provide a brief overview of the current status, the goals already achieved by existing algorithms, and the remaining challenges.

Clinical Validation of Artificial Intelligence-Powered PD-L1 Tumor Proportion Score Interpretation for Immune Checkpoint Inhibitor Response Prediction in Non-Small Cell Lung Cancer

PURPOSE

Evaluation of PD-L1 tumor proportion score (TPS) by pathologists has been very impactful but is limited by factors such as intraobserver/interobserver bias and intratumor heterogeneity. We developed an artificial intelligence (AI)-powered analyzer to assess TPS for the prediction of immune checkpoint inhibitor (ICI) response in advanced non-small cell lung cancer (NSCLC).

MATERIALS AND METHODS

The AI analyzer was trained with 393,565 tumor cells annotated by board-certified pathologists for PD-L1 expression in 802 whole-slide images (WSIs) stained by 22C3 pharmDx immunohistochemistry. The clinical performance of the analyzer was validated in an external cohort of 430 WSIs from patients with NSCLC. Three pathologists performed annotations of this external cohort, and their consensus TPS was compared with AI-based TPS.

RESULTS

In comparing PD-L1 TPS assessed by AI analyzer and by pathologists, a significant positive correlation was observed (Spearman coefficient = 0.925; P < .001). The concordance of TPS between AI analyzer and pathologists according to TPS ≥50%, 1%-49%, and <1% was 85.7%, 89.3%, and 52.4%, respectively. In median progression-free survival (PFS), AI-based TPS predicted prognosis in the TPS 1%-49% or TPS <1% group better than the pathologist's reading, with the TPS ≥50% group as a reference (hazard ratio [HR], 1.49 [95% CI, 1.19 to 1.86] v HR, 1.36 [95% CI, 1.08 to 1.71] for TPS 1%-49% group, and HR, 2.38 [95% CI, 1.69 to 3.35] v HR, 1.62 [95% CI, 1.23 to 2.13] for TPS <1% group).

CONCLUSION

PD-L1 TPS assessed by AI analyzer correlates with that of pathologists, with clinical performance also being comparable when referenced to PFS. The AI model can accurately predict tumor response and PFS of ICI in advanced NSCLC via assessment of PD-L1 TPS.

Harnessing artificial intelligence for prostate cancer management

Prostate cancer (PCa) is a common malignancy in males. The pathology review of PCa is crucial for clinical decision-making, but traditional pathology review is labor intensive and subjective to some extent. Digital pathology and whole-slide imaging enable the application of artificial intelligence (AI) in pathology. This review highlights the success of AI in detecting and grading PCa, predicting patient outcomes, and identifying molecular subtypes. We propose that AI-based methods could collaborate with pathologists to reduce workload and assist clinicians in formulating treatment recommendations. We also introduce the general process and challenges in developing AI pathology models for PCa. Importantly, we summarize publicly available datasets and open-source codes to facilitate the utilization of existing data and the comparison of the performance of different models to improve future studies.

Artificial Intelligence-Enabled Prostate Cancer Diagnosis and Prognosis: Current State and Future Implications

In this modern era of digital pathology, artificial intelligence (AI)-based diagnostics for prostate cancer has become a hot topic. Multiple retrospective studies have demonstrated the benefits of AI-based diagnostic solutions for prostate cancer that includes improved prostate cancer detection, quantification, grading, interobserver concordance, cost and time savings, and a potential to reduce pathologists' workload and enhance pathology laboratory workflow. One of the major milestones is the Food and Drug Administration approval of Paige prostate AI for a second review of prostate cancer diagnosed using core needle biopsies. However, implementation of these AI tools for routine prostate cancer diagnostics is still lacking. Some of the limiting factors include costly digital pathology workflow, lack of regulatory guidelines for deployment of AI, and lack of prospective studies demonstrating the actual benefits of AI algorithms. Apart from diagnosis, AI algorithms have the potential to uncover novel insights into understanding the biology of prostate cancer and enable better risk stratification, and prognostication. This article includes an in-depth review of the current state of AI for prostate cancer diagnosis and highlights the future prospects of AI in prostate pathology for improved patient care.

Placental differences between severe fetal growth restriction and hypertensive disorders of pregnancy requiring early preterm delivery: morphometric analysis of the villous tree supported by artificial intelligence

BACKGROUND

The great obstetrical syndromes of fetal growth restriction and hypertensive disorders of pregnancy can occur individually or be interrelated. Placental pathologic findings often overlap between these conditions, regardless of whether 1 or both diagnoses are present. Quantification of placental villous structures in each of these settings may identify distinct differences in developmental pathways.

OBJECTIVE

This study aimed to determine how the quantity and surface area of placental villi and vessels differ between severe, early-onset fetal growth restriction with absent or reversed umbilical artery Doppler indices and hypertensive disorders of pregnancy or the 2 conditions combined among subjects with disease severity that warrant early preterm delivery. We hypothesized that the trajectories of placental morphogenesis diverge after a common initiating insult of deep defective placentation. Specifically, we postulated that only villi are affected in pregnancy-related hypertension, whereas both villous and vascular structures are proportionally diminished in severe fetal growth restriction with no additional effect when hypertension is concomitantly present.

STUDY DESIGN

In this retrospective cohort study, paraffin-embedded placental tissue was obtained from 4 groups, namely (1) patients with severe fetal growth restriction with absent or reversed umbilical artery end-diastolic velocities and hypertensive disorders of pregnancy, (2) patients with severe fetal growth restriction with absent or reversed umbilical artery Doppler indices and no hypertension, (3) gestational age-matched, appropriately grown pregnancies with hypertensive disease, and (4) gestational age-matched, appropriately grown pregnancies without hypertension. Dual immunohistochemistry for cytokeratin-7 (trophoblast) and CD34 (endothelial cells) was performed, followed by artificial intelligence-driven morphometric analyses. The number of villi, total villous area, number of fetoplacental vessels, and total vascular area across villi within a uniform region of interest were quantified. Quantitative analyses of placental structures were modeled using linear regression.

RESULTS

Placentas from pregnancies complicated by hypertensive disorders of pregnancy exhibited significantly fewer stem villi (-282 stem villi; 95% confidence interval, -467 to -98; P<.01), a smaller stem villous area (-4.3 mm2; 95% confidence interval, -7.3 to -1.2; P<.01), and fewer stem villous vessels (-4967 stem villous vessels; 95% confidence interval, -8501 to -1433; P<.01) with no difference in the total vascular area. In contrast, placental abnormalities in cases with severe growth restriction were limited to terminal villi with global decreases in the number of villi (-873 terminal villi; 95% confidence interval, -1501 to -246; P<.01), the villous area (-1.5 mm2; 95% confidence interval, -2.7 to -0.4; P<.01), the number of blood vessels (-5165 terminal villous vessels; 95% confidence interval, -8201 to -2128; P<.01), and the vascular area (-0.6 mm2; 95% confidence interval, -1.1 to -0.1; P=.02). The combination of hypertension and growth restriction had no additional effect beyond the individual impact of each state.

CONCLUSION

Pregnancies complicated by hypertensive disorders of pregnancy exhibited defects in the stem villi only, whereas placental abnormalities in severely growth restricted pregnancies with absent or reversed umbilical artery end-diastolic velocities were limited to the terminal villi. There were no significant statistical interactions in the combination of growth restriction and hypertension, suggesting that distinct pathophysiological pathways downstream of the initial insult of defective placentation are involved in each entity and do not synergize to lead to more severe pathologic consequences. Delineating mechanisms that underly the divergence in placental development after a common inciting event of defective deep placentation may shed light on new targets for prevention or treatment.

Augmented interpretation of HER2, ER, and PR in breast cancer by artificial intelligence analyzer: enhancing interobserver agreement through a reader study of 201 cases

BACKGROUND

Accurate classification of breast cancer molecular subtypes is crucial in determining treatment strategies and predicting clinical outcomes. This classification largely depends on the assessment of human epidermal growth factor receptor 2 (HER2), estrogen receptor (ER), and progesterone receptor (PR) status. However, variability in interpretation among pathologists pose challenges to the accuracy of this classification. This study evaluates the role of artificial intelligence (AI) in enhancing the consistency of these evaluations.

METHODS

AI-powered HER2 and ER/PR analyzers, consisting of cell and tissue models, were developed using 1,259 HER2, 744 ER, and 466 PR-stained immunohistochemistry (IHC) whole-slide images of breast cancer. External validation cohort comprising HER2, ER, and PR IHCs of 201 breast cancer cases were analyzed with these AI-powered analyzers. Three board-certified pathologists independently assessed these cases without AI annotation. Then, cases with differing interpretations between pathologists and the AI analyzer were revisited with AI assistance, focusing on evaluating the influence of AI assistance on the concordance among pathologists during the revised evaluation compared to the initial assessment.

RESULTS

Reevaluation was required in 61 (30.3%), 42 (20.9%), and 80 (39.8%) of HER2, in 15 (7.5%), 17 (8.5%), and 11 (5.5%) of ER, and in 26 (12.9%), 24 (11.9%), and 28 (13.9%) of PR evaluations by the pathologists, respectively. Compared to initial interpretations, the assistance of AI led to a notable increase in the agreement among three pathologists on the status of HER2 (from 49.3 to 74.1%, p < 0.001), ER (from 93.0 to 96.5%, p = 0.096), and PR (from 84.6 to 91.5%, p = 0.006). This improvement was especially evident in cases of HER2 2+ and 1+, where the concordance significantly increased from 46.2 to 68.4% and from 26.5 to 70.7%, respectively. Consequently, a refinement in the classification of breast cancer molecular subtypes (from 58.2 to 78.6%, p < 0.001) was achieved with AI assistance.

CONCLUSIONS

This study underscores the significant role of AI analyzers in improving pathologists' concordance in the classification of breast cancer molecular subtypes.

Advances in radiology and pathology of prostate cancer: a review for the pathologist

Multiparametric magnetic resonance imaging (mpMRI) has improved systematic prostate biopsy procedures in the diagnosis of clinically significant prostate cancer (csPCa) by reducing the number of unnecessary biopsies; numerous level one evidence studies have confirmed the accuracy of MRI-targeted biopsy, but, still today, systematic prostate biopsy is recommended to reduce the 15-20% false negative rate of mpMRI. New advanced imaging has been proposed to detect suspicious lesions and perform targeted biopsies especially when mpMRI cannot be performed. Transrectal ultrasound (TRUS) modalities are emerging as methods with greater sensitivity and specificity for the detection of PCa compared to the traditional TRUS; these techniques include elastography and contrast-enhanced ultrasound, as well as improved B-mode and Doppler techniques. These modalities can be combined to define a novel ultrasound approach: multiparametric ultrasound (mpUS). More recently, micro-ultrasound (MicroUS) and prostate-specific membrane antigen (PSMA) positron emission tomography/computed tomography (PET/CT) have demonstrated to be sensitive for the detection of primary prostatic lesions resulting highly correlated with the aggressiveness of the primary prostatic tumor. In parallel, artificial intelligence is advancing and is set out to deeply change both radiology and pathology. In this study we address the role, advantages and shortcomings of novel imaging techniques for Pca, and discuss future directions including the applications of artificial intelligence-based techniques to imaging as well as histology. The significance of these findings for the practicing pathologist is discussed.

Why do errors arise in artificial intelligence diagnostic tools in histopathology and how can we minimize them?

Artificial intelligence (AI)-based diagnostic tools can offer numerous benefits to the field of histopathology, including improved diagnostic accuracy, efficiency and productivity. As a result, such tools are likely to have an increasing role in routine practice. However, all AI tools are prone to errors, and these AI-associated errors have been identified as a major risk in the introduction of AI into healthcare. The errors made by AI tools are different, in terms of both cause and nature, to the errors made by human pathologists. As highlighted by the National Institute for Health and Care Excellence, it is imperative that practising pathologists understand the potential limitations of AI tools, including the errors made. Pathologists are in a unique position to be gatekeepers of AI tool use, maximizing patient benefit while minimizing harm. Furthermore, their pathological knowledge is essential to understanding when, and why, errors have occurred and so to developing safer future algorithms. This paper summarises the literature on errors made by AI diagnostic tools in histopathology. These include erroneous errors, data concerns (data bias, hidden stratification, data imbalances, distributional shift, and lack of generalisability), reinforcement of outdated practices, unsafe failure mode, automation bias, and insensitivity to impact. Methods to reduce errors in both tool design and clinical use are discussed, and the practical roles for pathologists in error minimisation are highlighted. This aims to inform and empower pathologists to move safely through this seismic change in practice and help ensure that novel AI tools are adopted safely.

Pathologist-trained machine learning classifiers developed to quantitate celiac disease features differentiate endoscopic biopsies according to modified marsh score and dietary intervention response

BACKGROUND

Histologic evaluation of the mucosal changes associated with celiac disease is important for establishing an accurate diagnosis and monitoring the impact of investigational therapies. While the Marsh-Oberhuber classification has been used to categorize the histologic findings into discrete stages (i.e., Type 0-3c), significant variability has been documented between observers using this ordinal scoring system. Therefore, we evaluated whether pathologist-trained machine learning classifiers can be developed to objectively quantitate the pathological changes of villus blunting, intraepithelial lymphocytosis, and crypt hyperplasia in small intestine endoscopic biopsies.

METHODS

A convolutional neural network (CNN) was trained and combined with a secondary algorithm to quantitate intraepithelial lymphocytes (IEL) with 5 classes on CD3 immunohistochemistry whole slide images (WSI) and used to correlate feature outputs with ground truth modified Marsh scores in a total of 116 small intestine biopsies.

RESULTS

Across all samples, median %CD3 counts (positive cells/enterocytes) from villous epithelium (VE) increased with higher Marsh scores (Type 0%CD3 VE = 13.4; Type 1-3%CD3 VE = 41.9, p < 0.0001). Indicators of villus blunting and crypt hyperplasia were also observed (Type 0-2 villous epithelium/lamina propria area ratio = 0.81; Type 3a-3c villous epithelium/lamina propria area ratio = 0.29, p < 0.0001), and Type 0-1 crypt/villous epithelial area ratio = 0.59; Type 2-3 crypt/villous epithelial area ratio = 1.64, p < 0.0001). Using these individual features, a combined feature machine learning score (MLS) was created to evaluate a set of 28 matched pre- and post-intervention biopsies captured before and after dietary gluten restriction. The disposition of the continuous MLS paired biopsy result aligned with the Marsh score in 96.4% (27/28) of the cohort.

CONCLUSIONS

Machine learning classifiers can be developed to objectively quantify histologic features and capture additional data not achievable with manual scoring. Such approaches should be further investigated to improve biopsy evaluation, especially for clinical trials.

Translation of tissue-based artificial intelligence into clinical practice: from discovery to adoption

Digital pathology (DP), or the digitization of pathology images, has transformed oncology research and cancer diagnostics. The application of artificial intelligence (AI) and other forms of machine learning (ML) to these images allows for better interpretation of morphology, improved quantitation of biomarkers, introduction of novel concepts to discovery and diagnostics (such as spatial distribution of cellular elements), and the promise of a new paradigm of cancer biomarkers. The application of AI to tissue analysis can take several conceptual approaches, within the domains of language modelling and image analysis, such as Deep Learning Convolutional Neural Networks, Multiple Instance Learning approaches, or the modelling of risk scores and their application to ML. The use of different approaches solves different problems within pathology workflows, including assistive applications for the detection and grading of tumours, quantification of biomarkers, and the delivery of established and new image-based biomarkers for treatment prediction and prognostic purposes. All these AI formats, applied to digital tissue images, are also beginning to transform our approach to clinical trials. In parallel, the novelty of DP/AI devices and the related computational science pipeline introduces new requirements for manufacturers to build into their design, development, regulatory and post-market processes, which may need to be taken into account when using AI applied to tissues in cancer discovery. Finally, DP/AI represents challenge to the way we accredit new diagnostic tools with clinical applicability, the understanding of which will allow cancer patients to have access to a new generation of complex biomarkers.

Artificial intelligence in ovarian cancer histopathology: a systematic review

This study evaluates the quality of published research using artificial intelligence (AI) for ovarian cancer diagnosis or prognosis using histopathology data. A systematic search of PubMed, Scopus, Web of Science, Cochrane CENTRAL, and WHO-ICTRP was conducted up to May 19, 2023. Inclusion criteria required that AI was used for prognostic or diagnostic inferences in human ovarian cancer histopathology images. Risk of bias was assessed using PROBAST. Information about each model was tabulated and summary statistics were reported. The study was registered on PROSPERO (CRD42022334730) and PRISMA 2020 reporting guidelines were followed. Searches identified 1573 records, of which 45 were eligible for inclusion. These studies contained 80 models of interest, including 37 diagnostic models, 22 prognostic models, and 21 other diagnostically relevant models. Common tasks included treatment response prediction (11/80), malignancy status classification (10/80), stain quantification (9/80), and histological subtyping (7/80). Models were developed using 1-1375 histopathology slides from 1-776 ovarian cancer patients. A high or unclear risk of bias was found in all studies, most frequently due to limited analysis and incomplete reporting regarding participant recruitment. Limited research has been conducted on the application of AI to histopathology images for diagnostic or prognostic purposes in ovarian cancer, and none of the models have been demonstrated to be ready for real-world implementation. Key aspects to accelerate clinical translation include transparent and comprehensive reporting of data provenance and modelling approaches, and improved quantitative evaluation using cross-validation and external validations. This work was funded by the Engineering and Physical Sciences Research Council.

Deep Learning Methodologies Applied to Digital Pathology in Prostate Cancer: A Systematic Review

Deep learning (DL), often called artificial intelligence (AI), has been increasingly used in Pathology thanks to the use of scanners to digitize slides which allow us to visualize them on monitors and process them with AI algorithms. Many articles have focused on DL applied to prostate cancer (PCa). This systematic review explains the DL applications and their performances for PCa in digital pathology. Article research was performed using PubMed and Embase to collect relevant articles. A Risk of Bias (RoB) was assessed with an adaptation of the QUADAS-2 tool. Out of the 77 included studies, eight focused on pre-processing tasks such as quality assessment or staining normalization. Most articles (n = 53) focused on diagnosis tasks like cancer detection or Gleason grading. Fifteen articles focused on prediction tasks, such as recurrence prediction or genomic correlations. Best performances were reached for cancer detection with an Area Under the Curve (AUC) up to 0.99 with algorithms already available for routine diagnosis. A few biases outlined by the RoB analysis are often found in these articles, such as the lack of external validation. This review was registered on PROSPERO under CRD42023418661.

Application of digital pathology-based advanced analytics of tumour microenvironment organisation to predict prognosis and therapeutic response

In recent years, the application of advanced analytics, especially artificial intelligence (AI), to digital H&E images, and other histological image types, has begun to radically change how histological images are used in the clinic. Alongside the recognition that the tumour microenvironment (TME) has a profound impact on tumour phenotype, the technical development of highly multiplexed immunofluorescence platforms has enhanced the biological complexity that can be captured in the TME with high precision. AI has an increasingly powerful role in the recognition and quantitation of image features and the association of such features with clinically important outcomes, as occurs in distinct stages in conventional machine learning. Deep-learning algorithms are able to elucidate TME patterns inherent in the input data with minimum levels of human intelligence and, hence, have the potential to achieve clinically relevant predictions and discovery of important TME features. Furthermore, the diverse repertoire of deep-learning algorithms able to interrogate TME patterns extends beyond convolutional neural networks to include attention-based models, graph neural networks, and multimodal models. To date, AI models have largely been evaluated retrospectively, outside the well-established rigour of prospective clinical trials, in part because traditional clinical trial methodology may not always be suitable for the assessment of AI technology. However, to enable digital pathology-based advanced analytics to meaningfully impact clinical care, specific measures of 'added benefit' to the current standard of care and validation in a prospective setting are important. This will need to be accompanied by adequate measures of explainability and interpretability. Despite such challenges, the combination of expanding datasets, increased computational power, and the possibility of integration of pre-clinical experimental insights into model development means there is exciting potential for the future progress of these AI applications. © 2023 The Authors. The Journal of Pathology published by John Wiley & Sons Ltd on behalf of The Pathological Society of Great Britain and Ireland.

The slow-paced digital evolution of pathology: lights and shadows from a multifaceted board

Objective

The digital revolution in pathology represents an invaluable resource fto optimise costs, reduce the risk of error and improve patient care, even though it is still adopted in a minority of laboratories. Barriers include concerns about initial costs, lack of confidence in using whole slide images for primary diagnosis, and lack of guidance on transition. To address these challenges and develop a programme to facilitate the introduction of digital pathology (DP) in Italian pathology departments, a panel discussion was set up to identify the key points to be considered.

Methods

On 21 July 2022, an initial conference call was held on Zoom to identify the main issues to be discussed during the face-to-face meeting. The final summit was divided into four different sessions: (I) the definition of DP, (II) practical applications of DP, (III) the use of AI in DP, (IV) DP and education.

Results

Essential requirements for the implementation of DP are a fully tracked and automated workflow, selection of the appropriate scanner based on the specific needs of each department, and a strong commitment combined with coordinated teamwork (pathologists, technicians, biologists, IT service and industries). This could reduce human error, leading to the application of AI tools for diagnosis, prognosis and prediction. Open challenges are the lack of specific regulations for virtual slide storage and the optimal storage solution for large volumes of slides.

Conclusion

Teamwork is key to DP transition, including close collaboration with industry. This will ease the transition and help bridge the gap that currently exists between many labs and full digitisation. The ultimate goal is to improve patient care.

Diagnostic quality model (DQM): an integrated framework for the assessment of diagnostic quality when using AI/ML

BACKGROUND

Laboratory medicine has reached the era where promises of artificial intelligence and machine learning (AI/ML) seem palpable. Currently, the primary responsibility for risk-benefit assessment in clinical practice resides with the medical director. Unfortunately, there is no tool or concept that enables diagnostic quality assessment for the various potential AI/ML applications. Specifically, we noted that an operational definition of laboratory diagnostic quality - for the specific purpose of assessing AI/ML improvements - is currently missing.

METHODS

A session at the 3rd Strategic Conference of the European Federation of Laboratory Medicine in 2022 on "AI in the Laboratory of the Future" prompted an expert roundtable discussion. Here we present a conceptual diagnostic quality framework for the specific purpose of assessing AI/ML implementations.

RESULTS

The presented framework is termed diagnostic quality model (DQM) and distinguishes AI/ML improvements at the test, procedure, laboratory, or healthcare ecosystem level. The operational definition illustrates the nested relationship among these levels. The model can help to define relevant objectives for implementation and how levels come together to form coherent diagnostics. The affected levels are referred to as scope and we provide a rubric to quantify AI/ML improvements while complying with existing, mandated regulatory standards. We present 4 relevant clinical scenarios including multi-modal diagnostics and compare the model to existing quality management systems.

CONCLUSIONS

A diagnostic quality model is essential to navigate the complexities of clinical AI/ML implementations. The presented diagnostic quality framework can help to specify and communicate the key implications of AI/ML solutions in laboratory diagnostics.