Training of computational algorithms to predict NAFLD activity score and fibrosis stage from liver histopathology slides

Digital pathology and spatial omics in steatohepatitis: Clinical applications and discovery potentials

Steatohepatitis with diverse etiologies is the most common histological manifestation in patients with liver disease. However, there are currently no specific histopathological features pathognomonic for metabolic dysfunction-associated steatotic liver disease, alcohol-associated liver disease, or metabolic dysfunction-associated steatotic liver disease with increased alcohol intake. Digitizing traditional pathology slides has created an emerging field of digital pathology, allowing for easier access, storage, sharing, and analysis of whole-slide images. Artificial intelligence (AI) algorithms have been developed for whole-slide images to enhance the accuracy and speed of the histological interpretation of steatohepatitis and are currently employed in biomarker development. Spatial biology is a novel field that enables investigators to map gene and protein expression within a specific region of interest on liver histological sections, examine disease heterogeneity within tissues, and understand the relationship between molecular changes and distinct tissue morphology. Here, we review the utility of digital pathology (using linear and nonlinear microscopy) augmented with AI analysis to improve the accuracy of histological interpretation. We will also discuss the spatial omics landscape with special emphasis on the strengths and limitations of established spatial transcriptomics and proteomics technologies and their application in steatohepatitis. We then highlight the power of multimodal integration of digital pathology augmented by machine learning (ML)algorithms with spatial biology. The review concludes with a discussion of the current gaps in knowledge, the limitations and premises of these tools and technologies, and the areas of future research.

Lymphocyte-Infiltrated Periportal Region Detection With Structurally-Refined Deep Portal Segmentation and Heterogeneous Infiltration Features

Goal: The early diagnosis and treatment of hepatitis is essential to reduce hepatitis-related liver function deterioration and mortality. One component of the widely-used Ishak grading system for the grading of periportal interface hepatitis is based on the percentage of portal borders infiltrated by lymphocytes. Thus, the accurate detection of lymphocyte-infiltrated periportal regions is critical in the diagnosis of hepatitis. However, the infiltrating lymphocytes usually result in the formation of ambiguous and highly-irregular portal boundaries, and thus identifying the infiltrated portal boundary regions precisely using automated methods is challenging. This study aims to develop a deep-learning-based automatic detection framework to assist diagnosis. Methods: The present study proposes a framework consisting of a Structurally-REfined Deep Portal Segmentation module and an Infiltrated Periportal Region Detection module based on heterogeneous infiltration features to accurately identify the infiltrated periportal regions in liver Whole Slide Images. Results: The proposed method achieves 0.725 in F1-score of lymphocyte-infiltrated periportal region detection. Moreover, the statistics of the ratio of the detected infiltrated portal boundary have high correlation to the Ishak grade (Spearman's correlations more than 0.87 with p-values less than 0.001) and medium correlation to the liver function index aspartate aminotransferase and alanine aminotransferase (Spearman's correlations more than 0.63 and 0.57 with p-values less than 0.001). Conclusions: The study shows the statistics of the ratio of infiltrated portal boundary have correlation to the Ishak grade and liver function index. The proposed framework provides pathologists with a useful and reliable tool for hepatitis diagnosis.

Artificial Intelligence in Liver Diseases: Recent Advances

Liver diseases cause a significant burden on public health worldwide. In spite of great advances during recent years, there are still many challenges in the diagnosis and treatment of liver diseases. During recent years, artificial intelligence (AI) has been widely used for the diagnosis, risk stratification, and prognostic prediction of various diseases based on clinical datasets and medical images. Accumulative studies have shown its performance for diagnosing patients with nonalcoholic fatty liver disease and liver fibrosis and assessing their severity, and for predicting treatment response and recurrence of hepatocellular carcinoma, outcomes of liver transplantation recipients, and risk of drug-induced liver injury. Herein, we aim to comprehensively summarize the current evidence regarding diagnostic, prognostic, and/or therapeutic role of AI in these common liver diseases.

Object detection: A novel AI technology for the diagnosis of hepatocyte ballooning

Metabolic dysfunction-associated fatty liver disease (MAFLD) has reached epidemic proportions worldwide and is the most frequent cause of chronic liver disease in developed countries. Within the spectrum of liver disease in MAFLD, steatohepatitis is a progressive form of liver disease and hepatocyte ballooning (HB) is a cardinal pathological feature of steatohepatitis. The accurate and reproducible diagnosis of HB is therefore critical for the early detection and treatment of steatohepatitis. Currently, a diagnosis of HB relies on pathological examination by expert pathologists, which may be a time-consuming and subjective process. Hence, there has been interest in developing automated methods for diagnosing HB. This narrative review briefly discusses the development of artificial intelligence (AI) technology for diagnosing fatty liver disease pathology over the last 30 years and provides an overview of the current research status of AI algorithms for the identification of HB, including published articles on traditional machine learning algorithms and deep learning algorithms. This narrative review also provides a summary of object detection algorithms, including the principles, historical developments, and applications in the medical image analysis. The potential benefits of object detection algorithms for HB diagnosis (specifically those combined with a transformer architecture) are discussed, along with the future directions of object detection algorithms in HB diagnosis and the potential applications of generative AI on transformer architecture in this field. In conclusion, object detection algorithms have huge potential for the identification of HB and could make the diagnosis of MAFLD more accurate and efficient in the near future.

Digital pathology for nonalcoholic steatohepatitis assessment

Histological assessment of nonalcoholic fatty liver disease (NAFLD) has anchored knowledge development about the phenotypes of the condition, their natural history and their clinical course. This fact has led to the use of histological assessment as a reference standard for the evaluation of efficacy of drug interventions for nonalcoholic steatohepatitis (NASH) - the more histologically active form of NAFLD. However, certain limitations of conventional histological assessment systems pose challenges in drug development. These limitations have spurred intense scientific and commercial development of machine learning and digital approaches towards the assessment of liver histology in patients with NAFLD. This research field remains an area in rapid evolution. In this Perspective article, we summarize the current conventional assessment of NASH and its limitations, the use of specific digital approaches for histological assessment, and their application to the study of NASH and its response to therapy. Although this is not a comprehensive review, the leading tools currently used to assess therapeutic efficacy in drug development are specifically discussed. The potential translation of these approaches to support routine clinical assessment of NAFLD and an agenda for future research are also discussed.

Fibrosis severity scoring on Sirius red histology with multiple-instance deep learning

Non-alcoholic fatty liver disease (NAFLD) is now the leading cause of chronic liver disease, affecting approximately 30% of people worldwide. Histopathology reading of fibrosis patterns is crucial to diagnosing NAFLD. In particular, separating mild from severe stages corresponds to a critical transition as it correlates with clinical outcomes. Deep Learning for digitized histopathology whole-slide images (WSIs) can reduce high inter- and intra-rater variability. We demonstrate a novel solution to score fibrosis severity on a retrospective cohort of 152 Sirius-Red WSIs, with fibrosis stage annotated at slide level by an expert pathologist. We exploit multiple instance learning and multiple-inferences to address the sparsity of pathological signs. We achieved an accuracy of , an F1 score of and an AUC of . These results set new state-of-the-art benchmarks for this application.

Setting up of a machine learning algorithm for the identification of severe liver fibrosis profile in the general US population cohort

BACKGROUND

The progress of digital transformation in clinical practice opens the door to transforming the current clinical line for liver disease diagnosis from a late-stage diagnosis approach to an early-stage based one. Early diagnosis of liver fibrosis can prevent the progression of the disease and decrease liver-related morbidity and mortality. We developed here a machine learning (ML) algorithm containing standard parameters that can identify liver fibrosis in the general US population.

MATERIALS AND METHODS

Starting from a public database (National Health and Nutrition Examination Survey, NHANES), representative of the American population with 7265 eligible subjects (control population n = 6828, with Fibroscan values E < 9.7 KPa; target population n = 437 with Fibroscan values E ≥ 9.7 KPa), we set up an SVM algorithm able to discriminate for individuals with liver fibrosis among the general US population. The algorithm set up involved the removal of missing data and a sampling optimization step to managing the data imbalance (only ∼ 5 % of the dataset is the target population).

RESULTS

For the feature selection, we performed an unbiased analysis, starting from 33 clinical, anthropometric, and biochemical parameters regardless of their previous application as biomarkers of liver diseases. Through PCA analysis, we identified the 26 more significant features and then used them to set up a sampling method on an SVM algorithm. The best sampling technique to manage the data imbalance was found to be oversampling through the SMOTE-NC. For final model validation, we utilized a subset of 300 individuals (150 with liver fibrosis and 150 controls), subtracted from the main dataset prior to sampling. Performances were evaluated on multiple independent runs.

CONCLUSIONS

We provide proof of concept of an ML clinical decision support tool for liver fibrosis diagnosis in the general US population. Though the presented ML model represents at this stage only a prototype, in the future, it might be implemented and potentially applied to program broad screenings for liver fibrosis.

Deep learning-based quantification of NAFLD/NASH progression in human liver biopsies

Non-alcoholic fatty liver disease (NAFLD) affects about 24% of the world's population. Progression of early stages of NAFLD can lead to the more advanced form non-alcoholic steatohepatitis (NASH), and ultimately to cirrhosis or liver cancer. The current gold standard for diagnosis and assessment of NAFLD/NASH is liver biopsy followed by microscopic analysis by a pathologist. The Kleiner score is frequently used for a semi-quantitative assessment of disease progression. In this scoring system the features of active injury (steatosis, inflammation, and ballooning) and a separated fibrosis score are quantified. The procedure is time consuming for pathologists, scores have limited resolution and are subject to variation. We developed an automated deep learning method that provides full reproducibility and higher resolution. The system was established with 296 human liver biopsies and tested on 171 human liver biopsies with pathologist ground truth scores. The method is inspired by the way pathologist's analyze liver biopsies. First, the biopsies are analyzed microscopically for the relevant histopathological features. Subsequently, histopathological features are aggregated to a per-biopsy score. Scores are in the identical numeric range as the pathologist's ballooning, inflammation, steatosis, and fibrosis scores, but on a continuous scale. Resulting scores followed a pathologist's ground truth (quadratic weighted Cohen's κ on the test set: for steatosis 0.66, for inflammation 0.24, for ballooning 0.43, for fibrosis 0.62, and for the NAFLD activity score (NAS) 0.52. Mean absolute errors on a test set: for steatosis 0.29, for inflammation 0.53, for ballooning 0.61, for fibrosis 0.78, and for the NAS 0.77).

Applications of artificial intelligence (AI) in researches on non-alcoholic fatty liver disease(NAFLD) : A systematic review

Non-alcoholic fatty liver disease (NAFLD) is one of the most important causes of chronic liver disease in the world, it has been found that cardiovascular and renal risks and diseases are also highly prevalent in adults with NAFLD. Diagnosis and treatment of NAFLD face many challenges, although the medical science has been very developed. Efficiency, accuracy and individualization are the main goals to be solved. Evaluation of the severity of NAFLD involves a variety of clinical parameters, how to optimize non-invasive evaluation methods is a necessary issue that needs to be discussed in this field. Artificial intelligence (AI) has become increasingly widespread in healthcare applications, and it has been also brought many new insights into better analyzing chronic liver disease, including NAFLD. This paper reviewed AI related researches in NAFLD field published recently, summarized diagnostic models based on electronic health record and lab test, ultrasound and radio imaging, and liver histopathological data, described the application of therapeutic models in personalized lifestyle guidance and the development of drugs for NAFLD. In addition, we also analyzed present AI models in distinguishing healthy VS NAFLD/NASH, and fibrosis VS non-fibrosis in the evaluation of NAFLD progression. We hope to provide alternative directions for the future research.

Application of artificial intelligence in non-alcoholic fatty liver disease and viral hepatitis

Non-alcoholic fatty liver disease (NAFLD) and chronic viral hepatitis are among the most significant causes of liver-related mortality worldwide. It is critical to develop reliable methods of predicting progression to fibrosis, cirrhosis, and decompensated liver disease. Current screening methods such as biopsy and transient elastography are limited by invasiveness and observer variation in analysis of data. Artificial intelligence (AI) provides a unique opportunity to more accurately diagnose NAFLD and viral hepatitis, and to identify patients at high risk for disease progression. We conducted a literature review of existing evidence for AI in NAFLD and viral hepatitis. Thirteen articles on AI in NAFLD and 14 on viral hepatitis were included in our analysis. We found that machine learning algorithms were comparable in accuracy to current methods for diagnosis and fibrosis prediction (MELD-Na score, liver biopsy, FIB-4 score, and biomarkers). They also reliably predicted hepatitis C treatment failure and hepatic encephalopathy, for which there are currently no established prediction tools. These studies show that AI could be a helpful adjunct to existing techniques for diagnosing, monitoring, and treating both NAFLD and viral hepatitis.

[Histopathological evaluation of nonalcoholic fatty liver disease : Automated evaluation of liver biopsies]

Nonalcoholic fatty liver disease (NAFLD) is one of the most frequent chronic liver diseases with a rising incidence in industrial countries. This is accompanied by an increased prevalence for NAFLD-associated liver cirrhosis and an increased risk for developing hepatocellular carcinoma. The current gold standard in the diagnostics is a liver biopsy. The histopathological evaluation is performed through semiquantitative scoring. To optimize the standardization and quantification of the existing scoring systems, in the coming years procedures with artificial intelligence, such as deep learning models could be used. Fields of application could be the supplementation of conventional histopathological diagnostics, the identification of new predictive parameters for estimating the prognosis and the prediction of a possible response to treatment.

Artificial intelligence in liver diseases: improving diagnostics, prognostics and response prediction

Clinical routine in hepatology involves the diagnosis and treatment of a wide spectrum of metabolic, infectious, autoimmune and neoplastic diseases. Clinicians integrate qualitative and quantitative information from multiple data sources to make a diagnosis, prognosticate the disease course, and recommend a treatment. In the last 5 years, advances in artificial intelligence (AI), particularly in deep learning, have made it possible to extract clinically relevant information from complex and diverse clinical datasets. In particular, histopathology and radiology image data contain diagnostic, prognostic and predictive information which AI can extract. Ultimately, such AI systems could be implemented in clinical routine as decision support tools. However, in the context of hepatology, this requires further large-scale clinical validation and regulatory approval. Herein, we summarise the state of the art in AI in hepatology with a particular focus on histopathology and radiology data. We present a roadmap for the further development of novel biomarkers in hepatology and outline critical obstacles which need to be overcome.

Development and validation of a neural network for NAFLD diagnosis

Non-Alcoholic Fatty Liver Disease (NAFLD) affects about 20–30% of the adult population in developed countries and is an increasingly important cause of hepatocellular carcinoma. Liver ultrasound (US) is widely used as a noninvasive method to diagnose NAFLD. However, the intensive use of US is not cost-effective and increases the burden on the healthcare system. Electronic medical records facilitate large-scale epidemiological studies and, existing NAFLD scores often require clinical and anthropometric parameters that may not be captured in those databases. Our goal was to develop and validate a simple Neural Network (NN)-based web app that could be used to predict NAFLD particularly its absence. The study included 2970 subjects; training and testing of the neural network using a train–test-split approach was done on 2869 of them. From another population consisting of 2301 subjects, a further 100 subjects were randomly extracted to test the web app. A search was made to find the best parameters for the NN and then this NN was exported for incorporation into a local web app. The percentage of accuracy, area under the ROC curve, confusion matrix, Positive (PPV) and Negative Predicted Value (NPV) values, precision, recall and f1-score were verified. After that, Explainability (XAI) was analyzed to understand the diagnostic reasoning of the NN. Finally, in the local web app, the specificity and sensitivity values were checked. The NN achieved a percentage of accuracy during testing of 77.0%, with an area under the ROC curve value of 0.82. Thus, in the web app the NN evidenced to achieve good results, with a specificity of 1.00 and sensitivity of 0.73. The described approach can be used to support NAFLD diagnosis, reducing healthcare costs. The NN-based web app is easy to apply and the required parameters are easily found in healthcare databases.