Automatic detection of new tumors and tumor burden evaluation in longitudinal liver CT scan studies. Int J Comput Assist Radiol Surg. 2017;12:1945-1957. [PMID: 28856515 DOI: 10.1007/s11548-017-1660-z]

Artificial intelligence techniques in liver cancer

Hepatocellular Carcinoma (HCC), the most common primary liver cancer, is a significant contributor to worldwide cancer-related deaths. Various medical imaging techniques, including computed tomography, magnetic resonance imaging, and ultrasound, play a crucial role in accurately evaluating HCC and formulating effective treatment plans. Artificial Intelligence (AI) technologies have demonstrated potential in supporting physicians by providing more accurate and consistent medical diagnoses. Recent advancements have led to the development of AI-based multi-modal prediction systems. These systems integrate medical imaging with other modalities, such as electronic health record reports and clinical parameters, to enhance the accuracy of predicting biological characteristics and prognosis, including those associated with HCC. These multi-modal prediction systems pave the way for predicting the response to transarterial chemoembolization and microvascular invasion treatments and can assist clinicians in identifying the optimal patients with HCC who could benefit from interventional therapy. This paper provides an overview of the latest AI-based medical imaging models developed for diagnosing and predicting HCC. It also explores the challenges and potential future directions related to the clinical application of AI techniques.

Co-based Nanozymatic Profiling: Advances Spanning Chemistry, Biomedical, and Environmental Sciences

Nanozymes, next-generation enzyme-mimicking nanomaterials, have entered an era of rational design; among them, Co-based nanozymes have emerged as captivating players over times. Co-based nanozymes have been developed and have garnered significant attention over the past five years. Their extraordinary properties, including regulatable enzymatic activity, stability, and multifunctionality stemming from magnetic properties, photothermal conversion effects, cavitation effects, and relaxation efficiency, have made Co-based nanozymes a rising star. This review presents the first comprehensive profiling of the Co-based nanozymes in the chemistry, biology, and environmental sciences. The review begins by scrutinizing the various synthetic methods employed for Co-based nanozyme fabrication, such as template and sol-gel methods, highlighting their distinctive merits from a chemical standpoint. Furthermore, a detailed exploration of their wide-ranging applications in biosensing and biomedical therapeutics, as well as their contributions to environmental monitoring and remediation is provided. Notably, drawing inspiration from state-of-the-art techniques such as omics, a comprehensive analysis of Co-based nanozymes is undertaken, employing analogous statistical methodologies to provide valuable guidance. To conclude, a comprehensive outlook on the challenges and prospects for Co-based nanozymes is presented, spanning from microscopic physicochemical mechanisms to macroscopic clinical translational applications.

Identification of potential biomarkers for melanoma cancer (black tumor) using bioinformatics strategy: a study based on GEO and SRA datasets

Melanoma, a highly invasive type of skin cancer that penetrates the entire dermis layer, is associated with increased mortality rates. Excessive exposure of the skin to sunlight, specifically ultraviolet radiation, is the underlying cause of this malignant condition. The appearance of unique skin moles represents a visible clue, referred to as the "ugly duckling" sign, indicating the presence of melanoma and its association with cellular DNA damage. This research aims to explore potential biomarkers derived from microarray data, employing bioinformatics techniques and methodologies, for a thorough investigation of melanoma skin cancer. The microarray dataset for melanoma skin cancer was obtained from the GEO database, and thorough data analysis and quality control measures were performed to identify differentially expressed genes (DEGs). The top 14 highly expressed DEGs were identified, and their gene information and protein sequences were retrieved from the NCBI gene and protein database. These proteins were further analyzed for domain identification and network analysis. Gene expression analysis was conducted to visualize the upregulated and downregulated genes. Additionally, gene metabolite network analysis was carried out to understand the interactions between highly interconnected genes and regulatory transcripts. Molecular docking was employed to investigate the ligand-binding sites and visualize the three-dimensional structure of proteins. Our research unveiled a collection of genes with varying expression levels, some elevated and others reduced, which could function as promising biomarkers closely linked to the development and advancement of melanoma skin cancer. Through molecular docking analysis of the GINS2 protein, we identified two natural compounds (PubChem-156021169 and PubChem-60700) with potential as inhibitors against melanoma. This research has implications for early detection, treatment, and understanding the molecular basis of melanoma.

A survey on cancer detection via convolutional neural networks: Current challenges and future directions

Cancer is a condition in which abnormal cells uncontrollably split and damage the body tissues. Hence, detecting cancer at an early stage is highly essential. Currently, medical images play an indispensable role in detecting various cancers; however, manual interpretation of these images by radiologists is observer-dependent, time-consuming, and tedious. An automatic decision-making process is thus an essential need for cancer detection and diagnosis. This paper presents a comprehensive survey on automated cancer detection in various human body organs, namely, the breast, lung, liver, prostate, brain, skin, and colon, using convolutional neural networks (CNN) and medical imaging techniques. It also includes a brief discussion about deep learning based on state-of-the-art cancer detection methods, their outcomes, and the possible medical imaging data used. Eventually, the description of the dataset used for cancer detection, the limitations of the existing solutions, future trends, and challenges in this domain are discussed. The utmost goal of this paper is to provide a piece of comprehensive and insightful information to researchers who have a keen interest in developing CNN-based models for cancer detection.

Follow-up of liver metastases: a comparison of deep learning and RECIST 1.1

OBJECTIVES

To compare liver metastases changes in CT assessed by radiologists using RECIST 1.1 and with aided simultaneous deep learning-based volumetric lesion changes analysis.

METHODS

A total of 86 abdominal CT studies from 43 patients (prior and current scans) of abdominal CT scans of patients with 1041 liver metastases (mean = 12.1, std = 11.9, range 1-49) were analyzed. Two radiologists performed readings of all pairs; conventional with RECIST 1.1 and with computer-aided assessment. For computer-aided reading, we used a novel simultaneous multi-channel 3D R2U-Net classifier trained and validated on other scans. The reference was established by having an expert radiologist validate the computed lesion detection and segmentation. The results were then verified and modified as needed by another independent radiologist. The primary outcome measure was the disease status assessment with the conventional and the computer-aided readings with respect to the reference.

RESULTS

For conventional and computer-aided reading, there was a difference in disease status classification in 40 out of 86 (46.51%) and 10 out of 86 (27.9%) CT studies with respect to the reference, respectively. Computer-aided reading improved conventional reading in 30 CT studies by 34.5% for two readers (23.2% and 46.51%) with respect to the reference standard. The main reason for the difference between the two readings was lesion volume differences (p = 0.01).

CONCLUSIONS

AI-based computer-aided analysis of liver metastases may improve the accuracy of the evaluation of neoplastic liver disease status.

CLINICAL RELEVANCE STATEMENT

AI may aid radiologists to improve the accuracy of evaluating changes over time in metastasis of the liver.

KEY POINTS

• Classification of liver metastasis changes improved significantly in one-third of the cases with an automatically generated comprehensive lesion and lesion changes report. • Simultaneous deep learning changes detection and volumetric assessment may improve the evaluation of liver metastases temporal changes potentially improving disease management.

Artificial Intelligence-powered automatic volume calculation in medical images - available tools, performance and challenges for nuclear medicine

Volumetry is crucial in oncology and endocrinology, for diagnosis, treatment planning, and evaluating response to therapy for several diseases. The integration of Artificial Intelligence (AI) and Deep Learning (DL) has significantly accelerated the automatization of volumetric calculations, enhancing accuracy and reducing variability and labor. In this review, we show that a high correlation has been observed between Machine Learning (ML) methods and expert assessments in tumor volumetry; Yet, it is recognized as more challenging than organ volumetry. Liver volumetry has shown progression in accuracy with a decrease in error. If a relative error below 10 % is acceptable, ML-based liver volumetry can be considered reliable for standardized imaging protocols if used in patients without major anomalies. Similarly, ML-supported automatic kidney volumetry has also shown consistency and reliability in volumetric calculations. In contrast, AI-supported thyroid volumetry has not been extensively developed, despite initial works in 3D ultrasound showing promising results in terms of accuracy and reproducibility. Despite the advancements presented in the reviewed literature, the lack of standardization limits the generalizability of ML methods across diverse scenarios. The domain gap, i. e., the difference in probability distribution of training and inference data, is of paramount importance before clinical deployment of AI, to maintain accuracy and reliability in patient care. The increasing availability of improved segmentation tools is expected to further incorporate AI methods into routine workflows where volumetry will play a more prominent role in radionuclide therapy planning and quantitative follow-up of disease evolution.

A vendor-agnostic, PACS integrated, and DICOM-compatible software-server pipeline for testing segmentation algorithms within the clinical radiology workflow

Background

Reproducible approaches are needed to bring AI/ML for medical image analysis closer to the bedside. Investigators wishing to shadow test cross-sectional medical imaging segmentation algorithms on new studies in real-time will benefit from simple tools that integrate PACS with on-premises image processing, allowing visualization of DICOM-compatible segmentation results and volumetric data at the radiology workstation.

Purpose

In this work, we develop and release a simple containerized and easily deployable pipeline for shadow testing of segmentation algorithms within the clinical workflow.

Methods

Our end-to-end automated pipeline has two major components- 1. A router/listener and anonymizer and an OHIF web viewer backstopped by a DCM4CHEE DICOM query/retrieve archive deployed in the virtual infrastructure of our secure hospital intranet, and 2. An on-premises single GPU workstation host for DICOM/NIfTI conversion steps, and image processing. DICOM images are visualized in OHIF along with their segmentation masks and associated volumetry measurements (in mL) using DICOM SEG and structured report (SR) elements. Since nnU-net has emerged as a widely-used out-of-the-box method for training segmentation models with state-of-the-art performance, feasibility of our pipleine is demonstrated by recording clock times for a traumatic pelvic hematoma nnU-net model.

Results

Mean total clock time from PACS send by user to completion of transfer to the DCM4CHEE query/retrieve archive was 5 min 32 s (± SD of 1 min 26 s). This compares favorably to the report turnaround times for whole-body CT exams, which often exceed 30 min, and illustrates feasibility in the clinical setting where quantitative results would be expected prior to report sign-off. Inference times accounted for most of the total clock time, ranging from 2 min 41 s to 8 min 27 s. All other virtual and on-premises host steps combined ranged from a minimum of 34 s to a maximum of 48 s.

Conclusion

The software worked seamlessly with an existing PACS and could be used for deployment of DL models within the radiology workflow for prospective testing on newly scanned patients. Once configured, the pipeline is executed through one command using a single shell script. The code is made publicly available through an open-source license at "https://github.com/vastc/," and includes a readme file providing pipeline config instructions for host names, series filter, other parameters, and citation instructions for this work.

Performance and clinical applicability of machine learning in liver computed tomography imaging: a systematic review

OBJECTIVES

Machine learning (ML) for medical imaging is emerging for several organs and image modalities. Our objectives were to provide clinicians with an overview of this field by answering the following questions: (1) How is ML applied in liver computed tomography (CT) imaging? (2) How well do ML systems perform in liver CT imaging? (3) What are the clinical applications of ML in liver CT imaging?

METHODS

A systematic review was carried out according to the guidelines from the PRISMA-P statement. The search string focused on studies containing content relating to artificial intelligence, liver, and computed tomography.

RESULTS

One hundred ninety-one studies were included in the study. ML was applied to CT liver imaging by image analysis without clinicians' intervention in majority of studies while in newer studies the fusion of ML method with clinical intervention have been identified. Several were documented to perform very accurately on reliable but small data. Most models identified were deep learning-based, mainly using convolutional neural networks. Potentially many clinical applications of ML to CT liver imaging have been identified through our review including liver and its lesion segmentation and classification, segmentation of vascular structure inside the liver, fibrosis and cirrhosis staging, metastasis prediction, and evaluation of chemotherapy.

CONCLUSION

Several studies attempted to provide transparent result of the model. To make the model convenient for a clinical application, prospective clinical validation studies are in urgent call. Computer scientists and engineers should seek to cooperate with health professionals to ensure this.

KEY POINTS

• ML shows great potential for CT liver image tasks such as pixel-wise segmentation and classification of liver and liver lesions, fibrosis staging, metastasis prediction, and retrieval of relevant liver lesions from similar cases of other patients. • Despite presenting the result is not standardized, many studies have attempted to provide transparent results to interpret the machine learning method performance in the literature. • Prospective studies are in urgent call for clinical validation of ML method, preferably carried out by cooperation between clinicians and computer scientists.

A Review of the Clinical Applications of Artificial Intelligence in Abdominal Imaging

Artificial intelligence (AI) has been a topic of substantial interest for radiologists in recent years. Although many of the first clinical applications were in the neuro, cardiothoracic, and breast imaging subspecialties, the number of investigated and real-world applications of body imaging has been increasing, with more than 30 FDA-approved algorithms now available for applications in the abdomen and pelvis. In this manuscript, we explore some of the fundamentals of artificial intelligence and machine learning, review major functions that AI algorithms may perform, introduce current and potential future applications of AI in abdominal imaging, provide a basic understanding of the pathways by which AI algorithms can receive FDA approval, and explore some of the challenges with the implementation of AI in clinical practice.

A multi-modal deep neural network for multi-class liver cancer diagnosis

Liver disease is a potentially asymptomatic clinical entity that may progress to patient death. This study proposes a multi-modal deep neural network for multi-class malignant liver diagnosis. In parallel with the portal venous computed tomography (CT) scans, pathology data is utilized to prognosticate primary liver cancer variants and metastasis. The processed CT scans are fed to the deep dilated convolution neural network to explore salient features. The residual connections are further added to address vanishing gradient problems. Correspondingly, five pathological features are learned using a wide and deep network that gives a benefit of memorization with generalization. The down-scaled hierarchical features from CT scan and pathology data are concatenated to pass through fully connected layers for classification between liver cancer variants. In addition, the transfer learning of pre-trained deep dilated convolution layers assists in handling insufficient and imbalanced dataset issues. The fine-tuned network can predict three-class liver cancer variants with an average accuracy of 96.06% and an Area Under Curve (AUC) of 0.832. To the best of our knowledge, this is the first study to classify liver cancer variants by integrating pathology and image data, hence following the medical perspective of malignant liver diagnosis. The comparative analysis on the benchmark dataset shows that the proposed multi-modal neural network outperformed most of the liver diagnostic studies and is comparable to others.

A vendor-agnostic, PACS integrated, and DICOMcompatible software-server pipeline for testing segmentation algorithms within the clinical radiology workflow

Background

Reproducible approaches are needed to bring AI/ML for medical image analysis closer to the bedside. Investigators wishing to shadow test cross-sectional medical imaging segmentation algorithms on new studies in real-time will benefit from simple tools that integrate PACS with on-premises image processing, allowing visualization of DICOM-compatible segmentation results and volumetric data at the radiology workstation.

Purpose

In this work, we develop and release a simple containerized and easily deployable pipeline for shadow testing of segmentation algorithms within the clinical workflow.

Methods

Our end-to-end automated pipeline has two major components-1. a router/listener and anonymizer and an OHIF web viewer backstopped by a DCM4CHEE DICOM query/retrieve archive deployed in the virtual infrastructure of our secure hospital intranet, and 2. An on-premises single GPU workstation host for DICOM/NIfTI conversion steps, and image processing. DICOM images are visualized in OHIF along with their segmentation masks and associated volumetry measurements (in mL) using DICOM SEG and structured report (SR) elements. Feasibility is demonstrated by recording clock times for a traumatic pelvic hematoma cascaded nnU-net model.

Results

Mean total clock time from PACS send by user to completion of transfer to the DCM4CHEE query/retrieve archive was 5 minutes 32 seconds (+/- SD of 1 min 26 sec). This compares favorably to the report turnaround times for whole-body CT exams, which often exceed 30 minutes. Inference times accounted for most of the total clock time, ranging from 2 minutes 41 seconds to 8 minutes 27 seconds. All other virtual and on-premises host steps combined ranged from a minimum of 34 seconds to a maximum of 48 seconds.

Conclusion

The software worked seamlessly with an existing PACS and could be used for deployment of DL models within the radiology workflow for prospective testing on newly scanned patients. Once configured, the pipeline is executed through one command using a single shell script. The code is made publicly available through an open-source license at "https://github.com/vastc/", and includes a readme file providing pipeline config instructions for host names, series filter, other parameters, and citation instructions for this work.

Liver lesion changes analysis in longitudinal CECT scans by simultaneous deep learning voxel classification with SimU-Net

The identification and quantification of liver lesions changes in longitudinal contrast enhanced CT (CECT) scans is required to evaluate disease status and to determine treatment efficacy in support of clinical decision-making. This paper describes a fully automatic end-to-end pipeline for liver lesion changes analysis in consecutive (prior and current) abdominal CECT scans of oncology patients. The three key novelties are: (1) SimU-Net, a simultaneous multi-channel 3D R2U-Net model trained on pairs of registered scans of each patient that identifies the liver lesions and their changes based on the lesion and healthy tissue appearance differences; (2) a model-based bipartite graph lesions matching method for the analysis of lesion changes at the lesion level; (3) a method for longitudinal analysis of one or more of consecutive scans of a patient based on SimU-Net that handles major liver deformations and incorporates lesion segmentations from previous analysis. To validate our methods, five experimental studies were conducted on a unique dataset of 3491 liver lesions in 735 pairs from 218 clinical abdominal CECT scans of 71 patients with metastatic disease manually delineated by an expert radiologist. The pipeline with the SimU-Net model, trained and validated on 385 pairs and tested on 249 pairs, yields a mean lesion detection recall of 0.86±0.14, a precision of 0.74±0.23 and a lesion segmentation Dice of 0.82±0.14 for lesions > 5 mm. This outperforms a reference standalone 3D R2-UNet mdel that analyzes each scan individually by ∼50% in precision with similar recall and Dice score on the same training and test datasets. For lesions matching, the precision is 0.86±0.18 and the recall is 0.90±0.15. For lesion classification, the specificity is 0.97±0.07, the precision is 0.85±0.31, and the recall is 0.86±0.23. Our new methods provide accurate and comprehensive results that may help reduce radiologists' time and effort and improve radiological oncology evaluation.

Artificial intelligence: A review of current applications in hepatocellular carcinoma imaging

Hepatocellular carcinoma (HCC) is the most common type of primary liver cancer and currently the third-leading cause of cancer-related death worldwide. Recently, artificial intelligence (AI) has emerged as an important tool to improve clinical management of HCC, including for diagnosis, prognostication and evaluation of treatment response. Different AI approaches, such as machine learning and deep learning, are both based on the concept of developing prediction algorithms from large amounts of data, or big data. The era of digital medicine has led to a rapidly expanding amount of routinely collected health data which can be leveraged for the development of AI models. Various studies have constructed AI models by using features extracted from ultrasound imaging, computed tomography imaging and magnetic resonance imaging. Most of these models have used convolutional neural networks. These tools have shown promising results for HCC detection, characterization of liver lesions and liver/tumor segmentation. Regarding treatment, studies have outlined a role for AI in evaluation of treatment response and improvement of pre-treatment planning. Several challenges remain to fully integrate AI models in clinical practice. Future research is still needed to robustly evaluate AI algorithms in prospective trials, and improve interpretability, generalizability and transparency. If such challenges can be overcome, AI has the potential to profoundly change the management of patients with HCC. The purpose of this review was to sum up current evidence on AI approaches using imaging for the clinical management of HCC.

Role of artificial intelligence in the diagnosis and treatment of hepatocellular carcinoma

Artificial intelligence (AI) evolved many years ago, but it gained much advancement in recent years for its use in the medical domain. AI with its different subsidiaries, i.e. deep learning and machine learning, examine a large amount of data and performs an essential part in decision-making in addition to conquering the limitations related to human evaluation. Deep learning tries to imitate the functioning of the human brain. It utilizes much more data and intricate algorithms. Machine learning is AI based on automated learning. It utilizes earlier given data and uses algorithms to arrange and identify models. Globally, hepatocellular carcinoma is a major cause of illness and fatality. Although with substantial progress in the whole treatment strategy for hepatocellular carcinoma, managing it is still a major issue. AI in the area of gastroenterology, especially in hepatology, is particularly useful for various investigations of hepatocellular carcinoma because it is a commonly found tumor, and has specific radiological features that enable diagnostic procedures without the requirement of the histological study. However, interpreting and analyzing the resulting images is not always easy due to change of images throughout the disease process. Further, the prognostic process and response to the treatment process could be influenced by numerous components. Currently, AI is utilized in order to diagnose, curative and prediction goals. Future investigations are essential to prevent likely bias, which might subsequently influence the analysis of images and therefore restrict the consent and utilization of such models in medical practices. Moreover, experts are required to realize the real utility of such approaches, along with their associated potencies and constraints.

Artificial intelligence in liver ultrasound

Artificial intelligence (AI) is playing an increasingly important role in medicine, especially in the field of medical imaging. It can be used to diagnose diseases and predict certain statuses and possible events that may happen. Recently, more and more studies have confirmed the value of AI based on ultrasound in the evaluation of diffuse liver diseases and focal liver lesions. It can assess the severity of liver fibrosis and nonalcoholic fatty liver, differentially diagnose benign and malignant liver lesions, distinguish primary from secondary liver cancers, predict the curative effect of liver cancer treatment and recurrence after treatment, and predict microvascular invasion in hepatocellular carcinoma. The findings from these studies have great clinical application potential in the near future. The purpose of this review is to comprehensively introduce the current status and future perspectives of AI in liver ultrasound.

Liver surgery for colorectal metastasis: New paths and new goals with the help of artificial intelligence

Colorectal cancer is one of the most common neoplasia with an high risk to metastatic spread. Improving medical and surgical treatment is moving along with improving the precision of diagnosis and patient's assessment, the latter two aided more and more with the use of artificial intelligence (AI). The management of colorectal liver metastasis is multidisciplinary, and surgery is the main option. After the diagnosis, a surgical assessment of the patient is fundamental. Reaching a R0 resection with a proper remnant liver volume can be done using new techniques involving also artificial intelligence. Considering the recent application of artificial intelligence as a valid substitute for liver biopsy in chronic liver diseases, several authors tried to apply similar techniques to pre-operative imaging of liver metastasis. Radiomics showed good results in identifying structural changes in a unhealthy liver and in evaluating the prognosis after a liver resection. Recently deep learning has been successfully applied in estimating the remnant liver volume before surgery. Moreover AI techniques can help surgeons to perform an early diagnosis of neoplastic relapse or a better differentiation between a colorectal metastasis and a benign lesion. AI could be applied also in the histopathological diagnostic tool. Although AI implementation is still partially automatized, it appears faster and more precise than the usual diagnostic tools and, in the short future, could become the new gold standard in liver surgery.

Classification of malignant tumors by a non-sequential recurrent ensemble of deep neural network model

Many significant efforts have so far been made to classify malignant tumors by using various machine learning methods. Most of the studies have considered a particular tumor genre categorized according to its originating organ. This has enriched the domain-specific knowledge of malignant tumor prediction, we are devoid of an efficient model that may predict the stages of tumors irrespective of their origin. Thus, there is ample opportunity to study if a heterogeneous collection of tumor images can be classified according to their respective stages. The present research work has prepared a heterogeneous tumor dataset comprising eight different datasets from The Cancer Imaging Archives and classified them according to their respective stages, as suggested by the American Joint Committee on Cancer. The proposed model has been used for classifying 717 subjects comprising different imaging modalities and varied Tumor-Node-Metastasis stages. A new non-sequential deep hybrid model ensemble has been developed by exploiting branched and re-injected layers, followed by bidirectional recurrent layers to classify tumor images. Results have been compared with standard sequential deep learning models and notable recent studies. The training and validation accuracy along with the ROC-AUC scores have been found satisfactory over the existing models. No model or method in the literature could ever classify such a diversified mix of tumor images with such high accuracy. The proposed model may help radiologists by acting as an auxiliary decision support system and speed up the tumor diagnosis process.

Development of a Deep Learning Model to Assist With Diagnosis of Hepatocellular Carcinoma

Background

An accurate pathological diagnosis of hepatocellular carcinoma (HCC), one of the malignant tumors with the highest mortality rate, is time-consuming and heavily reliant on the experience of a pathologist. In this report, we proposed a deep learning model that required minimal noise reduction or manual annotation by an experienced pathologist for HCC diagnosis and classification.

Methods

We collected a whole-slide image of hematoxylin and eosin-stained pathological slides from 592 HCC patients at the First Affiliated Hospital, College of Medicine, Zhejiang University between 2015 and 2020. We propose a noise-specific deep learning model. The model was trained initially with 137 cases cropped into multiple-scaled datasets. Patch screening and dynamic label smoothing strategies are adopted to handle the histopathological liver image with noise annotation from the perspective of input and output. The model was then tested in an independent cohort of 455 cases with comparable tumor types and differentiations.

Results

Exhaustive experiments demonstrated that our two-step method achieved 87.81% pixel-level accuracy and 98.77% slide-level accuracy in the test dataset. Furthermore, the generalization performance of our model was also verified using The Cancer Genome Atlas dataset, which contains 157 HCC pathological slides, and achieved an accuracy of 87.90%.

Conclusions

The noise-specific histopathological classification model of HCC based on deep learning is effective for the dataset with noisy annotation, and it significantly improved the pixel-level accuracy of the regular convolutional neural network (CNN) model. Moreover, the model also has an advantage in detecting well-differentiated HCC and microvascular invasion.

Baseline Photos and Confident Annotation Improve Automated Detection of Cutaneous Graft-Versus-Host Disease

Cutaneous erythema is used in diagnosis and response assessment of cutaneous chronic graft-versus-host disease (cGVHD). The development of objective erythema evaluation methods remains a challenge. We used a pre-trained neural network to segment cGVHD erythema by detecting changes relative to a patient’s registered baseline photo. We fixed this change detection algorithm on human annotations from a single photo pair, by using either a traditional approach or by marking definitely affected (“Do Not Miss”, DNM) and definitely unaffected skin (“Do Not Include”, DNI). The fixed algorithm was applied to each of the remaining 47 test photo pairs from six follow-up sessions of one patient. We used both the Dice index and the opinion of two board-certified dermatologists to evaluate the algorithm performance. The change detection algorithm correctly assigned 80% of the pixels, regardless of whether it was fixed on traditional (median accuracy: 0.77, interquartile range 0.62–0.87) or DNM/DNI segmentations (0.81, 0.65–0.89). When the algorithm was fixed on markings by different annotators, the DNM/DNI achieved more consistent outputs (median Dice indices: 0.94–0.96) than the traditional method (0.73–0.81). Compared to viewing only rash photos, the addition of baseline photos improved the reliability of dermatologists’ scoring. The inter-rater intraclass correlation coefficient increased from 0.19 (95% confidence interval lower bound: 0.06) to 0.51 (lower bound: 0.35). In conclusion, a change detection algorithm accurately assigned erythema in longitudinal photos of cGVHD. The reliability was significantly improved by exclusively using confident human segmentations to fix the algorithm. Baseline photos improved the agreement among two dermatologists in assessing algorithm performance.

AI-Based Detection, Classification and Prediction/Prognosis in Medical Imaging:: Towards Radiophenomics

Artificial intelligence (AI) techniques have significant potential to enable effective, robust, and automated image phenotyping including the identification of subtle patterns. AI-based detection searches the image space to find the regions of interest based on patterns and features. There is a spectrum of tumor histologies from benign to malignant that can be identified by AI-based classification approaches using image features. The extraction of minable information from images gives way to the field of "radiomics" and can be explored via explicit (handcrafted/engineered) and deep radiomics frameworks. Radiomics analysis has the potential to be used as a noninvasive technique for the accurate characterization of tumors to improve diagnosis and treatment monitoring. This work reviews AI-based techniques, with a special focus on oncological PET and PET/CT imaging, for different detection, classification, and prediction/prognosis tasks. We also discuss needed efforts to enable the translation of AI techniques to routine clinical workflows, and potential improvements and complementary techniques such as the use of natural language processing on electronic health records and neuro-symbolic AI techniques.

What is new in computer vision and artificial intelligence in medical image analysis applications

Computer vision and artificial intelligence applications in medicine are becoming increasingly important day by day, especially in the field of image technology. In this paper we cover different artificial intelligence advances that tackle some of the most important worldwide medical problems such as cardiology, cancer, dermatology, neurodegenerative disorders, respiratory problems, and gastroenterology. We show how both areas have resulted in a large variety of methods that range from enhancement, detection, segmentation and characterizations of anatomical structures and lesions to complete systems that automatically identify and classify several diseases in order to aid clinical diagnosis and treatment. Different imaging modalities such as computer tomography, magnetic resonance, radiography, ultrasound, dermoscopy and microscopy offer multiple opportunities to build automatic systems that help medical diagnosis, taking advantage of their own physical nature. However, these imaging modalities also impose important limitations to the design of automatic image analysis systems for diagnosis aid due to their inherent characteristics such as signal to noise ratio, contrast and resolutions in time, space and wavelength. Finally, we discuss future trends and challenges that computer vision and artificial intelligence must face in the coming years in order to build systems that are able to solve more complex problems that assist medical diagnosis.

Computed Tomography Techniques, Protocols, Advancements, and Future Directions in Liver Diseases

Computed tomography (CT) is often performed as the initial imaging study for the workup of patients with known or suspected liver disease. Our article reviews liver CT techniques and protocols in clinical practice along with updates on relevant CT advances, including wide-detector CT, radiation dose optimization, and multienergy scanning, that have already shown clinical impact. Particular emphasis is placed on optimizing the late arterial phase of enhancement, which is critical to evaluation of hepatocellular carcinoma. We also discuss emerging techniques that may soon influence clinical care.

Artificial intelligence in assessment of hepatocellular carcinoma treatment response

Artificial Intelligence (AI) continues to shape the practice of radiology, with imaging of hepatocellular carcinoma (HCC) being of no exception. This article prepared by members of the LI-RADS Treatment Response (TR LI-RADS) work group and associates, presents recent trends in the utility of AI applications for the volumetric evaluation and assessment of HCC treatment response. Various topics including radiomics, prognostic imaging findings, and locoregional therapy (LRT) specific issues will be discussed in the framework of HCC treatment response classification systems with focus on the Liver Reporting and Data System treatment response algorithm (LI-RADS TRA).

An Overview of Artificial Intelligence Applications in Liver and Pancreatic Imaging

Artificial intelligence (AI) is one of the most promising fields of research in medical imaging so far. By means of specific algorithms, it can be used to help radiologists in their routine workflow. There are several papers that describe AI approaches to solve different problems in liver and pancreatic imaging. These problems may be summarized in four different categories: segmentation, quantification, characterization and image quality improvement. Segmentation is usually the first step of successive elaborations. If done manually, it is a time-consuming process. Therefore, the semi-automatic and automatic creation of a liver or a pancreatic mask may save time for other evaluations, such as quantification of various parameters, from organs volume to their textural features. The alterations of normal liver and pancreas structure may give a clue to the presence of a diffuse or focal pathology. AI can be trained to recognize these alterations and propose a diagnosis, which may then be confirmed or not by radiologists. Finally, AI may be applied in medical image reconstruction in order to increase image quality, decrease dose administration (referring to computed tomography) and reduce scan times. In this article, we report the state of the art of AI applications in these four main categories.

Artificial intelligence in gastroenterology and hepatology: Status and challenges

Originally proposed by John McCarthy in 1955, artificial intelligence (AI) has achieved a breakthrough and revolutionized the processing methods of clinical medicine with the increasing workloads of medical records and digital images. Doctors are paying attention to AI technologies for various diseases in the fields of gastroenterology and hepatology. This review will illustrate AI technology procedures for medical image analysis, including data processing, model establishment, and model validation. Furthermore, we will summarize AI applications in endoscopy, radiology, and pathology, such as detecting and evaluating lesions, facilitating treatment, and predicting treatment response and prognosis with excellent model performance. The current challenges for AI in clinical application include potential inherent bias in retrospective studies that requires larger samples for validation, ethics and legal concerns, and the incomprehensibility of the output results. Therefore, doctors and researchers should cooperate to address the current challenges and carry out further investigations to develop more accurate AI tools for improved clinical applications.

[Artificial intelligence in gastroenterology]

Artificial intelligence (AI) is currently transforming all aspects of our daily life, including the practice of medicine. Artificial neural networks are a key method of AI. They can very effectively detect subtle patterns in imaging data and speech or text data. This is highly relevant for the practice of gastroenterology. Here, we summarize the state of the art in AI in gastroenterology and outline major clinical applications. Our focus is on AI-based analysis of endoscopy images, non-invasive imaging and histology images. In these applications, AI can support human pattern recognition. Beyond detection and classification of pathological findings, AI can predict clinical outcome from subtle image features.

Application of artificial intelligence in the diagnosis and treatment of hepatocellular carcinoma: A review

Although artificial intelligence (AI) was initially developed many years ago, it has experienced spectacular advances over the last 10 years for application in the field of medicine, and is now used for diagnostic, therapeutic and prognostic purposes in almost all fields. Its application in the area of hepatology is especially relevant for the study of hepatocellular carcinoma (HCC), as this is a very common tumor, with particular radiological characteristics that allow its diagnosis without the need for a histological study. However, the interpretation and analysis of the resulting images is not always easy, in addition to which the images vary during the course of the disease, and prognosis and treatment response can be conditioned by multiple factors. The vast amount of data available lend themselves to study and analysis by AI in its various branches, such as deep-learning (DL) and machine learning (ML), which play a fundamental role in decision-making as well as overcoming the constraints involved in human evaluation. ML is a form of AI based on automated learning from a set of previously provided data and training in algorithms to organize and recognize patterns. DL is a more extensive form of learning that attempts to simulate the working of the human brain, using a lot more data and more complex algorithms. This review specifies the type of AI used by the various authors. However, well-designed prospective studies are needed in order to avoid as far as possible any bias that may later affect the interpretability of the images and thereby limit the acceptance and application of these models in clinical practice. In addition, professionals now need to understand the true usefulness of these techniques, as well as their associated strengths and limitations.

Three-Dimensional Neural Network to Automatically Assess Liver Tumor Burden Change on Consecutive Liver MRIs

BACKGROUND

Tumor response to therapy is often assessed by measuring change in liver lesion size between consecutive MRIs. However, these evaluations are both tedious and time-consuming for clinical radiologists.

PURPOSE

In this study, we sought to develop a convolutional neural network to detect liver metastases on MRI and applied this algorithm to assess change in tumor size on consecutive examinations.

METHODS

We annotated a data set of 64 patients with neuroendocrine tumors who underwent at least two consecutive liver MRIs with gadoxetic acid. We then developed a 3-D neural network using a U-Net architecture with ResNet-18 building blocks that first detected the liver and then lesions within the liver. Liver lesion labels for each examination were then matched in 3-D space using an iterative closest point algorithm followed by Kuhn-Munkres algorithm.

RESULTS

We developed a deep learning algorithm that detected liver metastases, co-registered the detected lesions, and then assessed the interval change in tumor burden between two multiparametric liver MRI examinations. Our deep learning algorithm was concordant in 91% with the radiologists' manual assessment about the interval change of disease burden. It had a sensitivity of 0.85 (95% confidence interval (95% CI): 0.77; 0.93) and specificity of 0.92 (95% CI: 0.87; 0.96) to classify liver segments as diseased or healthy. The mean DICE coefficient for individual lesions ranged between 0.73 and 0.81.

CONCLUSIONS

Our algorithm displayed high agreement with human readers for detecting change in liver lesions on MRI, offering evidence that artificial intelligence-based detectors may perform these tasks as part of routine clinical care in the future.

Automatic Change Detection in Sparse Repeat CT Scanning

We describe a new method for the automatic detection of changes in repeat CT scanning with a reduced X-ray radiation dose. We present a theoretical formulation of the automatic change detection problem based on the on-line sparse-view repeat CT scanning dose optimization framework. We prove that the change detection problem is NP-hard and therefore cannot be efficiently solved exactly. We describe a new greedy change detection algorithm that is simple and robust and relies on only two key parameters. We demonstrate that the greedy algorithm accurately detects small, low contrast changes with only 12 scan angles. Our experimental results show that the new algorithm yields a mean changed region recall rate >89% and a mean precision rate >76%. It outperforms both our previous heuristic approach and a thresholding method using a low-dose prior image-constrained compressed sensing (PICCS) reconstruction of the repeat scan. The resulting changed region map may obviate the need for a high-quality repeat scan image when no major changes are detected and may streamline the radiologist's workflow by highlighting the regions of interest.

Deep learning with convolutional neural networks for identification of liver masses and hepatocellular carcinoma: A systematic review

BACKGROUND

Artificial intelligence, such as convolutional neural networks (CNNs), has been used in the interpretation of images and the diagnosis of hepatocellular cancer (HCC) and liver masses. CNN, a machine-learning algorithm similar to deep learning, has demonstrated its capability to recognise specific features that can detect pathological lesions.

AIM

To assess the use of CNNs in examining HCC and liver masses images in the diagnosis of cancer and evaluating the accuracy level of CNNs and their performance.

METHODS

The databases PubMed, EMBASE, and the Web of Science and research books were systematically searched using related keywords. Studies analysing pathological anatomy, cellular, and radiological images on HCC or liver masses using CNNs were identified according to the study protocol to detect cancer, differentiating cancer from other lesions, or staging the lesion. The data were extracted as per a predefined extraction. The accuracy level and performance of the CNNs in detecting cancer or early stages of cancer were analysed. The primary outcomes of the study were analysing the type of cancer or liver mass and identifying the type of images that showed optimum accuracy in cancer detection.

RESULTS

A total of 11 studies that met the selection criteria and were consistent with the aims of the study were identified. The studies demonstrated the ability to differentiate liver masses or differentiate HCC from other lesions (n = 6), HCC from cirrhosis or development of new tumours (n = 3), and HCC nuclei grading or segmentation (n = 2). The CNNs showed satisfactory levels of accuracy. The studies aimed at detecting lesions (n = 4), classification (n = 5), and segmentation (n = 2). Several methods were used to assess the accuracy of CNN models used.

CONCLUSION

The role of CNNs in analysing images and as tools in early detection of HCC or liver masses has been demonstrated in these studies. While a few limitations have been identified in these studies, overall there was an optimal level of accuracy of the CNNs used in segmentation and classification of liver cancers images.

Fully automated convolutional neural network-based affine algorithm improves liver registration and lesion co-localization on hepatobiliary phase T1-weighted MR images

BACKGROUND

Liver alignment between series/exams is challenged by dynamic morphology or variability in patient positioning or motion. Image registration can improve image interpretation and lesion co-localization. We assessed the performance of a convolutional neural network algorithm to register cross-sectional liver imaging series and compared its performance to manual image registration.

METHODS

Three hundred fourteen patients, including internal and external datasets, who underwent gadoxetate disodium-enhanced magnetic resonance imaging for clinical care from 2011 to 2018, were retrospectively selected. Automated registration was applied to all 2,663 within-patient series pairs derived from these datasets. Additionally, 100 within-patient series pairs from the internal dataset were independently manually registered by expert readers. Liver overlap, image correlation, and intra-observation distances for manual versus automated registrations were compared using paired t tests. Influence of patient demographics, imaging characteristics, and liver uptake function was evaluated using univariate and multivariate mixed models.

RESULTS

Compared to the manual, automated registration produced significantly lower intra-observation distance (p < 0.001) and higher liver overlap and image correlation (p < 0.001). Intra-exam automated registration achieved 0.88 mean liver overlap and 0.44 mean image correlation for the internal dataset and 0.91 and 0.41, respectively, for the external dataset. For inter-exam registration, mean overlap was 0.81 and image correlation 0.41. Older age, female sex, greater inter-series time interval, differing uptake, and greater voxel size differences independently reduced automated registration performance (p ≤ 0.020).

CONCLUSION

A fully automated algorithm accurately registered the liver within and between examinations, yielding better liver and focal observation co-localization compared to manual registration.

Artificial intelligence in medical imaging of the liver

Artificial intelligence (AI), particularly deep learning algorithms, is gaining extensive attention for its excellent performance in image-recognition tasks. They can automatically make a quantitative assessment of complex medical image characteristics and achieve an increased accuracy for diagnosis with higher efficiency. AI is widely used and getting increasingly popular in the medical imaging of the liver, including radiology, ultrasound, and nuclear medicine. AI can assist physicians to make more accurate and reproductive imaging diagnosis and also reduce the physicians’ workload. This article illustrates basic technical knowledge about AI, including traditional machine learning and deep learning algorithms, especially convolutional neural networks, and their clinical application in the medical imaging of liver diseases, such as detecting and evaluating focal liver lesions, facilitating treatment, and predicting liver treatment response. We conclude that machine-assisted medical services will be a promising solution for future liver medical care. Lastly, we discuss the challenges and future directions of clinical application of deep learning techniques.

Convolutional Neural Networks for Radiologic Images: A Radiologist's Guide

Deep learning has rapidly advanced in various fields within the past few years and has recently gained particular attention in the radiology community. This article provides an introduction to deep learning technology and presents the stages that are entailed in the design process of deep learning radiology research. In addition, the article details the results of a survey of the application of deep learning-specifically, the application of convolutional neural networks-to radiologic imaging that was focused on the following five major system organs: chest, breast, brain, musculoskeletal system, and abdomen and pelvis. The survey of the studies is followed by a discussion about current challenges and future trends and their potential implications for radiology. This article may be used as a guide for radiologists planning research in the field of radiologic image analysis using convolutional neural networks.

Deep learning in medical imaging and radiation therapy

The goals of this review paper on deep learning (DL) in medical imaging and radiation therapy are to (a) summarize what has been achieved to date; (b) identify common and unique challenges, and strategies that researchers have taken to address these challenges; and (c) identify some of the promising avenues for the future both in terms of applications as well as technical innovations. We introduce the general principles of DL and convolutional neural networks, survey five major areas of application of DL in medical imaging and radiation therapy, identify common themes, discuss methods for dataset expansion, and conclude by summarizing lessons learned, remaining challenges, and future directions.

Survey on deep learning for radiotherapy

More than 50% of cancer patients are treated with radiotherapy, either exclusively or in combination with other methods. The planning and delivery of radiotherapy treatment is a complex process, but can now be greatly facilitated by artificial intelligence technology. Deep learning is the fastest-growing field in artificial intelligence and has been successfully used in recent years in many domains, including medicine. In this article, we first explain the concept of deep learning, addressing it in the broader context of machine learning. The most common network architectures are presented, with a more specific focus on convolutional neural networks. We then present a review of the published works on deep learning methods that can be applied to radiotherapy, which are classified into seven categories related to the patient workflow, and can provide some insights of potential future applications. We have attempted to make this paper accessible to both radiotherapy and deep learning communities, and hope that it will inspire new collaborations between these two communities to develop dedicated radiotherapy applications.

Biosignature Discovery for Substance Use Disorders Using Statistical Learning

There are limited biomarkers for substance use disorders (SUDs). Traditional statistical approaches are identifying simple biomarkers in large samples, but clinical use cases are still being established. High-throughput clinical, imaging, and 'omic' technologies are generating data from SUD studies and may lead to more sophisticated and clinically useful models. However, analytic strategies suited for high-dimensional data are not regularly used. We review strategies for identifying biomarkers and biosignatures from high-dimensional data types. Focusing on penalized regression and Bayesian approaches, we address how to leverage evidence from existing studies and knowledge bases, using nicotine metabolism as an example. We posit that big data and machine learning approaches will considerably advance SUD biomarker discovery. However, translation to clinical practice, will require integrated scientific efforts.