Adversarial radiomics: the rising of potential risks in medical imaging from adversarial learning

Radiomics and deep learning models for CT pre-operative lymph node staging in pancreatic ductal adenocarcinoma: A systematic review and meta-analysis

PURPOSE

To evaluate the diagnostic accuracy of computed tomography (CT)-based radiomic algorithms and deep learning models to preoperatively identify lymph node metastasis (LNM) in patients with pancreatic ductal adenocarcinoma (PDAC).

METHODS

PubMed, CENTRAL, Scopus, Web of Science and IEEE databases were searched to identify relevant studies published up until February 11, 2024. Two reviewers screened all papers independently for eligibility. Studies reporting the accuracy of CT-based radiomics or deep learning models for detecting LNM in PDAC, using histopathology as the reference standard, were included. Quality was assessed using the Quality Assessment of Diagnostic Accuracy Studies 2, the Radiomics Quality Score (RQS) and the the METhodological RadiomICs Score (METRICS). Overall sensitivity (SE), specificity (SP), diagnostic odds ratio (DOR), and the area under the curve (AUC) were calculated.

RESULTS

Four radiomics studies comprising 213 patients and four deep learning studies with 272 patients were included. The average RQS total score was 12.00 ± 3.89, corresponding to an RQS percentage of 33.33 ± 10.80, while the average METRICS score was 63.60 ± 10.88. A significant and strong positive correlation was found between RQS and METRICS (p = 0.016; r = 0.810). The pooled SE, SP, DOR, and AUC of all the studies were 0.83 (95 %CI = 0.77-0.88), 0.76 (95 %CI = 0.62-0.86), 15.70 (95 %CI = 8.12-27.50) and 0.85 (95 %CI = 0.77-0.88). Meta-regression analysis results indicated that neither the study type (radiomics vs deep learning) nor the dataset size of the studies had a significant effect on the DOR (p = 0.09 and p = 0.26, respectively).

CONCLUSION

Based on our meta-analysis findings, preoperative CT-based radiomics algorithms and deep learning models demonstrate favorable performance in predicting LNM in patients with PDAC, with a strong correlation between RQS and METRICS of the included studies.

An EANM position paper on the application of artificial intelligence in nuclear medicine

Artificial intelligence (AI) is coming into the field of nuclear medicine, and it is likely here to stay. As a society, EANM can and must play a central role in the use of AI in nuclear medicine. In this position paper, the EANM explains the preconditions for the implementation of AI in NM and takes position.

Blockchain in radiology research and clinical practice: current trends and future directions

Blockchain usage in healthcare, in radiology, in particular, is at its very early infancy. Only a few research applications have been tested, however, blockchain technology is widely known outside healthcare and widely adopted, especially in Finance, since 2009 at least. Learning by history, radiology is a potential ideal scenario to apply this technology. Blockchain could have the potential to increase radiological data value in both clinical and research settings for the patient digital record, radiological reports, privacy control, quantitative image analysis, cybersecurity, radiomics and artificial intelligence.

Up-to-date experiences using blockchain in radiology are still limited, but radiologists should be aware of the emergence of this technology and follow its next developments. We present here the potentials of some applications of blockchain in radiology.

Artificial intelligence for nuclear medicine in oncology

As in all other medical fields, artificial intelligence (AI) is increasingly being used in nuclear medicine for oncology. There are many articles that discuss AI from the viewpoint of nuclear medicine, but few focus on nuclear medicine from the viewpoint of AI. Nuclear medicine images are characterized by their low spatial resolution and high quantitativeness. It is noted that AI has been used since before the emergence of deep learning. AI can be divided into three categories by its purpose: (1) assisted interpretation, i.e., computer-aided detection (CADe) or computer-aided diagnosis (CADx). (2) Additional insight, i.e., AI provides information beyond the radiologist's eye, such as predicting genes and prognosis from images. It is also related to the field called radiomics/radiogenomics. (3) Augmented image, i.e., image generation tasks. To apply AI to practical use, harmonization between facilities and the possibility of black box explanations need to be resolved.

Enhancing adversarial defense for medical image analysis systems with pruning and attention mechanism

PURPOSE

Deep learning has achieved impressive performance across a variety of tasks, including medical image processing. However, recent research has shown that deep neural networks (DNNs) are susceptible to small adversarial perturbations in the image, which raise safety concerns about the deployment of these systems in clinical settings.

METHODS

To improve the defense of the medical imaging system against adversarial examples, we propose a new model-based defense framework for medical image DNNs model equipped with pruning and attention mechanism module based on the analysis of the reason why existing medical image DNNs models are vulnerable to attacks from adversarial examples is that complex biological texture of medical imaging and overparameterized medical image DNNs model.

RESULTS

Three benchmark medical image datasets have verified the effectiveness of our method in improving the robustness of medical image DNNs models. In the chest X-ray datasets, our defending method can even achieve up 77.18% defense rate for projected gradient descent attack and 69.49% defense rate for DeepFool attack. And through ablation experiments on the pruning module and the attention mechanism module, it is verified that the use of pruning and attention mechanism can effectively improve the robustness of the medical image DNNs model.

CONCLUSIONS

Compared with the existing model-based defense methods proposed for natural images, our defense method is more suitable for medical images. Our method can be a general strategy to approach the design of more explainable and secure medical deep learning systems, and can be widely used in various medical image tasks to improve the robustness of medical models.

AI applications to medical images: From machine learning to deep learning

PURPOSE

Artificial intelligence (AI) models are playing an increasing role in biomedical research and healthcare services. This review focuses on challenges points to be clarified about how to develop AI applications as clinical decision support systems in the real-world context.

METHODS

A narrative review has been performed including a critical assessment of articles published between 1989 and 2021 that guided challenging sections.

RESULTS

We first illustrate the architectural characteristics of machine learning (ML)/radiomics and deep learning (DL) approaches. For ML/radiomics, the phases of feature selection and of training, validation, and testing are described. DL models are presented as multi-layered artificial/convolutional neural networks, allowing us to directly process images. The data curation section includes technical steps such as image labelling, image annotation (with segmentation as a crucial step in radiomics), data harmonization (enabling compensation for differences in imaging protocols that typically generate noise in non-AI imaging studies) and federated learning. Thereafter, we dedicate specific sections to: sample size calculation, considering multiple testing in AI approaches; procedures for data augmentation to work with limited and unbalanced datasets; and the interpretability of AI models (the so-called black box issue). Pros and cons for choosing ML versus DL to implement AI applications to medical imaging are finally presented in a synoptic way.

CONCLUSIONS

Biomedicine and healthcare systems are one of the most important fields for AI applications and medical imaging is probably the most suitable and promising domain. Clarification of specific challenging points facilitates the development of such systems and their translation to clinical practice.

Quantitative FDG PET Assessment for Oncology Therapy

Simple Summary

PET enables quantitative assessment of tumour biology in vivo. Accumulation of F-18 fluorodeoxyglucose (FDG) may reflect tumour metabolic activity. Quantitative assessment of FDG uptake can be applied for treatment monitoring. Numerous studies indicated biochemical change assessed by FDG-PET as a more sensitive marker than morphological change. Those with complete metabolic response after therapy may show better prognosis. Assessment of metabolic change may be performed using absolute FDG uptake or metabolic tumour volume. More recently, radiomics approaches have been applied to FDG PET. Texture analysis quantifies intratumoral heterogeneity in a voxel-by-voxel basis. Combined with various machine learning techniques, these new quantitative parameters hold a promise for assessing tissue characterization and predicting treatment effect, and could also be used for future prognosis of various tumours.

Abstract

Positron emission tomography (PET) has unique characteristics for quantitative assessment of tumour biology in vivo. Accumulation of F-18 fluorodeoxyglucose (FDG) may reflect tumour characteristics based on its metabolic activity. Quantitative assessment of FDG uptake can often be applied for treatment monitoring after chemotherapy or chemoradiotherapy. Numerous studies indicated biochemical change assessed by FDG PET as a more sensitive marker than morphological change estimated by CT or MRI. In addition, those with complete metabolic response after therapy may show better disease-free survival and overall survival than those with other responses. Assessment of metabolic change may be performed using absolute FDG uptake in the tumour (standardized uptake value: SUV). In addition, volumetric parameters such as metabolic tumour volume (MTV) have been introduced for quantitative assessment of FDG uptake in tumour. More recently, radiomics approaches that focus on image-based precision medicine have been applied to FDG PET, as well as other radiological imaging. Among these, texture analysis extracts intratumoral heterogeneity on a voxel-by-voxel basis. Combined with various machine learning techniques, these new quantitative parameters hold a promise for assessing tissue characterization and predicting treatment effect, and could also be used for future prognosis of various tumours, although multicentre clinical trials are needed before application in clinical settings.

Artificial Intelligence and the Medical Physicist: Welcome to the Machine

Artificial intelligence (AI) is a branch of computer science dedicated to giving machines or computers the ability to perform human-like cognitive functions, such as learning, problem-solving, and decision making. Since it is showing superior performance than well-trained human beings in many areas, such as image classification, object detection, speech recognition, and decision-making, AI is expected to change profoundly every area of science, including healthcare and the clinical application of physics to healthcare, referred to as medical physics. As a result, the Italian Association of Medical Physics (AIFM) has created the “AI for Medical Physics” (AI4MP) group with the aims of coordinating the efforts, facilitating the communication, and sharing of the knowledge on AI of the medical physicists (MPs) in Italy. The purpose of this review is to summarize the main applications of AI in medical physics, describe the skills of the MPs in research and clinical applications of AI, and define the major challenges of AI in healthcare.