Artificial Intelligence in Medical Imaging and its Impact on the Rare Disease Community: Threats, Challenges and Opportunities

Charting a course for global progress in PIDs by 2030 - proceedings from the IPOPI global multi-stakeholders' summit (September 2023)

The International Patient Organisation for Primary Immunodeficiencies (IPOPI) held its second Global Multi-Stakeholders' Summit, an annual stimulating and forward-thinking meeting uniting experts to anticipate pivotal upcoming challenges and opportunities in the field of primary immunodeficiency (PID). The 2023 summit focused on three key identified discussion points: (i) How can immunoglobulin (Ig) therapy meet future personalized patient needs? (ii) Pandemic preparedness: what's next for public health and potential challenges for the PID community? (iii) Diagnosing PIDs in 2030: what needs to happen to diagnose better and to diagnose more? Clinician-Scientists, patient representatives and other stakeholders explored avenues to improve Ig therapy through mechanistic insights and tailored Ig preparations/products according to patient-specific needs and local exposure to infectious agents, amongst others. Urgency for pandemic preparedness was discussed, as was the threat of shortage of antibiotics and increasing antimicrobial resistance, emphasizing the need for representation of PID patients and other vulnerable populations throughout crisis and care management. Discussion also covered the complexities of PID diagnosis, addressing issues such as global diagnostic disparities, the integration of patient-reported outcome measures, and the potential of artificial intelligence to increase PID diagnosis rates and to enhance diagnostic precision. These proceedings outline the outcomes and recommendations arising from the 2023 IPOPI Global Multi-Stakeholders' Summit, offering valuable insights to inform future strategies in PID management and care. Integral to this initiative is its role in fostering collaborative efforts among stakeholders to prepare for the multiple challenges facing the global PID community.

An investigation into augmentation and preprocessing for optimising X-ray classification in limited datasets: a case study on necrotising enterocolitis

PURPOSE

Obtaining large volumes of medical images, required for deep learning development, can be challenging in rare pathologies. Image augmentation and preprocessing offer viable solutions. This work explores the case of necrotising enterocolitis (NEC), a rare but life-threatening condition affecting premature neonates, with challenging radiological diagnosis. We investigate data augmentation and preprocessing techniques and propose two optimised pipelines for developing reliable computer-aided diagnosis models on a limited NEC dataset.

METHODS

We present a NEC dataset of 1090 Abdominal X-rays (AXRs) from 364 patients and investigate the effect of geometric augmentations, colour scheme augmentations and their combination for NEC classification based on the ResNet-50 backbone. We introduce two pipelines based on colour contrast and edge enhancement, to increase the visibility of subtle, difficult-to-identify, critical NEC findings on AXRs and achieve robust accuracy in a challenging three-class NEC classification task.

RESULTS

Our results show that geometric augmentations improve performance, with Translation achieving +6.2%, while Flipping and Occlusion decrease performance. Colour augmentations, like Equalisation, yield modest improvements. The proposed Pr-1 and Pr-2 pipelines enhance model accuracy by +2.4% and +1.7%, respectively. Combining Pr-1/Pr-2 with geometric augmentation, we achieve a maximum performance increase of 7.1%, achieving robust NEC classification.

CONCLUSION

Based on an extensive validation of preprocessing and augmentation techniques, our work showcases the previously unreported potential of image preprocessing in AXR classification tasks with limited datasets. Our findings can be extended to other medical tasks for designing reliable classifier models with limited X-ray datasets. Ultimately, we also provide a benchmark for automated NEC detection and classification from AXRs.

PFMNet: Prototype-based feature mapping network for few-shot domain adaptation in medical image segmentation

Lack of data is one of the biggest hurdles for rare disease research using deep learning. Due to the lack of rare-disease images and annotations, training a robust network for automatic rare-disease image segmentation is very challenging. To address this challenge, few-shot domain adaptation (FSDA) has emerged as a practical research direction, aiming to leverage a limited number of annotated images from a target domain to facilitate adaptation of models trained on other large datasets in a source domain. In this paper, we present a novel prototype-based feature mapping network (PFMNet) designed for FSDA in medical image segmentation. PFMNet adopts an encoder-decoder structure for segmentation, with the prototype-based feature mapping (PFM) module positioned at the bottom of the encoder-decoder structure. The PFM module transforms high-level features from the target domain into the source domain-like features that are more easily comprehensible by the decoder. By leveraging these source domain-like features, the decoder can effectively perform few-shot segmentation in the target domain and generate accurate segmentation masks. We evaluate the performance of PFMNet through experiments on three typical yet challenging few-shot medical image segmentation tasks: cross-center optic disc/cup segmentation, cross-center polyp segmentation, and cross-modality cardiac structure segmentation. We consider four different settings: 5-shot, 10-shot, 15-shot, and 20-shot. The experimental results substantiate the efficacy of our proposed approach for few-shot domain adaptation in medical image segmentation.

Application of Artificial Intelligence in Neuroendocrine Lung Cancer Diagnosis and Treatment: A Systematic Review

Neuroendocrine tumors (NETs) represent a heterogeneous group of neoplasms with diverse clinical presentations and prognoses. Accurate and timely diagnosis of these tumors is crucial for appropriate management and improved patient outcomes. In recent years, exciting advancements in artificial intelligence (AI) technologies have been revolutionizing medical diagnostics, particularly in the realm of detecting and characterizing pulmonary NETs, offering promising avenues for improved patient care. This article aims to provide a comprehensive overview of the role of AI in diagnosing lung NETs. We discuss the current challenges associated with conventional diagnostic approaches, including histopathological examination and imaging modalities. Despite advancements in these techniques, accurate diagnosis remains challenging due to the overlapping features with other pulmonary lesions and the subjective interpretation of imaging findings. AI-based approaches, including machine learning and deep learning algorithms, have demonstrated remarkable potential in addressing these challenges. By leveraging large datasets of radiological images, histopathological samples, and clinical data, AI models can extract complex patterns and features that may not be readily discernible to human observers. Moreover, AI algorithms can continuously learn and improve from new data, leading to enhanced diagnostic accuracy and efficiency over time. Specific AI applications in the diagnosis of lung NETs include computer-aided detection and classification of pulmonary nodules on CT scans, quantitative analysis of PET imaging for tumor characterization, and integration of multi-modal data for comprehensive diagnostic assessments. These AI-driven tools hold promise for facilitating early detection, risk stratification, and personalized treatment planning in patients with lung NETs.

An investigation into augmentation and preprocessing for optimising X-ray classification in limited datasets: a case study on necrotising enterocolitis

Purpose

Obtaining large volumes of medical images, required for deep learning development, can be challenging in rare pathologies. Image augmentation and preprocessing offer viable solutions. This work explores the case of necrotising enterocolitis (NEC), a rare but life-threatening condition affecting premature neonates, with challenging radiological diagnosis. We investigate data augmentation and preprocessing techniques and propose two optimised pipelines for developing reliable computer-aided diagnosis models on a limited NEC dataset.

Methods

We present a NEC dataset of 1090 Abdominal X-rays (AXRs) from 364 patients and investigate the effect of geometric augmentations, colour scheme augmentations and their combination for NEC classification based on the ResNet-50 backbone. We introduce two pipelines based on colour contrast and edge enhancement, to increase the visibility of subtle, difficult-to-identify, critical NEC findings on AXRs and achieve robust accuracy in a challenging three-class NEC classification task.

Results

Our results show that geometric augmentations improve performance, with Translation achieving +6.2%, while Flipping and Occlusion decrease performance. Colour augmentations, like Equalisation, yield modest improvements. The proposed Pr-1 and Pr-2 pipelines enhance model accuracy by +2.4% and +1.7%, respectively. Combining Pr-1/Pr-2 with geometric augmentation, we achieve a maximum performance increase of 7.1%, achieving robust NEC classification.

Conclusion

Based on an extensive validation of preprocessing and augmentation techniques, our work showcases the previously unreported potential of image preprocessing in AXR classification tasks with limited datasets. Our findings can be extended to other medical tasks for designing reliable classifier models with limited X-ray datasets. Ultimately, we also provide a benchmark for automated NEC detection and classification from AXRs.

Strengths-weaknesses-opportunities-threats analysis of artificial intelligence in anesthesiology and perioperative medicine

The use of artificial intelligence (AI) and machine learning (ML) in anesthesiology and perioperative medicine is quickly becoming a mainstay of clinical practice. Anesthesiology is a data-rich medical specialty that integrates multitudes of patient-specific information. Perioperative medicine is ripe for applications of AI and ML to facilitate data synthesis for precision medicine and predictive assessments. Examples of emergent AI models include those that assist in assessing depth and modulating control of anesthetic delivery, event and risk prediction, ultrasound guidance, pain management, and operating room logistics. AI and ML support analyzing integrated perioperative data at scale and can assess patterns to deliver optimal patient-specific care. By exploring the benefits and limitations of this technology, we provide a basis of considerations for evaluating the adoption of AI models into various anesthesiology workflows. This analysis of AI and ML in anesthesiology and perioperative medicine explores the current landscape to understand better the strengths, weaknesses, opportunities, and threats (SWOT) these tools offer.

Nuclear medicine radiomics in digestive system tumors: Concept, applications, challenges, and future perspectives

Radiomics aims to develop novel biomarkers and provide relevant deeper subvisual information about pathology, immunophenotype, and tumor microenvironment. It uses automated or semiautomated quantitative analysis of high-dimensional images to improve characterization, diagnosis, and prognosis. Recent years have seen a rapid increase in radiomics applications in nuclear medicine, leading to some promising research results in digestive system oncology, which have been driven by big data analysis and the development of artificial intelligence. Although radiomics advances one step further toward the non-invasive precision medical analysis, it is still a step away from clinical application and faces many challenges. This review article summarizes the available literature on digestive system tumors regarding radiomics in nuclear medicine. First, we describe the workflow and steps involved in radiomics analysis. Subsequently, we discuss the progress in clinical application regarding the utilization of radiomics for distinguishing between various diseases and evaluating their prognosis, and demonstrate how radiomics advances this field. Finally, we offer our viewpoint on how the field can progress by addressing the challenges facing clinical implementation.

ChatGPT Performance in Diagnostic Clinical Microbiology Laboratory-Oriented Case Scenarios

BACKGROUND

Artificial intelligence (AI)-based tools can reshape healthcare practice. This includes ChatGPT which is considered among the most popular AI-based conversational models. Nevertheless, the performance of different versions of ChatGPT needs further evaluation in different settings to assess its reliability and credibility in various healthcare-related tasks. Therefore, the current study aimed to assess the performance of the freely available ChatGPT-3.5 and the paid version ChatGPT-4 in 10 different diagnostic clinical microbiology case scenarios.

METHODS

The current study followed the METRICS (Model, Evaluation, Timing/Transparency, Range/Randomization, Individual factors, Count, Specificity of the prompts/language) checklist for standardization of the design and reporting of AI-based studies in healthcare. The models tested on December 3, 2023 included ChatGPT-3.5 and ChatGPT-4 and the evaluation of the ChatGPT-generated content was based on the CLEAR tool (Completeness, Lack of false information, Evidence support, Appropriateness, and Relevance) assessed on a 5-point Likert scale with a range of the CLEAR scores of 1-5. ChatGPT output was evaluated by two raters independently and the inter-rater agreement was based on the Cohen's κ statistic. Ten diagnostic clinical microbiology laboratory case scenarios were created in the English language by three microbiologists at diverse levels of expertise following an internal discussion of common cases observed in Jordan. The range of topics included bacteriology, mycology, parasitology, and virology cases. Specific prompts were tailored based on the CLEAR tool and a new session was selected following prompting each case scenario.

RESULTS

The Cohen's κ values for the five CLEAR items were 0.351-0.737 for ChatGPT-3.5 and 0.294-0.701 for ChatGPT-4 indicating fair to good agreement and suitability for analysis. Based on the average CLEAR scores, ChatGPT-4 outperformed ChatGPT-3.5 (mean: 2.64±1.06 vs. 3.21±1.05, P=.012, t-test). The performance of each model varied based on the CLEAR items, with the lowest performance for the "Relevance" item (2.15±0.71 for ChatGPT-3.5 and 2.65±1.16 for ChatGPT-4). A statistically significant difference upon assessing the performance per each CLEAR item was only seen in ChatGPT-4 with the best performance in "Completeness", "Lack of false information", and "Evidence support" (P=0.043). The lowest level of performance for both models was observed with antimicrobial susceptibility testing (AST) queries while the highest level of performance was seen in bacterial and mycologic identification.

CONCLUSIONS

Assessment of ChatGPT performance across different diagnostic clinical microbiology case scenarios showed that ChatGPT-4 outperformed ChatGPT-3.5. The performance of ChatGPT demonstrated noticeable variability depending on the specific topic evaluated. A primary shortcoming of both ChatGPT models was the tendency to generate irrelevant content lacking the needed focus. Although the overall ChatGPT performance in these diagnostic microbiology case scenarios might be described as "above average" at best, there remains a significant potential for improvement, considering the identified limitations and unsatisfactory results in a few cases.

The Impact of Artificial Intelligence on Optimizing Diagnosis and Treatment Plans for Rare Genetic Disorders

Rare genetic disorders (RDs), characterized by their low prevalence and diagnostic complexities, present significant challenges to healthcare systems. This article explores the transformative impact of artificial intelligence (AI) and machine learning (ML) in addressing these challenges. It emphasizes the need for accurate and early diagnosis of RDs, often hindered by genetic and clinical heterogeneity. This article discusses how AI and ML are reshaping healthcare, providing examples of their effectiveness in disease diagnosis, prognosis, image analysis, and drug repurposing. It highlights AI's ability to efficiently analyze extensive datasets and expedite diagnosis, showcasing case studies like Face2Gene. Furthermore, the article explores how AI tailors treatment plans for RDs, leveraging ML and deep learning (DL) to create personalized therapeutic regimens. It emphasizes AI's role in drug discovery, including the identification of potential candidates for rare disease treatments. Challenges and limitations related to AI in healthcare, including ethical, legal, technical, and human aspects, are addressed. This article underscores the importance of data ethics, privacy, and algorithmic fairness, as well as the need for standardized evaluation techniques and transparency in AI research. It highlights second-generation AI systems that prioritize patient-centric care, efficient patient recruitment for clinical trials, and the significance of high-quality data. The integration of AI with telemedicine, the growth of health databases, and the potential for personalized therapeutic recommendations are identified as promising directions for the field. In summary, this article provides a comprehensive exploration of how AI and ML are revolutionizing the diagnosis and treatment of RDs, addressing challenges while considering ethical implications in this rapidly evolving healthcare landscape.

A Guide to Cross-Validation for Artificial Intelligence in Medical Imaging

Artificial intelligence (AI) is being increasingly used to automate and improve technologies within the field of medical imaging. A critical step in the development of an AI algorithm is estimating its prediction error through cross-validation (CV). The use of CV can help prevent overoptimism in AI algorithms and can mitigate certain biases associated with hyperparameter tuning and algorithm selection. This article introduces the principles of CV and provides a practical guide on the use of CV for AI algorithm development in medical imaging. Different CV techniques are described, as well as their advantages and disadvantages under different scenarios. Common pitfalls in prediction error estimation and guidance on how to avoid them are also discussed. Keywords: Education, Research Design, Technical Aspects, Statistics, Supervised Learning, Convolutional Neural Network (CNN) Supplemental material is available for this article. © RSNA, 2023.

Artificial Intelligence in Nuclear Medicine: Opportunities, Challenges, and Responsibilities Toward a Trustworthy Ecosystem

Trustworthiness is a core tenet of medicine. The patient-physician relationship is evolving from a dyad to a broader ecosystem of health care. With the emergence of artificial intelligence (AI) in medicine, the elements of trust must be revisited. We envision a road map for the establishment of trustworthy AI ecosystems in nuclear medicine. In this report, AI is contextualized in the history of technologic revolutions. Opportunities for AI applications in nuclear medicine related to diagnosis, therapy, and workflow efficiency, as well as emerging challenges and critical responsibilities, are discussed. Establishing and maintaining leadership in AI require a concerted effort to promote the rational and safe deployment of this innovative technology by engaging patients, nuclear medicine physicians, scientists, technologists, and referring providers, among other stakeholders, while protecting our patients and society. This strategic plan was prepared by the AI task force of the Society of Nuclear Medicine and Molecular Imaging.

Applications of artificial intelligence in orthopaedic surgery

The practice of medicine is rapidly transforming as a result of technological breakthroughs. Artificial intelligence (AI) systems are becoming more and more relevant in medicine and orthopaedic surgery as a result of the nearly exponential growth in computer processing power, cloud based computing, and development, and refining of medical-task specific software algorithms. Because of the extensive role of technologies such as medical imaging that bring high sensitivity, specificity, and positive/negative prognostic value to management of orthopaedic disorders, the field is particularly ripe for the application of machine-based integration of imaging studies, among other applications. Through this review, we seek to promote awareness in the orthopaedics community of the current accomplishments and projected uses of AI and ML as described in the literature. We summarize the current state of the art in the use of ML and AI in five key orthopaedic disciplines: joint reconstruction, spine, orthopaedic oncology, trauma, and sports medicine.

Sports Injury Risk Prevention and MRI Image Performance of Athletes in Physical Education

In order to effectively prevent athletes' injury during sports training in physical education, a method of risk prevention of sports injury based on MRI technology was proposed. This method solves the problem of injury prevention in sports training by studying the association analysis algorithm in data mining technology and the research of MRI technology. The experimental results show that the average prediction error of CT and US is about 5%, so it can be considered that the model can predict accurately. Conclusion. The method of risk prevention of sports injury based on MRI technology can effectively prevent the injury of athletes in the process of sports training and reduce the injury rate of athletes.

Sports Medical Image Modeling of Injury Prevention in Dance Learning and Sports Training

In order to effectively prevent injuries in dance learning and sports training, this paper proposes a method based on sports medical image modeling. This method solves the problem of injury prevention in dance learning by studying the association analysis algorithm, medical image information system, and CT technology and analyzing the role of data mining technology in the medical image information system. The experimental results show that the average prediction error of CT and US is about 5%, which can be considered that the model can predict accurately. The error of MR is as high as 28.2%, and the prediction is relatively inaccurate. Conclusion. the model can effectively prevent the injury in training.

[18F]FDG-PET/CT radiomics and artificial intelligence in lung cancer: Technical aspects and potential clinical applications

Lung cancer is the second most common cancer and the leading cause of cancer-related death worldwide. Molecular imaging using [¹⁸F]fluorodeoxyglucose Positron Emission Tomography and/or Computed Tomography ([¹⁸F]FDG-PET/CT) plays an essential role in the diagnosis, evaluation of response to treatment, and prediction of outcomes. The images are evaluated using qualitative and conventional quantitative indices. However, there is far more information embedded in the images, which can be extracted by sophisticated algorithms. Recently, the concept of uncovering and analyzing the invisible data extracted from medical images, called radiomics, is gaining more attention. Currently, [¹⁸F]FDG-PET/CT radiomics is growingly evaluated in lung cancer to discover if it enhances the diagnostic performance or implication of [¹⁸F]FDG-PET/CT in the management of lung cancer. In this review, we provide a short overview of the technical aspects, as they are discussed in different articles of this special issue. We mainly focus on the diagnostic performance of the [¹⁸F]FDG-PET/CT-based radiomics and the role of artificial intelligence in non-small cell lung cancer, impacting the early detection, staging, prediction of tumor subtypes, biomarkers, and patient's outcomes.

AI-Driven Image Analysis in Central Nervous System Tumors-Traditional Machine Learning, Deep Learning and Hybrid Models

The interpretation of imaging in medicine in general and in oncology specifically remains problematic due to several limitations which include the need to incorporate detailed clinical history, patient and disease-specific history, clinical exam features, previous and ongoing treatment, and account for the dependency on reproducible human interpretation of multiple factors with incomplete data linkage. To standardize reporting, minimize bias, expedite management, and improve outcomes, the use of Artificial Intelligence (AI) has gained significant prominence in imaging analysis. In oncology, AI methods have as a result been explored in most cancer types with ongoing progress in employing AI towards imaging for oncology treatment, assessing treatment response, and understanding and communicating prognosis. Challenges remain with limited available data sets, variability in imaging changes over time augmented by a growing heterogeneity in analysis approaches. We review the imaging analysis workflow and examine how hand-crafted features also referred to as traditional Machine Learning (ML), Deep Learning (DL) approaches, and hybrid analyses, are being employed in AI-driven imaging analysis in central nervous system tumors. ML, DL, and hybrid approaches coexist, and their combination may produce superior results although data in this space is as yet novel, and conclusions and pitfalls have yet to be fully explored. We note the growing technical complexities that may become increasingly separated from the clinic and enforce the acute need for clinician engagement to guide progress and ensure that conclusions derived from AI-driven imaging analysis reflect that same level of scrutiny lent to other avenues of clinical research.